-- Logs begin at Mon 2022-07-18 12:01:28 UTC, end at Mon 2022-07-18 14:53:02 UTC. -- Jul 18 12:37:27.219467 n-d-850003-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 12:37:27.228549 n-d-850003-3 devstack@n-api.service[115952]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 12:37:27 2022] *** Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: nodename: n-d-850003-3 Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: machine: x86_64 Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: clock source: unix Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: pcre jit disabled Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: detected number of CPU cores: 4 Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: current working directory: / Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: detected binary path: /usr/bin/uwsgi-core Jul 18 12:37:27.230705 n-d-850003-3 devstack@n-api.service[115952]: your processes number limit is 47680 Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: your memory page size is 4096 bytes Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: detected max file descriptor number: 2048 Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: lock engine: pthread robust mutexes Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: thunder lock: enabled Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 12:37:27.231656 n-d-850003-3 devstack@n-api.service[115952]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 12:37:27.271900 n-d-850003-3 devstack@n-api.service[115952]: Python main interpreter initialized at 0x55b390fcc9c0 Jul 18 12:37:27.271900 n-d-850003-3 devstack@n-api.service[115952]: python threads support enabled Jul 18 12:37:27.271900 n-d-850003-3 devstack@n-api.service[115952]: your server socket listen backlog is limited to 100 connections Jul 18 12:37:27.271900 n-d-850003-3 devstack@n-api.service[115952]: your mercy for graceful operations on workers is 90 seconds Jul 18 12:37:27.272317 n-d-850003-3 devstack@n-api.service[115952]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 12:37:27.272403 n-d-850003-3 devstack@n-api.service[115952]: *** Operational MODE: preforking *** Jul 18 12:37:27.272654 n-d-850003-3 devstack@n-api.service[115952]: *** uWSGI is running in multiple interpreter mode *** Jul 18 12:37:27.272654 n-d-850003-3 devstack@n-api.service[115952]: spawned uWSGI master process (pid: 115952) Jul 18 12:37:27.272866 n-d-850003-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 12:37:27.273469 n-d-850003-3 devstack@n-api.service[115952]: spawned uWSGI worker 1 (pid: 115953, cores: 1) Jul 18 12:37:27.273803 n-d-850003-3 devstack@n-api.service[115952]: spawned uWSGI worker 2 (pid: 115954, cores: 1) Jul 18 12:37:27.273971 n-d-850003-3 devstack@n-api.service[115952]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 12:37:27.965851 n-d-850003-3 devstack@n-api.service[115954]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 12:37:27.998844 n-d-850003-3 devstack@n-api.service[115953]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 12:37:29.509457 n-d-850003-3 devstack@n-api.service[115953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:37:29.509457 n-d-850003-3 devstack@n-api.service[115953]: from cryptography.utils import int_from_bytes Jul 18 12:37:29.510213 n-d-850003-3 devstack@n-api.service[115953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:37:29.510213 n-d-850003-3 devstack@n-api.service[115953]: from cryptography.utils import int_from_bytes Jul 18 12:37:29.512247 n-d-850003-3 devstack@n-api.service[115954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:37:29.512247 n-d-850003-3 devstack@n-api.service[115954]: from cryptography.utils import int_from_bytes Jul 18 12:37:29.512761 n-d-850003-3 devstack@n-api.service[115954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:37:29.512761 n-d-850003-3 devstack@n-api.service[115954]: from cryptography.utils import int_from_bytes Jul 18 12:37:33.985400 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 12:37:33.986192 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 12:37:33.987038 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 12:37:33.987193 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 12:37:33.987639 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 12:37:33.987797 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 12:37:33.988173 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 12:37:33.988321 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 12:37:33.988819 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.988960 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 12:37:33.989235 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 12:37:33.989370 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.989909 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.990080 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.990432 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.990668 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.990968 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.991215 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.991482 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.991751 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.992018 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.992284 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.992530 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.992803 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.993050 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.993334 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.993566 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.993766 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.994117 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.994405 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.994601 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.994822 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850003-3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.995060 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.995591 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.995728 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850003-3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.996088 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.996228 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.996592 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.996726 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.997178 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.997321 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.997592 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.997854 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.997994 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.998309 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.998489 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.998654 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.999057 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.999198 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.999575 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:33.999880 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.000061 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.000263 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.000522 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.000709 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.000884 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.001193 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.001436 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.001623 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.001803 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.001971 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.002139 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.002355 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.002587 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.002935 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850003-3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.003280 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.003587 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.003938 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.004168 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.004168 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.004538 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.004737 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.004935 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.005572 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.005572 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.005845 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.005997 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.006140 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.006363 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.006546 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.006823 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.006973 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850003-3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.007185 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.007447 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.007620 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.007813 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008054 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008233 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008407 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008589 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008769 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.008962 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.009265 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.009441 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.009619 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.009812 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.009962 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.010178 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.010480 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.010658 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.010853 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.011023 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.011211 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.011460 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.011624 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.011786 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012017 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012180 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012345 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012636 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012790 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.012954 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.013234 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.013395 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.013557 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.013817 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.014034 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.014242 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.014449 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.014684 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.014843 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.015082 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.015287 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.015459 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.015621 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.015814 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.016006 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.016169 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.016336 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.016677 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.016844 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.017029 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.017250 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.017403 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.017594 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.017913 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.018073 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.018288 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.018445 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.018601 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.018850 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.019003 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.019164 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.019448 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.019620 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.019781 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.020056 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.020216 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.020393 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.020695 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.021479 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.021633 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.021796 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.021952 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.022204 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.022417 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.022645 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.022831 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023037 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023230 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023430 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023615 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023780 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.023978 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.024194 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.024368 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.024544 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.024757 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.024946 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.025085 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.025251 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.025555 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.025691 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.025860 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.026180 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.026309 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.026478 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.026764 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.026897 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.027110 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.027339 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.027462 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.027704 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.027933 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.028065 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.028297 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.028522 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.028654 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.028904 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.029106 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.029237 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.029510 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.029708 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.029838 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.030100 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.030324 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.030454 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.030728 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.030931 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.031075 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.031332 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.031628 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.031762 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.031931 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.032094 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.032244 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.032552 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.032684 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.032853 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.033151 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.033274 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.033451 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.033751 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.033873 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.034052 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.034348 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.034516 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.034656 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.034932 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.035141 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.035264 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.035505 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.035628 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.035840 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.036058 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.036194 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.036610 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.036758 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.036886 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.037134 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.037281 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.037625 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.037828 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.038008 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.038219 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.038551 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.038719 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.038899 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.039019 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.039230 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.039329 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.039544 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.039850 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.039943 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.040173 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.040266 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.040482 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.040685 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.040778 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.041087 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.041241 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.041405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.041719 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.041811 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.042048 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.042292 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.042400 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.042643 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.042757 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.042993 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.043085 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.043304 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.043409 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.043618 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.043724 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.043945 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.044037 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.044266 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.044377 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.044571 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.044717 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.044920 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.045205 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.045339 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.045538 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.045672 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.045848 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.046055 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.046219 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.046449 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.046591 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.046772 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.046895 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.047100 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.047232 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.047408 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.047631 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.047767 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.047951 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.048084 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.048287 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.048423 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.048604 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.048739 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.048923 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.049059 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.049235 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.049367 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.049539 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.049680 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.049847 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.049980 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.050214 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.050344 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.050511 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.050650 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.050823 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.050945 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.051133 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.051264 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.051445 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.051709 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.051832 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.052587 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.052763 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.052888 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.053196 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.053330 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.053500 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.053684 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.053817 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.054092 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.054242 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.054423 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.054626 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.054822 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.055030 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.055208 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.055392 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.055589 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.055723 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.055970 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.056102 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.056272 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.056569 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.056694 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.056873 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.057048 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.057193 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.057466 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.057678 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.057808 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.058033 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.058204 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.058377 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.058576 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.058715 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.058990 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.059114 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.059290 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.059532 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.059671 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.059899 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.060075 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.060242 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.062980 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063127 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:37:34.063252 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063362 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063479 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063479 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063690 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063797 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.063797 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064020 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064135 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064135 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064333 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064448 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064564 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064672 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064672 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064867 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064979 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.064979 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065194 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065301 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065301 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065509 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065615 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065615 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065825 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065931 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.065931 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.066134 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.066267 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.066469 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.066591 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.066772 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.067030 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.067155 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.067362 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.067507 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.067830 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.068524 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.068663 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.068941 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.069041 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.069244 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.069535 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.069623 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.069835 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.070096 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.070276 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.070492 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.070669 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.070835 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.071172 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.071265 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.071489 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.071668 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.071811 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.072123 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.072209 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.072436 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.072744 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.072842 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073053 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073258 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073352 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073658 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073744 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.073975 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.074306 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.074398 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.074626 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.074858 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.074948 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.075246 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.075334 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.075556 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.075870 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.075968 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.076175 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.076460 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.076548 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.076883 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.077029 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.077217 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.077533 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.077645 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.077853 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.078122 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.078297 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.078485 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.078739 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.078828 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.079086 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.079349 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.079449 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.079688 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.079873 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080002 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080311 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080397 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080627 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080841 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.080929 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.081240 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.081354 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.081547 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.081862 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.081948 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.082177 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.082471 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.082571 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.082813 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.083025 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.083141 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.083641 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.083738 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.083954 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.084241 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.084330 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.084569 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.084854 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085149 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085149 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085399 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085492 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085747 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.085985 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.086075 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.086435 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.086856 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.086970 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.087279 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.087447 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.087570 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.087878 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.088016 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.088182 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.088485 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.088572 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.088784 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089027 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089130 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089491 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089712 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.089942 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.090042 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.090357 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.090532 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.090659 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.090960 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.091114 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.091279 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.091586 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.091719 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.091887 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.092187 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.092305 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.092486 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.092837 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.092924 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.093143 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.093443 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.093542 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.093758 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.094076 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.094180 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.094406 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.094719 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.094900 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.095026 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.095314 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.095409 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.095635 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.095904 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.096006 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.096236 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.096508 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.096595 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.096838 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.097091 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.097189 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.097437 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.097656 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.097770 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.098048 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.098305 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.098405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.098669 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.098942 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.099034 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.099319 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.099526 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.099615 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.100092 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.100191 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.100523 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.100612 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.100834 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.101148 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.101248 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.101465 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.101721 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.101808 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.102093 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.102343 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.102447 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.102765 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.102919 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.103066 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.103370 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.103490 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.103670 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.103969 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.104055 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.104274 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.104578 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.104678 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.104880 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.105180 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.105267 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.105484 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.105784 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.105878 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.106083 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.106407 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.106496 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.106707 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107018 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107107 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107317 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107623 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107751 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.107923 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.108246 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.108324 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.108549 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.108850 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.108937 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.109150 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.109451 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.109546 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.109788 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.110037 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.110132 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.110437 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.110674 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.110762 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.111084 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.111267 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.111387 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.111688 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.111861 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.112006 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.112307 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.112451 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.112607 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.112910 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.113048 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.113214 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.113520 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.113614 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.113818 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.114124 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.114235 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.114984 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.115295 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.115384 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.115601 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.115862 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.115950 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.116200 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.116412 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.116507 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.116797 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117032 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117120 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117391 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117616 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117746 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.117985 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.118347 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.118607 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.118607 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.118831 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.118966 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.119237 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.119344 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.119633 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.119938 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.120043 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.120262 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.120528 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.120628 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.120943 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.121185 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.121347 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.121674 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.121813 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.122048 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.122414 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.122539 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.122720 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.123022 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.123112 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.123338 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.123617 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.123710 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124026 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124222 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124338 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124662 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124839 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.124980 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.125269 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.125396 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.125592 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.125896 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.126005 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.126296 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.126605 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.126695 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.126910 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.127207 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.127295 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.127505 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.127797 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.127887 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.128100 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.128401 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.128531 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.128800 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.129019 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.129120 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.129479 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.129616 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.129787 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.130137 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.130808 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.131015 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.131321 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.131410 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.131679 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.131976 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.132072 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.132286 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.132586 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.132675 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.132900 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.133209 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.133297 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.133525 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.133827 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.133914 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.134139 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.134470 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.134565 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.134781 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135082 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135169 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135383 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135677 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135775 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.135999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.136276 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.136372 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.136611 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.136864 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.136953 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.137240 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.137453 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.137540 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.137835 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.138039 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.138127 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.138461 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.138659 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.138768 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139074 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139273 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139382 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139691 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139876 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.139999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.140308 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.140480 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.140616 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.140920 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.141069 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.141226 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.141533 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.141691 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.141834 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.142232 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.142328 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.142475 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.142777 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.142865 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.143083 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.143392 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.143479 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.143701 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.144003 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.144091 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.144443 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.144629 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.144753 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.145063 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.145261 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.145349 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.145660 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.145892 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.146011 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.146355 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.146518 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.146670 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.146971 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.147125 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.147390 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.147750 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.147943 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.148189 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.148384 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.150268 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.150268 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.150570 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.150723 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.150723 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151007 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151140 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151140 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151390 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151531 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151670 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151797 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.151797 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152046 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152177 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152177 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152429 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152559 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152559 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152815 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.152955 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.153922 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154067 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154268 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154402 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154551 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154551 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154833 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154991 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.154991 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155302 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155447 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155447 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155725 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155888 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.155888 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.156174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.156318 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.156459 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.156598 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.156750 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157114 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157297 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157460 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157605 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157740 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.157897 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.158420 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.158580 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.158748 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.158918 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.159634 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.159634 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.159945 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160094 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160094 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160361 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160517 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160517 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160795 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.160949 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161093 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161236 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161396 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161645 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161798 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.161942 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.162262 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.162415 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.162582 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.162860 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.163026 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.163166 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.163450 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.163598 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.163753 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164055 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164207 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164350 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164671 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164849 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.164990 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.165292 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.165441 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.165598 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.165865 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.166024 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.166221 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.166495 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.166668 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.166821 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.167092 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.167258 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.167404 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.167689 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.167841 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.168020 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.168304 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.168574 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.168724 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.168917 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.169063 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.169863 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170025 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170117 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170117 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170498 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170653 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170653 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.170929 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171086 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171086 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171361 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171504 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171646 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171799 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.171943 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.172234 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.172397 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.172542 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.172822 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.172987 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.173132 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.173411 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.173567 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.173722 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174029 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174212 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174358 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174660 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174811 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.174953 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.175246 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.175407 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.175551 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.175843 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.176013 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.176154 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.176478 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.176796 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.176913 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.177635 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.177960 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.178048 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.178343 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.178613 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.178765 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.178923 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.179226 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.179397 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.179562 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180274 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180427 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180427 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180688 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180841 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.180841 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181101 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181242 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181368 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181664 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181877 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.181877 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.182255 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.182557 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.182810 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.182968 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.183221 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.183382 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.183526 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.183836 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.183988 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.184144 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.184444 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.184606 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.184772 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185083 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185241 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185389 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185613 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185728 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.185946 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.186221 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.186370 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.186612 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.186783 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.186924 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.187227 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.187376 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.187531 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.187835 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.188006 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.188163 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.188494 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.188654 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.188802 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.189061 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.189223 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.189371 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.189650 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.189827 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.190582 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.190795 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.190925 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.190925 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.191174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.191312 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.191312 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.191778 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.191982 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.192182 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.192182 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.192667 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.193366 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.193572 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.193822 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.194025 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.194274 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.194579 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.194956 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.195175 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.195450 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.195664 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.195871 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.196081 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.196333 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.196547 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.196744 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.196941 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.197152 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.197389 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.197523 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.197717 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.198040 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.198316 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.198538 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.198759 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.198995 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.199220 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.199423 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.199596 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.199788 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.199983 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.200193 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201037 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201037 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201421 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201617 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201617 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.201999 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.202274 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.202545 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.202842 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203040 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203239 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203239 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203620 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203816 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.203816 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.204196 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.204394 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.204609 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.204774 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.204975 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.205169 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.205169 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.205538 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.205762 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.205762 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.206132 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.206412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.206412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.206815 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207046 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207046 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207405 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207604 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207604 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.207974 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.208223 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.208223 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.208613 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.208784 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.208928 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209084 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209084 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209426 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209617 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209617 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.209915 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.210111 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.210276 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.210430 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.211133 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.211133 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.211884 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212032 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212166 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212325 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212325 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212659 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212840 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.212840 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.213196 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.213349 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.213522 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.213668 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.213837 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.214045 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.214254 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.214442 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.214630 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.214825 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.215095 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.215307 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.215515 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.215712 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.215864 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.216163 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.216307 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.216482 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.216793 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.216920 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.217154 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.217359 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.217574 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.217969 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.218229 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.218463 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.218665 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.218930 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.219156 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.219352 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.219545 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.219782 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.219976 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.220183 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.220389 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.220600 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.221415 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.221625 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.221833 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.221833 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.222306 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.222701 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.222701 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223091 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223278 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223278 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223660 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223894 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.223894 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.224269 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.224483 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.224676 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.224874 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.224874 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.225343 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.225550 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.225550 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.225944 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.226142 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.226367 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.226562 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.226562 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.226969 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.227164 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.227164 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.227530 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.227727 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.227939 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.228138 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.228138 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.228525 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.228722 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.228722 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.229208 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.229412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.229412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.229799 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.229998 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.230263 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.230476 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.230803 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.231227 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.231227 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.232208 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.232405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.232405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.232802 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.232996 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.233204 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.233405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.233405 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.233799 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234009 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234009 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234399 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234583 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234789 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.234999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.235388 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.235848 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.235848 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.236243 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.236442 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.236442 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.236805 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237002 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237002 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237398 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237594 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237594 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.237986 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.238311 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.238311 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.238696 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.238890 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.238890 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.239263 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.239989 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.239989 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.240478 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.240684 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.240886 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.241087 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.241087 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.241087 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.242311 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.242515 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.242515 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.242924 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.243135 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.243362 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.243563 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.243563 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.243950 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.244147 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.244147 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.244548 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.244745 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.244745 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.245132 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.245354 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.245354 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.245759 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.246262 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.246262 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.246646 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.246846 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.246846 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.247244 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.247444 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.247444 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.247819 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248024 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248238 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248432 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248432 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248802 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.248999 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.249453 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.249663 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.249663 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250036 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250277 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250277 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250687 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250885 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.250885 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.251286 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.251663 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.251663 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.252308 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.252643 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.252643 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.253031 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.253241 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.253241 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.253629 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.253843 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254043 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254287 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254287 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254689 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254889 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.254889 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.255817 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256014 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256014 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256544 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256743 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256743 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.256743 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.257533 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.257749 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.257962 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.258182 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.258182 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.258582 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.258795 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.258795 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.259189 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.259402 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.259402 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.259775 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.259989 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.260194 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.260388 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.260388 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.260768 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.261011 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.261220 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.261412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.261412 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.261987 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.262421 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.262421 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.262421 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.263174 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.264430 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.264430 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.264811 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.265356 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.265945 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.266661 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.267248 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.267839 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.268432 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.269044 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.269621 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.270229 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.270857 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.271561 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.272135 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.272743 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.273557 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.274130 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.274742 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.275531 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.276122 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.276707 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.277312 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.277922 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.278576 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.279107 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.279743 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.280276 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.280882 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.281495 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.282099 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.282735 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.283306 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.283881 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.284497 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.285092 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.285709 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.286603 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.287228 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.287824 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.288411 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.289029 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.289623 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.290239 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.290835 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.291409 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.291990 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.292591 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.293172 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.293765 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.294386 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.294968 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.295554 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.296122 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.296739 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.297305 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.297912 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.298543 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.299157 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.299750 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.300325 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.300928 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.301517 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.302698 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.303213 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.303799 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.304461 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.305043 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.305656 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.306314 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.306926 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.307512 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.308143 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.308765 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.309368 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.309973 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.310615 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.311186 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.311731 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.312390 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.312940 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.313498 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.314046 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.314646 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.315210 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.315793 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.316372 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.316974 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.317531 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.318737 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.319320 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.319887 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.320488 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.321023 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.321666 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.322264 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.322924 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.323522 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.324103 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.324677 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.325247 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.325691 n-d-850003-3 devstack@n-api.service[115953]: INFO dbcounter [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Registered counter for database nova_api Jul 18 12:37:34.325922 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.326457 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.327054 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.327716 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.328242 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.328839 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.329422 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.329998 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.330616 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.331180 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.331757 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.332364 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.333446 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.334064 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.334697 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.335280 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.335856 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.336438 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.337287 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.337950 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.338455 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.339030 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.339609 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.340254 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.340828 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.341403 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.342012 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.342649 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.343233 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.343934 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.344455 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.345139 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.345738 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.346349 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.346944 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.347527 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.348149 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.348677 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.349357 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.349886 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.350487 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.351065 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.351644 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.352257 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.352845 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.353444 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.354236 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.354933 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.355431 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.356041 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.356655 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.357696 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.358354 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.358912 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.359510 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.360092 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.360687 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.361288 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.361877 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.362573 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.363132 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.363709 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.364295 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.365392 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.365979 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.366606 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.367197 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.367782 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.368380 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.369441 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.370078 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.370689 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.371278 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.371888 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.372461 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.373029 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.373629 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.374292 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.374785 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.375379 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.375923 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.376479 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.377038 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.377614 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.378214 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.378917 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.379353 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.379925 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.381091 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.381663 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.382238 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.382822 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.383272 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.383903 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.384488 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.385044 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.385595 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.386220 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.386796 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.387357 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.387912 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.388487 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.389106 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.389604 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.390292 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.390905 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.391466 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.392030 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.392619 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.393196 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.393760 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.394320 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.395006 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.395466 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.396091 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.397140 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.397730 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.398352 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.398980 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.399575 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.400137 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.400694 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.401270 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.401879 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.402455 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.403040 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.403610 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.404217 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.404888 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.405434 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.405962 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.406504 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.407034 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.407586 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.408158 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.408727 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.409301 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.409896 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.410585 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.411189 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.412303 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.412920 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.413466 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.414053 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.414664 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.415386 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.415825 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.416448 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.417087 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.417648 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.418257 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.419055 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.419767 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.420229 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.420828 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.421428 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.422039 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.422681 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.423279 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.423886 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.424454 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.425074 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.425702 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.426359 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.426928 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.428149 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.428716 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.429278 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.430090 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.430518 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.431096 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.431674 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.432245 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.432830 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.433399 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.433977 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.434603 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.437013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.437013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.437013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.437013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.437890 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.438030 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.438526 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.439098 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.439673 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.440335 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.440911 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.441494 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.442061 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.442696 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.443335 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.443963 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.444510 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_db.sqlalchemy.engines [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.444646 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.445146 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.445723 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.446354 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.447240 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.447495 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.448084 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.448667 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.449246 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.449861 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.450585 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.451027 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.451606 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.451760 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writer thread running {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:34.452190 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.452785 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.453382 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.453994 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.454629 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.455312 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.455908 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.456503 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.457215 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.457693 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.458300 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.458947 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.459522 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.460136 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.460725 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.461221 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.462069 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.462687 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.463263 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.463849 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.464486 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.465123 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.465758 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.466417 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.467013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.467609 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.468216 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.468863 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.469466 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.470112 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.470863 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.471321 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.471906 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.472465 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:37:34.472906 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 12:37:34.512596 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.context [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=115953) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 12:37:34.516950 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:37:34.518741 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:37:34.519602 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:37:34.522020 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:37:34.524128 n-d-850003-3 devstack@n-api.service[115953]: INFO dbcounter [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Registered counter for database nova_cell0 Jul 18 12:37:34.528306 n-d-850003-3 devstack@n-api.service[115953]: INFO dbcounter [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Registered counter for database nova_cell1 Jul 18 12:37:34.537438 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_db.sqlalchemy.engines [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.539805 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_db.sqlalchemy.engines [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.545564 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writer thread running {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:34.548213 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writer thread running {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:34.598565 n-d-850003-3 devstack@n-api.service[115954]: INFO dbcounter [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Registered counter for database nova_api Jul 18 12:37:34.705923 n-d-850003-3 devstack@n-api.service[115953]: INFO dbcounter [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Registered counter for database nova_cell0 Jul 18 12:37:34.713818 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_db.sqlalchemy.engines [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.719188 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writer thread running {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:34.763980 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_db.sqlalchemy.engines [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.775997 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writer thread running {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:34.888589 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.context [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=115954) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 12:37:34.897128 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_concurrency.lockutils [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:37:34.900638 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_concurrency.lockutils [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:37:34.902186 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_concurrency.lockutils [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:37:34.906523 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_concurrency.lockutils [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:37:34.910566 n-d-850003-3 devstack@n-api.service[115954]: INFO dbcounter [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Registered counter for database nova_cell0 Jul 18 12:37:34.919296 n-d-850003-3 devstack@n-api.service[115954]: INFO dbcounter [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Registered counter for database nova_cell1 Jul 18 12:37:34.936578 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_db.sqlalchemy.engines [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.941543 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_db.sqlalchemy.engines [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:34.949536 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writer thread running {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:35.077192 n-d-850003-3 devstack@n-api.service[115953]: WARNING keystonemiddleware.auth_token [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:37:35.084946 n-d-850003-3 devstack@n-api.service[115953]: WARNING keystonemiddleware.auth_token [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:37:35.185323 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writer thread running {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:35.197153 n-d-850003-3 devstack@n-api.service[115954]: INFO dbcounter [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Registered counter for database nova_cell0 Jul 18 12:37:35.206665 n-d-850003-3 devstack@n-api.service[115954]: DEBUG oslo_db.sqlalchemy.engines [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:37:35.211892 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writer thread running {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:37:35.550425 n-d-850003-3 devstack@n-api.service[115954]: WARNING keystonemiddleware.auth_token [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:37:35.561460 n-d-850003-3 devstack@n-api.service[115954]: WARNING keystonemiddleware.auth_token [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:37:35.573955 n-d-850003-3 devstack@n-api.service[115953]: WARNING keystonemiddleware.auth_token [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:37:35.585427 n-d-850003-3 devstack@n-api.service[115953]: WARNING keystonemiddleware.auth_token [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:37:35.596732 n-d-850003-3 devstack@n-api.service[115953]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55b390fcc9c0 pid: 115953 (default app) Jul 18 12:37:35.601728 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:37:35.604249 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003763 Jul 18 12:37:35.605642 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Mon Jul 18 12:37:35 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:37:36.026513 n-d-850003-3 devstack@n-api.service[115954]: WARNING keystonemiddleware.auth_token [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:37:36.033090 n-d-850003-3 devstack@n-api.service[115954]: WARNING keystonemiddleware.auth_token [None req-7c843dc8-6794-45ed-99ae-5a33eb6ab8be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:37:36.038871 n-d-850003-3 devstack@n-api.service[115954]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55b390fcc9c0 pid: 115954 (default app) Jul 18 12:39:04.475359 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:04.480072 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005081 Jul 18 12:39:04.486178 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:04.520084 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_api:SELECT=3 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:04.523451 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_cell1:SELECT=3 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:04.525019 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_cell0:SELECT=3 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:04.527777 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_cell0:SELECT=3 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:05.781452 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-fd0fa47e-f7ce-4cde-b168-ae7c79f61daf admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:05.816948 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-fd0fa47e-f7ce-4cde-b168-ae7c79f61daf admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.321919 Jul 18 12:39:05.817845 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 12:39:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:08.517231 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:08.518299 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-360db417-ff89-42c5-b5cd-53aa933ef066 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 18 12:39:08.519891 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:39:09.292747 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-55eca8fb-ac2f-42a8-bfeb-eaf6ec6130bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:09.314229 n-d-850003-3 devstack@n-api.service[115954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:39:09.314229 n-d-850003-3 devstack@n-api.service[115954]: warnings.warn(msg) Jul 18 12:39:09.354955 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-55eca8fb-ac2f-42a8-bfeb-eaf6ec6130bb admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.828767 Jul 18 12:39:09.366028 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:09.376435 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_api:SELECT=3 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:09.378069 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_cell0:SELECT=3 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:09.379296 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_cell1:SELECT=3 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:09.381626 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:09.816055 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-267b68d1-169c-4806-ac6f-15487254a1a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:09.821515 n-d-850003-3 devstack@n-api.service[115953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:39:09.821515 n-d-850003-3 devstack@n-api.service[115953]: warnings.warn(msg) Jul 18 12:39:09.931302 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-267b68d1-169c-4806-ac6f-15487254a1a7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.563176 Jul 18 12:39:09.932327 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 12:39:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:12.580160 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-55eca8fb-ac2f-42a8-bfeb-eaf6ec6130bb admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:12.581602 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-55eca8fb-ac2f-42a8-bfeb-eaf6ec6130bb admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Jul 18 12:39:12.582513 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:13.646609 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-050ac75c-ee66-4ab5-86a2-e6c0af783456 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:13.665767 n-d-850003-3 devstack@n-api.service[115953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:39:13.665767 n-d-850003-3 devstack@n-api.service[115953]: warnings.warn(msg) Jul 18 12:39:13.687943 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-050ac75c-ee66-4ab5-86a2-e6c0af783456 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.097738 Jul 18 12:39:13.689106 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 12:39:13.707013 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-6b27dbfe-3d2a-4d8d-bbef-f41687e6e1c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:13.709782 n-d-850003-3 devstack@n-api.service[115954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:39:13.709782 n-d-850003-3 devstack@n-api.service[115954]: warnings.warn(msg) Jul 18 12:39:13.755016 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-6b27dbfe-3d2a-4d8d-bbef-f41687e6e1c0 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051800 Jul 18 12:39:13.766184 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 12:39:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:16.699463 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-050ac75c-ee66-4ab5-86a2-e6c0af783456 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:16.700604 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-050ac75c-ee66-4ab5-86a2-e6c0af783456 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jul 18 12:39:16.701089 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:17.707417 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-84d2eed6-3e3c-4aaf-b152-3bf855c4006e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "vcpus": 1}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:17.731283 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-84d2eed6-3e3c-4aaf-b152-3bf855c4006e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.021751 Jul 18 12:39:17.739893 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:17.745944 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-4d9ffd4c-e7bd-4912-896a-eba143627f93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:17.775914 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-4d9ffd4c-e7bd-4912-896a-eba143627f93 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033410 Jul 18 12:39:17.782954 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 12:39:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:39:20.287334 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-84d2eed6-3e3c-4aaf-b152-3bf855c4006e admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:20.288333 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-84d2eed6-3e3c-4aaf-b152-3bf855c4006e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 18 12:39:20.288748 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:20.928528 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-3b67acf8-e1ad-4fda-8cbd-cc37dedf0c7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "vcpus": 2, "ram": 2048}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:20.959474 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-3b67acf8-e1ad-4fda-8cbd-cc37dedf0c7d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.663453 Jul 18 12:39:20.960491 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 12:39:20.983512 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-26cf0c7a-1426-4751-a613-0d611a74df68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:21.031635 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-26cf0c7a-1426-4751-a613-0d611a74df68 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055040 Jul 18 12:39:21.032724 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 12:39:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:24.715661 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-3b67acf8-e1ad-4fda-8cbd-cc37dedf0c7d admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:24.717163 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-3b67acf8-e1ad-4fda-8cbd-cc37dedf0c7d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002373 Jul 18 12:39:24.718499 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:25.429213 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:25.454967 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.728822 Jul 18 12:39:25.462335 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:25.469153 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-50b9b3c1-0c5e-4597-9aad-67d06e8d886f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:25.502083 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-50b9b3c1-0c5e-4597-9aad-67d06e8d886f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036698 Jul 18 12:39:25.502743 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 12:39:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:28.213059 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:28.214832 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002383 Jul 18 12:39:28.221121 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:28.772704 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-8d09ef1b-8e41-4e84-9dba-666c280b167e admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:28.863568 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-8d09ef1b-8e41-4e84-9dba-666c280b167e admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.640604 Jul 18 12:39:28.878179 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 12:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:39:32.078179 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:32.079165 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-f73a9a09-1d2d-4af4-87b7-260eb4136e12 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 18 12:39:32.079796 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:32.676758 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-a1a5d14b-df36-4993-859a-72277f4a0487 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "ram": 512, "swap": 0, "vcpus": 1, "name": "m1.tiny"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:32.699869 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-a1a5d14b-df36-4993-859a-72277f4a0487 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.612856 Jul 18 12:39:32.700894 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:32.721767 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-8a996450-2d1c-410a-a160-04832dc0e76e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:32.765406 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-8a996450-2d1c-410a-a160-04832dc0e76e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050256 Jul 18 12:39:32.766519 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 12:39:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:35.929985 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-a1a5d14b-df36-4993-859a-72277f4a0487 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:35.931288 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-a1a5d14b-df36-4993-859a-72277f4a0487 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002304 Jul 18 12:39:35.931771 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:36.564504 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-5a0f50fd-4ef2-4990-bac9-d0cb56c9fc15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:36.574254 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:36.603716 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-5a0f50fd-4ef2-4990-bac9-d0cb56c9fc15 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.664313 Jul 18 12:39:36.604806 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:36.625368 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-259ee11c-41df-48b1-ac1c-8c9460394708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:36.676700 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-259ee11c-41df-48b1-ac1c-8c9460394708 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057913 Jul 18 12:39:36.677652 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 12:39:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:39.396793 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-5a0f50fd-4ef2-4990-bac9-d0cb56c9fc15 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:39.397962 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-5a0f50fd-4ef2-4990-bac9-d0cb56c9fc15 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jul 18 12:39:39.398534 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:39.921045 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-a9529fa8-8d6e-4a60-a539-a91378050927 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "swap": 0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:39.926719 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:39:39.944501 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-a9529fa8-8d6e-4a60-a539-a91378050927 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.538522 Jul 18 12:39:39.945291 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:39.958675 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-b3e4ba90-12bc-46b9-9b9d-8c9d2c5fea4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:39.985556 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-b3e4ba90-12bc-46b9-9b9d-8c9d2c5fea4d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031824 Jul 18 12:39:39.986218 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 12:39:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:42.384163 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-a9529fa8-8d6e-4a60-a539-a91378050927 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:42.386364 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-a9529fa8-8d6e-4a60-a539-a91378050927 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004914 Jul 18 12:39:42.387153 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:42.925555 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-715055c4-e3b0-4cf5-b9b2-1a1dcb85d4a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:42.949210 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-715055c4-e3b0-4cf5-b9b2-1a1dcb85d4a6 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.554708 Jul 18 12:39:42.949927 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:42.966785 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-a682a085-08a6-47bf-813e-524091953eb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:43.057495 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-a682a085-08a6-47bf-813e-524091953eb9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097911 Jul 18 12:39:43.059829 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 12:39:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:39:45.553213 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-715055c4-e3b0-4cf5-b9b2-1a1dcb85d4a6 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:39:45.556469 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-715055c4-e3b0-4cf5-b9b2-1a1dcb85d4a6 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003872 Jul 18 12:39:45.557963 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:39:46.310617 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5"}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:46.333530 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.768696 Jul 18 12:39:46.342528 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 12:39:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:39:46.352006 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-2b7e8f0f-df87-4600-96ac-912dc574381e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:39:46.407236 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-2b7e8f0f-df87-4600-96ac-912dc574381e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062203 Jul 18 12:39:46.408706 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 12:39:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:40:13.176908 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:13.178065 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jul 18 12:40:13.178584 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:40:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:13.195634 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:40:13.702806 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-3ed2b731-172c-401d-aa62-aee324357360 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:13.739513 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-3ed2b731-172c-401d-aa62-aee324357360 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.552106 Jul 18 12:40:13.740524 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 12:40:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:14.973866 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:14.975351 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-fe07da82-d966-4559-bbda-a3fe827d6806 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001899 Jul 18 12:40:14.975936 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:15.626565 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-57552bcd-979f-4a74-8d4f-d8e7874ada32 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:15.633528 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.wsgi [None req-57552bcd-979f-4a74-8d4f-d8e7874ada32 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-57552bcd-979f-4a74-8d4f-d8e7874ada32 admin admin] Request method failure captured: Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Accept: application/json Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Accept-Encoding: gzip, deflate Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Connection: keep-alive Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Content-Length: 0 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Host: 10.222.0.88 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: Openstack-System-Scope: None Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: User-Agent: python-novaclient Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Auth-Token: gAAAAABi1VSug6QtJyH8mneUTB4Q5UBrV6xmetg4zXL7jNkVQz3PWDNYHN1930IsjbhJPL85hq3czJZLbRYJ104w9ettc12Hr9WN68Pz3oxiwgQc5eqiMlutNReznYuhv260gPoZgA2OVmjNpTpnwftvcF9fzJDKWBIzNM5IVR8XEk3fboBKHyw Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Id: None Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Name: None Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Identity-Status: Confirmed Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Is-Admin-Project: True Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Id: default Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Name: Default Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Name: admin Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Role: reader,member,admin Jul 18 12:40:15.636992 n-d-850003-3 devstack@n-api.service[115954]: X-Roles: reader,member,admin Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant: admin Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Name: admin Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-User: admin Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Id: default Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Name: Default Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: X-User-Name: admin Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: method: > Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: exception: Flavor 42 could not be found. Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: action_args: {'id': '42'} Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:15.639702 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:15.641715 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.644898 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-57552bcd-979f-4a74-8d4f-d8e7874ada32 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:15.647418 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-57552bcd-979f-4a74-8d4f-d8e7874ada32 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.498359 Jul 18 12:40:15.647418 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:40:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 12:40:15.652147 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-4accc48d-80ae-471e-8e5f-16f7fbc154cf admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:15.655189 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:40:15.677038 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-4accc48d-80ae-471e-8e5f-16f7fbc154cf admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028508 Jul 18 12:40:15.677685 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:15.696780 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-541ee9e3-ff1c-45d2-acea-2dd0ee5b36a7 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:15.726813 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-541ee9e3-ff1c-45d2-acea-2dd0ee5b36a7 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033690 Jul 18 12:40:15.727664 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:15.738766 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-c241d7be-3ab6-49dd-9928-45f68a52525b admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:15.745441 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.wsgi [None req-c241d7be-3ab6-49dd-9928-45f68a52525b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-c241d7be-3ab6-49dd-9928-45f68a52525b admin admin] Request method failure captured: Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Accept: application/json Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Accept-Encoding: gzip, deflate Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Connection: keep-alive Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Content-Length: 0 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Host: 10.222.0.88 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: Openstack-System-Scope: None Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: User-Agent: python-novaclient Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Auth-Token: gAAAAABi1VSug6QtJyH8mneUTB4Q5UBrV6xmetg4zXL7jNkVQz3PWDNYHN1930IsjbhJPL85hq3czJZLbRYJ104w9ettc12Hr9WN68Pz3oxiwgQc5eqiMlutNReznYuhv260gPoZgA2OVmjNpTpnwftvcF9fzJDKWBIzNM5IVR8XEk3fboBKHyw Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Id: None Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Name: None Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Identity-Status: Confirmed Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Is-Admin-Project: True Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Id: default Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Name: Default Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Name: admin Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Role: reader,member,admin Jul 18 12:40:15.748957 n-d-850003-3 devstack@n-api.service[115953]: X-Roles: reader,member,admin Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant: admin Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Name: admin Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-User: admin Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Id: default Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Name: Default Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: X-User-Name: admin Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: method: > Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: exception: Flavor 42 could not be found. Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: action_args: {'id': '42'} Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:15.751592 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:15.753178 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:15.756132 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-c241d7be-3ab6-49dd-9928-45f68a52525b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:15.759537 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-c241d7be-3ab6-49dd-9928-45f68a52525b admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016172 Jul 18 12:40:15.759537 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:40:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:40:16.852269 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-541ee9e3-ff1c-45d2-acea-2dd0ee5b36a7 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:16.853962 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-541ee9e3-ff1c-45d2-acea-2dd0ee5b36a7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002311 Jul 18 12:40:16.854632 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:17.627221 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-53ca6037-0cf8-4b8c-82c1-d5751ca14e1f admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:17.633999 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.wsgi [None req-53ca6037-0cf8-4b8c-82c1-d5751ca14e1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-53ca6037-0cf8-4b8c-82c1-d5751ca14e1f admin admin] Request method failure captured: Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Accept: application/json Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Accept-Encoding: gzip, deflate Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Connection: keep-alive Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Content-Length: 0 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Host: 10.222.0.88 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: Openstack-System-Scope: None Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: User-Agent: python-novaclient Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Auth-Token: gAAAAABi1VSw6V6STbG20-g927Tz-UF6h9s8jOr6P53Zry8c9bKvcS3xUcaTo6DLa1aDJFOmhBVmvSOdpYELGkgvRX3xTzXitpHN0Z5WpAPG20FBQ2HUT7scNQa2kQUMg7BFsWiZH2HAnWqcQ1EsFM73YAHKSwQHh3l0HNMuTFjpp3cLP6U9ljk Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Id: None Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Name: None Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Identity-Status: Confirmed Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Is-Admin-Project: True Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Id: default Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Name: Default Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Name: admin Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Role: reader,member,admin Jul 18 12:40:17.635792 n-d-850003-3 devstack@n-api.service[115953]: X-Roles: reader,member,admin Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant: admin Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Name: admin Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-User: admin Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Id: default Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Name: Default Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: X-User-Name: admin Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: method: > Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: exception: Flavor 84 could not be found. Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: action_args: {'id': '84'} Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:17.638084 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:17.639514 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.641410 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-53ca6037-0cf8-4b8c-82c1-d5751ca14e1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:17.643384 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-53ca6037-0cf8-4b8c-82c1-d5751ca14e1f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.526379 Jul 18 12:40:17.643384 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:40:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:40:17.651068 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-92fe6d5e-c07a-433c-affe-11ae8cd6c5bd admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:17.666967 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-92fe6d5e-c07a-433c-affe-11ae8cd6c5bd admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019500 Jul 18 12:40:17.667733 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:17.682302 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-5e61f80f-8f78-4b05-885a-516bea082068 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:17.698555 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-5e61f80f-8f78-4b05-885a-516bea082068 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019900 Jul 18 12:40:17.699062 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:40:17.709715 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-acb32fe7-deef-4fa3-b2c8-516cc1a608d9 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:17.716545 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.wsgi [None req-acb32fe7-deef-4fa3-b2c8-516cc1a608d9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-acb32fe7-deef-4fa3-b2c8-516cc1a608d9 admin admin] Request method failure captured: Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Accept: application/json Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Accept-Encoding: gzip, deflate Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Connection: keep-alive Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Content-Length: 0 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Host: 10.222.0.88 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: Openstack-System-Scope: None Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: User-Agent: python-novaclient Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Auth-Token: gAAAAABi1VSw6V6STbG20-g927Tz-UF6h9s8jOr6P53Zry8c9bKvcS3xUcaTo6DLa1aDJFOmhBVmvSOdpYELGkgvRX3xTzXitpHN0Z5WpAPG20FBQ2HUT7scNQa2kQUMg7BFsWiZH2HAnWqcQ1EsFM73YAHKSwQHh3l0HNMuTFjpp3cLP6U9ljk Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Id: None Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Name: None Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Identity-Status: Confirmed Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Is-Admin-Project: True Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Id: default Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Name: Default Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Name: admin Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Role: reader,member,admin Jul 18 12:40:17.718262 n-d-850003-3 devstack@n-api.service[115954]: X-Roles: reader,member,admin Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant: admin Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Name: admin Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-User: admin Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Id: default Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Name: Default Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: X-User-Name: admin Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: method: > Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: exception: Flavor 84 could not be found. Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: action_args: {'id': '84'} Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:17.721222 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:17.723226 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:17.725703 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-acb32fe7-deef-4fa3-b2c8-516cc1a608d9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:17.728026 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-acb32fe7-deef-4fa3-b2c8-516cc1a608d9 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014894 Jul 18 12:40:17.728026 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:40:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:40:18.787733 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-5e61f80f-8f78-4b05-885a-516bea082068 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:18.788981 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-5e61f80f-8f78-4b05-885a-516bea082068 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 18 12:40:18.790485 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:19.444233 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-2e02c06c-4952-4f5c-bc98-7149281db0a1 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:19.450765 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.wsgi [None req-2e02c06c-4952-4f5c-bc98-7149281db0a1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-2e02c06c-4952-4f5c-bc98-7149281db0a1 admin admin] Request method failure captured: Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Accept: application/json Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Accept-Encoding: gzip, deflate Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Connection: keep-alive Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Content-Length: 0 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Host: 10.222.0.88 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: Openstack-System-Scope: None Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: User-Agent: python-novaclient Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Auth-Token: gAAAAABi1VSyydgdblWIegIaaRtjX_8AxWzhVOIJ3OD4yfnD45nE6biggATbFoYDU6h4z2PV6psjgmqYlAE1bolPod1WyjQ4lTaFJLwCGSW5QUDJHGWQczWh9U7BzacwwUfOYo7VrY_jnOnI9bcgEQpiXx-HcWIxheU1LQg83y4tLAgQ_2D1Nm4 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Id: None Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Domain-Name: None Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Identity-Status: Confirmed Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Is-Admin-Project: True Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Id: default Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Domain-Name: Default Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Project-Name: admin Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Role: reader,member,admin Jul 18 12:40:19.452362 n-d-850003-3 devstack@n-api.service[115954]: X-Roles: reader,member,admin Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant: admin Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-Tenant-Name: admin Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-User: admin Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Id: default Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-User-Domain-Name: Default Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: X-User-Name: admin Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: method: > Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: exception: Flavor 451 could not be found. Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: action_args: {'id': '451'} Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:19.455369 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:19.457142 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.459761 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-2e02c06c-4952-4f5c-bc98-7149281db0a1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:19.461988 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-2e02c06c-4952-4f5c-bc98-7149281db0a1 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.521118 Jul 18 12:40:19.461988 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:40:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 12:40:19.464528 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-194abf8c-6a5f-4fab-ba60-1939d757a644 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:19.480429 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-194abf8c-6a5f-4fab-ba60-1939d757a644 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019624 Jul 18 12:40:19.481009 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:19.492654 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:19.510604 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021586 Jul 18 12:40:19.510787 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:40:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:40:19.521789 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-6002506c-129a-4e8a-a386-b5a4d4dd6010 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:19.527770 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.wsgi [None req-6002506c-129a-4e8a-a386-b5a4d4dd6010 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-6002506c-129a-4e8a-a386-b5a4d4dd6010 admin admin] Request method failure captured: Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Accept: application/json Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Accept-Encoding: gzip, deflate Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Connection: keep-alive Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Content-Length: 0 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Host: 10.222.0.88 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Openstack-Api-Version: compute 2.90 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: Openstack-System-Scope: None Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: User-Agent: python-novaclient Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Auth-Token: gAAAAABi1VSyydgdblWIegIaaRtjX_8AxWzhVOIJ3OD4yfnD45nE6biggATbFoYDU6h4z2PV6psjgmqYlAE1bolPod1WyjQ4lTaFJLwCGSW5QUDJHGWQczWh9U7BzacwwUfOYo7VrY_jnOnI9bcgEQpiXx-HcWIxheU1LQg83y4tLAgQ_2D1Nm4 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Id: None Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Domain-Name: None Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Identity-Status: Confirmed Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Is-Admin-Project: True Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Id: default Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Domain-Name: Default Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Project-Name: admin Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Role: reader,member,admin Jul 18 12:40:19.529315 n-d-850003-3 devstack@n-api.service[115953]: X-Roles: reader,member,admin Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f10f4f8e54a49d186e7db57e3edbeb7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f10f4f8e54a49d186e7db57e3edbeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant: admin Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Id: 2f10f4f8e54a49d186e7db57e3edbeb7 Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-Tenant-Name: admin Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-User: admin Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Id: default Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-User-Domain-Name: Default Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-User-Id: 9fe4d1d7046a4ed88f4b3097a762639a Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: X-User-Name: admin Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: method: > Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: exception: Flavor 451 could not be found. Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: action_args: {'id': '451'} Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:40:19.531793 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:19.532882 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: ERROR nova.api.openstack.wsgi Jul 18 12:40:19.535188 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-6002506c-129a-4e8a-a386-b5a4d4dd6010 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:40:19.536783 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-6002506c-129a-4e8a-a386-b5a4d4dd6010 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013110 Jul 18 12:40:19.536783 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:40:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:40:20.619700 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:20.621002 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jul 18 12:40:20.621489 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:21.301962 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-8dbe757a-5165-4a44-a429-8696c7a9b098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:40:21.324341 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-8dbe757a-5165-4a44-a429-8696c7a9b098 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.559825 Jul 18 12:40:21.325008 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 12:40:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 12:40:22.405625 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:22.406640 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jul 18 12:40:22.407058 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:40:23.174899 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-5ca78900-50cd-4dad-9bd0-6ab3f6efc45b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:40:23.203274 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-5ca78900-50cd-4dad-9bd0-6ab3f6efc45b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.652920 Jul 18 12:40:23.203876 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 12:40:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:40:24.493045 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:24.494916 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002540 Jul 18 12:40:24.495865 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:25.143899 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-0910e589-a040-4ea7-9e6d-9b54551d1b4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:40:25.173786 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-0910e589-a040-4ea7-9e6d-9b54551d1b4e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.530542 Jul 18 12:40:25.174806 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 12:40:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 12:40:26.279980 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:26.281049 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 18 12:40:26.281587 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:40:26.894035 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-2e235207-fecb-42a0-821f-0c502b30036f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:40:26.916105 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-2e235207-fecb-42a0-821f-0c502b30036f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.491436 Jul 18 12:40:26.916784 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 12:40:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:40:27.983796 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:27.985665 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002550 Jul 18 12:40:27.986453 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:40:28.743823 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-2223b1d5-1669-4d07-85e4-c9668e0051a8 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:40:28.764779 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-2223b1d5-1669-4d07-85e4-c9668e0051a8 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.512822 Jul 18 12:40:28.765365 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 18 12:40:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:41:27.018264 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.019604 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-a9861a3f-4fdf-482d-b138-fef51c23633d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jul 18 12:41:27.020070 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:41:27.037050 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:41:27.558671 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-ffaaef2f-5986-4545-89ca-72de55c4ac17 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.596813 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-ffaaef2f-5986-4545-89ca-72de55c4ac17 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.568275 Jul 18 12:41:27.597854 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:41:27.622935 n-d-850003-3 devstack@n-api.service[115954]: DEBUG dbcounter [-] [115954] Writing DB stats nova_api:SELECT=14 {{(pid=115954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:41:27.628798 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-7fc2b066-f162-4af0-a9be-94562cfd7250 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.638763 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-7fc2b066-f162-4af0-a9be-94562cfd7250 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017761 Jul 18 12:41:27.639607 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:41:27.653341 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-cbaa1a15-e269-437a-9921-b33700cb769c admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.664060 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-cbaa1a15-e269-437a-9921-b33700cb769c admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014231 Jul 18 12:41:27.664739 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:41:27.679868 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.689045 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013527 Jul 18 12:41:27.689667 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:41:27.702587 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-08140a21-30eb-4bcc-ade0-be94650f0d77 admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:41:27.710837 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-08140a21-30eb-4bcc-ade0-be94650f0d77 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011958 Jul 18 12:41:27.711414 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 18 12:41:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:47:21.544166 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:47:21.545187 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 18 12:47:21.545591 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:47:21.692563 n-d-850003-3 devstack@n-api.service[115953]: DEBUG dbcounter [-] [115953] Writing DB stats nova_api:SELECT=6 {{(pid=115953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:47:21.871062 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:47:21.872447 n-d-850003-3 devstack@n-api.service[115953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:47:21.872447 n-d-850003-3 devstack@n-api.service[115953]: warnings.warn(msg) Jul 18 12:47:21.874015 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:47:21.874784 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:47:21.875768 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:47:21.876278 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:47:21.920328 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-85d41500-bdad-429d-ac67-a2223177547e admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.229276 Jul 18 12:47:21.920929 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:47:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:47:22.838233 n-d-850003-3 devstack@n-api.service[115954]: DEBUG nova.api.openstack.wsgi [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] Calling method '>' {{(pid=115954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:47:22.839284 n-d-850003-3 devstack@n-api.service[115954]: INFO nova.api.openstack.requestlog [None req-8696f7b6-40c3-4324-9756-8387978199b2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Jul 18 12:47:22.839694 n-d-850003-3 devstack@n-api.service[115954]: [pid: 115954|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 12:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:47:23.054926 n-d-850003-3 devstack@n-api.service[115953]: DEBUG nova.api.openstack.wsgi [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] Calling method '>' {{(pid=115953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:47:23.057484 n-d-850003-3 devstack@n-api.service[115953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:47:23.057484 n-d-850003-3 devstack@n-api.service[115953]: warnings.warn(msg) Jul 18 12:47:23.059924 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:47:23.060640 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:47:23.061486 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:47:23.061917 n-d-850003-3 devstack@n-api.service[115953]: DEBUG oslo_concurrency.lockutils [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:47:23.087771 n-d-850003-3 devstack@n-api.service[115953]: INFO nova.api.openstack.requestlog [None req-e3d42fb7-17c1-40a9-b51e-2be8cbec05fe admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.102155 Jul 18 12:47:23.088446 n-d-850003-3 devstack@n-api.service[115953]: [pid: 115953|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:47:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:48:10.393941 n-d-850003-3 devstack@n-api.service[115952]: Mon Jul 18 12:48:10 2022 - graceful shutdown triggered... Jul 18 12:48:10.394830 n-d-850003-3 devstack@n-api.service[115953]: Gracefully killing worker 1 (pid: 115953)... Jul 18 12:48:10.394043 n-d-850003-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 12:48:10.396699 n-d-850003-3 devstack@n-api.service[115954]: Gracefully killing worker 2 (pid: 115954)... Jul 18 12:48:11.394230 n-d-850003-3 devstack@n-api.service[115952]: worker 1 buried after 1 seconds Jul 18 12:48:11.394779 n-d-850003-3 devstack@n-api.service[115952]: worker 2 buried after 1 seconds Jul 18 12:48:11.394779 n-d-850003-3 devstack@n-api.service[115952]: goodbye to uWSGI. Jul 18 12:48:11.396593 n-d-850003-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 18 12:48:11.397281 n-d-850003-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 12:48:11.400556 n-d-850003-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 12:48:11.421260 n-d-850003-3 devstack@n-api.service[131355]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 12:48:11 2022] *** Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: nodename: n-d-850003-3 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: machine: x86_64 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: clock source: unix Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: pcre jit disabled Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: detected number of CPU cores: 4 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: current working directory: / Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: detected binary path: /usr/bin/uwsgi-core Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: your processes number limit is 47680 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: your memory page size is 4096 bytes Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: detected max file descriptor number: 2048 Jul 18 12:48:11.438894 n-d-850003-3 devstack@n-api.service[131355]: lock engine: pthread robust mutexes Jul 18 12:48:11.440597 n-d-850003-3 devstack@n-api.service[131355]: thunder lock: enabled Jul 18 12:48:11.440597 n-d-850003-3 devstack@n-api.service[131355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 12:48:11.440597 n-d-850003-3 devstack@n-api.service[131355]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 12:48:11.483765 n-d-850003-3 devstack@n-api.service[131355]: Python main interpreter initialized at 0x55fa843f49c0 Jul 18 12:48:11.483765 n-d-850003-3 devstack@n-api.service[131355]: python threads support enabled Jul 18 12:48:11.483765 n-d-850003-3 devstack@n-api.service[131355]: your server socket listen backlog is limited to 100 connections Jul 18 12:48:11.483765 n-d-850003-3 devstack@n-api.service[131355]: your mercy for graceful operations on workers is 90 seconds Jul 18 12:48:11.484423 n-d-850003-3 devstack@n-api.service[131355]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 12:48:11.484423 n-d-850003-3 devstack@n-api.service[131355]: *** Operational MODE: preforking *** Jul 18 12:48:11.484649 n-d-850003-3 devstack@n-api.service[131355]: *** uWSGI is running in multiple interpreter mode *** Jul 18 12:48:11.484649 n-d-850003-3 devstack@n-api.service[131355]: spawned uWSGI master process (pid: 131355) Jul 18 12:48:11.484766 n-d-850003-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 12:48:11.485673 n-d-850003-3 devstack@n-api.service[131355]: spawned uWSGI worker 1 (pid: 131366, cores: 1) Jul 18 12:48:11.486207 n-d-850003-3 devstack@n-api.service[131355]: spawned uWSGI worker 2 (pid: 131367, cores: 1) Jul 18 12:48:11.486520 n-d-850003-3 devstack@n-api.service[131355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 12:48:12.220161 n-d-850003-3 devstack@n-api.service[131366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 12:48:12.222371 n-d-850003-3 devstack@n-api.service[131367]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 12:48:13.468149 n-d-850003-3 devstack@n-api.service[131366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:48:13.468149 n-d-850003-3 devstack@n-api.service[131366]: from cryptography.utils import int_from_bytes Jul 18 12:48:13.469072 n-d-850003-3 devstack@n-api.service[131366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:48:13.469072 n-d-850003-3 devstack@n-api.service[131366]: from cryptography.utils import int_from_bytes Jul 18 12:48:13.673501 n-d-850003-3 devstack@n-api.service[131367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:48:13.673501 n-d-850003-3 devstack@n-api.service[131367]: from cryptography.utils import int_from_bytes Jul 18 12:48:13.674267 n-d-850003-3 devstack@n-api.service[131367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 12:48:13.674267 n-d-850003-3 devstack@n-api.service[131367]: from cryptography.utils import int_from_bytes Jul 18 12:48:16.602650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 12:48:16.603719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 12:48:16.603719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 12:48:16.604076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 12:48:16.604076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 12:48:16.604428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.604792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.605088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.605411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.605748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.606060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.606407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.606742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.607076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.607337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.607657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.607983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850003-3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.608304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.608615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.608928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.609248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.609553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.609883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.610210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.610717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.611169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.611475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.611781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.612306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.612627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.612943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.613266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.613621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.614363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.614363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.614716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850003-3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.614994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.615340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.615653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.616101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.616429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.616998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.617326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.617668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.617984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.618333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.618850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.619174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.619521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.619806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.620122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.620432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.620753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.621056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.621361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.621612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.621922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.622272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.622600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.622921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.623170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.623418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.623736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.624056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.624365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.624674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.624981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.625288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.625593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.625897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.626225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.626538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.626871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.627237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.627486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.627840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.628111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.628529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.628771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.629080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.629472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.629789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.630097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.630448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.630772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.631083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.631472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.631785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.632106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.632452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.632872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.633131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.633442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.633752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.634075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.634413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.634724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.635033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.635338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.635646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.635953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.636261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.636574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.636879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.637185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.637528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.637793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.638103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.638458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.638783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.639091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.639397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.639702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.640008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.640328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.640635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.640940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.641263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.641573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.641878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.642212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.642526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.642833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.643152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.643452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.643758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.644075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.644380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.644692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.645537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.645842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.646223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.646478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.646843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.647612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.647612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.647969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.648245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.648556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.648866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.649175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.649551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.649825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.650189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.650527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.650845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.651324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.651545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.651973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.652207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.652524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.652849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.653162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.653475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.653786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.654106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.654471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.654803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.655118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.655434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.655754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.656064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.656381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.656713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.657034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.657349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.657908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.658080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.658366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.658693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.659041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.659517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.659774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.660195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.661073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.661417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.661734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.662055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.662740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.663059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.663373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.663686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.664027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.664342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.664660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.664976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.665296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.665609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.665765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 12:48:16.666508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.666667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 12:48:16.666852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.666852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.666852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.667314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 12:48:16.667515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.667515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.668437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.668597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 12:48:16.668824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.668984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 12:48:16.669201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.669201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.669522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.669731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.669731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.670121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.670411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.670411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.671034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.671242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.671242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.671747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.671922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.672099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.672263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.672263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.672559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.672726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.672726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.673044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.673200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.673200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.673497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.673662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.673662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.673977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.674129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.674340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.674494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.674494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.674793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.674960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.674960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.675366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850003-3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.675527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.675527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.675833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.675998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.676149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.676299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.676460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.676682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.676852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.677006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.677287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.677450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.677621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.678064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.678818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.678818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.679212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.679433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.679588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.679758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.679758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.679758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.680211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.680447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.680447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.680761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.680914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.680914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.681195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.681348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.681532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.681705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.681869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.682139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.682350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.682505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.682733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.682906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.683074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.683294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.683455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.683712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.683912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.684065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.684373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.684535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.684690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.684939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.685118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.685285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.685500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.685672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.685874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.686231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850003-3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.686398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.686551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.686771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.686944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.687122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.687345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.687567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.687843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.688048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.688238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.688490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.689213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.689385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.689385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.689723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.689891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.689891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.690298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.690507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.690507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.690809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.690979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.690979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.691321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.691492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.691658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.691826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.691979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.692158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.692340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.692507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.692757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.692939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.693112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.693258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.693435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.693693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.693900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.694284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.694461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.694775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.694937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.695105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.695330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.695511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.695678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.695907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.696070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.696333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.696505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.696669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.696945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.697120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.697274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.697437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.697589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.697863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.698023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.698270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.698576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.698809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.699344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.699552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.699767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.699767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.700088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.700314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.700314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.700602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.700755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.700922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.701088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.701088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.701380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.701549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.701549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.701839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.701994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.702204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.702376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.702543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.702788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.702959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.703125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.703384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.703549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.703717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.703954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.704138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.704292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.704503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.704688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.704864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.705141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.705319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.705473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.705637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.706062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.706351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.706508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.706659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.706960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.707124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.707832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.708073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.708237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.708405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.708649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.708871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.709119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.709569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.709787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.709787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.710185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.710342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.710342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.710718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.710878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.711024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.711194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.711350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.711525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.711676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.711827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.712003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.712151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.712318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.712592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.712760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.712925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.713185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.713489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.713704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.713864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.714131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.714325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.714478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.714777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.714962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.715119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.715336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.715498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.715710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.715880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.716046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.716357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.716539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.716716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.716957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.717170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.717331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.717497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.717651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.717857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.718022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.718282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.718476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.718632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.718806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.719070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.719293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.719517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.719663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.719818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.720173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.720325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.720463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.720617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.720751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.720888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.721116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.721313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.721526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.721743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.721898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.722096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.722364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.722586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.722797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.723039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.723748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.724149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.724352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.724492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.725013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.725184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.725353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.725530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.725698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.725849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.726019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.727194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.727381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.727658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.727817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.727971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.727971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.728265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.728432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.728432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.728751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.728917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.728917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.729204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.729342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.729342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.729610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.729745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.729745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.729999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.730207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.730207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.730477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.730626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.730782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.730917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.731221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.731393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.731548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.731814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.731972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.732128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.732513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.732727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.732940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.733140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.733305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.733461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.733676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.733914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.733914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.734343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.734540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.734540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.734900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.735096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.735096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.735489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.735680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.735868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.736083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.736277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.736492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.736695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.736898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.736898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.737269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.737471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.737471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.737846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.738037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.738315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.738523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.738523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.738941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.739144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.739144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.739524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.739714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.739714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.740086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.740535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.740535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.740988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.741181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.741571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.741762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.742248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.742482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.742697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.742878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.743050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.743382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.743534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.743702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.743918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.744088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.744259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.744555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.744782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.744954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.745106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.745260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.745524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.745695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.745860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.746113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.746367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.746553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.746746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 12:48:16.746916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.747084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.747345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.747510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.747687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.747934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.748108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.748261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.748519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.748683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.748860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.749087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.749289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.749463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.749698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.749890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.750058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.750330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.750489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.750855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.751893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.752344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.752526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.752674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.753993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.754914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.755977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.756159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.756332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.756662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.756820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.756985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.757135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.757292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.757593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.757748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.757899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.758084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.758288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.758528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.758700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.758853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.759104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.759263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.759565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.759737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.759904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.760073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.760221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.760463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.760622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.760783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.761029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.761183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.761379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.761527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.761684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.762891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.763948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.764792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.765894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.766023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.767750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.768992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.769118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.769277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.769543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.769683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.770522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.770722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.770875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.771150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.771303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.771469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.772036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.772242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.772374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.773779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.774727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.775896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.776352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.776529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.776529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.776820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.776977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.777117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.777269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.777462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.777687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.777999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.778339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.778646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.779255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.779255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.779582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.779883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.780174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.780341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.780711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.780886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.781903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.782083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.782387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.782654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.782959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.783390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.783588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.784471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.784690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.784894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.784894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.785870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.786363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.786553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.786553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.786859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.787972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.788973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.789930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.790905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.791982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.792280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.792502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.792683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.792910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.793111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.793329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.793692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.793874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.794062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.794766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.794917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.795853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.796963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.797981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.798249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.798409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.798575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.798719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.798867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.799948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.800879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.801842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.802924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.803078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.803297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.803512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.803873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.804134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.804332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.804565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.804788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.805169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.805371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.805694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.805862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.806986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.807909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.808857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.809969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.810119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.810383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.810664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.810862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.811016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.811274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.811479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.811685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.811875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.812074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.812277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.812467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.812679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.812874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.813057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.813057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.813442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.813689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.814256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.814448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.814636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.814825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.815016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.815414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.815627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.815885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.816097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.816287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.816486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.817181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.817380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.817574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.817774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.817774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.818195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.818424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.818627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.818831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.819030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.819219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.819406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.819621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.819827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.820083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.820289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.820470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.820664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.820865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.821056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.821255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.821458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.821458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.821838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.822025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.822321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.822540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.822727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.822978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.823176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.823373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.823574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.823781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.823995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.824390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.824591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.824851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.825040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.825225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.825432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.825661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.825837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.826001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.826250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.826454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.826669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.826852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.827973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.828123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.828281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.828441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.828648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.828854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.829072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.829273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.829458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.829749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.830016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.830277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.830483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.830673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.831141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.831415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.831615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.831817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.832017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.832197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.832402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.833886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.834053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.834551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.834720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.834869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.835937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.836097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.836265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.836428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.836596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.836811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.837941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.838142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.839375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.839585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.839790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.839995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.840185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.840401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.840611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.840805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.841957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.842197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.842406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.842612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.842828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.842991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.843160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.843318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.843491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.843649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.843939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.844949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.845995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.846244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.846471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.846639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.846803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.847992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.848937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.849102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.849325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.849512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.849698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.849858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.850927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.851155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.851331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.851489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.851663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.851814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.852882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.853973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.854928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.855902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.856987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.857876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.858936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.859097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.859255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.859411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.859557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.893953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.895780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.896567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.897022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.897340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.897715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.898036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.898462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.898854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.899535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.899792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.900030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.900244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.900556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.900899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.901127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.901373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.902041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.902294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.902516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.903029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.903267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.903494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.903494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.904087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.904311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.904630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.904843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.905041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.905274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.905758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.906080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.906346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.906577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.906772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.907016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.907235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.907459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.907697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.907938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.908142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.908418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.908633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.908844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.909049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.909265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.909484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.909703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.909930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.910171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.910377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.910638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.910855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.911070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.911306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.911508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.911735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.912405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.912666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.913643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.915929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.916145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.916460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.916782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.917004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.917216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.917427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.917634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.917853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.918085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.918085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.918524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.918741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.918972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.919171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.919434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.919640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.920014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.920478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.920478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.920478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.921071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.922950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.923314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.923744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.924073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.924073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.924628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.924628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.925444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.925748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.925972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.926252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.926470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.926676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.926932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.927358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.927737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.928081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.928457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.928770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.929172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.929436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.929658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.930043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.930319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.930951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.931175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.931416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.931643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.931856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.932045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.932242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.932495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.933204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.933426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.933664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.934030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.934321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.934564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.934781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.935001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.935218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.935629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.935847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.936077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.936296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.936533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.936749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.936970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.937197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.937197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.937197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.937197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.937197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.938197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.938434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.938655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.938871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.939106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.940698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.943470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.945998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.947535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.949017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.950762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.952603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.955145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.957186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.959353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.960918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.962750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.965006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.966881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.968423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.969981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.971593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.973305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.975177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.976559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.978330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.979756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.981617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.983486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.985980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.987924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.989604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.991152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.992876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.995176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.997010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:16.999025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.000612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.002250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.003955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.006841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.008573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.009983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.011584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.013378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.015039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.017322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.021850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.021850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 12:48:17.021850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 12:48:17.043914 n-d-850003-3 devstack@n-api.service[131367]: INFO dbcounter [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Registered counter for database nova_api Jul 18 12:48:17.075627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_db.sqlalchemy.engines [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.089036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writer thread running {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.170844 n-d-850003-3 devstack@n-api.service[131366]: INFO dbcounter [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Registered counter for database nova_api Jul 18 12:48:17.193589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.201734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writer thread running {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.202629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.context [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131367) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 12:48:17.211337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:48:17.214566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:48:17.215980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:48:17.220028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:48:17.223246 n-d-850003-3 devstack@n-api.service[131367]: INFO dbcounter [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Registered counter for database nova_cell0 Jul 18 12:48:17.231138 n-d-850003-3 devstack@n-api.service[131367]: INFO dbcounter [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Registered counter for database nova_cell1 Jul 18 12:48:17.246379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_db.sqlalchemy.engines [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.247743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_db.sqlalchemy.engines [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.255390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writer thread running {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.258933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writer thread running {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.266277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.context [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131366) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 12:48:17.270489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:48:17.272349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:48:17.273287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:48:17.275458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:48:17.277622 n-d-850003-3 devstack@n-api.service[131366]: INFO dbcounter [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Registered counter for database nova_cell0 Jul 18 12:48:17.282324 n-d-850003-3 devstack@n-api.service[131366]: INFO dbcounter [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Registered counter for database nova_cell1 Jul 18 12:48:17.292824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.293823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.303227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writer thread running {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.308149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writer thread running {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.416238 n-d-850003-3 devstack@n-api.service[131367]: INFO dbcounter [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Registered counter for database nova_cell0 Jul 18 12:48:17.431801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_db.sqlalchemy.engines [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.440791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writer thread running {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.502096 n-d-850003-3 devstack@n-api.service[131366]: INFO dbcounter [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Registered counter for database nova_cell0 Jul 18 12:48:17.515477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 12:48:17.522121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writer thread running {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 12:48:17.845988 n-d-850003-3 devstack@n-api.service[131367]: WARNING keystonemiddleware.auth_token [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:48:17.854557 n-d-850003-3 devstack@n-api.service[131367]: WARNING keystonemiddleware.auth_token [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:48:17.872301 n-d-850003-3 devstack@n-api.service[131366]: WARNING keystonemiddleware.auth_token [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:48:17.881774 n-d-850003-3 devstack@n-api.service[131366]: WARNING keystonemiddleware.auth_token [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:48:18.235921 n-d-850003-3 devstack@n-api.service[131367]: WARNING keystonemiddleware.auth_token [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:48:18.244579 n-d-850003-3 devstack@n-api.service[131367]: WARNING keystonemiddleware.auth_token [None req-1a26bea9-3cdf-415a-9731-7914048d2df1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:48:18.250697 n-d-850003-3 devstack@n-api.service[131367]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fa843f49c0 pid: 131367 (default app) Jul 18 12:48:18.252089 n-d-850003-3 devstack@n-api.service[131366]: WARNING keystonemiddleware.auth_token [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 12:48:18.259232 n-d-850003-3 devstack@n-api.service[131366]: WARNING keystonemiddleware.auth_token [None req-e1ca3b34-1e72-4ba4-8be3-3eb01f2cdb4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 12:48:18.265228 n-d-850003-3 devstack@n-api.service[131366]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fa843f49c0 pid: 131366 (default app) Jul 18 12:49:12.773159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:12.777992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:12.782474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:12.785091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:13.335226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:13.336693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:13.337946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:13.339200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:14.724116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-298774871", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:15.010893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Calling method '.version_select at 0x7f96e7210940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:15.013794 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:15.013794 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:15.015526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:15.016236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:15.017316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:15.018961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:15.087709 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6d1933c-4d4a-441f-aa4d-78d47ad36bb6 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.776044 Jul 18 12:49:15.089189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1/1] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:49:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:49:15.544647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '.version_select at 0x7f96e70dd280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:15.548203 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:15.548203 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:15.556940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131366) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 12:49:15.558377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:15.559035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:15.595637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:15.597184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:15.605217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:49:15.613036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:15.613973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:15.640930 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-83649065-28c0-41f5-bbaf-5631060dd448 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.543019 Jul 18 12:49:15.644492 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2/2] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 12:49:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:16.096603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4b3c84e-f16a-4d81-a6a1-8227ea2345b4 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1754477285", "ram": 512, "vcpus": 1, "disk": 10, "id": 686812645, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:16.132212 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:16.132212 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:16.216043 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4b3c84e-f16a-4d81-a6a1-8227ea2345b4 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.565874 Jul 18 12:49:16.216802 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3/3] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:15 2022] POST /compute/v2.1/flavors => generated 413 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:16.344605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:49:16.345384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:49:16.346678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:49:16.347746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:49:16.348780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:49:16.389363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:16.390635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:16.392445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:16.394087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:16.480416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Getting quotas for project 1d696868b7554f829b1b44c0f18d93c6. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:16.499388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Getting quotas for user ddeca78fbb614783b68e6ae47c0c92d0 and project 1d696868b7554f829b1b44c0f18d93c6. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:16.528277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:49:16.532196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:49:16.681701 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da456d12-2042-4bd6-898a-cdd16a505c18 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.933707 Jul 18 12:49:16.683375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1/4] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 12:49:16.926142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:16.929206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:16.930017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:16.931772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:16.934984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:16.941778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Calling method '.version_select at 0x7f96e70dd5e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:16.951096 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:16.951096 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:16.959883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:16.961028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:17.047209 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c044cde-eb2f-459a-9d35-2bd21dda9834 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.361105 Jul 18 12:49:17.048314 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2/5] 10.222.0.88 () {58 vars in 1163 bytes} [Mon Jul 18 12:49:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:17.053685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:17.054698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:17.095073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:17.096731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:17.118479 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c39542bc-1956-431b-9ea0-009f8b70e5f5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.897882 Jul 18 12:49:17.130504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 4/6] 10.222.0.88 () {60 vars in 1207 bytes} [Mon Jul 18 12:49:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:49:17.157730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8398547f-3e84-4ee1-90c9-536ae471e88a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1391263122", "name": "tempest-test_aggregate-521240596"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:17.219509 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.219509 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:17.222524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-8398547f-3e84-4ee1-90c9-536ae471e88a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid 456146a1-005b-4538-a71b-a59a7460c678 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:49:17.376906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68f9ab56-b28d-449c-a38b-1e982bdb4281 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Calling method '.version_select at 0x7f96e5ff7a60>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.386087 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.386087 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:17.390897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-68f9ab56-b28d-449c-a38b-1e982bdb4281 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:17.394524 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8398547f-3e84-4ee1-90c9-536ae471e88a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.265971 Jul 18 12:49:17.396230 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 5/7] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 18 12:49:17 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68f9ab56-b28d-449c-a38b-1e982bdb4281 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:17.406261 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 12:49:17.409030 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:17.410296 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 12:49:17.412083 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.418219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68f9ab56-b28d-449c-a38b-1e982bdb4281 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:17.418219 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68f9ab56-b28d-449c-a38b-1e982bdb4281 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.357555 Jul 18 12:49:17.426035 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3/8] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:17.542737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-652c6efe-1999-4c10-9151-452fbe8946fd tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1602973573", "id": 1917831014, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:17.555746 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.555746 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:17.629693 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-652c6efe-1999-4c10-9151-452fbe8946fd tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.201838 Jul 18 12:49:17.630924 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 4/9] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:17 2022] POST /compute/v2.1/flavors => generated 430 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:17.638261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f4324d5-9def-44c8-8d90-90b9607b4cf3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.639325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4f4324d5-9def-44c8-8d90-90b9607b4cf3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:17.741249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-870c41cd-fe43-4607-acc2-8de186bd83e7 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.788811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-870c41cd-fe43-4607-acc2-8de186bd83e7 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] HTTP exception thrown: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-870c41cd-fe43-4607-acc2-8de186bd83e7 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Request method failure captured: Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbG0OPhmjxMQOwqmZW83ArZXO7e1uo5TEfHO4BLqKMd-0C6EYBPCV7vsrUH8dlo3Qjd64qN6H_zeVUF89SUgMaj5IUmBoGHDKwRf3xc_Beadi9fXzWYQpn2MyEsxiE5uqsv0eWMetJhRKCGkIst1Wj99yYejzSB4UzsC5EjkIYxKms Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:49:17.793534 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f2d8c7b4a234bcca0704152ee3d3b6c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f869eaf1185440fdb98e1502ebb35f10 Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:49:17.795652 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'flavor_id': '686812645', 'id': 'hw:cpu_thread_policy'} Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:17.796745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.798832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-870c41cd-fe43-4607-acc2-8de186bd83e7 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Returning 404 to user: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:17.799653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-870c41cd-fe43-4607-acc2-8de186bd83e7 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] 10.222.0.88 "GET /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.400221 Jul 18 12:49:17.806817 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 6/10] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:17.819477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4f4324d5-9def-44c8-8d90-90b9607b4cf3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:17.822609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.825290 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.825290 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:17.831716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:17.832715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:17.836089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:17.836997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:17.868407 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f4324d5-9def-44c8-8d90-90b9607b4cf3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1219 microversion: 2.1 time: 0.234997 Jul 18 12:49:17.870933 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 5/11] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:17.879847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0416cb2-732c-4395-b12a-80b51e928fd2 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.886410 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a93f329d-5925-48bb-82cf-6592199b0ed0 tempest-AZAdminV2TestJSON-1301750177 tempest-AZAdminV2TestJSON-1301750177-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.078321 Jul 18 12:49:17.887699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 7/12] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:17.894059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3babc6b-3109-4988-beaf-bf90ad7f308b tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Calling method '.version_select at 0x7f96e57c7ee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.895605 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.895605 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:17.896245 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.896245 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:17.898129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3babc6b-3109-4988-beaf-bf90ad7f308b tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3babc6b-3109-4988-beaf-bf90ad7f308b tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hosts/n-d-850003-3/reboot HTTP/1.1 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:49:17.911028 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'n-d-850003-3'} Jul 18 12:49:17.912224 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:17.912847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 12:49:17.913714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.915562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3babc6b-3109-4988-beaf-bf90ad7f308b tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:17.915562 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3babc6b-3109-4988-beaf-bf90ad7f308b tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-850003-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024085 Jul 18 12:49:17.915562 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 8/13] 10.222.0.88 () {58 vars in 1187 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/os-hosts/n-d-850003-3/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:17.938249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-292db66d-8cae-4cb7-958f-702fe1d3e5bf tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:17.938999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0416cb2-732c-4395-b12a-80b51e928fd2 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.065479 Jul 18 12:49:17.939249 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.939249 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:17.947228 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 6/14] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:17.956237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-650c9258-5d89-4fb4-a76b-908d40e5d96b tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:17.969691 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:17.969691 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:17.973780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-650c9258-5d89-4fb4-a76b-908d40e5d96b tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f869eaf1185440fdb98e1502ebb35f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d8c7b4a234bcca0704152ee3d3b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-650c9258-5d89-4fb4-a76b-908d40e5d96b tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Request method failure captured: Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/flavors/686812645/os-extra_specs HTTP/1.1 Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 66 Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbG0OPhmjxMQOwqmZW83ArZXO7e1uo5TEfHO4BLqKMd-0C6EYBPCV7vsrUH8dlo3Qjd64qN6H_zeVUF89SUgMaj5IUmBoGHDKwRf3xc_Beadi9fXzWYQpn2MyEsxiE5uqsv0eWMetJhRKCGkIst1Wj99yYejzSB4UzsC5EjkIYxKms Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:17.976937 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f2d8c7b4a234bcca0704152ee3d3b6c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f869eaf1185440fdb98e1502ebb35f10 Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 18 12:49:17.979268 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'flavor_id': '686812645', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:17.980370 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 12:49:17.982830 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:17.987691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-650c9258-5d89-4fb4-a76b-908d40e5d96b tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:17.989671 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-650c9258-5d89-4fb4-a76b-908d40e5d96b tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] 10.222.0.88 "POST /compute/v2.1/flavors/686812645/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.040440 Jul 18 12:49:17.991290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 7/15] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:17 2022] POST /compute/v2.1/flavors/686812645/os-extra_specs => generated 124 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:18.001636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51508a96-cc18-41ec-ba57-e2668dd2ff72 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Calling method '.version_select at 0x7f96e5f28040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.004228 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.004228 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.046813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-292db66d-8cae-4cb7-958f-702fe1d3e5bf tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1917831014" status: 202 len: 0 microversion: 2.1 time: 0.131197 Jul 18 12:49:18.047625 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 9/16] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:49:17 2022] DELETE /compute/v2.1/flavors/1917831014 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:18.063154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ddff18d4-2fa4-4245-b87c-c94a4eea9ba8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:18.071814 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.071814 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:18.081427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-51508a96-cc18-41ec-ba57-e2668dd2ff72 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.093547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddff18d4-2fa4-4245-b87c-c94a4eea9ba8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:18.095238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddff18d4-2fa4-4245-b87c-c94a4eea9ba8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51508a96-cc18-41ec-ba57-e2668dd2ff72 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:49:18.103648 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'nonexistent_hostname'} Jul 18 12:49:18.106122 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:49:18.108038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 12:49:18.112197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.114341 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.116547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51508a96-cc18-41ec-ba57-e2668dd2ff72 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.118550 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51508a96-cc18-41ec-ba57-e2668dd2ff72 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.125103 Jul 18 12:49:18.119825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 8/17] 10.222.0.88 () {58 vars in 1211 bytes} [Mon Jul 18 12:49:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:49:18.131335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8c2d441-9fea-4924-80de-eb054bc73995 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:18.262722 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8c2d441-9fea-4924-80de-eb054bc73995 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/686812645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.139523 Jul 18 12:49:18.264264 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 9/18] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:18 2022] POST /compute/v2.1/flavors/686812645/os-extra_specs => generated 66 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:18.321347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9a1faff-f7bb-484a-9766-86049026c595 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.489854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b9a1faff-f7bb-484a-9766-86049026c595 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.221216 Jul 18 12:49:18.491003 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 10/19] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:18 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:18.524209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a3f1009-6459-4486-9366-52505088ae6a tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Calling method '.version_select at 0x7f96e5617ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.526185 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.526185 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.529445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a3f1009-6459-4486-9366-52505088ae6a tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a3f1009-6459-4486-9366-52505088ae6a tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hosts/n-d-850003-3 HTTP/1.1 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:18.534337 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'n-d-850003-3'} Jul 18 12:49:18.536736 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:18.538005 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 12:49:18.539696 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.541184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a3f1009-6459-4486-9366-52505088ae6a tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.541184 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a3f1009-6459-4486-9366-52505088ae6a tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-850003-3" status: 403 len: 109 microversion: 2.1 time: 0.027855 Jul 18 12:49:18.547574 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 11/20] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 12:49:18 2022] GET /compute/v2.1/os-hosts/n-d-850003-3 => generated 109 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:18.557424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d58e13f2-a7a1-47d2-8749-4d9a7c6c1f7d tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.560319 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.560319 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.562979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d58e13f2-a7a1-47d2-8749-4d9a7c6c1f7d tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f869eaf1185440fdb98e1502ebb35f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d8c7b4a234bcca0704152ee3d3b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d58e13f2-a7a1-47d2-8749-4d9a7c6c1f7d tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Request method failure captured: Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbG0OPhmjxMQOwqmZW83ArZXO7e1uo5TEfHO4BLqKMd-0C6EYBPCV7vsrUH8dlo3Qjd64qN6H_zeVUF89SUgMaj5IUmBoGHDKwRf3xc_Beadi9fXzWYQpn2MyEsxiE5uqsv0eWMetJhRKCGkIst1Wj99yYejzSB4UzsC5EjkIYxKms Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:18.567619 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f2d8c7b4a234bcca0704152ee3d3b6c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f869eaf1185440fdb98e1502ebb35f10 Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:49:18.568841 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'flavor_id': '686812645', 'id': 'hw:numa_nodes'} Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:18.569470 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 12:49:18.570447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.573053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d58e13f2-a7a1-47d2-8749-4d9a7c6c1f7d tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.576638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d58e13f2-a7a1-47d2-8749-4d9a7c6c1f7d tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] 10.222.0.88 "DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026758 Jul 18 12:49:18.578877 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 12/21] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 12:49:18 2022] DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:18.592153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea3157b5-206f-4092-b1be-997a8819e80e tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1822813287", "id": 1698518708, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:18.598078 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.598078 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.633198 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea3157b5-206f-4092-b1be-997a8819e80e tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.052306 Jul 18 12:49:18.636030 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 13/22] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:18 2022] POST /compute/v2.1/flavors => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:18.646955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b17d7cb2-0dc7-4f5d-89b5-f6e53aa87bd1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Calling method '.version_select at 0x7f96e5617c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.665666 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b17d7cb2-0dc7-4f5d-89b5-f6e53aa87bd1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b17d7cb2-0dc7-4f5d-89b5-f6e53aa87bd1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:49:18.670825 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'nonexistent_hostname'} Jul 18 12:49:18.673048 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.677231 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:18.680777 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.683874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b17d7cb2-0dc7-4f5d-89b5-f6e53aa87bd1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.683874 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b17d7cb2-0dc7-4f5d-89b5-f6e53aa87bd1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039958 Jul 18 12:49:18.687366 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 14/23] 10.222.0.88 () {58 vars in 1190 bytes} [Mon Jul 18 12:49:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:49:18.707112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c036afb-de9c-4621-99a0-97fe7a1b176e tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:18.768900 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c036afb-de9c-4621-99a0-97fe7a1b176e tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/686812645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079580 Jul 18 12:49:18.771147 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 15/24] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:18 2022] POST /compute/v2.1/flavors/686812645/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:18.781271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b672f7c0-8a5d-43a1-8c86-2e225c8e88a7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.844756 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b672f7c0-8a5d-43a1-8c86-2e225c8e88a7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5801 microversion: 2.1 time: 0.070967 Jul 18 12:49:18.847103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 16/25] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:18 2022] GET /compute/v2.1/flavors/detail => generated 5801 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:18.889089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a11645b-4830-4080-94a5-96b31af4b02d tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Calling method '.version_select at 0x7f96e563aca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:18.891911 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.891911 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.897219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a11645b-4830-4080-94a5-96b31af4b02d tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a11645b-4830-4080-94a5-96b31af4b02d tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hosts/n-d-850003-3/shutdown HTTP/1.1 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:18.901343 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'n-d-850003-3'} Jul 18 12:49:18.903960 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:18.907105 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 12:49:18.910252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.921547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a11645b-4830-4080-94a5-96b31af4b02d tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.923656 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a11645b-4830-4080-94a5-96b31af4b02d tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-850003-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.073228 Jul 18 12:49:18.928158 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 17/26] 10.222.0.88 () {58 vars in 1193 bytes} [Mon Jul 18 12:49:18 2022] GET /compute/v2.1/os-hosts/n-d-850003-3/shutdown => generated 113 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:18.947112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72b6fd66-2ee3-4018-b1a3-73d096c326a9 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:18.957997 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:18.957997 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:18.959833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72b6fd66-2ee3-4018-b1a3-73d096c326a9 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f869eaf1185440fdb98e1502ebb35f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d8c7b4a234bcca0704152ee3d3b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72b6fd66-2ee3-4018-b1a3-73d096c326a9 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Request method failure captured: Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 22 Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbG0OPhmjxMQOwqmZW83ArZXO7e1uo5TEfHO4BLqKMd-0C6EYBPCV7vsrUH8dlo3Qjd64qN6H_zeVUF89SUgMaj5IUmBoGHDKwRf3xc_Beadi9fXzWYQpn2MyEsxiE5uqsv0eWMetJhRKCGkIst1Wj99yYejzSB4UzsC5EjkIYxKms Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:18.980323 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f2d8c7b4a234bcca0704152ee3d3b6c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f2d8c7b4a234bcca0704152ee3d3b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0f2d8c7b4a234bcca0704152ee3d3b6c Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f869eaf1185440fdb98e1502ebb35f10 Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: {"hw:numa_nodes": "1"} Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:49:18.981518 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'flavor_id': '686812645', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:18.982212 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 12:49:18.983147 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:18.984069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72b6fd66-2ee3-4018-b1a3-73d096c326a9 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:18.984069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72b6fd66-2ee3-4018-b1a3-73d096c326a9 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453 tempest-FlavorsExtraSpecsNegativeTestJSON-82275453-project] 10.222.0.88 "PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.052265 Jul 18 12:49:18.994509 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 18/27] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:49:18 2022] PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes => generated 124 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:19.008870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cfad27bc-9451-4eea-bfcb-16d270097dbc tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.015224 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.015224 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:19.096621 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cfad27bc-9451-4eea-bfcb-16d270097dbc tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1698518708" status: 202 len: 0 microversion: 2.1 time: 0.099376 Jul 18 12:49:19.112639 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 19/28] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:49:18 2022] DELETE /compute/v2.1/flavors/1698518708 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:19.142079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.143705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:19.168587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:19.181554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:19.193069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:19.194405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:19.325513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ddff18d4-2fa4-4245-b87c-c94a4eea9ba8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.275617 Jul 18 12:49:19.328231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 10/29] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:49:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:19.360505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42cea468-f1c8-4de3-9c8c-4a9bf37b6781 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Calling method '.version_select at 0x7f96e57b29d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.362539 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.362539 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.388926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-42cea468-f1c8-4de3-9c8c-4a9bf37b6781 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42cea468-f1c8-4de3-9c8c-4a9bf37b6781 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:19.399797 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'nonexistent_hostname'} Jul 18 12:49:19.402042 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:49:19.405787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 12:49:19.409273 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42cea468-f1c8-4de3-9c8c-4a9bf37b6781 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42cea468-f1c8-4de3-9c8c-4a9bf37b6781 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.069405 Jul 18 12:49:19.415303 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 11/30] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 12:49:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:49:19.420220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad27d17a-6905-4070-8cad-861c67200096 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.421095 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.421095 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.495038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ad27d17a-6905-4070-8cad-861c67200096 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] HTTP exception thrown: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad27d17a-6905-4070-8cad-861c67200096 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Request method failure captured: Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJWHBnBPR7oz-5o-xOvhySRMNUtwPc17iCRuxBuGxW5Mq-Tmj1C4jNct6w-teVgVfNavBOeCmvAh4ODp9Y46DqkDP4FVgjVTxZ4yfPctQZ5PUPnExfZDPAIv_FLKN3ELHiVQX4uYdtS4j-VsSM4WcavKy3PicJv90spzv38nVHbe8 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:19.504916 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e73835dc4984c928e197f144d2342b6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ad60716b15934533a0015149c386c525 Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:49:19.506697 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'flavor_id': '686812645', 'id': 'hw:cpu_thread_policy'} Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.507477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. Jul 18 12:49:19.510070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.511905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad27d17a-6905-4070-8cad-861c67200096 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Returning 404 to user: Flavor 686812645 has no extra specs with key hw:cpu_thread_policy. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.513313 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad27d17a-6905-4070-8cad-861c67200096 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.100713 Jul 18 12:49:19.516366 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 12/31] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 12:49:19 2022] DELETE /compute/v2.1/flavors/686812645/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:19.531784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-076dcff3-c128-45c5-b41c-d25d0fc6e58b tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.605224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-076dcff3-c128-45c5-b41c-d25d0fc6e58b tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.087253 Jul 18 12:49:19.620802 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 13/32] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:19 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:19.629172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffd5a862-3395-4f92-b667-58b5ad0aa240 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Calling method '.version_select at 0x7f96e57bc940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.630491 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.630491 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.632233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ffd5a862-3395-4f92-b667-58b5ad0aa240 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffd5a862-3395-4f92-b667-58b5ad0aa240 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hosts/n-d-850003-3/startup HTTP/1.1 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:49:19.634267 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'n-d-850003-3'} Jul 18 12:49:19.635398 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:19.636047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 12:49:19.637004 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.639558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffd5a862-3395-4f92-b667-58b5ad0aa240 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.640819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ffd5a862-3395-4f92-b667-58b5ad0aa240 tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-850003-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.018583 Jul 18 12:49:19.642012 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 14/33] 10.222.0.88 () {58 vars in 1190 bytes} [Mon Jul 18 12:49:19 2022] GET /compute/v2.1/os-hosts/n-d-850003-3/startup => generated 110 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:19.648048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09df0772-f9a5-4c23-893e-5a5d6fc412f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:19.650641 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.650641 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.653216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-09df0772-f9a5-4c23-893e-5a5d6fc412f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09df0772-f9a5-4c23-893e-5a5d6fc412f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Request method failure captured: Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 27 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJWHBnBPR7oz-5o-xOvhySRMNUtwPc17iCRuxBuGxW5Mq-Tmj1C4jNct6w-teVgVfNavBOeCmvAh4ODp9Y46DqkDP4FVgjVTxZ4yfPctQZ5PUPnExfZDPAIv_FLKN3ELHiVQX4uYdtS4j-VsSM4WcavKy3PicJv90spzv38nVHbe8 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:19.655378 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e73835dc4984c928e197f144d2342b6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ad60716b15934533a0015149c386c525 Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: {"hw:cpu_policy": "shared"} Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:49:19.656503 n-d-850003-3 devstack@n-api.service[131366]: exception: Request body and URI mismatch Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'flavor_id': '686812645', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.657169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.658251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:19.658251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:19.658251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 18 12:49:19.658251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.660444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09df0772-f9a5-4c23-893e-5a5d6fc412f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.661824 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09df0772-f9a5-4c23-893e-5a5d6fc412f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017716 Jul 18 12:49:19.663121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 15/34] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:49:19 2022] PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:49:19.669133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e41946d-dcc5-407d-b3ff-15bfb22b523b tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1743254591", "id": 1261236440, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:19.671249 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.671249 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.709732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e41946d-dcc5-407d-b3ff-15bfb22b523b tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.043020 Jul 18 12:49:19.711405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 16/35] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:19 2022] POST /compute/v2.1/flavors => generated 429 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:19.749838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-227bedfe-f901-4633-a22c-c79fe966d787 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Calling method '.version_select at 0x7f96e57bc820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.782590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-227bedfe-f901-4633-a22c-c79fe966d787 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-227bedfe-f901-4633-a22c-c79fe966d787 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:19.785921 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'nonexistent_hostname'} Jul 18 12:49:19.787884 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:49:19.788926 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 12:49:19.791662 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.795402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-227bedfe-f901-4633-a22c-c79fe966d787 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.807832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-227bedfe-f901-4633-a22c-c79fe966d787 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.071192 Jul 18 12:49:19.809145 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 17/36] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 12:49:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:49:19.823291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c71fdd17-0dd0-4334-9037-b564a3907189 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c71fdd17-0dd0-4334-9037-b564a3907189 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Request method failure captured: Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 49 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJWHBnBPR7oz-5o-xOvhySRMNUtwPc17iCRuxBuGxW5Mq-Tmj1C4jNct6w-teVgVfNavBOeCmvAh4ODp9Y46DqkDP4FVgjVTxZ4yfPctQZ5PUPnExfZDPAIv_FLKN3ELHiVQX4uYdtS4j-VsSM4WcavKy3PicJv90spzv38nVHbe8 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:19.851715 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e73835dc4984c928e197f144d2342b6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e73835dc4984c928e197f144d2342b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1e73835dc4984c928e197f144d2342b6 Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ad60716b15934533a0015149c386c525 Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 18 12:49:19.854008 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'flavor_id': '686812645', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance: Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 18 12:49:19.855955 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.859119 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c71fdd17-0dd0-4334-9037-b564a3907189 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.872010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c71fdd17-0dd0-4334-9037-b564a3907189 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.042430 Jul 18 12:49:19.873976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:19.874874 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:49:19 2022] PUT /compute/v2.1/flavors/686812645/os-extra_specs/hw:numa_nodes => generated 117 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:49:19.875111 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1b86e67-4ec0-4055-9db7-98858f8d5ebf tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1223 microversion: 2.1 time: 0.756842 Jul 18 12:49:19.875111 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 20/38] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:19 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1223 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:19.888467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57e51ee9-bb2a-4399-b879-53bfc4636dbd tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:19.898059 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:19.898059 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:19.901743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c5a182-a9c4-4b13-957c-bcfc293c9a69 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Action: 'update', calling method: .version_select at 0x7f96e55c0d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c5a182-a9c4-4b13-957c-bcfc293c9a69 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/os-hosts/n-d-850003-3 HTTP/1.1 Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 51 Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:49:19.922069 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: {"status": "enable", "maintenance_mode": "invalid"} Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:19.924386 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'n-d-850003-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance: Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.925743 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:19.929270 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:19.931043 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:19.931043 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:49:19.931043 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:49:19.931043 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:19.931043 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:19.935987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c5a182-a9c4-4b13-957c-bcfc293c9a69 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:19.942230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60c5a182-a9c4-4b13-957c-bcfc293c9a69 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-850003-3" status: 400 len: 199 microversion: 2.1 time: 0.058527 Jul 18 12:49:19.954086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 21/39] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:19 2022] PUT /compute/v2.1/os-hosts/n-d-850003-3 => generated 199 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:49:19.985420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57e51ee9-bb2a-4399-b879-53bfc4636dbd tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1261236440" status: 202 len: 0 microversion: 2.1 time: 0.111611 Jul 18 12:49:19.989530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 19/40] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:49:19 2022] DELETE /compute/v2.1/flavors/1261236440 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:20.004773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d26d044-63f6-4cc2-a4a1-38a988cf238a tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.083198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d26d044-63f6-4cc2-a4a1-38a988cf238a tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/686812645" status: 202 len: 0 microversion: 2.1 time: 0.090733 Jul 18 12:49:20.085336 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 20/41] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:19 2022] DELETE /compute/v2.1/flavors/686812645 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:20.095361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2469f83d-8b36-4210-9215-4c3a6c756e03 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Action: 'update', calling method: .version_select at 0x7f96e56120d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2469f83d-8b36-4210-9215-4c3a6c756e03 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-hosts/n-d-850003-3 HTTP/1.1 Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 51 Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:20.099621 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: {"status": "invalid", "maintenance_mode": "enable"} Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:20.100860 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'n-d-850003-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance: Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.101981 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.103349 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.104348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.104348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:49:20.104348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:49:20.104348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 12:49:20.104348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.109610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2469f83d-8b36-4210-9215-4c3a6c756e03 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:20.110932 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2469f83d-8b36-4210-9215-4c3a6c756e03 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-850003-3" status: 400 len: 189 microversion: 2.1 time: 0.024194 Jul 18 12:49:20.112897 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 21/42] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:20 2022] PUT /compute/v2.1/os-hosts/n-d-850003-3 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:49:20.127812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff09ce98-2daa-4140-bdbc-461655f2db76 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.194903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff09ce98-2daa-4140-bdbc-461655f2db76 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077152 Jul 18 12:49:20.195222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1800058598", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "availability_zone": "tempest-test_az-1391263122"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.196059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 22/43] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:20.230615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9fec33f3-357d-40c0-9daf-0ef2c1b483d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.240003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:20.242531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:20.256143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:20.258669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:20.302553 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9fec33f3-357d-40c0-9daf-0ef2c1b483d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615 tempest-FlavorsExtraSpecsNegativeTestJSON-1801226615-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077797 Jul 18 12:49:20.304210 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 23/44] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:20.323271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e629442b-4989-4cf0-b601-3984b1f50f0e tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Action: 'update', calling method: .version_select at 0x7f96e56b8d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.328107 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:20.328107 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:20.332318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e629442b-4989-4cf0-b601-3984b1f50f0e tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '349eee55bf2f45f18c04cbdc6a7d11ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d8e49381b2419cb37bc32cd590fd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e629442b-4989-4cf0-b601-3984b1f50f0e tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Request method failure captured: Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-hosts/n-d-850003-3 HTTP/1.1 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 50 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbFfUpwi_S6qjQSw4OWbJe-GPFQvi3mtDofI_93fittlD12n6T9vE6G_uw1M_sy2LENT2cPbmZPproXQd5iV-BhB-kKivGV5wGpBEVr3OOT3XARO4RystPA-x0GS8ca8G6blxiIl83b8IR0xXDe3Tzi1jhRq3nmul-4Ha8OsY0gpgs Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:49:20.347002 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_08d8e49381b2419cb37bc32cd590fd06", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/08d8e49381b2419cb37bc32cd590fd06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 08d8e49381b2419cb37bc32cd590fd06 Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1365075805 Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 349eee55bf2f45f18c04cbdc6a7d11ac Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1365075805-project Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 12:49:20.349529 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'n-d-850003-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:20.351032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 12:49:20.352942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.362085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e629442b-4989-4cf0-b601-3984b1f50f0e tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:20.366031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e629442b-4989-4cf0-b601-3984b1f50f0e tempest-HostsAdminNegativeTestJSON-1365075805 tempest-HostsAdminNegativeTestJSON-1365075805-project] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-850003-3" status: 403 len: 111 microversion: 2.1 time: 0.059499 Jul 18 12:49:20.375605 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 24/45] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:20 2022] PUT /compute/v2.1/os-hosts/n-d-850003-3 => generated 111 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:20.392275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-169bb171-77ba-4c19-812d-a5b4d92b466c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2082112457", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.438447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-169bb171-77ba-4c19-812d-a5b4d92b466c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.060787 Jul 18 12:49:20.470518 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 25/46] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:20 2022] POST /compute/v2.1/flavors => generated 507 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:20.485654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:49:20.489537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cb4b63c-c199-450f-88db-6bf1a7481d77 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Action: 'update', calling method: .version_select at 0x7f96e56123a0>, body: {"status": null, "maintenance_mode": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cb4b63c-c199-450f-88db-6bf1a7481d77 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-hosts/n-d-850003-3 HTTP/1.1 Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 42 Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:20.492623 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: {"status": null, "maintenance_mode": null} Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 12:49:20.493896 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'n-d-850003-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance: Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi None Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.495509 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.496835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.497787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:49:20.497787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:49:20.497787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 12:49:20.497787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.501040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cb4b63c-c199-450f-88db-6bf1a7481d77 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:20.503370 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0cb4b63c-c199-450f-88db-6bf1a7481d77 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-850003-3" status: 400 len: 127 microversion: 2.1 time: 0.029540 Jul 18 12:49:20.504151 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 26/47] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:20 2022] PUT /compute/v2.1/os-hosts/n-d-850003-3 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:49:20.527262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e413599-c449-4888-8853-a5193ec32ee1 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.567299 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e413599-c449-4888-8853-a5193ec32ee1 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/fd5ed393-07c9-45e6-ba4f-891a114a74fb" status: 202 len: 0 microversion: 2.1 time: 0.047307 Jul 18 12:49:20.574886 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 27/48] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:49:20 2022] DELETE /compute/v2.1/flavors/fd5ed393-07c9-45e6-ba4f-891a114a74fb => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:20.587189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Action: 'update', calling method: .version_select at 0x7f96e56b8dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.592032 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.hosts [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Enabling host nonexistent_hostname. Jul 18 12:49:20.609144 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Request method failure captured: Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 50 Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJ8_BeExBAB2P2KlIA44tIyF4NFZYfVIoorj8HSncIXFHl-9-K8Rf5lf1A4SPm1y10vluWtsklF49lG2G5BC3MOHEKuNSU21UC_EReBE5MwG-l9WTwyjYH-r4FoiABz8hgzG23DjBGhCJGkqHjB6UA5WEcZmpM96qcaS8EBA99O0s Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:49:20.613888 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_501ac0a7b2f442c3935319858549de1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/501ac0a7b2f442c3935319858549de1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 501ac0a7b2f442c3935319858549de1b Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-118714515 Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6f9addcea84c499a976b88affb683b70 Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HostsAdminNegativeTestJSON-118714515-project-admin Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:20.616687 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:49:20.618240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:20.620219 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 12:49:20.624936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:20.630201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:20.630918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f924875a-7392-422c-a84b-e335474758e1 tempest-HostsAdminNegativeTestJSON-118714515 tempest-HostsAdminNegativeTestJSON-118714515-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.052878 Jul 18 12:49:20.634582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 28/49] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:49:20 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:49:20.650070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b586ce0-de5d-466f-b45e-59ff5d4580f7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.713163 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b586ce0-de5d-466f-b45e-59ff5d4580f7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068069 Jul 18 12:49:20.727520 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 29/50] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:20.749830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45873fae-de32-437c-8b4e-02f61385b813 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1351571291", "id": "2ed597e2-86bc-4b81-8b80-256271bbe04b", "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:20.792055 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45873fae-de32-437c-8b4e-02f61385b813 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.051946 Jul 18 12:49:20.799020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 30/51] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:20 2022] POST /compute/v2.1/flavors => generated 507 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:49:20.821153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e8906e2-7da3-453b-8aca-a988793c1276 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.828688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:20.889828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e8906e2-7da3-453b-8aca-a988793c1276 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/2ed597e2-86bc-4b81-8b80-256271bbe04b" status: 202 len: 0 microversion: 2.1 time: 0.078219 Jul 18 12:49:20.891547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 31/52] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:49:20 2022] DELETE /compute/v2.1/flavors/2ed597e2-86bc-4b81-8b80-256271bbe04b => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:20.918020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:20.943651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:21.013615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:21.017229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:21.020231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:21.021817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:21.210460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:49:21.211289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:49:21.211454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:49:21.211786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:49:21.212407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:49:21.252833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:21.254455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:21.256442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:21.259746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:21.356407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Getting quotas for project 4f632c11ac594f4ab80777f0736c091d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:21.383685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Getting quotas for user 428dc0f106214c48b12e795b26862164 and project 4f632c11ac594f4ab80777f0736c091d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:21.429055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:49:21.434933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:49:21.596811 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8042ea74-9733-4fe6-8d01-fd2a7c277998 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638393 Jul 18 12:49:21.602009 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 22/53] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:49:21.644421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4b7ed96-d94d-4798-b87a-a12d0b9b9471 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:21.780454 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4b7ed96-d94d-4798-b87a-a12d0b9b9471 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.175476 Jul 18 12:49:21.781479 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 23/54] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:21.837379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-373f5638-85e9-4c7d-9e0a-b00c17cc36ab tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:21.841712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-373f5638-85e9-4c7d-9e0a-b00c17cc36ab tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:22.262192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-373f5638-85e9-4c7d-9e0a-b00c17cc36ab tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:22.295658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-373f5638-85e9-4c7d-9e0a-b00c17cc36ab tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1243 microversion: 2.1 time: 0.487932 Jul 18 12:49:22.307998 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 24/55] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:21 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1243 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:22.327978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-031f7f1e-6953-4a55-9eab-7d4f674dac8a tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2125270564", "id": 1499665345, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:22.337005 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:22.337005 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:22.360061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:22.426258 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-031f7f1e-6953-4a55-9eab-7d4f674dac8a tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.113032 Jul 18 12:49:22.430000 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 25/56] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:22 2022] POST /compute/v2.1/flavors => generated 414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:22.456223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-beeae054-fb67-40e4-a4c8-b644d852b5c3 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:22.479412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-beeae054-fb67-40e4-a4c8-b644d852b5c3 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/1499665345" status: 200 len: 414 microversion: 2.1 time: 0.034537 Jul 18 12:49:22.485444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 26/57] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:22 2022] GET /compute/v2.1/flavors/1499665345 => generated 414 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:23.390002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:23.448750 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23041728-cadb-4be9-9498-9689cba49fce tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1301 microversion: 2.1 time: 2.543861 Jul 18 12:49:23.449778 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 32/58] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:20 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1301 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:23.466996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58361be1-6599-44fd-899c-6994597f4f98 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:23.468949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58361be1-6599-44fd-899c-6994597f4f98 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:23.661522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad1cd818-9747-4186-9061-7133079b73a1 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:23.782026 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad1cd818-9747-4186-9061-7133079b73a1 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 1.287330 Jul 18 12:49:23.785712 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 27/59] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:22 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:49:23.817413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0d7b6bb-eeff-4f01-80ee-59e17d9dc875 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:23.819045 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:23.819045 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:23.852798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58361be1-6599-44fd-899c-6994597f4f98 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:23.920976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58361be1-6599-44fd-899c-6994597f4f98 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1243 microversion: 2.1 time: 0.468742 Jul 18 12:49:23.928776 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 33/60] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:23 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1243 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:23.929946 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0d7b6bb-eeff-4f01-80ee-59e17d9dc875 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1499665345" status: 202 len: 0 microversion: 2.1 time: 0.119948 Jul 18 12:49:23.931030 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 28/61] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:49:23 2022] DELETE /compute/v2.1/flavors/1499665345 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:49:23.949440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-428d37dc-36bc-4012-baf8-9e783958c944 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:24.137554 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-428d37dc-36bc-4012-baf8-9e783958c944 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.196688 Jul 18 12:49:24.145235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 34/62] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:24.178032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a486340-c647-4684-905e-cda72f8dc69c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1495275680", "id": 931799054, "os-flavor-access:is_public": "False"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:24.211345 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a486340-c647-4684-905e-cda72f8dc69c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.038507 Jul 18 12:49:24.212224 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 29/63] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:24 2022] POST /compute/v2.1/flavors => generated 427 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:24.234788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b376500c-588e-49fe-9ba9-31803bdebd70 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "931799054"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:24.276941 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b376500c-588e-49fe-9ba9-31803bdebd70 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] HTTP exception thrown: Flavor 931799054 could not be found. Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b376500c-588e-49fe-9ba9-31803bdebd70 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Request method failure captured: Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 106 Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbKwBPXuD9dUFrLGmPW9Wat5TuA7S17bz7B27wjwY4yFMtq8PhbKqlmVGF8s_Ckg7YgnAbWXHz3xkN0sH5uzlOSka2m1c3UlK97O0xpr3oFT9ITGj7YMoLuSLGShjj24C48FcQqbzD0ocncU8eh-HEM-xX24ip-xbG7t167B8txiwk Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f12ef3f7384a412ca3db6b8e8e73e43e Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsAdminTestJSON-1751440899 Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:49:24.315917 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f12ef3f7384a412ca3db6b8e8e73e43e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f12ef3f7384a412ca3db6b8e8e73e43e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f12ef3f7384a412ca3db6b8e8e73e43e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f12ef3f7384a412ca3db6b8e8e73e43e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsAdminTestJSON-1751440899 Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f12ef3f7384a412ca3db6b8e8e73e43e Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1751440899 Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsAdminTestJSON-1751440899-project Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 2a7205b164b949ce85038c38ef9b5736 Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsAdminTestJSON-1751440899-project Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "test", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "931799054"}} Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:49:24.323836 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor 931799054 could not be found. Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '931799054'}}} Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 931799054 could not be found. Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:24.326907 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 931799054 could not be found. Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:24.331433 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 931799054 could not be found. Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b376500c-588e-49fe-9ba9-31803bdebd70 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Returning 400 to user: Flavor 931799054 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b376500c-588e-49fe-9ba9-31803bdebd70 tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.098147 Jul 18 12:49:24.336234 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 35/64] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:24 2022] POST /compute/v2.1/servers => generated 80 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:49:24.340576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f98468b-db8b-46f2-bf8b-0b1dafe175da tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:24.415652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f98468b-db8b-46f2-bf8b-0b1dafe175da tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/931799054" status: 202 len: 0 microversion: 2.1 time: 0.087425 Jul 18 12:49:24.418770 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 30/65] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:24 2022] DELETE /compute/v2.1/flavors/931799054 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:24.434346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b7f994e-7edc-4277-b30c-f1b9702a046a tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:24.469154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:24.470075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:24.479729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:24.491188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:24.492335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:24.495643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:24.576431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b7f994e-7edc-4277-b30c-f1b9702a046a tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.139806 Jul 18 12:49:24.582782 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 36/66] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:24.601788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8003e55a-84a9-420b-8082-fa0830c5a9f8 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-358238433", "id": 743400483, "os-flavor-access:is_public": "False"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:24.627810 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:24.627810 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:24.761749 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8003e55a-84a9-420b-8082-fa0830c5a9f8 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.164455 Jul 18 12:49:24.776596 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 37/67] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:24 2022] POST /compute/v2.1/flavors => generated 411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:49:24.818484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0658e02-9b49-4d16-b67c-59f743ace702 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2025678043", "id": 1804198144, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:24.884422 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0658e02-9b49-4d16-b67c-59f743ace702 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.096504 Jul 18 12:49:24.897707 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 38/68] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:24 2022] POST /compute/v2.1/flavors => generated 414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:24.906952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8d84804-019a-4276-945c-77065fe39ed7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.003624 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8d84804-019a-4276-945c-77065fe39ed7 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.088134 Jul 18 12:49:25.008221 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 39/69] 10.222.0.88 () {58 vars in 1168 bytes} [Mon Jul 18 12:49:24 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:25.032355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.033964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:25.062967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:25.101803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:25.107282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:25.111587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:25.266374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:25.287007 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf115930-4759-43c6-9ee0-966ef1643d93 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1299 microversion: 2.1 time: 0.822454 Jul 18 12:49:25.291249 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 31/70] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:24 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1299 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:49:25.340807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea92b6f8-2dc8-4cd7-9427-c64bbf956502 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.397582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:25.449147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee65bfe9-0cc2-4a30-bcb2-ee0da11db1d5 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1235 microversion: 2.1 time: 0.438543 Jul 18 12:49:25.450281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 40/71] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1235 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:25.490614 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea92b6f8-2dc8-4cd7-9427-c64bbf956502 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.184811 Jul 18 12:49:25.491248 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 32/72] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:25.557229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6471a1a5-3457-405b-b6a6-f086eeffe0f2 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.644217 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6471a1a5-3457-405b-b6a6-f086eeffe0f2 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.133264 Jul 18 12:49:25.657335 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 41/73] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:25.674115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-848d4919-2d0e-44f3-a2fe-6bd43bc31bce tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.709453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-848d4919-2d0e-44f3-a2fe-6bd43bc31bce tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.048101 Jul 18 12:49:25.716610 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 33/74] 10.222.0.88 () {58 vars in 1168 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:25.750461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc9da2e5-c52d-4f1f-b428-1e18ebd458a9 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.795834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc9da2e5-c52d-4f1f-b428-1e18ebd458a9 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.059489 Jul 18 12:49:25.797750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 42/75] 10.222.0.88 () {58 vars in 1168 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:25.833867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a3c022c-9f20-4630-a706-4bcdfe612197 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:25.964979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a3c022c-9f20-4630-a706-4bcdfe612197 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.125995 Jul 18 12:49:25.964979 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 34/76] 10.222.0.88 () {58 vars in 1174 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:25.989890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59f31904-d327-4f07-9932-efaeafef8cca tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.050300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59f31904-d327-4f07-9932-efaeafef8cca tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.072250 Jul 18 12:49:26.052207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 43/77] 10.222.0.88 () {58 vars in 1172 bytes} [Mon Jul 18 12:49:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:26.077107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59320bc9-8c5c-44a2-9d81-683e0996e9b5 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.155497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59320bc9-8c5c-44a2-9d81-683e0996e9b5 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.087281 Jul 18 12:49:26.156987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 35/78] 10.222.0.88 () {58 vars in 1168 bytes} [Mon Jul 18 12:49:26 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:26.186037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e50e890-7e58-4c2a-811b-a05347d4c90d tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.198508 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:26.198508 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:26.275751 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e50e890-7e58-4c2a-811b-a05347d4c90d tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1804198144" status: 202 len: 0 microversion: 2.1 time: 0.096699 Jul 18 12:49:26.279634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 44/79] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:49:26 2022] DELETE /compute/v2.1/flavors/1804198144 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:26.315248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d72126ce-0788-4f61-93df-10868eefadda tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.325586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.325586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:26.358939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:26.359665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:26.363729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:26.364610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:26.381634 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d72126ce-0788-4f61-93df-10868eefadda tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094261 Jul 18 12:49:26.382259 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 36/80] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:26.414082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85c60ce5-63c7-4146-9b29-e9d71747fe37 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.414898 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:26.414898 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:26.508462 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85c60ce5-63c7-4146-9b29-e9d71747fe37 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/743400483" status: 202 len: 0 microversion: 2.1 time: 0.099525 Jul 18 12:49:26.509972 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 37/81] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:26 2022] DELETE /compute/v2.1/flavors/743400483 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:49:26.525283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:26.529273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:26.552396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:26.555622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:26.560096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:26.561495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:26.827847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:26.872055 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6d90b30-7ccb-495e-9f89-fc563a91a402 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1291 microversion: 2.1 time: 0.360444 Jul 18 12:49:26.893375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 38/82] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:26 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1291 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:26.919175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-527d22ed-c5f0-4882-8505-2736af8f6d90 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.068729 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-527d22ed-c5f0-4882-8505-2736af8f6d90 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.153473 Jul 18 12:49:27.070141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 39/83] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.121659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50d0bfab-99f3-46b6-8237-102b0839c8aa tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1787366934", "id": 297681409, "os-flavor-access:is_public": "False"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:27.129302 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:27.129302 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:27.215942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50d0bfab-99f3-46b6-8237-102b0839c8aa tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.102228 Jul 18 12:49:27.224559 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 40/84] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:27 2022] POST /compute/v2.1/flavors => generated 412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:27.249138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ff96a72-40c6-43b7-b70c-d3751198ed7f tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.311922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ff96a72-40c6-43b7-b70c-d3751198ed7f tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072952 Jul 18 12:49:27.318140 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 41/85] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.349595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ba4ce7c-506c-4e73-be4e-b93f2622cfea tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.351783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:27.381486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-128e51e1-8795-4d77-ae2d-07dfd210dd6c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 1.064388 Jul 18 12:49:27.383135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 45/86] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:26 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.428623 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ba4ce7c-506c-4e73-be4e-b93f2622cfea tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088994 Jul 18 12:49:27.429187 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 42/87] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.462411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d33c147c-b5ac-4146-9cd2-72e25cd71fe5 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.474821 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:27.474821 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:27.537713 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d33c147c-b5ac-4146-9cd2-72e25cd71fe5 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/297681409" status: 202 len: 0 microversion: 2.1 time: 0.082956 Jul 18 12:49:27.539477 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 46/88] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:27 2022] DELETE /compute/v2.1/flavors/297681409 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:27.553568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1fe580b3-7e8e-4b32-bb11-a2e559474e7d tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.663145 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1fe580b3-7e8e-4b32-bb11-a2e559474e7d tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.118113 Jul 18 12:49:27.664269 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 43/89] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.688607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a853e9a-959c-4456-9e15-c776f7314f48 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-259433653", "id": 746872090, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:27.690411 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:27.690411 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:27.729151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a853e9a-959c-4456-9e15-c776f7314f48 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.044353 Jul 18 12:49:27.730117 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 47/90] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:27 2022] POST /compute/v2.1/flavors => generated 410 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:27.740525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38f4be0b-f7ce-4236-b522-438fb8ef6ada tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.782394 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38f4be0b-f7ce-4236-b522-438fb8ef6ada tempest-FlavorsAdminTestJSON-1751440899 tempest-FlavorsAdminTestJSON-1751440899-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.045251 Jul 18 12:49:27.785058 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 44/91] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:27.800126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e3296bc-b095-45db-8bf5-b3af07066e4c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.853959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:27.861548 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e3296bc-b095-45db-8bf5-b3af07066e4c tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/746872090" status: 202 len: 0 microversion: 2.1 time: 0.064971 Jul 18 12:49:27.862175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 48/92] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:27 2022] DELETE /compute/v2.1/flavors/746872090 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:27.880147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd0af45f-63f7-4fa8-94c2-a4ee15437809 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.924197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:27.925269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:27.945895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:27.946649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:27.947925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:27.948546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:27.989899 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd0af45f-63f7-4fa8-94c2-a4ee15437809 tempest-FlavorsAdminTestJSON-552443926 tempest-FlavorsAdminTestJSON-552443926-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.116786 Jul 18 12:49:27.994543 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 45/93] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:28.225103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:28.262844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0905dda8-0f5b-414d-a642-6d1f59826be8 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 0.344578 Jul 18 12:49:28.277243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 49/94] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:27 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:28.410044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:28.414188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:28.451529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:28.452945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:28.459387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:28.465657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:29.294646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:29.299592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:29.345906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:29.349139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:29.352354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:29.354512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:29.746426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:29.763431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ce7fceb-7fb0-4ca0-8ef7-ce64a7a39d51 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 0.481236 Jul 18 12:49:29.765895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 50/95] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:29 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:30.801538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:30.805777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:30.837864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:30.839640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:30.844948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:30.847182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:31.234722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:31.289533 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6383cef7-b95c-41b9-9174-ccfeb44e85bc tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 0.493886 Jul 18 12:49:31.310583 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 51/96] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:30 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:49:31.324645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:32.237670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:32.273767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:32.305339 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e67beb72-37e4-438e-91b5-a4ad43a228bc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 3.903234 Jul 18 12:49:32.318545 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 46/97] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:28 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 3918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:32.328522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:32.334437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:32.366051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:32.374553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:32.382137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:32.395110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:33.335838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:33.338175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:33.433292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:33.435725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:33.443899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:33.451398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:33.563536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:33.610238 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d1d8f1d-0016-45f8-987a-1b439c9e78f3 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 1.288247 Jul 18 12:49:33.614345 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 52/98] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:32 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:34.676374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:34.681827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:34.738246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:34.759657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:34.760690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:34.768720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:34.775947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:35.179886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:35.212972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-477257c0-f6cf-4c1c-abc5-76f8775d62a2 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 0.572552 Jul 18 12:49:35.213923 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 53/99] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:34 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:49:35.449824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:35.488770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-abcfd512-f3a9-4a23-96fe-8513a6d57830 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 2.160936 Jul 18 12:49:35.499067 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 47/100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:33 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:35.886815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c3b5712-a3b9-449b-b5ab-e271fb842e93 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1379569147", "ram": 512, "vcpus": 1, "disk": 10, "id": 250711571, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:35.907115 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:35.907115 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:36.023128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c3b5712-a3b9-449b-b5ab-e271fb842e93 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.798955 Jul 18 12:49:36.040898 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 54/101] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:35 2022] POST /compute/v2.1/flavors => generated 413 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:36.065730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75e39692-8306-43c9-92f3-6fba16b0867d tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:36.076040 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:36.076040 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:36.212203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75e39692-8306-43c9-92f3-6fba16b0867d tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.165171 Jul 18 12:49:36.213296 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 55/102] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:36 2022] POST /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 12:49:36.330952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-48d31b8d-2ac5-421d-9f5d-82915147c77c req-3e3ec26a-db17-463f-952b-a7ffa76a0c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc2a69b3-393f-4c1f-a8c2-956688a066af", "tag": "814f5d32-2614-4720-8edd-e6b1deca18ac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:36.392849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-48d31b8d-2ac5-421d-9f5d-82915147c77c req-3e3ec26a-db17-463f-952b-a7ffa76a0c13 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.395831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-48d31b8d-2ac5-421d-9f5d-82915147c77c req-3e3ec26a-db17-463f-952b-a7ffa76a0c13 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.515399 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-48d31b8d-2ac5-421d-9f5d-82915147c77c req-3e3ec26a-db17-463f-952b-a7ffa76a0c13 service nova] Creating event network-changed:814f5d32-2614-4720-8edd-e6b1deca18ac for instance bc2a69b3-393f-4c1f-a8c2-956688a066af on n-h2-850003-3 Jul 18 12:49:36.516465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-48d31b8d-2ac5-421d-9f5d-82915147c77c req-3e3ec26a-db17-463f-952b-a7ffa76a0c13 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:49:36.521475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.522329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.528520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.529326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.585381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.rpcapi [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 12:49:36.587481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] Releasing lock "compute-rpcapi-router" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:49:36.638849 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f2bc0c4-2d30-41a4-b1d4-8fc123022318 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.103719 Jul 18 12:49:36.642967 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 48/103] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:49:36.668619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:36.669988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:36.717362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.722861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.729992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.747110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.752656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5eb90d7d-5fa1-4a41-af0a-461c4e53d184 tempest-FlavorsExtraSpecsTestJSON-366175461 tempest-FlavorsExtraSpecsTestJSON-366175461-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:36.804000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5eb90d7d-5fa1-4a41-af0a-461c4e53d184 tempest-FlavorsExtraSpecsTestJSON-366175461 tempest-FlavorsExtraSpecsTestJSON-366175461-project] 10.222.0.88 "GET /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.578896 Jul 18 12:49:36.815306 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 56/104] 10.222.0.88 () {58 vars in 1199 bytes} [Mon Jul 18 12:49:36 2022] GET /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:36.861327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:36.869266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:36.910307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.911357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:36.927394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:36.928206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:37.085685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:37.096710 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7770ae3-ea68-4a94-8db2-ef8b84911aaa tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1297 microversion: 2.1 time: 0.448962 Jul 18 12:49:37.104931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 49/105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:36 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1297 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:37.140619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-caaf8b74-f84f-49b5-8316-d8230ea06a19 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:37.166594 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:37.166594 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:37.213314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-caaf8b74-f84f-49b5-8316-d8230ea06a19 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104744 Jul 18 12:49:37.219916 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 50/106] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:37 2022] POST /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:37.233859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca4e3a1e-078e-4d28-9cd3-73885405dd6d tempest-FlavorsExtraSpecsTestJSON-366175461 tempest-FlavorsExtraSpecsTestJSON-366175461-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:37.264778 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca4e3a1e-078e-4d28-9cd3-73885405dd6d tempest-FlavorsExtraSpecsTestJSON-366175461 tempest-FlavorsExtraSpecsTestJSON-366175461-project] 10.222.0.88 "GET /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030764 Jul 18 12:49:37.266383 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 51/107] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 12:49:37 2022] GET /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:37.280837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-520b1acb-a8de-4f23-9677-0c97b30a1960 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:37.356459 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-520b1acb-a8de-4f23-9677-0c97b30a1960 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080189 Jul 18 12:49:37.361783 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 52/108] 10.222.0.88 () {60 vars in 1220 bytes} [Mon Jul 18 12:49:37 2022] POST /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 12:49:37.384399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fff17d65-9d8d-41c5-8dcd-6e24e14b65d0 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:37.454003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=80,nova_api:DELETE=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:37.472883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fff17d65-9d8d-41c5-8dcd-6e24e14b65d0 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.105673 Jul 18 12:49:37.476118 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 53/109] 10.222.0.88 () {58 vars in 1199 bytes} [Mon Jul 18 12:49:37 2022] GET /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:37.496294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb8135a5-04f5-4f9a-b7d5-09893898786d tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:37.497808 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:37.497808 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:37.624231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb8135a5-04f5-4f9a-b7d5-09893898786d tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.140449 Jul 18 12:49:37.625989 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 54/110] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:49:37 2022] PUT /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes => generated 22 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:38.289220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:38.348529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e212b75e-a0d1-405b-9a71-29bfb3d70d8c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 1.515006 Jul 18 12:49:38.352626 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 57/111] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:36 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:38.383723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02169d5a-b0eb-4bc6-9fb0-c5d9411ab8d6 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:38.424447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=12,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:38.461121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02169d5a-b0eb-4bc6-9fb0-c5d9411ab8d6 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102559 Jul 18 12:49:38.466621 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 58/112] 10.222.0.88 () {58 vars in 1199 bytes} [Mon Jul 18 12:49:38 2022] GET /compute/v2.1/flavors/250711571/os-extra_specs => generated 66 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:38.495905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:38.498768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:38.539717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:38.545710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:38.547916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:38.549076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:38.707578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Calling method '.version_select at 0x7f96e555baf0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:38.719053 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:38.719053 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:38.763918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131367) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 12:49:38.765933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:38.771279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:38.963288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:38.964108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:39.174933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:39.175782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:39.234673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:39.235473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:39.271592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:39.272979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:39.327843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b17a1e68-6892-4c5c-9457-6f50963072b2 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 1.699730 Jul 18 12:49:39.334805 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 55/113] 10.222.0.88 () {60 vars in 1242 bytes} [Mon Jul 18 12:49:37 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:49:39.347789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ade21bb8-20dd-4c08-a003-bc2e4a21b3fa tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:39.357342 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:39.357342 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:39.461035 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ade21bb8-20dd-4c08-a003-bc2e4a21b3fa tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.122400 Jul 18 12:49:39.463188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 56/114] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 12:49:39 2022] DELETE /compute/v2.1/flavors/250711571/os-extra_specs/hw:numa_nodes => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:49:40.116602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:40.183717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb2fab8c-64cd-40f6-bfad-84637c05e7fe tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 1.714538 Jul 18 12:49:40.202864 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 59/115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:38 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:40.253528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Calling method '.version_select at 0x7f96e55635e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.263395 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:40.263395 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:40.269387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.283382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.385053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.385776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.559601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.560445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.596426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Calling method '.version_select at 0x7f96e54f25e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.602432 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:40.602432 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:40.605392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.613990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.623681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.629657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.660427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.661674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.662259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.663908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.680361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e0f024f-25cd-4a8d-b335-337b00bfc82f tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.462447 Jul 18 12:49:40.687156 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 60/116] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 18 12:49:40 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:40.694130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.694878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.699047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.702929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:40.716363 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-06a3b8e3-906f-4c6b-8c3c-3bfe191174cc tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.247392 Jul 18 12:49:40.716363 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 57/117] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:40.723607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.725977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.730714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.732056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f528fc8-d4e2-4ad1-a75b-e3c3c48fea55 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.733370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.736396 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:40.736396 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:40.820519 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f528fc8-d4e2-4ad1-a75b-e3c3c48fea55 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/250711571/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.104229 Jul 18 12:49:40.824333 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 58/118] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 12:49:40 2022] DELETE /compute/v2.1/flavors/250711571/os-extra_specs/hw:cpu_policy => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:49:40.846194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Calling method '.version_select at 0x7f96e563ac10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.853752 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:40.853752 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:40.862191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.863571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.903897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.905160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.915357 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dde460c8-f0be-483f-adf0-0b20f56e8361 tempest-HypervisorAdminV253TestBase-1025304060 tempest-HypervisorAdminV253TestBase-1025304060-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/812ba57f-1203-428c-a33e-a5cbc0ebc9ae" status: 200 len: 792 microversion: 2.53 time: 0.089115 Jul 18 12:49:40.931505 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 59/119] 10.222.0.88 () {60 vars in 1297 bytes} [Mon Jul 18 12:49:40 2022] GET /compute/v2.1/os-hypervisors/812ba57f-1203-428c-a33e-a5cbc0ebc9ae => generated 792 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:40.931505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Calling method '.version_select at 0x7f96e563ae50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:40.931505 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:40.931505 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:40.931505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.932356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:40.978970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:40.979644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.024795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.025574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.040071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-daa76f94-8901-4dae-b1af-c80e404eb358 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h2-850003-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.122395 Jul 18 12:49:41.054598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 60/120] 10.222.0.88 () {58 vars in 1211 bytes} [Mon Jul 18 12:49:40 2022] GET /compute/v2.1/os-hypervisors/n-h2-850003-3/servers => generated 275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:41.070632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57df5bb0-9716-44c3-a9e0-6295c026c8a5 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:41.081581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57df5bb0-9716-44c3-a9e0-6295c026c8a5 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/250711571/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025059 Jul 18 12:49:41.088513 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 61/121] 10.222.0.88 () {58 vars in 1199 bytes} [Mon Jul 18 12:49:41 2022] GET /compute/v2.1/flavors/250711571/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:41.096570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Calling method '.version_select at 0x7f96e5503700>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:41.097380 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:41.097380 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:41.099369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.100416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.142228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.144154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.189189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.190959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.212316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8b0a25d-c471-4704-b928-13c5397b6438 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.120817 Jul 18 12:49:41.216464 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 62/122] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:41.234963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8aad545-9fd1-408c-9040-e7cb30613a46 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:41.235742 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:41.235742 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:41.294493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8aad545-9fd1-408c-9040-e7cb30613a46 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/250711571" status: 202 len: 0 microversion: 2.1 time: 0.067118 Jul 18 12:49:41.296077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 63/123] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:49:41 2022] DELETE /compute/v2.1/flavors/250711571 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:49:41.319679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Calling method '.version_select at 0x7f96e55034c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:41.321420 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:41.321420 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:41.335181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.341141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.422379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.423101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.450620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ec78db7-50ae-4f06-a66c-c4f2f54fbbb3 tempest-HypervisorAdminUnderV252Test-455938190 tempest-HypervisorAdminUnderV252Test-455938190-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h2-850003-3/search" status: 200 len: 104 microversion: 2.1 time: 0.148603 Jul 18 12:49:41.459158 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 64/124] 10.222.0.88 () {58 vars in 1208 bytes} [Mon Jul 18 12:49:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-850003-3/search => generated 104 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:41.472315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:41.474208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:41.494521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.495956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.498841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:41.500139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:41.948901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:42.026285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-936248bf-d210-4223-a1f2-0c567c48559d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 1.337240 Jul 18 12:49:42.028550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 61/125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:40 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:42.064521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86425e2c-3afd-48d6-8744-527967a9e5f0 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:42.180040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-86425e2c-3afd-48d6-8744-527967a9e5f0 tempest-FlavorsExtraSpecsTestJSON-336965717 tempest-FlavorsExtraSpecsTestJSON-336965717-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.138160 Jul 18 12:49:42.182426 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 62/126] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:42.392605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:42.411874 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f138fbf8-890b-49f0-bbc9-01f27aeeb3d7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.957239 Jul 18 12:49:42.413832 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 65/127] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:41 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:43.058926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:43.073927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:43.140310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:43.146433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:43.156669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:43.160114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:43.187879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:43.444104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:43.445619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:43.460468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:43.468349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:43.472011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:43.473754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:43.487585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:44.078891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:44.088027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:44.104274 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16aee596-a3d7-4dbe-aebe-854cfeeb29b2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 1.052844 Jul 18 12:49:44.105510 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 63/128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:43 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:44.109047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9b46502-b3f3-4357-bc91-3f3a20934121 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.669787 Jul 18 12:49:44.131626 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 66/129] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:43 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:44.134801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a493b56d-5cbd-45ed-8cbc-4fa4adc04752 req-cd58c40b-3660-445e-86a7-be96147b7ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a533c01-673a-413d-b492-63a1617e19d9", "tag": "30ec3c13-d048-47d7-91b1-27c192b51f87"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:44.153100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a493b56d-5cbd-45ed-8cbc-4fa4adc04752 req-cd58c40b-3660-445e-86a7-be96147b7ed9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:44.153426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a493b56d-5cbd-45ed-8cbc-4fa4adc04752 req-cd58c40b-3660-445e-86a7-be96147b7ed9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:44.194618 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a493b56d-5cbd-45ed-8cbc-4fa4adc04752 req-cd58c40b-3660-445e-86a7-be96147b7ed9 service nova] Creating event network-changed:30ec3c13-d048-47d7-91b1-27c192b51f87 for instance 5a533c01-673a-413d-b492-63a1617e19d9 on n-h2-850003-3 Jul 18 12:49:44.195808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a493b56d-5cbd-45ed-8cbc-4fa4adc04752 req-cd58c40b-3660-445e-86a7-be96147b7ed9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:49:44.197635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:44.198882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:44.201220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:44.202174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:44.242473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.rpcapi [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 12:49:44.244698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] Releasing lock "compute-rpcapi-router" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:49:44.283819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5cd866b9-dd4f-4437-9f8b-95c15e45d44b None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160740 Jul 18 12:49:44.285682 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 64/130] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:45.165272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:45.170829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:45.205292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:45.215911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:45.221864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:45.222434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:45.479880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d70d0f12-827f-494b-bcf5-cb6a24c9b094 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Action: 'create', calling method: .version_select at 0x7f96e53e2550>, body: {"keypair": {"name": "tempest-keypair-1343978722", "type": "ssh", "user_id": "def053b04dc54bf99327c9433b02604d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBksRy9g60bCt6ko2hUhEyKxLxKO9XklsfiZhkaYwJd3aNJQ1ZjWWtsScwTsmC0Wbnf21MAIIf2lI2zSQ+Ld/bhsETE2IUzDJfKztgTXRx179boIB2IpezEg7+b7TbYpcQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:45.590432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d70d0f12-827f-494b-bcf5-cb6a24c9b094 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:45.613563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d70d0f12-827f-494b-bcf5-cb6a24c9b094 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for user 37658f2bb5f14a288c52bb91c8ee6ceb and project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:45.674916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d70d0f12-827f-494b-bcf5-cb6a24c9b094 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.704813 Jul 18 12:49:45.683932 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 67/131] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 12:49:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 715 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 12:49:45.695325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:45.697896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:45.720119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:45.727284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:45.743565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:45.744746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:46.012421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:46.025414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03cef7f0-407e-4cca-91eb-08c2d54aa3e3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.890548 Jul 18 12:49:46.040285 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 65/132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:45 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:46.056710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f038ec04-939e-44cd-bde9-befff0f85f83 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Action: 'create', calling method: .version_select at 0x7f96e5487940>, body: {"keypair": {"name": "tempest-keypair-1845258102", "type": "ssh", "user_id": "def053b04dc54bf99327c9433b02604d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJglBHTo64wHv7m/vY4Fq9vss15ztKPCLuFs9/UmdSrVRRU/6SG27T+/nEbKl7fcaHlqwz4AH+OkRXS9VSiHVagrtp7t8LQscmt++RenPClKwbloheNOc6c7I98B3nfnTg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:46.124844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f038ec04-939e-44cd-bde9-befff0f85f83 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:46.144464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f038ec04-939e-44cd-bde9-befff0f85f83 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for user 37658f2bb5f14a288c52bb91c8ee6ceb and project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:46.229294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f038ec04-939e-44cd-bde9-befff0f85f83 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.187220 Jul 18 12:49:46.234304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 66/133] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 12:49:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 12:49:46.274194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a382188-c442-4b4e-86eb-cb50793cfde6 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Calling method '.version_select at 0x7f96e54c3700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:46.299287 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a382188-c442-4b4e-86eb-cb50793cfde6 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-1343978722?user_id=def053b04dc54bf99327c9433b02604d" status: 200 len: 512 microversion: 2.10 time: 0.039139 Jul 18 12:49:46.301353 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 67/134] 10.222.0.88 () {60 vars in 1339 bytes} [Mon Jul 18 12:49:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1343978722?user_id=def053b04dc54bf99327c9433b02604d => generated 512 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:46.330079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1db145f-2711-4f4c-b690-d67079110a9b tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Action: 'create', calling method: .version_select at 0x7f96e55b6af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1842738771", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7m95wmFzn292/OIGeL676yHHvrmyKLjE7tZzMN550bhTQ6Edaw9cq3dtRUAdjY71ESGUGmQGC5/pVCUbCbmMH+zKqdHz/XKZcKfllfunImMt4Uc8NK1CGHHXlENw0OQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:46.343693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:46.378280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a6ff9d7-c69e-49ca-a7a6-8939701da602 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.688251 Jul 18 12:49:46.379974 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 68/135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:45 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:46.394367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b1db145f-2711-4f4c-b690-d67079110a9b tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:46.401571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b1db145f-2711-4f4c-b690-d67079110a9b tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Getting quotas for user 37658f2bb5f14a288c52bb91c8ee6ceb and project f95f5a862eb347038f5040e834d6106e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:46.479447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1db145f-2711-4f4c-b690-d67079110a9b tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.161422 Jul 18 12:49:46.488269 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 68/136] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 12:49:46 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 12:49:46.497313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fed89a2a-a040-45a8-a21b-0c9845102ab3 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Calling method '.version_select at 0x7f96e53860d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:46.505222 n-d-850003-3 devstack@n-api.service[131367]: WARNING oslo_db.sqlalchemy.utils [None req-fed89a2a-a040-45a8-a21b-0c9845102ab3 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 12:49:46.516810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fed89a2a-a040-45a8-a21b-0c9845102ab3 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "GET /compute/v2.1/os-keypairs?user_id=def053b04dc54bf99327c9433b02604d" status: 200 len: 726 microversion: 2.10 time: 0.026016 Jul 18 12:49:46.517651 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 69/137] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 18 12:49:46 2022] GET /compute/v2.1/os-keypairs?user_id=def053b04dc54bf99327c9433b02604d => generated 726 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:46.535520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-185e39f3-20aa-43ea-8134-d472be0604e3 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Calling method '.version_select at 0x7f96e53ff940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:46.597991 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-185e39f3-20aa-43ea-8134-d472be0604e3 tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1842738771" status: 204 len: 0 microversion: 2.10 time: 0.069850 Jul 18 12:49:46.600433 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 69/138] 10.222.0.88 () {60 vars in 1324 bytes} [Mon Jul 18 12:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1842738771 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 12:49:46.613733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff1a0a61-a29c-4a99-8ce0-29935e2b8c8f tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Calling method '.version_select at 0x7f96e5386af0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:46.633209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:46.670357 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff1a0a61-a29c-4a99-8ce0-29935e2b8c8f tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845258102?user_id=def053b04dc54bf99327c9433b02604d" status: 204 len: 0 microversion: 2.10 time: 0.062594 Jul 18 12:49:46.672685 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 70/139] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845258102?user_id=def053b04dc54bf99327c9433b02604d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 12:49:46.684010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b58fcad-2dc4-43a2-85ab-a4401631deee tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] Calling method '.version_select at 0x7f96e53ffc10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:46.734487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b58fcad-2dc4-43a2-85ab-a4401631deee tempest-KeyPairsV210TestJSON-1173297153 tempest-KeyPairsV210TestJSON-1173297153-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343978722?user_id=def053b04dc54bf99327c9433b02604d" status: 204 len: 0 microversion: 2.10 time: 0.054512 Jul 18 12:49:46.756133 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 70/140] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343978722?user_id=def053b04dc54bf99327c9433b02604d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 12:49:47.045663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:47.049174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:47.069145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:47.075951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:47.077216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:47.077803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:47.408531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:47.409324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:47.445723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:47.449385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:47.452431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:47.453140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:47.905897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:47.935556 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1297300-f128-4c12-b79e-3e9d99d3195d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.893237 Jul 18 12:49:47.938746 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 71/141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:47 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:48.031947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:48.065123 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-706fbea6-b1bb-4fbc-bf36-864e1a0f0dc7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.657066 Jul 18 12:49:48.067413 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 71/142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:47 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:48.963106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:48.963106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:48.971470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:48.971944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:48.979701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:48.980329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:49.442968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:49.461223 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2939741b-da2a-47a8-981d-59940f52c26b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.503143 Jul 18 12:49:49.461826 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 72/143] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:48 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:49:49.469475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:49.474581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:49.484473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:49.484925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:49.487988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:49.488482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:49.699599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1af27dda-dc0a-4d95-a6cc-2c0696ecf939 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:49.716098 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1af27dda-dc0a-4d95-a6cc-2c0696ecf939 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.901438 Jul 18 12:49:49.720236 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 72/144] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:49:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:49.725065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:49.746502 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae7150a8-ca76-4ed7-9649-c18464c921f0 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.272932 Jul 18 12:49:49.747567 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 73/145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:49 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:50.462868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97cd7a7d-370d-4c15-90e8-0bc91ad10473 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-46966005", "id": 411795138, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:50.465003 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:50.465003 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:50.490387 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97cd7a7d-370d-4c15-90e8-0bc91ad10473 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.763684 Jul 18 12:49:50.491854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:50.492945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 73/146] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:49 2022] POST /compute/v2.1/flavors => generated 420 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:50.494841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:50.512755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:50.513770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1035153a-4f1a-43b6-9dc9-07a826b29678 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:50.516228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:50.519285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:50.521619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:50.531557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1035153a-4f1a-43b6-9dc9-07a826b29678 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026405 Jul 18 12:49:50.534891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 74/147] 10.222.0.88 () {58 vars in 1181 bytes} [Mon Jul 18 12:49:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:50.545648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd77adf8-3ede-4083-b79b-edc1bc7e9871 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-330842331", "id": 2143769661, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:50.566780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:50.597769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd77adf8-3ede-4083-b79b-edc1bc7e9871 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.055638 Jul 18 12:49:50.599178 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 75/148] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:50.631084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a96f0b27-09b9-4a98-ba58-12a5c4090d17 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:50.673743 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a96f0b27-09b9-4a98-ba58-12a5c4090d17 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048708 Jul 18 12:49:50.686297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 76/149] 10.222.0.88 () {58 vars in 1181 bytes} [Mon Jul 18 12:49:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:49:50.702478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c382af23-145c-48f0-b9f7-5f832d0f0d3d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Action: 'create', calling method: .version_select at 0x7f96e543c1f0>, body: {"keypair": {"name": "tempest-keypair-39912689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI/Nreno4ta9Mgj8eXGY3GSaXIcpvk+gPRdwuV6MRddGQmon4a7niFqpGDHh9ixLg3DzqvZWWBL7y3oMC36/nVKnmqLhqoLEl31UQvOYwFayonDo+xFoJGVueKdv/rpGw=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:50.784843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c382af23-145c-48f0-b9f7-5f832d0f0d3d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:50.812840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c382af23-145c-48f0-b9f7-5f832d0f0d3d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for user ab603aa7a37344fc8e71e4b6d6fc32c0 and project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:50.889837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c382af23-145c-48f0-b9f7-5f832d0f0d3d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.194387 Jul 18 12:49:50.891939 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 77/150] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 12:49:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:50.905451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:50.907425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:50.920884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:50.921890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:50.922398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:50.924780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:50.925916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:50.936732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e973ac97-9b76-4579-92fc-55a50eb70b19 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.454854 Jul 18 12:49:50.937412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 74/151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:50 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:51.953264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:51.967704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:51.970361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:51.997346 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-df31bd98-de04-49e6-a405-273023eacc31 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 1.103322 Jul 18 12:49:52.003800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:52.004386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 78/152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:50 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:52.004555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:52.005889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:52.015187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:52.450401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:52.489339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d03dd0f-a7b0-4740-8e64-c56504221af7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.530181 Jul 18 12:49:52.492457 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 75/153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:51 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:53.035438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:53.039270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:53.049894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:53.050647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:53.051691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:53.052309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:53.532898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:53.537503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:53.582410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:53.583239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:53.586353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:53.592508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:53.594259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:53.604260 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61673868-cf90-4e9c-8c7f-36ece5ab64eb tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.576987 Jul 18 12:49:53.605867 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 79/154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:53 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:54.179771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:54.211008 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2892f8be-ab52-49b9-ae2e-8e3e1dc5050e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.694179 Jul 18 12:49:54.213342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 76/155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:53 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:54.627669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:54.628780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:54.654399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:54.655220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:54.656065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:54.656719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:54.990520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:55.011077 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20ed46e5-dff5-410c-9589-2e707342acea tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.389460 Jul 18 12:49:55.014413 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 80/156] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:54 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:55.239279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:55.239816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:55.243623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:55.264503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:55.265021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:55.265875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:55.269918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:55.698251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:55.732699 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b6ad8df-87dc-439e-b104-e725d5ea621b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.498619 Jul 18 12:49:55.733415 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 77/157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:55 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:56.103443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5dfaea39-7c7a-4bff-9d40-341583f3646e req-32e2a6dc-7e11-4ab2-b544-0fa2e2d80cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc2a69b3-393f-4c1f-a8c2-956688a066af", "name": "network-vif-plugged", "status": "completed", "tag": "814f5d32-2614-4720-8edd-e6b1deca18ac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:56.118318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5dfaea39-7c7a-4bff-9d40-341583f3646e req-32e2a6dc-7e11-4ab2-b544-0fa2e2d80cb2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.119059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5dfaea39-7c7a-4bff-9d40-341583f3646e req-32e2a6dc-7e11-4ab2-b544-0fa2e2d80cb2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.144979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5dfaea39-7c7a-4bff-9d40-341583f3646e req-32e2a6dc-7e11-4ab2-b544-0fa2e2d80cb2 service nova] Creating event network-vif-plugged:814f5d32-2614-4720-8edd-e6b1deca18ac for instance bc2a69b3-393f-4c1f-a8c2-956688a066af on n-h2-850003-3 Jul 18 12:49:56.159092 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5dfaea39-7c7a-4bff-9d40-341583f3646e req-32e2a6dc-7e11-4ab2-b544-0fa2e2d80cb2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.721302 Jul 18 12:49:56.161185 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 81/158] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:56.169784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:56.170615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:56.179637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.180515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.181599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.182421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.409992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Calling method '.version_select at 0x7f96e54aa310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:56.411636 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:56.411636 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:56.414210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.414753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.437046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.437678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.443406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:56.456770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:56.457910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:56.467996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51b01664-37ed-49d3-b64b-dceb081e32d6 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.580402 Jul 18 12:49:56.468724 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 78/159] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:49:56.507862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:56.524789 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b11483cb-48da-4b5c-a5f8-a2c126861f43 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.361704 Jul 18 12:49:56.538110 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 82/160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:56 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:56.582744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-664d4225-15ec-4cae-9035-4dfe8feda49d tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1087912857", "id": 260060606, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:56.586003 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:56.586003 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:56.631106 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-664d4225-15ec-4cae-9035-4dfe8feda49d tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.160485 Jul 18 12:49:56.632046 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 79/161] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:49:56 2022] POST /compute/v2.1/flavors => generated 446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:56.668371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2103961223", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "2143769661", "adminPass": "***", "networks": [{"uuid": "be0aed87-b9e9-42c3-af6e-9e2325a79318"}], "security_groups": [{"name": "tempest-securitygroup--1086590509"}], "key_name": "tempest-keypair-39912689", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:57.023735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] validate_networks() for [('be0aed87-b9e9-42c3-af6e-9e2325a79318', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:49:57.072927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d03618ba-d1d4-4bb4-8591-01df3a8ac997 tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] Calling method '.version_select at 0x7f96e53e20d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:57.287723 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d03618ba-d1d4-4bb4-8591-01df3a8ac997 tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.745380 Jul 18 12:49:57.289726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 83/162] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:49:56 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:57.483305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11586c6b-d2c9-4c4c-972b-74194809385e tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Calling method '.version_select at 0x7f96e53b1c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:57.485576 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:57.485576 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:57.487894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11586c6b-d2c9-4c4c-972b-74194809385e tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '48eb7f222eda4d888cf2f60233b5b781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61adc5bceace4d22a70b4b7c55f76250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11586c6b-d2c9-4c4c-972b-74194809385e tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Request method failure captured: Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/n-h2-850003-3/search HTTP/1.1 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbwuRauV0Ltn16Szlz2FIYZo25e-8pH3dJOUkF_193Xd5X2D_0HwN_vNWBjaquGZGBUwuf4i1AiRFH_4WTTtti7z3SmOCpqj7qugyu_ipoIWO33UvyOqCOjGRfmlOOlpRi1dQ-RgUX4JY8ilEvcKyRKd85nTAO3YXU99F7DcQuEwsA Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 61adc5bceace4d22a70b4b7c55f76250 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:57.491716 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_61adc5bceace4d22a70b4b7c55f76250", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 61adc5bceace4d22a70b4b7c55f76250 Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 48eb7f222eda4d888cf2f60233b5b781 Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 12:49:57.493995 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'n-h2-850003-3'} Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:57.495418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 12:49:57.497524 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:57.500923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11586c6b-d2c9-4c4c-972b-74194809385e tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:57.500923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11586c6b-d2c9-4c4c-972b-74194809385e tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h2-850003-3/search" status: 403 len: 117 microversion: 2.1 time: 0.202206 Jul 18 12:49:57.500923 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 84/163] 10.222.0.88 () {58 vars in 1208 bytes} [Mon Jul 18 12:49:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-850003-3/search => generated 117 bytes in 204 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:57.697068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-790d7c5a-8855-4d89-a87b-8e8bc2dc497f tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:57.720040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-790d7c5a-8855-4d89-a87b-8e8bc2dc497f tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] 10.222.0.88 "GET /compute/v2.1/flavors/260060606" status: 200 len: 446 microversion: 2.55 time: 0.223133 Jul 18 12:49:57.720981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 85/164] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 18 12:49:57 2022] GET /compute/v2.1/flavors/260060606 => generated 446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:57.743627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:57.744312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:57.758343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:57.759539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:57.761082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:57.762096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.039645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:58.057613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a2f0f11-c3c6-4981-b570-6edbffedeb4e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.333550 Jul 18 12:49:58.059977 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 86/165] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:57 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:58.080041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e43f518e-464b-41ad-a214-24177ce5dbf7 tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] Calling method '.version_select at 0x7f96e53b1820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.346999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e43f518e-464b-41ad-a214-24177ce5dbf7 tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks/fae3a6a5-0ff2-4f06-b214-fc03fff2005b" status: 200 len: 652 microversion: 2.1 time: 0.284890 Jul 18 12:49:58.354606 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 87/166] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/os-networks/fae3a6a5-0ff2-4f06-b214-fc03fff2005b => generated 652 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:58.361149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Calling method '.version_select at 0x7f96e53b1550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.362353 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:58.362353 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:58.366054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.366871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.378657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Request method failure captured: Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbzyibPg7f8VHoSrto5fpAIWbFAcgeekK43nO7cH17HPNfzAKUlpbHYy8LXa0nF_V-q1OF1JMIFs9Rz5-fc-13etVWaF5Z7yNRMDnt9gW_tKg68UnoOS3E8zPnnzssjV-m4MO9Ew27swkofQU-n4phcgt3KtqRqqPDB3aZio0LrD3M Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 16fcdf620e604a739e6155ab16d5ff73 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:49:58.381151 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_16fcdf620e604a739e6155ab16d5ff73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 16fcdf620e604a739e6155ab16d5ff73 Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cf1be21aea548219003c104c4bd4377 Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 12:49:58.384347 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:58.385966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-704663de-da38-499e-9d04-ca2cc23f5974 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.032434 Jul 18 12:49:58.388534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 88/167] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:58.394047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.395052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:58.409159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.409745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.411566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.412468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.477399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:49:58.478459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:49:58.478459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:49:58.479132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:49:58.479665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:49:58.492411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.493291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.494586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.495385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.519733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:49:58.532982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:49:58.541385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for user ab603aa7a37344fc8e71e4b6d6fc32c0 and project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:49:58.560212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:49:58.569112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:49:58.698715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:58.707186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-684b08f5-0506-4458-b106-51aad15407dd tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.055487 Jul 18 12:49:58.714405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 80/168] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:49:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:49:58.728932 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b9c417c-bb84-4529-9f1f-4513fd2510b4 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 0.340385 Jul 18 12:49:58.730602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12a05b94-22a5-412d-a990-23ba0bd347ef tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] Action: 'update', calling method: .version_select at 0x7f96e75cbca0>, body: {"flavor": {"description": "new"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:58.751404 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:58.751404 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:49:58.752375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 89/169] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:58.764760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-30477d63-327e-4df5-97b4-ccc440d74d85 req-6c3ad3e6-f6c8-4e89-8ab7-da61cf1ccae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a533c01-673a-413d-b492-63a1617e19d9", "name": "network-vif-plugged", "status": "completed", "tag": "30ec3c13-d048-47d7-91b1-27c192b51f87"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:49:58.792374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-30477d63-327e-4df5-97b4-ccc440d74d85 req-6c3ad3e6-f6c8-4e89-8ab7-da61cf1ccae9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.793847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-30477d63-327e-4df5-97b4-ccc440d74d85 req-6c3ad3e6-f6c8-4e89-8ab7-da61cf1ccae9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.824494 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12a05b94-22a5-412d-a990-23ba0bd347ef tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/260060606" status: 200 len: 447 microversion: 2.55 time: 0.106432 Jul 18 12:49:58.828026 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-30477d63-327e-4df5-97b4-ccc440d74d85 req-6c3ad3e6-f6c8-4e89-8ab7-da61cf1ccae9 service nova] Creating event network-vif-plugged:30ec3c13-d048-47d7-91b1-27c192b51f87 for instance 5a533c01-673a-413d-b492-63a1617e19d9 on n-h2-850003-3 Jul 18 12:49:58.831678 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 81/170] 10.222.0.88 () {62 vars in 1215 bytes} [Mon Jul 18 12:49:58 2022] PUT /compute/v2.1/flavors/260060606 => generated 447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:49:58.837433 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-30477d63-327e-4df5-97b4-ccc440d74d85 req-6c3ad3e6-f6c8-4e89-8ab7-da61cf1ccae9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083007 Jul 18 12:49:58.839602 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 90/171] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:58.847051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2532135b-094b-44cf-8a75-177580839c4f tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] Calling method '.version_select at 0x7f96e57bc670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.852576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Calling method '.version_select at 0x7f96e543c310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.854332 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:58.854332 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:58.857917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.858741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.892036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.892974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.929774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:58.932911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:58.972808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-187a8db1-f5bd-4046-b47d-d89a50a54893 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.130520 Jul 18 12:49:58.982817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 91/172] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:49:58.995212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d036755-958a-4ebc-8cae-4179ab59dce6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:58.997350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4d036755-958a-4ebc-8cae-4179ab59dce6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:59.191661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4d036755-958a-4ebc-8cae-4179ab59dce6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:59.237104 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4d036755-958a-4ebc-8cae-4179ab59dce6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1263 microversion: 2.1 time: 0.252418 Jul 18 12:49:59.241150 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 92/173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1263 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:59.271346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52cab986-8872-44cf-953d-80e5526aef13 tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.368785 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52cab986-8872-44cf-953d-80e5526aef13 tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6588 microversion: 2.55 time: 0.125331 Jul 18 12:49:59.392698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 93/174] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/flavors/detail => generated 6588 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:49:59.404121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2532135b-094b-44cf-8a75-177580839c4f tempest-NetworksTest-805120010 tempest-NetworksTest-805120010-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks" status: 200 len: 4021 microversion: 2.1 time: 0.570414 Jul 18 12:49:59.405488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dda7b165-960f-46fd-9afe-82238565a342 tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Calling method '.version_select at 0x7f96e53863a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.412414 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:59.412414 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:59.416212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dda7b165-960f-46fd-9afe-82238565a342 tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '48eb7f222eda4d888cf2f60233b5b781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61adc5bceace4d22a70b4b7c55f76250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:49:59.419429 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 82/175] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:49:58 2022] GET /compute/v2.1/os-networks => generated 4021 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dda7b165-960f-46fd-9afe-82238565a342 tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Request method failure captured: Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbwuRauV0Ltn16Szlz2FIYZo25e-8pH3dJOUkF_193Xd5X2D_0HwN_vNWBjaquGZGBUwuf4i1AiRFH_4WTTtti7z3SmOCpqj7qugyu_ipoIWO33UvyOqCOjGRfmlOOlpRi1dQ-RgUX4JY8ilEvcKyRKd85nTAO3YXU99F7DcQuEwsA Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 61adc5bceace4d22a70b4b7c55f76250 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:49:59.423120 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_61adc5bceace4d22a70b4b7c55f76250", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/61adc5bceace4d22a70b4b7c55f76250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 61adc5bceace4d22a70b4b7c55f76250 Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254 Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 48eb7f222eda4d888cf2f60233b5b781 Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 12:49:59.425476 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1'} Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:49:59.426938 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 12:49:59.429124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.433694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dda7b165-960f-46fd-9afe-82238565a342 tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:59.434216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.435367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:59.436617 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dda7b165-960f-46fd-9afe-82238565a342 tempest-HypervisorAdminNegativeUnderV252Test-1112769254 tempest-HypervisorAdminNegativeUnderV252Test-1112769254-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.040757 Jul 18 12:49:59.438387 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 94/176] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:59.452321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d0c27b43-82bf-4ac6-a7f7-81c7216b9146 tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.469075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:59.469933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:59.471377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:59.472195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:59.486756 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d0c27b43-82bf-4ac6-a7f7-81c7216b9146 tempest-FlavorsV255TestJSON-1264486948 tempest-FlavorsV255TestJSON-1264486948-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 3678 microversion: 2.55 time: 0.044433 Jul 18 12:49:59.510927 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 95/177] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/flavors => generated 3678 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:49:59.519839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Calling method '.version_select at 0x7f96e5425ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.523747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:59.524692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:59.553858 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] HTTP exception thrown: No hypervisor matching 'b05d0805-312e-482d-ba6b-92d91166547e' could be found. Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Request method failure captured: Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/b05d0805-312e-482d-ba6b-92d91166547e/servers HTTP/1.1 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbzyibPg7f8VHoSrto5fpAIWbFAcgeekK43nO7cH17HPNfzAKUlpbHYy8LXa0nF_V-q1OF1JMIFs9Rz5-fc-13etVWaF5Z7yNRMDnt9gW_tKg68UnoOS3E8zPnnzssjV-m4MO9Ew27swkofQU-n4phcgt3KtqRqqPDB3aZio0LrD3M Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 16fcdf620e604a739e6155ab16d5ff73 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:49:59.559604 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_16fcdf620e604a739e6155ab16d5ff73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/16fcdf620e604a739e6155ab16d5ff73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 16fcdf620e604a739e6155ab16d5ff73 Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774 Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cf1be21aea548219003c104c4bd4377 Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: exception: No hypervisor matching 'b05d0805-312e-482d-ba6b-92d91166547e' could be found. Jul 18 12:49:59.563023 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b05d0805-312e-482d-ba6b-92d91166547e'} Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'b05d0805-312e-482d-ba6b-92d91166547e' could be found. Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.565100 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'b05d0805-312e-482d-ba6b-92d91166547e' could be found. Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:49:59.567937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] Returning 404 to user: No hypervisor matching 'b05d0805-312e-482d-ba6b-92d91166547e' could be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:49:59.569320 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-014f1e75-8b7a-4e2d-b636-2a8f88aba983 tempest-HypervisorAdminNegativeUnderV252Test-702612774 tempest-HypervisorAdminNegativeUnderV252Test-702612774-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/b05d0805-312e-482d-ba6b-92d91166547e/servers" status: 404 len: 123 microversion: 2.1 time: 0.053322 Jul 18 12:49:59.572249 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 96/178] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/os-hypervisors/b05d0805-312e-482d-ba6b-92d91166547e/servers => generated 123 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:49:59.598245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6cdd75a-36bb-4be7-a80a-9a7cb586d506 tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.607687 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:49:59.607687 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:49:59.656131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6cdd75a-36bb-4be7-a80a-9a7cb586d506 tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/260060606" status: 202 len: 0 microversion: 2.55 time: 0.081279 Jul 18 12:49:59.659498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 97/179] 10.222.0.88 () {60 vars in 1198 bytes} [Mon Jul 18 12:49:59 2022] DELETE /compute/v2.1/flavors/260060606 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:49:59.688060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1e462a5-6481-4eb3-808e-dc58ad5e5f9c tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.741620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1e462a5-6481-4eb3-808e-dc58ad5e5f9c tempest-FlavorsV255TestJSON-357547278 tempest-FlavorsV255TestJSON-357547278-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.076087 Jul 18 12:49:59.743697 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 98/180] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:49:59.771000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:49:59.772223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:49:59.800346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:59.808682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:49:59.811798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:49:59.814065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:00.208994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:00.249915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a88f832-9f92-4432-b4d5-05defe51796b tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1341 microversion: 2.1 time: 0.828370 Jul 18 12:50:00.251830 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 83/181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1341 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:00.274120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e3a938e-7939-49a1-a4f4-01d9a9870b99 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:00.275675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e3a938e-7939-49a1-a4f4-01d9a9870b99 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:00.495884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e3a938e-7939-49a1-a4f4-01d9a9870b99 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:00.531019 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e3a938e-7939-49a1-a4f4-01d9a9870b99 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1263 microversion: 2.1 time: 0.270111 Jul 18 12:50:00.536861 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 84/182] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:00 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:01.139075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:01.189523 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e83774cd-c950-4e89-881e-2c7323233417 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1339 microversion: 2.1 time: 1.432038 Jul 18 12:50:01.214194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 99/183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:49:59 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1339 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:01.279223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:01.280382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:01.330876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:01.331867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:01.333365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:01.347475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:01.569528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:01.574405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:01.603682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:01.607165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:01.609359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:01.612041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:01.835519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:01.877570 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4cf0110-b2c5-4a77-9b56-70d22b961905 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1259 microversion: 2.1 time: 0.318476 Jul 18 12:50:01.878898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 100/184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:01 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1259 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:02.229306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:02.231773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:02.246343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:02.247595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:02.250102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:02.251404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:02.517891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:02.564254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b2959624-ea2e-4b32-a1a2-d487db18ebc2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1491 microversion: 2.1 time: 1.291629 Jul 18 12:50:02.573132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 85/185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:01 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1491 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:03.169262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:03.210398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3443753d-b470-4c5a-9600-57da98939b37 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1488 microversion: 2.1 time: 0.989042 Jul 18 12:50:03.223017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:03.223697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:03.228935 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 101/186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:02 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1488 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:03.234256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:03.238401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.239026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.239938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.240893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.247096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:03.264292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.274996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.276240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.276918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.411807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:50:03.730217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:03.762716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5bf385d0-e480-447e-98d2-d65a3661e9a8 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1321 microversion: 2.1 time: 0.523804 Jul 18 12:50:03.779378 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 102/187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:03 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:03.800043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:03.802068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:03.826923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.832341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.845614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.847174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.931118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76e4b36e-4b25-450a-b12c-e3404e25611f tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 204 len: 0 microversion: 2.1 time: 1.330376 Jul 18 12:50:03.932419 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 86/188] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:02 2022] DELETE /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 0 bytes in 1333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 12:50:03.944397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:03.953264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:03.993398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:03.994740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:03.996287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:04.004121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:05.349706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:05.391827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cda886fe-f86a-4d50-8e79-aaeefe2df2d6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1497 microversion: 2.1 time: 1.448254 Jul 18 12:50:05.407306 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 87/189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:03 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1497 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:05.419754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:05.420714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:05.446951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:05.452196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:05.454172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:05.459188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:05.481749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:05.913538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:05.942204 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7bc7d3ae-cdb4-4fa7-872c-76b72b684260 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1321 microversion: 2.1 time: 0.532617 Jul 18 12:50:05.943480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 88/190] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:05 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:06.419520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:06.421458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:06.448430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.448952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:06.449736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.455747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:06.505544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-871037c7-f9be-40a3-b3bf-c65f4984fd21 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1639 microversion: 2.1 time: 2.720822 Jul 18 12:50:06.513489 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 103/191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:03 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1639 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:06.541926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:06.544168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:06.556269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.557085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:06.558787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.560041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:06.596794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:06.621866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:50:06.916763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:06.928386 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-138a3278-5379-4079-b21e-f7785eff3c7e tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1497 microversion: 2.1 time: 0.516247 Jul 18 12:50:06.933452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 89/192] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:06 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1497 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:06.972274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:06.972980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:06.990431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.990948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:06.991779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:06.992276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:07.144826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34e54f97-bd9d-414e-86c7-60d04f63c085 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 204 len: 0 microversion: 2.1 time: 0.613246 Jul 18 12:50:07.147049 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 104/193] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:06 2022] DELETE /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:50:07.177021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:07.178262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:07.194958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:07.195906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:07.200261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:07.201030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:07.398493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:07.409367 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1cfafc48-52f6-4d62-a4c1-c1dc344a9992 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.443030 Jul 18 12:50:07.410705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 90/194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:06 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:07.876842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:07.892012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ce68824-3618-447d-81f8-d2222845a40c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1494 microversion: 2.1 time: 0.728711 Jul 18 12:50:07.892928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 105/195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:07 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1494 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:07.961406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:07.962403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:08.000560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.011950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.014232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.015018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.325017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:08.341781 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad252fa6-a2b0-4728-9abf-288d96514b0f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1497 microversion: 2.1 time: 0.393122 Jul 18 12:50:08.344652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 91/196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:07 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:08.439031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:08.443550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:08.461322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.463991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.465723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.468365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.749717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-94122fcd-8caa-4ce5-8e2d-3ad3b56dff1c req-e8194762-1ae9-42d8-a6e3-186aa318036a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc2a69b3-393f-4c1f-a8c2-956688a066af", "name": "network-vif-deleted", "tag": "814f5d32-2614-4720-8edd-e6b1deca18ac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:08.771723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:08.800718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-94122fcd-8caa-4ce5-8e2d-3ad3b56dff1c req-e8194762-1ae9-42d8-a6e3-186aa318036a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.801639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-94122fcd-8caa-4ce5-8e2d-3ad3b56dff1c req-e8194762-1ae9-42d8-a6e3-186aa318036a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.831147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-94122fcd-8caa-4ce5-8e2d-3ad3b56dff1c req-e8194762-1ae9-42d8-a6e3-186aa318036a service nova] Creating event network-vif-deleted:814f5d32-2614-4720-8edd-e6b1deca18ac for instance bc2a69b3-393f-4c1f-a8c2-956688a066af on n-h2-850003-3 Jul 18 12:50:08.843487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-94122fcd-8caa-4ce5-8e2d-3ad3b56dff1c req-e8194762-1ae9-42d8-a6e3-186aa318036a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102120 Jul 18 12:50:08.845412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 92/197] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:08.924050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:08.927140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:08.949556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.957482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:08.957482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:08.958890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:09.144893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:09.164024 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72cdfa87-f7e1-455a-91dd-e2ba11db8573 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.732796 Jul 18 12:50:09.183548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 106/198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:08 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:09.372854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:09.374319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:09.377561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:09.390281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:09.391812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:09.396696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:09.397547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:09.413240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:09.421941 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0ef1061-05ae-4dd0-b978-4bdecd567354 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1494 microversion: 2.1 time: 0.507864 Jul 18 12:50:09.423349 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 93/199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:08 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:09.483512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:09.485518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:09.491242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid bc2a69b3-393f-4c1f-a8c2-956688a066af {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:09.850247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:09.883090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68539121-17c4-4345-9dd1-91eeee790eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 200 len: 1331 microversion: 2.1 time: 0.514293 Jul 18 12:50:09.884358 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 107/200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:09 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 1331 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:10.192768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:10.197670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:10.216331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.217953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.220783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.222354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.441810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:10.442692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:10.458138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.458622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.459578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.460231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.514584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:10.619390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:10.644243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cdf50ca-03fa-48a3-91ac-7a8d6b8f62d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.462067 Jul 18 12:50:10.645763 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 94/201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:10 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:10.831166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:10.844160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07f75b3d-7be9-42c5-a4a6-0cc2f81bc47c tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1494 microversion: 2.1 time: 0.406312 Jul 18 12:50:10.845908 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 108/202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:10 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:10.912736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:10.917542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:10.940277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.945992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.947044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:10.947501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:10.979994 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af HTTP/1.1 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:10.991832 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:10.993264 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc2a69b3-393f-4c1f-a8c2-956688a066af'} Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:10.993987 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:10.995120 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:10.998464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:10.998464 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b94fe23-0a8c-40b2-9e6a-511a16f0c348 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 404 len: 111 microversion: 2.1 time: 0.095070 Jul 18 12:50:10.998464 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 95/203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:10 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:11.547518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1389215782", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:11.614758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-61acb976-012f-48c1-ae59-b7b6c6838ff3 req-e740265e-a6db-4cad-81c5-38d3fa08c718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a533c01-673a-413d-b492-63a1617e19d9", "name": "network-vif-deleted", "tag": "30ec3c13-d048-47d7-91b1-27c192b51f87"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:11.643092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-61acb976-012f-48c1-ae59-b7b6c6838ff3 req-e740265e-a6db-4cad-81c5-38d3fa08c718 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:11.647891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-61acb976-012f-48c1-ae59-b7b6c6838ff3 req-e740265e-a6db-4cad-81c5-38d3fa08c718 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:11.687175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-61acb976-012f-48c1-ae59-b7b6c6838ff3 req-e740265e-a6db-4cad-81c5-38d3fa08c718 service nova] Creating event network-vif-deleted:30ec3c13-d048-47d7-91b1-27c192b51f87 for instance 5a533c01-673a-413d-b492-63a1617e19d9 on n-h2-850003-3 Jul 18 12:50:11.702547 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-61acb976-012f-48c1-ae59-b7b6c6838ff3 req-e740265e-a6db-4cad-81c5-38d3fa08c718 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091847 Jul 18 12:50:11.709017 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 96/204] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:11.731375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:11.744635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:11.745582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:11.764265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:11.767122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:11.768749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:11.769711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.657416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:12.659236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:12.660361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:12.661172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:12.661948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:12.695133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:12.695869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.696959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:12.697593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.751346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:12.764750 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0606f601-eb2c-44a7-90d9-9fdc46ac0da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 1.053286 Jul 18 12:50:12.768932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Getting quotas for project 1d696868b7554f829b1b44c0f18d93c6. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:12.774580 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 97/205] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:11 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:12.789257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Getting quotas for user ddeca78fbb614783b68e6ae47c0c92d0 and project 1d696868b7554f829b1b44c0f18d93c6. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:12.792052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:12.793101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:12.809339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:12.810362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.813961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:12.821077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.832745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:50:12.839727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:50:12.915520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:12.917386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:12.918557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:12.919043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lazy-loading 'fault' on Instance uuid 5a533c01-673a-413d-b492-63a1617e19d9 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:12.973191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17eee67f-3882-48a4-811a-4b10c208dad9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.429992 Jul 18 12:50:12.974906 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 109/206] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:50:13.370939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428dc0f106214c48b12e795b26862164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f632c11ac594f4ab80777f0736c091d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:13.423950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95fbb149-d87a-4b4d-be4d-5981727ef091 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 200 len: 1329 microversion: 2.1 time: 0.638965 Jul 18 12:50:13.441043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 98/207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:12 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 1329 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:13.724991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5652a7e-7b00-4ff3-96ca-0b85e541bab8 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Calling method '.version_select at 0x7f96e5316820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:13.725951 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:13.725951 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:13.727618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5652a7e-7b00-4ff3-96ca-0b85e541bab8 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '23c964f7e6c54414a93ba06674defbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a078b49c6d433f8a0fb03e25404153', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5652a7e-7b00-4ff3-96ca-0b85e541bab8 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Request method failure captured: Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcBqnwmuaO0DeXSfkrsXZO6LnmzGd1JIp5IhLiP7VRX8wENIbKa9X2wR5Jk_ycoS-hbFwqDHMOcSHBi7rG4pggAWkDJEgbQoH2dICmdLDtQzhidB7gx4AZDoLM3fHAMYp28bSN5j_DGmsvgzH11Y6x-a-fJYURUK_gY5mOcWFSZAw4 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:13.729750 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_52a078b49c6d433f8a0fb03e25404153", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 23c964f7e6c54414a93ba06674defbbd Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: action_args: {} Jul 18 12:50:13.742938 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:13.745299 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 12:50:13.747384 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.749420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5652a7e-7b00-4ff3-96ca-0b85e541bab8 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:13.749420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5652a7e-7b00-4ff3-96ca-0b85e541bab8 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.288682 Jul 18 12:50:13.749420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 99/208] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 12:50:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:13.749420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b328a89b-ecc7-4f76-8693-1a6d82fcfbc7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:13.749420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b328a89b-ecc7-4f76-8693-1a6d82fcfbc7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:13.758344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7bab5264-7f25-4be9-a999-da752f657be7 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Calling method '.version_select at 0x7f96e53c2160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:13.888940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b328a89b-ecc7-4f76-8693-1a6d82fcfbc7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:13.904713 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b328a89b-ecc7-4f76-8693-1a6d82fcfbc7 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1220 microversion: 2.1 time: 0.158991 Jul 18 12:50:13.904713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 100/209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:13 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:13.921229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6eecb05-df08-47c9-a685-9b64b21fb378 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Calling method '.version_select at 0x7f96e56b8700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:13.922901 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:13.922901 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:13.924510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6eecb05-df08-47c9-a685-9b64b21fb378 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '23c964f7e6c54414a93ba06674defbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a078b49c6d433f8a0fb03e25404153', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6eecb05-df08-47c9-a685-9b64b21fb378 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Request method failure captured: Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcBqnwmuaO0DeXSfkrsXZO6LnmzGd1JIp5IhLiP7VRX8wENIbKa9X2wR5Jk_ycoS-hbFwqDHMOcSHBi7rG4pggAWkDJEgbQoH2dICmdLDtQzhidB7gx4AZDoLM3fHAMYp28bSN5j_DGmsvgzH11Y6x-a-fJYURUK_gY5mOcWFSZAw4 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:13.926052 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_52a078b49c6d433f8a0fb03e25404153", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 23c964f7e6c54414a93ba06674defbbd Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: action_args: {} Jul 18 12:50:13.928272 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:13.929726 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 12:50:13.931681 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:13.938587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6eecb05-df08-47c9-a685-9b64b21fb378 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:13.939524 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6eecb05-df08-47c9-a685-9b64b21fb378 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.033348 Jul 18 12:50:13.946703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 101/210] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:50:13 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:13.951878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:13.952511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:13.982964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:13.983468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:13.984904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:13.985329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:14.016469 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7bab5264-7f25-4be9-a999-da752f657be7 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 371 microversion: 2.1 time: 1.039457 Jul 18 12:50:14.060466 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 110/211] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 12:50:12 2022] GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 371 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:14.102853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46ecf8d6-3095-4cd4-a9ce-7dcec4f1359a tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Calling method '.version_select at 0x7f96e52ae310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:14.103927 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:14.103927 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:14.105201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46ecf8d6-3095-4cd4-a9ce-7dcec4f1359a tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '23c964f7e6c54414a93ba06674defbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a078b49c6d433f8a0fb03e25404153', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46ecf8d6-3095-4cd4-a9ce-7dcec4f1359a tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Request method failure captured: Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcBqnwmuaO0DeXSfkrsXZO6LnmzGd1JIp5IhLiP7VRX8wENIbKa9X2wR5Jk_ycoS-hbFwqDHMOcSHBi7rG4pggAWkDJEgbQoH2dICmdLDtQzhidB7gx4AZDoLM3fHAMYp28bSN5j_DGmsvgzH11Y6x-a-fJYURUK_gY5mOcWFSZAw4 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:14.107044 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_52a078b49c6d433f8a0fb03e25404153", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 23c964f7e6c54414a93ba06674defbbd Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 12:50:14.109153 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:14.112323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 12:50:14.116285 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:14.120711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46ecf8d6-3095-4cd4-a9ce-7dcec4f1359a tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:14.120711 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46ecf8d6-3095-4cd4-a9ce-7dcec4f1359a tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.038028 Jul 18 12:50:14.120711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 111/212] 10.222.0.88 () {58 vars in 1178 bytes} [Mon Jul 18 12:50:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:14.122495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e52a20d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:14.406512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:14.406772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:14.409831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:14.412433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:14.562051 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aca68692-b302-40d4-8cc5-1949f2083513 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 328 microversion: 2.1 time: 0.444310 Jul 18 12:50:14.564436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 112/213] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:14 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 328 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:14.910553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Calling method '.version_select at 0x7f96e52aea60>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:14.912087 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:14.912087 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:14.914925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:14.920630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:14.994074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:14.994583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.049202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.049663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.078962 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e197b025-da7a-4819-a66b-a99e4a0ba0d1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.512252 Jul 18 12:50:15.087491 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 113/214] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:50:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:15.103823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:15.107449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:15.127862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.128089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.128890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.129344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.161522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] HTTP exception thrown: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Request method failure captured: Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 HTTP/1.1 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbGda4LBHFBhHFL1X0RLgOYJtoF_kh3bTroKevCkyZmWXgL2dX2hZpDc6cQQzjhQQ3I1qYUzSI1KUJiAu_2wWILl0coVmVnOWwnwSMUeaIdkAtTanhXfxuYiVLrkisVnR_84uVndewP5RUQzx-tnC7G1hHKHJspaWje8xdBWOrLSN4 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:15.164617 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4f632c11ac594f4ab80777f0736c091d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 428dc0f106214c48b12e795b26862164 Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:15.167254 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5a533c01-673a-413d-b492-63a1617e19d9'} Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:15.168656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:15.170808 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.172616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Returning 404 to user: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:15.178121 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-335c5a47-3e81-455a-8a30-9269e95dbd77 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 404 len: 111 microversion: 2.1 time: 0.077340 Jul 18 12:50:15.184865 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 114/215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:15 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:15.189110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:15.190227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:15.213278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.213740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.214626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.215077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.425924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:15.438891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-df3aa451-8e4a-40d5-b6c1-3634d51210d9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1294 microversion: 2.1 time: 0.258667 Jul 18 12:50:15.451412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 115/216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:15 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1294 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:15.461457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:15.482866 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87b52ffa-7fa2-4900-8f66-033415aa5457 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 1.534693 Jul 18 12:50:15.498546 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 102/217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:13 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:15.504965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ab9fa8e-922b-45c9-8b84-62c1304db13c tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Calling method '.version_select at 0x7f96e5259700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:15.505841 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:15.505841 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:15.518465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ab9fa8e-922b-45c9-8b84-62c1304db13c tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '23c964f7e6c54414a93ba06674defbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a078b49c6d433f8a0fb03e25404153', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ab9fa8e-922b-45c9-8b84-62c1304db13c tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Request method failure captured: Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcBqnwmuaO0DeXSfkrsXZO6LnmzGd1JIp5IhLiP7VRX8wENIbKa9X2wR5Jk_ycoS-hbFwqDHMOcSHBi7rG4pggAWkDJEgbQoH2dICmdLDtQzhidB7gx4AZDoLM3fHAMYp28bSN5j_DGmsvgzH11Y6x-a-fJYURUK_gY5mOcWFSZAw4 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:15.520141 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_52a078b49c6d433f8a0fb03e25404153", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 23c964f7e6c54414a93ba06674defbbd Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1'} Jul 18 12:50:15.521303 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:15.522014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 12:50:15.524288 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:15.525248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ab9fa8e-922b-45c9-8b84-62c1304db13c tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:15.525248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ab9fa8e-922b-45c9-8b84-62c1304db13c tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021943 Jul 18 12:50:15.525248 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 103/218] 10.222.0.88 () {58 vars in 1172 bytes} [Mon Jul 18 12:50:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:15.540227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ba26e79-b214-49a7-9008-146c210864eb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:15.541614 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:15.541614 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:15.563265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ba26e79-b214-49a7-9008-146c210864eb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:15.563719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ba26e79-b214-49a7-9008-146c210864eb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:15.650576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2066233584", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:15.770745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:15.829539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ba26e79-b214-49a7-9008-146c210864eb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.293162 Jul 18 12:50:15.836973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 104/219] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:15 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:16.173874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dc9777bd-982f-4e81-8a5f-3c9c653e6b85 req-17a9e0f7-9b0d-4e23-ad08-12c12073c15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b147194b-0153-47c3-b2ed-1f398764e2d6", "tag": "8623e45a-b41b-491e-9309-51d84fa4dfc1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:16.198414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc9777bd-982f-4e81-8a5f-3c9c653e6b85 req-17a9e0f7-9b0d-4e23-ad08-12c12073c15f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.198866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc9777bd-982f-4e81-8a5f-3c9c653e6b85 req-17a9e0f7-9b0d-4e23-ad08-12c12073c15f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.241481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dc9777bd-982f-4e81-8a5f-3c9c653e6b85 req-17a9e0f7-9b0d-4e23-ad08-12c12073c15f service nova] Creating event network-changed:8623e45a-b41b-491e-9309-51d84fa4dfc1 for instance b147194b-0153-47c3-b2ed-1f398764e2d6 on n-h1-850003-3 Jul 18 12:50:16.248237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dc9777bd-982f-4e81-8a5f-3c9c653e6b85 req-17a9e0f7-9b0d-4e23-ad08-12c12073c15f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408797 Jul 18 12:50:16.249203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 105/220] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:16.258570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f643c227-61d8-420e-901f-69d214e625e8 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Calling method '.version_select at 0x7f96e5259160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.260759 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.260759 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:16.262335 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f643c227-61d8-420e-901f-69d214e625e8 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] HTTP exception thrown: Hypervisor with ID '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' could not be found. Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f643c227-61d8-420e-901f-69d214e625e8 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Request method failure captured: Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-hypervisors/5d8fe518-a3c3-41bd-b73f-3ff56631b3f9/uptime HTTP/1.1 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcEJtlO2Bbm8pAWKV_UcXJhJ6gvEhQOF-kGedKPW7CJsZv3drCu1DjWUi98cUEQwKfr-e9UnezD0Fgxl57K5mTNciLf-IANomlm7_aWjJWf2vPicRZ-b6yDFNGRky5TCV6_ThJ3To3X9S079Eht_VwLOMyHumqtnpwjqE__DfLY-iQ Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 81f2630ec1664b54bb6832a0afdda9b5 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:16.289314 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81f2630ec1664b54bb6832a0afdda9b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 81f2630ec1664b54bb6832a0afdda9b5 Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: d55c61b1b7e54960b9f26a8d1ef76c7d Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: exception: Hypervisor with ID '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' could not be found. Jul 18 12:50:16.290926 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9'} Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 12:50:16.291794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' could not be found. Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.293414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' could not be found. Jul 18 12:50:16.294847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.296266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f643c227-61d8-420e-901f-69d214e625e8 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Returning 404 to user: Hypervisor with ID '5d8fe518-a3c3-41bd-b73f-3ff56631b3f9' could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:16.298300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f643c227-61d8-420e-901f-69d214e625e8 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/5d8fe518-a3c3-41bd-b73f-3ff56631b3f9/uptime" status: 404 len: 123 microversion: 2.1 time: 0.047236 Jul 18 12:50:16.299025 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 106/221] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 12:50:16 2022] GET /compute/v2.1/os-hypervisors/5d8fe518-a3c3-41bd-b73f-3ff56631b3f9/uptime => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:16.303972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-902ddc0a-a495-405b-9a88-8a159be6bd72 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.305052 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.305052 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:16.409068 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-902ddc0a-a495-405b-9a88-8a159be6bd72 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.108261 Jul 18 12:50:16.413637 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 107/222] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:16 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:16.435662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Calling method '.version_select at 0x7f96e54aab80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.439012 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.439012 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:16.445016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.448974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.526095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.527327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.549064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.550346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.565851 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d629465-4fd0-4429-8851-e82b221a7acd tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.149156 Jul 18 12:50:16.572634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 108/223] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:50:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:16.580946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a135d2c7-7e91-429b-aab4-83d27e9d06cc tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-769074592"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:16.583363 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.583363 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:16.584935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-a135d2c7-7e91-429b-aab4-83d27e9d06cc tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid 668974f6-75a8-4c34-a9eb-6dcfeacd405b for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:16.606637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:16.623902 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a135d2c7-7e91-429b-aab4-83d27e9d06cc tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047142 Jul 18 12:50:16.625172 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 109/224] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:16.633056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.635965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:16.668928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.669758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.670630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.671077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.761189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:16.762329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:16.762917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:16.763473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:16.764058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:16.789805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.790698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.793028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.794577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.834956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:16.841151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for user 28d7b628ceb4452d81c22fadbd77c6d3 and project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:16.858570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:16.871503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d73aaa66-2e05-4fa2-a76c-18e00812c9a6 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1278 microversion: 2.1 time: 0.244824 Jul 18 12:50:16.872429 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 110/225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:16 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:16.884839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.utils [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] cores quota exceeded for 930ef2eec94b46529d52aaa0c268926a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131367) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 12:50:16.886142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.886814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:16.887301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Request method failure captured: Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 145 Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcBvjsUPR4Rmw8XuHYy8bXXwwiOPaNlP9ozA9jlsLmQGyWD3pZiVA4z-m9zsdmGNRy07DZ4u8ACd0A0RK2zSfktQ8_pleCf5key65bYta9ymuqdzZvCh6a2dyqenpt4BOFKix6F6BtS9bwjoP0slVmJr9LLetbjhDZZ4WhiWqwmp3Y Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:16.894287 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_930ef2eec94b46529d52aaa0c268926a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28d7b628ceb4452d81c22fadbd77c6d3 Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2066233584", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} Jul 18 12:50:16.895652 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2066233584', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452'}}} Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 12:50:16.896399 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.897435 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.898704 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5d64e0d-2322-4d26-8130-422426aaf462 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.448286 Jul 18 12:50:16.906128 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 116/226] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 1450 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:16.907499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.908386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.908629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.908956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:16.917685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba765b86-182d-4c4f-b368-58aac1dac7a4 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Calling method '.version_select at 0x7f96e523c9d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:16.920769 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.920769 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:16.924731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba765b86-182d-4c4f-b368-58aac1dac7a4 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '23c964f7e6c54414a93ba06674defbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a078b49c6d433f8a0fb03e25404153', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba765b86-182d-4c4f-b368-58aac1dac7a4 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Request method failure captured: Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcBqnwmuaO0DeXSfkrsXZO6LnmzGd1JIp5IhLiP7VRX8wENIbKa9X2wR5Jk_ycoS-hbFwqDHMOcSHBi7rG4pggAWkDJEgbQoH2dICmdLDtQzhidB7gx4AZDoLM3fHAMYp28bSN5j_DGmsvgzH11Y6x-a-fJYURUK_gY5mOcWFSZAw4 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:16.927652 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_52a078b49c6d433f8a0fb03e25404153", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/52a078b49c6d433f8a0fb03e25404153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 52a078b49c6d433f8a0fb03e25404153 Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-528642336 Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 23c964f7e6c54414a93ba06674defbbd Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-528642336-project Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1'} Jul 18 12:50:16.929077 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:16.929849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 12:50:16.931039 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:16.934884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba765b86-182d-4c4f-b368-58aac1dac7a4 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:16.936214 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba765b86-182d-4c4f-b368-58aac1dac7a4 tempest-HypervisorAdminNegativeTestJSON-528642336 tempest-HypervisorAdminNegativeTestJSON-528642336-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.032996 Jul 18 12:50:16.939673 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 117/227] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:16.947752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce67897c-1c23-45c3-b1f4-20a80d245e1d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:16.952142 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:16.952142 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:16.966523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce67897c-1c23-45c3-b1f4-20a80d245e1d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:16.967431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce67897c-1c23-45c3-b1f4-20a80d245e1d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:17.274224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:17.289929 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75d246b7-09b2-494b-b13c-4ba2d11f1564 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.416159 Jul 18 12:50:17.293353 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 111/228] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:16 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:17.310872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e5390310>, body: {"quota_set": {"cores": 20}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:17.729776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce67897c-1c23-45c3-b1f4-20a80d245e1d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.788200 Jul 18 12:50:17.730820 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 118/229] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:16 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:17.744620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d08fe127-e65a-4ba1-8994-88c783269ff1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Calling method '.version_select at 0x7f96e527d550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:17.745637 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:17.745637 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:17.746653 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d08fe127-e65a-4ba1-8994-88c783269ff1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] HTTP exception thrown: Hypervisor with ID '6b589031-519c-41dc-9e05-cb252d13e570' could not be found. Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d08fe127-e65a-4ba1-8994-88c783269ff1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Request method failure captured: Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-hypervisors/6b589031-519c-41dc-9e05-cb252d13e570 HTTP/1.1 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcEJtlO2Bbm8pAWKV_UcXJhJ6gvEhQOF-kGedKPW7CJsZv3drCu1DjWUi98cUEQwKfr-e9UnezD0Fgxl57K5mTNciLf-IANomlm7_aWjJWf2vPicRZ-b6yDFNGRky5TCV6_ThJ3To3X9S079Eht_VwLOMyHumqtnpwjqE__DfLY-iQ Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 81f2630ec1664b54bb6832a0afdda9b5 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:17.753199 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81f2630ec1664b54bb6832a0afdda9b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81f2630ec1664b54bb6832a0afdda9b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 81f2630ec1664b54bb6832a0afdda9b5 Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212 Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: d55c61b1b7e54960b9f26a8d1ef76c7d Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: exception: Hypervisor with ID '6b589031-519c-41dc-9e05-cb252d13e570' could not be found. Jul 18 12:50:17.754871 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6b589031-519c-41dc-9e05-cb252d13e570'} Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6b589031-519c-41dc-9e05-cb252d13e570' Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 12:50:17.755505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:50:17.756630 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6b589031-519c-41dc-9e05-cb252d13e570' could not be found. Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6b589031-519c-41dc-9e05-cb252d13e570' could not be found. Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:17.757650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d08fe127-e65a-4ba1-8994-88c783269ff1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] Returning 404 to user: Hypervisor with ID '6b589031-519c-41dc-9e05-cb252d13e570' could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:17.760748 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d08fe127-e65a-4ba1-8994-88c783269ff1 tempest-HypervisorAdminNegativeTestJSON-2077988212 tempest-HypervisorAdminNegativeTestJSON-2077988212-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/6b589031-519c-41dc-9e05-cb252d13e570" status: 404 len: 123 microversion: 2.1 time: 0.022822 Jul 18 12:50:17.763216 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 119/230] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 12:50:17 2022] GET /compute/v2.1/os-hypervisors/6b589031-519c-41dc-9e05-cb252d13e570 => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:17.796364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecdb6318-031d-4d6d-a152-e25ea14c2d58 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:17.801423 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:17.801423 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:17.842944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecdb6318-031d-4d6d-a152-e25ea14c2d58 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.076092 Jul 18 12:50:17.854788 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 120/231] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:50:17 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:17.859149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c21f8987-4a01-40b6-a9ca-7c472ea9fa26 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:17.863709 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:17.863709 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:17.880663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:17.882277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:17.883287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:17.883732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:17.893307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c21f8987-4a01-40b6-a9ca-7c472ea9fa26 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:17.905768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c21f8987-4a01-40b6-a9ca-7c472ea9fa26 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:18.149984 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33265b3f-e849-434e-826d-8016603d7724 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 329 microversion: 2.1 time: 0.855186 Jul 18 12:50:18.154787 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 112/232] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:17 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 329 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:18.165868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:18.166905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:18.184808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:18.187210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:18.189723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:18.193839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:18.608695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:18.626567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f06e3642-2d2b-43d9-b165-8fc477a7f430 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 0.470248 Jul 18 12:50:18.634357 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 113/233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:18 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:18.657630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5dd2bc1-564b-497d-95db-6d635985646b tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Calling method '.version_select at 0x7f96e52d1d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:18.798069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c21f8987-4a01-40b6-a9ca-7c472ea9fa26 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.942617 Jul 18 12:50:18.800266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 121/234] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:17 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:18.813911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:18.814633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:18.842973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:18.843562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:18.845784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:18.846945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.221720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5dd2bc1-564b-497d-95db-6d635985646b tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 371 microversion: 2.1 time: 0.584572 Jul 18 12:50:19.223669 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 114/235] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 12:50:18 2022] GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:19.240326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0ba5d9d-cd3a-4f2f-b270-8c4d59d8fa3a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:19.241989 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:19.241989 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:19.306819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:19.324623 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-424a3e7a-cfb9-4d07-b5ad-46dbd3226337 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.522313 Jul 18 12:50:19.327808 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 122/236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:18 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:19.344111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e527d8b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:19.348923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0ba5d9d-cd3a-4f2f-b270-8c4d59d8fa3a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.123474 Jul 18 12:50:19.352498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 115/237] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:19 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:19.367673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ab45e19-a1fd-49b5-a2f3-fc6d44a4513c tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286490862"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:19.370719 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:19.370719 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:19.371780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-6ab45e19-a1fd-49b5-a2f3-fc6d44a4513c tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid da024220-1744-41b2-929a-f3b8eb22dd33 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:19.442547 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ab45e19-a1fd-49b5-a2f3-fc6d44a4513c tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077032 Jul 18 12:50:19.452230 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 116/238] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:19.474940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91306970-2a6b-4943-9c7c-03495de210c1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:19.480403 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:19.480403 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:19.502896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91306970-2a6b-4943-9c7c-03495de210c1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.505851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91306970-2a6b-4943-9c7c-03495de210c1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.533611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.536579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.537872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.540551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.689877 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ca565b1-b1db-41f4-8044-cf76882689f2 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 328 microversion: 2.1 time: 0.358542 Jul 18 12:50:19.691629 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 123/239] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:19 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 328 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:19.697456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:19.698531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:19.736652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.739956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.741056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.742030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.829469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91306970-2a6b-4943-9c7c-03495de210c1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.372019 Jul 18 12:50:19.830283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 117/240] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:19.844757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-517f8bb6-57ca-483e-8418-5ec873828aeb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:19.846282 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:19.846282 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:19.878067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-517f8bb6-57ca-483e-8418-5ec873828aeb tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.037304 Jul 18 12:50:19.880340 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 118/241] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:50:19 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:19.897077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27ae92ae-01ab-4a8e-a0f1-eb1ad189e7f6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:19.899267 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:19.899267 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:19.919659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ae92ae-01ab-4a8e-a0f1-eb1ad189e7f6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:19.920112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ae92ae-01ab-4a8e-a0f1-eb1ad189e7f6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:19.958634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:20.170394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27ae92ae-01ab-4a8e-a0f1-eb1ad189e7f6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.278890 Jul 18 12:50:20.171600 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 119/242] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:20.185250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-123797363", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:20.306480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:20.524161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:20.547200 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07fcdab1-9d5d-439c-a438-e0fc8f22b53c tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 0.853354 Jul 18 12:50:20.560042 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 124/243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:19 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:20.567105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d385ec68-64b2-4037-9ff1-ef4f5492d402 req-d5d40310-99da-49ef-8c78-712a4cc9957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83f01e4-6329-49e1-a8aa-9669ae6577b8", "tag": "a1037c76-93cb-4565-b496-9fb6fb3d2de3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:20.579917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d385ec68-64b2-4037-9ff1-ef4f5492d402 req-d5d40310-99da-49ef-8c78-712a4cc9957e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:20.581174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d385ec68-64b2-4037-9ff1-ef4f5492d402 req-d5d40310-99da-49ef-8c78-712a4cc9957e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:20.602732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d385ec68-64b2-4037-9ff1-ef4f5492d402 req-d5d40310-99da-49ef-8c78-712a4cc9957e service nova] Creating event network-changed:a1037c76-93cb-4565-b496-9fb6fb3d2de3 for instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 on n-h2-850003-3 Jul 18 12:50:20.610821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d385ec68-64b2-4037-9ff1-ef4f5492d402 req-d5d40310-99da-49ef-8c78-712a4cc9957e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048257 Jul 18 12:50:20.612097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 125/244] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:20.619294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b83dd35e-cdcd-4dbe-ace2-fd2d4c5e9fa4 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:20.620671 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:20.620671 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:20.662981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b83dd35e-cdcd-4dbe-ace2-fd2d4c5e9fa4 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.048990 Jul 18 12:50:20.663830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 126/245] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:20 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:20.680621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:20.681416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:20.696240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:20.697431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:20.698809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:20.699590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:20.918968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:20.930909 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5f24afd-ed7a-414f-b110-5b965c43d649 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.266101 Jul 18 12:50:20.931518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 127/246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:20 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:20.959830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f27e908-763c-4eee-b29e-2505220ff8ac tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-364747432"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:20.965578 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:20.965578 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:20.974130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-5f27e908-763c-4eee-b29e-2505220ff8ac tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid b233b6cc-49c0-49ec-a0ca-d3dcb113fdd5 for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:21.069360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f27e908-763c-4eee-b29e-2505220ff8ac tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.129673 Jul 18 12:50:21.070875 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 128/247] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:21.087772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa90490a-20fa-4ed2-ab70-61174d193c49 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:21.092326 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:21.092326 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:21.117969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa90490a-20fa-4ed2-ab70-61174d193c49 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.120277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa90490a-20fa-4ed2-ab70-61174d193c49 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.461762 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa90490a-20fa-4ed2-ab70-61174d193c49 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.380858 Jul 18 12:50:21.464052 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 129/248] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:21.484995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-daecc256-c0d2-471e-961f-b428d79382b5 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:21.487975 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:21.487975 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:21.498778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:21.500090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:21.501103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:21.501697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:21.502624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:21.514455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=89,nova_api:DELETE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:21.532883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.533346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.534509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daecc256-c0d2-471e-961f-b428d79382b5 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.536138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.536929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daecc256-c0d2-471e-961f-b428d79382b5 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.539077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.601561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:21.612135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for user 28d7b628ceb4452d81c22fadbd77c6d3 and project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:21.637633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.utils [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] instances quota exceeded for 930ef2eec94b46529d52aaa0c268926a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131366) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 12:50:21.644642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Request method failure captured: Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 144 Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcBvjsUPR4Rmw8XuHYy8bXXwwiOPaNlP9ozA9jlsLmQGyWD3pZiVA4z-m9zsdmGNRy07DZ4u8ACd0A0RK2zSfktQ8_pleCf5key65bYta9ymuqdzZvCh6a2dyqenpt4BOFKix6F6BtS9bwjoP0slVmJr9LLetbjhDZZ4WhiWqwmp3Y Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:21.650824 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_930ef2eec94b46529d52aaa0c268926a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28d7b628ceb4452d81c22fadbd77c6d3 Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-123797363", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} Jul 18 12:50:21.652851 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-123797363', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452'}}} Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 12:50:21.653778 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:21.655263 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.658521 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 12:50:21.662953 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:21.665535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:21.666936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3a1083dc-b23b-45f3-af67-fd5cefe84ffb tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.491399 Jul 18 12:50:21.667773 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 120/249] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 1496 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:21.674460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:21.675766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:21.692719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.695465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.698415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:21.701683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:21.926979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-daecc256-c0d2-471e-961f-b428d79382b5 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.448324 Jul 18 12:50:21.936677 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 130/250] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:21.941182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e523c790>, body: {"quota_set": {"instances": 10}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:22.431163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:22.433622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:22.444934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:22.445433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:22.639889 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6c83c1c4-4eb8-4a33-a749-bf768580911f tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 329 microversion: 2.1 time: 0.709306 Jul 18 12:50:22.650628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 131/251] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:21 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 329 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:22.656629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b10df4a4-4546-4220-935b-6a1b463bd72c tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:22.657578 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:22.657578 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:22.709573 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b10df4a4-4546-4220-935b-6a1b463bd72c tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.056790 Jul 18 12:50:22.710758 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 132/252] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:22.725653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:22.727997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:22.745184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:22.745648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:22.746516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:22.746963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:22.756924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:22.761945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:22.796341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc0d47bc-d99d-4f62-8679-d1d3b208c2cd tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 1.126824 Jul 18 12:50:22.804243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 121/253] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:21 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:22.812078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59bfd635-d7f4-4da8-bfae-2a71cb32afda tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Calling method '.version_select at 0x7f96e5395af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:23.086431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59bfd635-d7f4-4da8-bfae-2a71cb32afda tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 371 microversion: 2.1 time: 0.279978 Jul 18 12:50:23.087501 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 122/254] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 12:50:22 2022] GET /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:23.103230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3664f651-1a28-43ca-ab2a-a87961c0a2f0 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1204425565"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:23.107382 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:23.107382 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:23.113337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-3664f651-1a28-43ca-ab2a-a87961c0a2f0 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid 57187d40-7776-4fe4-a0ad-f2f95cecdfa3 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:23.203972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3664f651-1a28-43ca-ab2a-a87961c0a2f0 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.105526 Jul 18 12:50:23.205100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 123/255] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:23.222414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90975e73-3547-41ea-ad5e-591ab96b0cb5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1536511271"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:23.225444 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:23.225444 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:23.227845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-90975e73-3547-41ea-ad5e-591ab96b0cb5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Generated uuid 07505fd5-5b5b-4450-8dc3-3739af1c23b4 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:23.293173 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90975e73-3547-41ea-ad5e-591ab96b0cb5 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.078536 Jul 18 12:50:23.294714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 124/256] 10.222.0.88 () {62 vars in 1204 bytes} [Mon Jul 18 12:50:23 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:23.301206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e54aab80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:23.752395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:23.753076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:23.755024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:23.755764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:23.916695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:23.918680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72073ecb-1de2-4a7d-a313-8a44f808a370 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 325 microversion: 2.1 time: 0.622118 Jul 18 12:50:23.919808 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 125/257] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:23 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 325 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:23.927109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9eaef36-2f86-4532-9a6b-4452d0450b97 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:23.928726 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:23.928726 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:24.005839 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9eaef36-2f86-4532-9a6b-4452d0450b97 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.084235 Jul 18 12:50:24.009765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 126/258] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:24.037194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20d50d9b-da40-41bd-9950-6118da893d71 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-825849036"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:24.151029 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:24.151029 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:24.208889 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20d50d9b-da40-41bd-9950-6118da893d71 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.195987 Jul 18 12:50:24.209854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 127/259] 10.222.0.88 () {62 vars in 1209 bytes} [Mon Jul 18 12:50:24 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:24.217264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:24.217888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:24.236153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:24.236607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:24.237419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:24.237858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:24.509121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:24.543493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0682cd51-c510-48ad-842c-8399036f680f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 1.831132 Jul 18 12:50:24.545184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 133/260] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:22 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:24.553351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-926a7fa0-a7ae-48a8-a775-631871219f41 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:24.554200 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:24.554200 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:24.593491 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-926a7fa0-a7ae-48a8-a775-631871219f41 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-926a7fa0-a7ae-48a8-a775-631871219f41 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Request method failure captured: Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbJr5-6ApsIZCWbcdg3fTqtnEjTAO3Okqzpz5ROH5bJwgho9d2QwbkENPTkyXcDIrdo4L3jqNfXqbw0WiUkJHVa79zXbLnFEXiec5-rnKZsQWZaszQ_HzlqM2u1PY48cnwqTfi333mUWRY2aORgbLhiYXbUnwX4NJjfA8TxbKz2cwQ Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:24.602172 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca99d25d45ff4145838015678f2d4944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1ed79fbeffda404da074d6c3d9379ee0 Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: exception: Aggregate 5 could not be found. Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5'} Jul 18 12:50:24.604445 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:24.607026 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 18 12:50:24.610288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:24.621355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-926a7fa0-a7ae-48a8-a775-631871219f41 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:24.623497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-926a7fa0-a7ae-48a8-a775-631871219f41 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.076548 Jul 18 12:50:24.626284 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 134/261] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:50:24 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:24.676995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-976007843", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:24.938772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:25.235013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:25.265196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00ec4ca2-b7a1-465e-9200-773350423c91 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 1.052183 Jul 18 12:50:25.266469 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 128/262] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:24 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:25.300844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14f4aab3-a1c7-4834-ad0e-832c169032a2 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:25.304799 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:25.304799 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:25.334579 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14f4aab3-a1c7-4834-ad0e-832c169032a2 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.050611 Jul 18 12:50:25.336123 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 129/263] 10.222.0.88 () {60 vars in 1189 bytes} [Mon Jul 18 12:50:25 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:25.354315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1431f35-6cf0-4cdd-a3cd-9ee542bf0877 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:25.355947 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:25.355947 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:25.398096 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b1431f35-6cf0-4cdd-a3cd-9ee542bf0877 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1431f35-6cf0-4cdd-a3cd-9ee542bf0877 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Request method failure captured: Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJr5-6ApsIZCWbcdg3fTqtnEjTAO3Okqzpz5ROH5bJwgho9d2QwbkENPTkyXcDIrdo4L3jqNfXqbw0WiUkJHVa79zXbLnFEXiec5-rnKZsQWZaszQ_HzlqM2u1PY48cnwqTfi333mUWRY2aORgbLhiYXbUnwX4NJjfA8TxbKz2cwQ Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:25.402814 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca99d25d45ff4145838015678f2d4944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1ed79fbeffda404da074d6c3d9379ee0 Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: exception: Aggregate 5 could not be found. Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '5'} Jul 18 12:50:25.405550 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:25.407262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:25.410329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:25.412984 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:25.412984 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:25.412984 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:25.412984 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 18 12:50:25.412984 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:25.416759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1431f35-6cf0-4cdd-a3cd-9ee542bf0877 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:25.418540 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1431f35-6cf0-4cdd-a3cd-9ee542bf0877 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.080615 Jul 18 12:50:25.430056 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 130/264] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:25 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:25.476277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfdaa948-99fc-451e-bf55-8497adedc64d tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:25.489292 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:25.489292 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:25.561722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfdaa948-99fc-451e-bf55-8497adedc64d tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:25.563451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfdaa948-99fc-451e-bf55-8497adedc64d tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.047322 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfdaa948-99fc-451e-bf55-8497adedc64d tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.619203 Jul 18 12:50:26.050602 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 131/265] 10.222.0.88 () {62 vars in 1231 bytes} [Mon Jul 18 12:50:25 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:26.069569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:26.070388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:26.070838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:26.071374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:26.071894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:26.086513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d744f1ce-68e7-4229-a0dc-dd95251664bd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1366533490", "name": "tempest-test_aggregate-1212459497"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:26.095814 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:26.095814 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:26.097682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-d744f1ce-68e7-4229-a0dc-dd95251664bd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid a6463960-e139-4f71-90ea-d5086140dd8b for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:26.118398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:26.129022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.130759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:26.135985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.234661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:26.235243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d744f1ce-68e7-4229-a0dc-dd95251664bd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.170380 Jul 18 12:50:26.248395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 132/266] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 18 12:50:26 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:26.258403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Getting quotas for user 28d7b628ceb4452d81c22fadbd77c6d3 and project 930ef2eec94b46529d52aaa0c268926a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:26.275417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:26.282943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:26.301842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:26.318129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.utils [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] ram quota exceeded for 930ef2eec94b46529d52aaa0c268926a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131367) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 12:50:26.318712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.321350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:26.321894 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Request method failure captured: Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 144 Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcBvjsUPR4Rmw8XuHYy8bXXwwiOPaNlP9ozA9jlsLmQGyWD3pZiVA4z-m9zsdmGNRy07DZ4u8ACd0A0RK2zSfktQ8_pleCf5key65bYta9ymuqdzZvCh6a2dyqenpt4BOFKix6F6BtS9bwjoP0slVmJr9LLetbjhDZZ4WhiWqwmp3Y Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:26.324598 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_930ef2eec94b46529d52aaa0c268926a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28d7b628ceb4452d81c22fadbd77c6d3 Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-976007843", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} Jul 18 12:50:26.327204 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-976007843', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452'}}} Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 12:50:26.328870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:26.330942 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.333315 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 12:50:26.335783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:26.338389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.340593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:26.357288 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-132d7281-5188-4fbb-9b27-1163e67d6628 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.722819 Jul 18 12:50:26.358617 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 135/267] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:24 2022] POST /compute/v2.1/servers => generated 110 bytes in 1731 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:26.367988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fed2317-f01b-4201-9273-6e6dd237c664 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:26.379895 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:26.379895 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:26.438821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fed2317-f01b-4201-9273-6e6dd237c664 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:26.442109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fed2317-f01b-4201-9273-6e6dd237c664 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:26.856165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:26.870963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d5de5b6-3aee-446a-93a4-7b213c696e62 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.618285 Jul 18 12:50:26.875932 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 133/268] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:26 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:26.893646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8970dc8-21fe-4d7c-b261-1cc63c345d39 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:26.895379 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:26.895379 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:26.919031 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fed2317-f01b-4201-9273-6e6dd237c664 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.558059 Jul 18 12:50:26.923990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 136/269] 10.222.0.88 () {62 vars in 1231 bytes} [Mon Jul 18 12:50:26 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:26.941559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8970dc8-21fe-4d7c-b261-1cc63c345d39 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.059481 Jul 18 12:50:26.946241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 134/270] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:26 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:26.950062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:26.958191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:26.960352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Action: 'update', calling method: .version_select at 0x7f96e515d430>, body: {"quota_set": {"ram": 51200}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:27.004583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:27.008794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:27.012312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:27.017399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:27.603014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:27.603801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:27.605369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:27.605903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:27.742828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42f63549-22c2-4adc-9559-19ffc232b192 tempest-QuotasAdminNegativeTest-116118005 tempest-QuotasAdminNegativeTest-116118005-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 200 len: 329 microversion: 2.1 time: 0.794552 Jul 18 12:50:27.754535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 135/271] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:26 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 329 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:27.767403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-52eb483d-b4b1-4cbe-923e-521ec2d127f0 req-004afa0a-a070-40ec-a6ab-1b79991eb1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b147194b-0153-47c3-b2ed-1f398764e2d6", "name": "network-vif-plugged", "status": "completed", "tag": "8623e45a-b41b-491e-9309-51d84fa4dfc1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:27.794418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-52eb483d-b4b1-4cbe-923e-521ec2d127f0 req-004afa0a-a070-40ec-a6ab-1b79991eb1dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:27.802520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-52eb483d-b4b1-4cbe-923e-521ec2d127f0 req-004afa0a-a070-40ec-a6ab-1b79991eb1dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:27.840952 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-52eb483d-b4b1-4cbe-923e-521ec2d127f0 req-004afa0a-a070-40ec-a6ab-1b79991eb1dd service nova] Creating event network-vif-plugged:8623e45a-b41b-491e-9309-51d84fa4dfc1 for instance b147194b-0153-47c3-b2ed-1f398764e2d6 on n-h1-850003-3 Jul 18 12:50:27.871002 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-52eb483d-b4b1-4cbe-923e-521ec2d127f0 req-004afa0a-a070-40ec-a6ab-1b79991eb1dd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124969 Jul 18 12:50:27.872419 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 136/272] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:27.904233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:27.905000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-83eb1021-7ea6-4be7-b8b5-c43c136f3419 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:27.905000 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:27.905000 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:27.923085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-df46fb72-23ca-4a27-9038-4e2f5fa4dae2 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 0.995519 Jul 18 12:50:27.924168 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 137/273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:26 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:27.973663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31ab0db2-d1fc-4208-aa4f-01f1007dbafd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:27.975521 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:27.975521 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:27.994393 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-83eb1021-7ea6-4be7-b8b5-c43c136f3419 tempest-AggregatesAdminTestV241-1238838286 tempest-AggregatesAdminTestV241-1238838286-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.119201 Jul 18 12:50:27.995877 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 137/274] 10.222.0.88 () {60 vars in 1192 bytes} [Mon Jul 18 12:50:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:28.021934 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-31ab0db2-d1fc-4208-aa4f-01f1007dbafd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31ab0db2-d1fc-4208-aa4f-01f1007dbafd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Request method failure captured: Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbJr5-6ApsIZCWbcdg3fTqtnEjTAO3Okqzpz5ROH5bJwgho9d2QwbkENPTkyXcDIrdo4L3jqNfXqbw0WiUkJHVa79zXbLnFEXiec5-rnKZsQWZaszQ_HzlqM2u1PY48cnwqTfi333mUWRY2aORgbLhiYXbUnwX4NJjfA8TxbKz2cwQ Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:28.025323 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca99d25d45ff4145838015678f2d4944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1ed79fbeffda404da074d6c3d9379ee0 Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: exception: Aggregate 7 could not be found. Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7'} Jul 18 12:50:28.026578 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.027346 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 18 12:50:28.028498 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.047361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31ab0db2-d1fc-4208-aa4f-01f1007dbafd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:28.049173 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-31ab0db2-d1fc-4208-aa4f-01f1007dbafd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.123141 Jul 18 12:50:28.050200 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 138/275] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:50:27 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:28.080906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9696739-41b5-4184-8581-ff53e1f88c17 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Action: 'update', calling method: .version_select at 0x7f96e52ae700>, body: {"quota_set": {"ram": 0}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:28.097222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d9696739-41b5-4184-8581-ff53e1f88c17 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '28d7b628ceb4452d81c22fadbd77c6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930ef2eec94b46529d52aaa0c268926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9696739-41b5-4184-8581-ff53e1f88c17 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Request method failure captured: Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a HTTP/1.1 Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 25 Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcBvjsUPR4Rmw8XuHYy8bXXwwiOPaNlP9ozA9jlsLmQGyWD3pZiVA4z-m9zsdmGNRy07DZ4u8ACd0A0RK2zSfktQ8_pleCf5key65bYta9ymuqdzZvCh6a2dyqenpt4BOFKix6F6BtS9bwjoP0slVmJr9LLetbjhDZZ4WhiWqwmp3Y Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:28.101341 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_930ef2eec94b46529d52aaa0c268926a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/930ef2eec94b46529d52aaa0c268926a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 930ef2eec94b46529d52aaa0c268926a Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2120942529 Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28d7b628ceb4452d81c22fadbd77c6d3 Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-QuotasAdminNegativeTest-2120942529-project Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: {"quota_set": {"ram": 0}} Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 12:50:28.102929 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '930ef2eec94b46529d52aaa0c268926a', 'body': {'quota_set': {'ram': 0}}} Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:28.103974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.104952 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9696739-41b5-4184-8581-ff53e1f88c17 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9696739-41b5-4184-8581-ff53e1f88c17 tempest-QuotasAdminNegativeTest-2120942529 tempest-QuotasAdminNegativeTest-2120942529-project] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a" status: 403 len: 116 microversion: 2.1 time: 0.052511 Jul 18 12:50:28.106323 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 139/276] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 12:50:28 2022] PUT /compute/v2.1/os-quota-sets/930ef2eec94b46529d52aaa0c268926a => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:28.121257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:28.122649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:28.166617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:28.167445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:28.168918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:28.169724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:28.196210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63c57661-3de8-46e0-97db-7076330718c7 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:28.198300 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:28.198300 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:28.204966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-63c57661-3de8-46e0-97db-7076330718c7 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63c57661-3de8-46e0-97db-7076330718c7 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin] Request method failure captured: Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcTKw1tC7Zo2t5vP_9fxqHEWj-9nTVw7f83-qQKpZ89ey1ysBU9XX4Tezs8xQLC9U03tsfFjuWotJOv4iYeH-N1Ij7U1XZDJXgmsf2zh1tTXv_HYf4SodG93YfHiLeSxMxE0v3j4GOtxX9VU7IeSIbeykP8ZW1orDhTubbW8kXllRE Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: abc5ff11534245d28f30bf7e1361eb7a Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:28.231635 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/abc5ff11534245d28f30bf7e1361eb7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/abc5ff11534245d28f30bf7e1361eb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_abc5ff11534245d28f30bf7e1361eb7a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/abc5ff11534245d28f30bf7e1361eb7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: abc5ff11534245d28f30bf7e1361eb7a Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 160e0cb359ed40979f77e83f68c9f0c7 Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid timestamp for date invalid_time Jul 18 12:50:28.234935 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'invalid_time'} Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:28.237699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 18 12:50:28.242704 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.248053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63c57661-3de8-46e0-97db-7076330718c7 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:28.249483 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63c57661-3de8-46e0-97db-7076330718c7 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609 tempest-InstanceUsageAuditLogNegativeTestJSON-336104609-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.251979 Jul 18 12:50:28.252582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 138/277] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jul 18 12:50:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:50:28.269446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23123524-5381-4aba-95fa-2d447b97720a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:28.271565 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:28.271565 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:28.295157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-23123524-5381-4aba-95fa-2d447b97720a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23123524-5381-4aba-95fa-2d447b97720a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Request method failure captured: Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbJr5-6ApsIZCWbcdg3fTqtnEjTAO3Okqzpz5ROH5bJwgho9d2QwbkENPTkyXcDIrdo4L3jqNfXqbw0WiUkJHVa79zXbLnFEXiec5-rnKZsQWZaszQ_HzlqM2u1PY48cnwqTfi333mUWRY2aORgbLhiYXbUnwX4NJjfA8TxbKz2cwQ Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:28.299812 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca99d25d45ff4145838015678f2d4944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca99d25d45ff4145838015678f2d4944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ca99d25d45ff4145838015678f2d4944 Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1238027706 Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1ed79fbeffda404da074d6c3d9379ee0 Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminTestJSON-1238027706-project-admin Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: exception: Aggregate 7 could not be found. Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '7'} Jul 18 12:50:28.301330 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:28.302007 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:28.303132 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:28.307678 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:28.307678 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:28.307678 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:28.307678 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 18 12:50:28.307678 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:28.319492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23123524-5381-4aba-95fa-2d447b97720a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:28.321080 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23123524-5381-4aba-95fa-2d447b97720a tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.059178 Jul 18 12:50:28.326760 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 139/278] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:28.869162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:28.887502 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-55d7ee9d-fe00-4679-bd82-73cbb3d3a8d5 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.775208 Jul 18 12:50:28.891299 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 140/279] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:28 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:28.900216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09fee596-a703-4273-bab8-d477763b9efe tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-778763731"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:28.901743 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:28.901743 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:28.902726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-09fee596-a703-4273-bab8-d477763b9efe tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid b4d5ba4f-f0e9-4528-abb5-28857f95e5ec for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:28.980161 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09fee596-a703-4273-bab8-d477763b9efe tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.087255 Jul 18 12:50:28.987040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 141/280] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:29.006771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.013327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:29.038234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:29.043008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:29.044245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:29.044901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:29.386125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:29.401289 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-89fdbd30-dc81-41bc-9850-3e0f64a6f5f0 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 0.412178 Jul 18 12:50:29.401929 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 142/281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:28 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:29.419106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dbab8b1a-7c21-44f4-a9c7-1a7fa9676899 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.419106 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.419106 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:29.437698 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dbab8b1a-7c21-44f4-a9c7-1a7fa9676899 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.030909 Jul 18 12:50:29.438450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 143/282] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:50:29 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:29.460971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dafac8d6-86ed-4db0-8db4-82f6b5b087bd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:29.462544 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.462544 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:29.492004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6c0c047-bf22-4d5b-9db0-be5154b50eb9 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.493789 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.493789 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:29.496481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6c0c047-bf22-4d5b-9db0-be5154b50eb9 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '125838fc31f14676acd1d8c106bb64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb561746b7f456bb8be5fae763fe596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6c0c047-bf22-4d5b-9db0-be5154b50eb9 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Request method failure captured: Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcQdpBpr61XEHpEJIRGQPTehOqV7m4ZcXBWa0miBPTHKijc_HEBtr3wuA6YcGoG9nXAjZhKctrBULoL0dm8ZoCUK53Su0hwSbT86cTlSnoJgKik0byhOblT-57Vd8BIrKOxBLaaMK96217IFDkKA0ERvQKfqFaYSO0-4xE7EoXk1ZY Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0bb561746b7f456bb8be5fae763fe596 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:29.501974 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0bb561746b7f456bb8be5fae763fe596", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0bb561746b7f456bb8be5fae763fe596 Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 125838fc31f14676acd1d8c106bb64e0 Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:29.503435 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: action_args: {} Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:29.504181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 12:50:29.505511 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.510241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6c0c047-bf22-4d5b-9db0-be5154b50eb9 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:29.512236 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6c0c047-bf22-4d5b-9db0-be5154b50eb9 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 1.183954 Jul 18 12:50:29.513452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 140/283] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:50:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 1186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:29.531984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c19b663-31d2-4c78-9a04-e7a541171eb8 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.534339 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dafac8d6-86ed-4db0-8db4-82f6b5b087bd tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.078873 Jul 18 12:50:29.535293 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 144/284] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 12:50:29 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:29.535922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c19b663-31d2-4c78-9a04-e7a541171eb8 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '125838fc31f14676acd1d8c106bb64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb561746b7f456bb8be5fae763fe596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c19b663-31d2-4c78-9a04-e7a541171eb8 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Request method failure captured: Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2012:50:29 HTTP/1.1 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcQdpBpr61XEHpEJIRGQPTehOqV7m4ZcXBWa0miBPTHKijc_HEBtr3wuA6YcGoG9nXAjZhKctrBULoL0dm8ZoCUK53Su0hwSbT86cTlSnoJgKik0byhOblT-57Vd8BIrKOxBLaaMK96217IFDkKA0ERvQKfqFaYSO0-4xE7EoXk1ZY Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0bb561746b7f456bb8be5fae763fe596 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:29.538592 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0bb561746b7f456bb8be5fae763fe596", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bb561746b7f456bb8be5fae763fe596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0bb561746b7f456bb8be5fae763fe596 Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 125838fc31f14676acd1d8c106bb64e0 Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:29.539920 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '2022-07-18 12:50:29'} Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:29.540518 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 12:50:29.541606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:29.545102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c19b663-31d2-4c78-9a04-e7a541171eb8 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:29.545968 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c19b663-31d2-4c78-9a04-e7a541171eb8 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979 tempest-InstanceUsageAuditLogNegativeTestJSON-1033862979-project] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 12:50:29" status: 403 len: 128 microversion: 2.1 time: 0.020720 Jul 18 12:50:29.546619 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 141/285] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 12:50:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2012%3A50%3A29 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:29.547896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7153de8f-a190-40a0-8757-43d02d7b9771 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.548783 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.548783 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:29.566645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7153de8f-a190-40a0-8757-43d02d7b9771 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.022136 Jul 18 12:50:29.575220 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 145/286] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:50:29 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:29.586923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0327c132-b438-4ecf-8e66-9c576bc2b15d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.632661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0327c132-b438-4ecf-8e66-9c576bc2b15d tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.052649 Jul 18 12:50:29.634093 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 142/287] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 12:50:29.646494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-696463b7-3ca0-49af-b47c-23134e46c2f3 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1947613441", "availability_zone": "tempest-test_az-1463126481"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:29.676052 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.676052 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:29.679230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-696463b7-3ca0-49af-b47c-23134e46c2f3 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid b5e30839-63b5-4429-9ec1-1cd9b727e62c for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:29.724129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-696463b7-3ca0-49af-b47c-23134e46c2f3 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.080062 Jul 18 12:50:29.724926 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 146/288] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 18 12:50:29 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:29.742276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe367fc-bfb1-4efd-abca-e2480810724b tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1947613441_new", "availability_zone": "tempest-test_az-1463126481_new"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:29.744166 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.744166 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:29.826929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe367fc-bfb1-4efd-abca-e2480810724b tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:29.829491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe367fc-bfb1-4efd-abca-e2480810724b tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:29.877815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afe367fc-bfb1-4efd-abca-e2480810724b tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.139978 Jul 18 12:50:29.879196 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 143/289] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:50:29 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:50:29.893119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd118ae6-17b2-4a14-a659-cf5981e32eba tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.899495 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.899495 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:29.925116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.926625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:29.928853 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd118ae6-17b2-4a14-a659-cf5981e32eba tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.042595 Jul 18 12:50:29.938925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 147/290] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:50:29 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:29.951697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:29.953552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:29.954721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:29.955199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:29.968581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-992270a7-df92-4d5c-8a7e-797c64fcf3b8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:29.971531 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:29.971531 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:30.081383 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-992270a7-df92-4d5c-8a7e-797c64fcf3b8 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.132400 Jul 18 12:50:30.093101 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 148/291] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:29 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 12:50:30.127712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffd1f372-84d9-438e-b999-c7c826ca3063 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1424465610"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:30.134179 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:30.134179 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:30.138770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-ffd1f372-84d9-438e-b999-c7c826ca3063 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Generated uuid 23d42ee0-01ff-47b2-ac1a-f63bd42b2923 for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:30.219658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffd1f372-84d9-438e-b999-c7c826ca3063 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.113489 Jul 18 12:50:30.226255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 149/292] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:30.258845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa65f610-16bc-47b6-a6fb-41c1e9c8e1f1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:30.260656 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:30.260656 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:30.301942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa65f610-16bc-47b6-a6fb-41c1e9c8e1f1 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.064728 Jul 18 12:50:30.314468 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 150/293] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:50:30 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:30.325293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de1ee7e0-23f4-4483-bdf2-5b4b9b168ff6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:30.326066 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:30.326066 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:30.348701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:30.382902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de1ee7e0-23f4-4483-bdf2-5b4b9b168ff6 tempest-AggregatesAdminTestJSON-1238027706 tempest-AggregatesAdminTestJSON-1238027706-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.061240 Jul 18 12:50:30.384148 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 151/294] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:30 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 12:50:30.397161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:30.408515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:30.415296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:30.422229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.427363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.428449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.429072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.435524 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fcb46645-80e9-4760-ba82-c7dc2120ba08 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1389 microversion: 2.1 time: 0.520500 Jul 18 12:50:30.436125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 144/295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:29 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1389 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:30.456813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:30.457441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:30.479741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] HTTP exception thrown: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Request method failure captured: Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 HTTP/1.1 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbGda4LBHFBhHFL1X0RLgOYJtoF_kh3bTroKevCkyZmWXgL2dX2hZpDc6cQQzjhQQ3I1qYUzSI1KUJiAu_2wWILl0coVmVnOWwnwSMUeaIdkAtTanhXfxuYiVLrkisVnR_84uVndewP5RUQzx-tnC7G1hHKHJspaWje8xdBWOrLSN4 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:30.481329 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4f632c11ac594f4ab80777f0736c091d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 428dc0f106214c48b12e795b26862164 Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.482662 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5a533c01-673a-413d-b492-63a1617e19d9'} Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:30.483342 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.485011 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.490044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Returning 404 to user: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:30.490605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.491177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.492123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.492675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.506061 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6953112c-84b5-4364-a3a8-74abb5be99f7 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 404 len: 111 microversion: 2.1 time: 0.109188 Jul 18 12:50:30.513251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 152/296] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:30 2022] DELETE /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:50:30.567797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:30.573486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] [instance: 5a533c01-673a-413d-b492-63a1617e19d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:30.653455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.663875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.666491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:30.667060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:30.798965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] HTTP exception thrown: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Request method failure captured: Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 HTTP/1.1 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbGda4LBHFBhHFL1X0RLgOYJtoF_kh3bTroKevCkyZmWXgL2dX2hZpDc6cQQzjhQQ3I1qYUzSI1KUJiAu_2wWILl0coVmVnOWwnwSMUeaIdkAtTanhXfxuYiVLrkisVnR_84uVndewP5RUQzx-tnC7G1hHKHJspaWje8xdBWOrLSN4 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:30.811792 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4f632c11ac594f4ab80777f0736c091d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4f632c11ac594f4ab80777f0736c091d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4f632c11ac594f4ab80777f0736c091d Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-697757095 Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 428dc0f106214c48b12e795b26862164 Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminTestJSON-697757095-project Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.813052 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5a533c01-673a-413d-b492-63a1617e19d9'} Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:30.814756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. Jul 18 12:50:30.816543 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:30.818779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] Returning 404 to user: Instance 5a533c01-673a-413d-b492-63a1617e19d9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:30.868771 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee6ec3ee-f489-4db2-a5bd-88674e7d9a13 tempest-AggregatesAdminTestJSON-697757095 tempest-AggregatesAdminTestJSON-697757095-project] 10.222.0.88 "GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9" status: 404 len: 111 microversion: 2.1 time: 0.337913 Jul 18 12:50:30.888493 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 153/297] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:30 2022] GET /compute/v2.1/servers/5a533c01-673a-413d-b492-63a1617e19d9 => generated 111 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:31.125621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:31.140840 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-31e34990-930b-4671-b108-cba9eb9f401f tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 0.699376 Jul 18 12:50:31.141649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 145/298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:30 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:31.390666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0c37cdaa-f6f7-4240-8829-0e547f105372 req-045eb0a6-2b13-42c8-b397-50942474d710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83f01e4-6329-49e1-a8aa-9669ae6577b8", "name": "network-vif-plugged", "status": "completed", "tag": "a1037c76-93cb-4565-b496-9fb6fb3d2de3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:31.424213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0c37cdaa-f6f7-4240-8829-0e547f105372 req-045eb0a6-2b13-42c8-b397-50942474d710 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:31.425807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0c37cdaa-f6f7-4240-8829-0e547f105372 req-045eb0a6-2b13-42c8-b397-50942474d710 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:31.467181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:31.467885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:31.482713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:31.484410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:31.487769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:31.490676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:31.516403 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0c37cdaa-f6f7-4240-8829-0e547f105372 req-045eb0a6-2b13-42c8-b397-50942474d710 service nova] Creating event network-vif-plugged:a1037c76-93cb-4565-b496-9fb6fb3d2de3 for instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 on n-h2-850003-3 Jul 18 12:50:31.543104 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0c37cdaa-f6f7-4240-8829-0e547f105372 req-045eb0a6-2b13-42c8-b397-50942474d710 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154324 Jul 18 12:50:31.548002 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 154/299] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:31.862530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:31.872731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4432228a-08e7-4801-b1be-3b7f202e4da7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1588 microversion: 2.1 time: 0.411535 Jul 18 12:50:31.876133 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 146/300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:31 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1588 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:31.924331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:31.928123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:31.958373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:31.959284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:31.965872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:31.972009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:32.143533 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee549a7a-618b-4a22-a470-a1b8834c234e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234183 Jul 18 12:50:32.144857 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 155/301] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 12:50:31 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:32.180375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:32.181515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:32.211355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:32.213442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:32.220893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:32.223255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:34.090383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:34.123049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff959dbf-fd53-4521-9537-e46d7e2f7eb9 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1320 microversion: 2.1 time: 1.953504 Jul 18 12:50:34.131904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 147/302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:32 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1320 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:35.168990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:35.170077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:35.210969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:35.212174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:35.217288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:35.220339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:36.165935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:36.288749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=44 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:36.467806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:36.502971 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b872653-c600-4e98-86af-325387adc615 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1470 microversion: 2.1 time: 1.342830 Jul 18 12:50:36.504044 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 156/303] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:35 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1470 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:36.537008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:36.543570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:36.574753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:36.584234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:36.588099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:36.593497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:36.973844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4f03592-a037-4ef8-aa9f-4479380f5c72 tempest-DeleteServersAdminTestJSON-770088287 tempest-DeleteServersAdminTestJSON-770088287-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8/action" status: 202 len: 0 microversion: 2.1 time: 0.443499 Jul 18 12:50:36.976675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 148/304] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:50:36 2022] POST /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:50:36.991748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:36.992914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:37.018539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:37.019327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:37.020759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:37.021520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:37.233060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:37.236016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:37.242704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid c83f01e4-6329-49e1-a8aa-9669ae6577b8 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:38.119302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:38.164607 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b690ca31-8097-40e9-83fe-5ab0718166d3 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1453 microversion: 2.1 time: 1.181014 Jul 18 12:50:38.182930 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 157/305] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:36 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1453 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:38.204084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:38.205065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:38.210280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:38.211329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:38.252949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:38.253415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:38.254256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:38.258422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:38.353605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:50:38.624866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:UPDATE=4,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:38.645045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9020b8aa-9aae-4e7c-9e09-32f970ea57ea tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 204 len: 0 microversion: 2.1 time: 0.446438 Jul 18 12:50:38.648011 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 149/306] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:38 2022] DELETE /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:50:38.660108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:38.661570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:38.730649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:38.737111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:38.742891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:38.751934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:38.949899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:38.956767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:38.962007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid c83f01e4-6329-49e1-a8aa-9669ae6577b8 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:39.841893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:39.855896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:39.896627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:39.899240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:39.900023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:39.900224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:39.902755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:39.951330 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c30f07d-d7f9-4026-ac40-3b9c5b914a1d tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1459 microversion: 2.1 time: 1.292037 Jul 18 12:50:39.957108 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 158/307] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:38 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1459 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:39.994906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-54a49b55-966b-40c4-bce1-97cdfa9174ec req-c8e39f31-19ea-4dbd-8b72-3ac285ac5d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b147194b-0153-47c3-b2ed-1f398764e2d6", "tag": "8623e45a-b41b-491e-9309-51d84fa4dfc1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:40.053913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-54a49b55-966b-40c4-bce1-97cdfa9174ec req-c8e39f31-19ea-4dbd-8b72-3ac285ac5d67 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:40.059422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-54a49b55-966b-40c4-bce1-97cdfa9174ec req-c8e39f31-19ea-4dbd-8b72-3ac285ac5d67 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:40.118785 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-54a49b55-966b-40c4-bce1-97cdfa9174ec req-c8e39f31-19ea-4dbd-8b72-3ac285ac5d67 service nova] Creating event network-changed:8623e45a-b41b-491e-9309-51d84fa4dfc1 for instance b147194b-0153-47c3-b2ed-1f398764e2d6 on n-h1-850003-3 Jul 18 12:50:40.141538 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-54a49b55-966b-40c4-bce1-97cdfa9174ec req-c8e39f31-19ea-4dbd-8b72-3ac285ac5d67 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177557 Jul 18 12:50:40.147267 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 159/308] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:41.011050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:41.019678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:41.055104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:41.055917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:41.057409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:41.066278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:41.224778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:41.225599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:41.234138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid c83f01e4-6329-49e1-a8aa-9669ae6577b8 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:41.418251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:41.431394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0c91427-eb2a-4a25-8799-23728027c72f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 200 len: 1588 microversion: 2.1 time: 1.618409 Jul 18 12:50:41.436774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 150/309] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:39 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 1588 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:42.219845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:42.249570 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa00dc4f-c9d7-47ae-b01a-00bf08908132 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1459 microversion: 2.1 time: 1.266476 Jul 18 12:50:42.259911 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 160/310] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:40 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1459 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:43.270961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:43.271789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:43.287168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:43.289708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:43.291039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:43.293530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:43.383628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:43.390478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:43.391302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid c83f01e4-6329-49e1-a8aa-9669ae6577b8 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:43.910016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb04debb-f2b9-44f6-a0aa-3e0eebd1d242 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1865943466", "id": 1093000862, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:43.912233 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:43.912233 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:43.954108 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb04debb-f2b9-44f6-a0aa-3e0eebd1d242 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.520420 Jul 18 12:50:43.957613 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 161/311] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:50:43 2022] POST /compute/v2.1/flavors => generated 468 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:44.042472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:44.062277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:44.163458 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8e9ebdb-011e-4a28-84c4-d2f35fcde4f1 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1459 microversion: 2.1 time: 0.898307 Jul 18 12:50:44.177445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 151/312] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:43 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1459 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:44.880975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Action: 'update', calling method: .version_select at 0x7f96e517d550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:44.883477 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:44.883477 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:44.885333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:44.886643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:44.918175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:44.926870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:44.955897 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] HTTP exception thrown: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Request method failure captured: Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 HTTP/1.1 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 56 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcjkOn9EfkjoCYeiRyeolIow7zlcZND9k5L4d6vWa-qZv6Nk45kHytxXdxIFTcvvuHuy7MPnSsNpAes8BNV0BJWixvWQWdQNwnMtsXr9ewI8motNh5y5recBz7D9z3Demyfn7MPJYbzyDp-od3DrNS3-k6rbpXvAr2TRWEYxWaHRJ4 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:44.971152 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_37cce8c4f275469882ad1b7ca5186f0f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28ca4db078754f81bbb75c8314ff930b Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:44.972652 n-d-850003-3 devstack@n-api.service[131367]: exception: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1616c4ce-e23d-4b87-a28c-b7eb8ae18a42', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.973515 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:44.974841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:44.976064 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:44.976064 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:44.976064 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:44.980026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Returning 404 to user: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:44.985781 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65aa5eda-2388-4ad1-84a2-98eabcd3a1f7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42" status: 404 len: 110 microversion: 2.53 time: 1.026740 Jul 18 12:50:44.991050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 162/313] 10.222.0.88 () {62 vars in 1308 bytes} [Mon Jul 18 12:50:43 2022] PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 => generated 110 bytes in 1033 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:50:45.017799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-18a281c6-3d01-40b7-bced-80fd2e0c54e1 req-02d83b02-c845-4b9b-9119-8c58f929feab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83f01e4-6329-49e1-a8aa-9669ae6577b8", "name": "network-vif-deleted", "tag": "a1037c76-93cb-4565-b496-9fb6fb3d2de3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:45.053498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa911cae-fdae-408b-9cc6-e6e98d6dc22a tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.075771 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa911cae-fdae-408b-9cc6-e6e98d6dc22a tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] 10.222.0.88 "GET /compute/v2.1/flavors/1093000862" status: 200 len: 468 microversion: 2.61 time: 0.891941 Jul 18 12:50:45.076794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-18a281c6-3d01-40b7-bced-80fd2e0c54e1 req-02d83b02-c845-4b9b-9119-8c58f929feab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.078248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-18a281c6-3d01-40b7-bced-80fd2e0c54e1 req-02d83b02-c845-4b9b-9119-8c58f929feab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.082943 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 152/314] 10.222.0.88 () {60 vars in 1198 bytes} [Mon Jul 18 12:50:44 2022] GET /compute/v2.1/flavors/1093000862 => generated 468 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:45.101057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Action: 'update', calling method: .version_select at 0x7f96e5136040>, body: {"status": "disabled"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:45.105083 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.105083 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:45.113867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.115308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.118203 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-18a281c6-3d01-40b7-bced-80fd2e0c54e1 req-02d83b02-c845-4b9b-9119-8c58f929feab service nova] Creating event network-vif-deleted:a1037c76-93cb-4565-b496-9fb6fb3d2de3 for instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 on n-h2-850003-3 Jul 18 12:50:45.149103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-18a281c6-3d01-40b7-bced-80fd2e0c54e1 req-02d83b02-c845-4b9b-9119-8c58f929feab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152013 Jul 18 12:50:45.152944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.153921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.155794 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 163/315] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:45.176473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-409dba44-a57c-4e34-bf6d-a4097d70e200 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] Action: 'update', calling method: .version_select at 0x7f96e7589c10>, body: {"flavor": {"description": "new"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:45.196726 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] HTTP exception thrown: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Request method failure captured: Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 HTTP/1.1 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 22 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcjkOn9EfkjoCYeiRyeolIow7zlcZND9k5L4d6vWa-qZv6Nk45kHytxXdxIFTcvvuHuy7MPnSsNpAes8BNV0BJWixvWQWdQNwnMtsXr9ewI8motNh5y5recBz7D9z3Demyfn7MPJYbzyDp-od3DrNS3-k6rbpXvAr2TRWEYxWaHRJ4 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:45.208506 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_37cce8c4f275469882ad1b7ca5186f0f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28ca4db078754f81bbb75c8314ff930b Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: {"status": "disabled"} Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: exception: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.209843 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1616c4ce-e23d-4b87-a28c-b7eb8ae18a42', 'body': {'status': 'disabled'}} Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.210654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:45.211749 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:45.212799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.212799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.217067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Returning 404 to user: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:45.219639 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ce18eb8d-0315-4ba5-893b-a707127d33a6 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42" status: 404 len: 110 microversion: 2.53 time: 0.135178 Jul 18 12:50:45.220750 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.220750 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:45.230359 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 153/316] 10.222.0.88 () {62 vars in 1308 bytes} [Mon Jul 18 12:50:45 2022] PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 => generated 110 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:50:45.240256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.246273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:45.263844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.265574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.269616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.270719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.305002 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-409dba44-a57c-4e34-bf6d-a4097d70e200 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/1093000862" status: 200 len: 469 microversion: 2.61 time: 0.147715 Jul 18 12:50:45.312038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 164/317] 10.222.0.88 () {62 vars in 1218 bytes} [Mon Jul 18 12:50:45 2022] PUT /compute/v2.1/flavors/1093000862 => generated 469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:50:45.317109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Action: 'update', calling method: .version_select at 0x7f96e527daf0>, body: {"status": "enabled"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:45.324881 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.324881 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:45.326609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.330057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.352781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.353546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.377172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] HTTP exception thrown: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Request method failure captured: Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 HTTP/1.1 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 21 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcjkOn9EfkjoCYeiRyeolIow7zlcZND9k5L4d6vWa-qZv6Nk45kHytxXdxIFTcvvuHuy7MPnSsNpAes8BNV0BJWixvWQWdQNwnMtsXr9ewI8motNh5y5recBz7D9z3Demyfn7MPJYbzyDp-od3DrNS3-k6rbpXvAr2TRWEYxWaHRJ4 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:45.379466 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_37cce8c4f275469882ad1b7ca5186f0f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/37cce8c4f275469882ad1b7ca5186f0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 37cce8c4f275469882ad1b7ca5186f0f Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228 Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28ca4db078754f81bbb75c8314ff930b Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: {"status": "enabled"} Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: exception: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.382894 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1616c4ce-e23d-4b87-a28c-b7eb8ae18a42', 'body': {'status': 'enabled'}} Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.384958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:45.387831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:45.391643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. Jul 18 12:50:45.391643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:45.391643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Returning 404 to user: Service 1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:45.391643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69073d95-c21f-43b2-a71f-0f4deeeef1fb tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42" status: 404 len: 110 microversion: 2.53 time: 0.067780 Jul 18 12:50:45.391643 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 165/318] 10.222.0.88 () {62 vars in 1308 bytes} [Mon Jul 18 12:50:45 2022] PUT /compute/v2.1/os-services/1616c4ce-e23d-4b87-a28c-b7eb8ae18a42 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:50:45.397057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c860a18-f373-4ecc-a410-c919b6a543fc tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.462424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.463326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.464284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lazy-loading 'fault' on Instance uuid c83f01e4-6329-49e1-a8aa-9669ae6577b8 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:50:45.495492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c860a18-f373-4ecc-a410-c919b6a543fc tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.107688 Jul 18 12:50:45.501705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 166/319] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:45.519509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.524049 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.524049 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:45.532991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.534487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.537762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.540882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.693054 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47c75b9f-2114-4cc2-a6e9-6ebe1a921dc0 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.189355 Jul 18 12:50:45.698527 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 167/320] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:45.708891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca78fbb614783b68e6ae47c0c92d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d696868b7554f829b1b44c0f18d93c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:45.722840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad2cbbdf-f697-491d-8d5f-02bd8cbf8dd3 tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.736602 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37eceaca-9352-4195-b3ca-10fea0c0aeb4 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 200 len: 1310 microversion: 2.1 time: 0.497033 Jul 18 12:50:45.738127 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 154/321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 1310 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:45.778007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.785918 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.785918 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:45.793138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.799922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.804995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad2cbbdf-f697-491d-8d5f-02bd8cbf8dd3 tempest-FlavorsV261TestJSON-1230041307 tempest-FlavorsV261TestJSON-1230041307-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.104294 Jul 18 12:50:45.806379 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 168/322] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:45.806614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.813516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.836796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cca15bd-17a3-49e1-b0ce-ae877457ec40 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.839740 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.839740 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:45.895996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cca15bd-17a3-49e1-b0ce-ae877457ec40 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1093000862" status: 202 len: 0 microversion: 2.61 time: 0.068943 Jul 18 12:50:45.896605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 169/323] 10.222.0.88 () {60 vars in 1201 bytes} [Mon Jul 18 12:50:45 2022] DELETE /compute/v2.1/flavors/1093000862 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:50:45.907351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8283851-c607-450d-aa16-c4e79b4d8a99 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.958347 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4b4526ea-615f-49dc-91a2-e01ae29cffd1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.208127 Jul 18 12:50:45.965431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8283851-c607-450d-aa16-c4e79b4d8a99 tempest-FlavorsV261TestJSON-212472980 tempest-FlavorsV261TestJSON-212472980-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.062311 Jul 18 12:50:45.968121 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 170/324] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:50:45.970467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 155/325] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:45.985652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:45.987639 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:45.987639 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:45.992897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.993594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:45.996748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:45.997265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.078010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d9eca58-a0b1-4e05-8b52-6224fec81191 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.099397 Jul 18 12:50:46.079418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 171/326] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 18 12:50:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:46.097948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:46.099611 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:46.099611 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:46.101052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.101608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.102683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.108521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.224000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-437d3be7-7598-400d-bad3-60085d0a35a1 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-850003-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.131839 Jul 18 12:50:46.234231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 156/327] 10.222.0.88 () {60 vars in 1234 bytes} [Mon Jul 18 12:50:46 2022] GET /compute/v2.1/os-services?host=n-d-850003-3&binary=xxx => generated 16 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:46.246688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:46.248246 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:46.248246 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:46.251092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.252457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.256150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.256878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.348729 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82342996-f509-4837-9d16-101fcba29ea7 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.106981 Jul 18 12:50:46.361355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 172/328] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 18 12:50:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:50:46.368304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:46.370570 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:46.370570 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:46.372126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.372585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.373428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.373909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.495411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05bf8b49-f48a-442c-9f4e-257b61280a23 tempest-ServicesAdminNegativeV253TestJSON-594340228 tempest-ServicesAdminNegativeV253TestJSON-594340228-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.127940 Jul 18 12:50:46.520775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 157/329] 10.222.0.88 () {60 vars in 1238 bytes} [Mon Jul 18 12:50:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:46.771193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:46.775818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:46.821839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.824251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.825416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.836609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.890513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 HTTP/1.1 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:46.895744 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:46.898108 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c83f01e4-6329-49e1-a8aa-9669ae6577b8'} Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:46.900712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:46.902693 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:46.909018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:46.909018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57b6316f-8b42-4e5a-9baa-80159b712d67 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 404 len: 111 microversion: 2.1 time: 0.144742 Jul 18 12:50:46.911264 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 158/330] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:46 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:46.945025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:46.949878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:46.974172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.985046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:46.986648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:46.988815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.086772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 HTTP/1.1 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:47.103365 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.106017 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c83f01e4-6329-49e1-a8aa-9669ae6577b8'} Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:47.107240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.113894 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.118926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:47.118926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e10c2547-a16e-4834-b2ad-e47f7a3e3445 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 404 len: 111 microversion: 2.1 time: 0.193455 Jul 18 12:50:47.118926 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 159/331] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:46 2022] DELETE /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:47.137966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:47.137966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: c83f01e4-6329-49e1-a8aa-9669ae6577b8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:47.173505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.179696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.184829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.184829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.272294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 HTTP/1.1 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:47.281412 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.282890 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c83f01e4-6329-49e1-a8aa-9669ae6577b8'} Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:47.283532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. Jul 18 12:50:47.284631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.287797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance c83f01e4-6329-49e1-a8aa-9669ae6577b8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:47.289003 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80b320e3-c06c-4a64-8ca6-1255fc6454ad tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8" status: 404 len: 111 microversion: 2.1 time: 0.172357 Jul 18 12:50:47.290125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 160/332] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:47 2022] GET /compute/v2.1/servers/c83f01e4-6329-49e1-a8aa-9669ae6577b8 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:47.301789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:47.302743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:47.319319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.320362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.322078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.324541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.385499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af HTTP/1.1 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:47.390712 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.392505 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc2a69b3-393f-4c1f-a8c2-956688a066af'} Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:47.393203 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.394313 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.411503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:47.417906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f42757c-6371-4cd0-b341-07c77a3107fc tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 404 len: 111 microversion: 2.1 time: 0.114836 Jul 18 12:50:47.421484 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 161/333] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:50:47 2022] DELETE /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:47.432788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:47.442775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] [instance: bc2a69b3-393f-4c1f-a8c2-956688a066af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:47.473500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.473958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.482751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:47.491152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:47.550008 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] HTTP exception thrown: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Request method failure captured: Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af HTTP/1.1 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbElPLAqRBdUW_CmuDwaP0MufZKcewlJhD91Ku76YCKh4z0bYt55f-EZZ4POsv5RqO5kVyhfGAsa29xpT5WxwpGKlH6-mLwpVCq6TxPpEBOLBUGXb-xhO9O7-QYsSsMmeAKeLID4RTA8jjmNLyLBwvcF-PX0s9o1DfdDDBwq36fqtU Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:47.560053 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1d696868b7554f829b1b44c0f18d93c6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1d696868b7554f829b1b44c0f18d93c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1d696868b7554f829b1b44c0f18d93c6 Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1806853489 Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ddeca78fbb614783b68e6ae47c0c92d0 Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersAdminTestJSON-1806853489-project Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.562300 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc2a69b3-393f-4c1f-a8c2-956688a066af'} Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:47.563197 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. Jul 18 12:50:47.564734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.568225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] Returning 404 to user: Instance bc2a69b3-393f-4c1f-a8c2-956688a066af could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:47.572187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-071b7634-c2b2-4c1b-ac7e-76fe8242efe8 tempest-DeleteServersAdminTestJSON-1806853489 tempest-DeleteServersAdminTestJSON-1806853489-project] 10.222.0.88 "GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af" status: 404 len: 111 microversion: 2.1 time: 0.142481 Jul 18 12:50:47.578314 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 162/334] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:47 2022] GET /compute/v2.1/servers/bc2a69b3-393f-4c1f-a8c2-956688a066af => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:47.832325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f177e1cc-4724-4811-9c4a-e25d06a670bf tempest-ServicesAdminNegativeV253TestJSON-760745725 tempest-ServicesAdminNegativeV253TestJSON-760745725-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:47.833401 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:47.833401 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:47.834637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f177e1cc-4724-4811-9c4a-e25d06a670bf tempest-ServicesAdminNegativeV253TestJSON-760745725 tempest-ServicesAdminNegativeV253TestJSON-760745725-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '553c263efeb046feb127a90e4f7df84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef13d35a4dc42559c8e8c00f5adecba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f177e1cc-4724-4811-9c4a-e25d06a670bf tempest-ServicesAdminNegativeV253TestJSON-760745725 tempest-ServicesAdminNegativeV253TestJSON-760745725-project] Request method failure captured: Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcfvBXbTUa3cV87y9d6bdL-RCapCzXrfAXVaULwjsEU9n7NRqCk45XTles1vMlRElMBfEvUrwqsZFmhitN90YRsC1P2T-FPEBp3OLZlXMdvZ1UNw5IRlEyZS7d9lJeIiv5OVNQaUPrJw9r2BqqmhDvqiMNhKyGLN1riGjhSWEIv1eY Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6ef13d35a4dc42559c8e8c00f5adecba Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-760745725 Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:47.836321 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6ef13d35a4dc42559c8e8c00f5adecba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6ef13d35a4dc42559c8e8c00f5adecba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6ef13d35a4dc42559c8e8c00f5adecba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6ef13d35a4dc42559c8e8c00f5adecba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-760745725 Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6ef13d35a4dc42559c8e8c00f5adecba Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-760745725 Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServicesAdminNegativeV253TestJSON-760745725-project Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 553c263efeb046feb127a90e4f7df84b Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-760745725-project Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 12:50:47.846576 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:47.848497 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 12:50:47.850671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:47.852887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f177e1cc-4724-4811-9c4a-e25d06a670bf tempest-ServicesAdminNegativeV253TestJSON-760745725 tempest-ServicesAdminNegativeV253TestJSON-760745725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:47.852887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f177e1cc-4724-4811-9c4a-e25d06a670bf tempest-ServicesAdminNegativeV253TestJSON-760745725 tempest-ServicesAdminNegativeV253TestJSON-760745725-project] 10.222.0.88 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 1.316679 Jul 18 12:50:47.852887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 173/335] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 18 12:50:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1329 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 18 12:50:49.259834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:49.261360 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:49.261360 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:49.262981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:49.263804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:49.267039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:49.273453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:49.391099 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ec08e97-c685-4b38-822e-90157e732a8c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.209451 Jul 18 12:50:49.391918 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 163/336] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:50:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:49.406412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51585495-f9b9-47c2-b851-32452276bd0f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-332810774"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:49.407868 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:49.407868 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:49.410571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-51585495-f9b9-47c2-b851-32452276bd0f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid 268940e0-dbb1-4a26-b1c3-70976d6a4a4a for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:49.483757 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51585495-f9b9-47c2-b851-32452276bd0f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081106 Jul 18 12:50:49.496281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49a57893-bcf6-4ae1-9669-5765a6419ab7 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:49.498171 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:49.498171 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:49.501994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 174/337] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:49.516044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49a57893-bcf6-4ae1-9669-5765a6419ab7 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:49.520747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49a57893-bcf6-4ae1-9669-5765a6419ab7 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:49.840026 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49a57893-bcf6-4ae1-9669-5765a6419ab7 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.348553 Jul 18 12:50:49.858413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:49.859454 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 164/338] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:49.873550 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:49.873550 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:49.962863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:49.967005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:50.165115 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-850003-3. Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 39 Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:50.225395 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: {"add_host": {"host": "n-h2-850003-3"}} Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:50.228281 n-d-850003-3 devstack@n-api.service[131367]: exception: Aggregate 11 already has host n-h2-850003-3. Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-850003-3'}}} Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result.read() Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 12:50:50.229986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-850003-3-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 12:50:50.232601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 12:50:50.234883 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 12:50:50.237295 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result.read() Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-850003-3-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 12, 50, 50, 83585), 'updated_at': None, 'host': 'n-h2-850003-3', 'aggregate_id': 11}] Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:50.239302 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-850003-3. Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.241086 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-850003-3. Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:50.243643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:50.246141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-850003-3. Jul 18 12:50:50.246141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:50.246141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-850003-3. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:50.246141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dce80dfc-bf39-4c3c-8bd8-2149a5fe5aa2 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.383898 Jul 18 12:50:50.246141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 175/339] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 390 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 18 12:50:50.251756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bdccc80c-b6f6-4120-aca6-24a33882fc58 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:50.255782 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:50.255782 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:50.296270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdccc80c-b6f6-4120-aca6-24a33882fc58 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:50.297864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdccc80c-b6f6-4120-aca6-24a33882fc58 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:50.698540 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bdccc80c-b6f6-4120-aca6-24a33882fc58 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.453833 Jul 18 12:50:50.700141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 165/340] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:50.716116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b51824c-e8cf-4e7e-a2b7-66c096ac0e7f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:50.717930 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:50.717930 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:50.789839 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b51824c-e8cf-4e7e-a2b7-66c096ac0e7f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.077574 Jul 18 12:50:50.791855 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 176/341] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:50 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:50.807557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c5c3be2-557c-40dc-833f-a9e76ade35c5 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1393259441"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:50.809850 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:50.809850 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:50.812857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-1c5c3be2-557c-40dc-833f-a9e76ade35c5 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid eed74710-5ad4-4538-b0c7-90ad1850c229 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:50.877501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c5c3be2-557c-40dc-833f-a9e76ade35c5 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073691 Jul 18 12:50:50.878508 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 166/342] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:51.228319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f775817-40bf-4605-bd54-d06f5e40c6d2 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.246430 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.246430 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.258547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f775817-40bf-4605-bd54-d06f5e40c6d2 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f775817-40bf-4605-bd54-d06f5e40c6d2 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 39 Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:51.266555 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: {"add_host": {"host": "n-h2-850003-3"}} Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:51.269273 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-850003-3'}}} Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:51.271366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 12:50:51.274461 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.287024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f775817-40bf-4605-bd54-d06f5e40c6d2 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:51.287024 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f775817-40bf-4605-bd54-d06f5e40c6d2 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.386329 Jul 18 12:50:51.287024 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 177/343] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:50 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:51.311389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-684072029", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.320345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d34ca34-1e5b-486e-9a99-9cffe1d37353 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:51.322563 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.322563 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.424972 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d34ca34-1e5b-486e-9a99-9cffe1d37353 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.118226 Jul 18 12:50:51.426592 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 178/344] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:51 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:51.446114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b82226c7-3848-4455-96f9-1655edbae317 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-57893345"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.452327 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.452327 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.457236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.aggregate [None req-b82226c7-3848-4455-96f9-1655edbae317 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid f20f51bf-ef5c-4141-88a0-a54ca51fb03c for aggregate {{(pid=131367) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:51.574867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b82226c7-3848-4455-96f9-1655edbae317 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.091075 Jul 18 12:50:51.575410 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 179/345] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:51.592045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1671871628"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.595621 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.595621 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.601227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:51.625406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:51.626231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:51.647396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:51.656526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:51.668976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:51.684355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1671871628 could not be found. Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 58 Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:51.688068 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: {"add_host": {"host": "tempest-nonexist_host-1671871628"}} Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:51.689457 n-d-850003-3 devstack@n-api.service[131367]: exception: Compute host tempest-nonexist_host-1671871628 could not be found. Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1671871628'}}} Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1671871628' is not mapped to any cell Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.690360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 18 12:50:51.691656 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1671871628 could not be found. Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1671871628 could not be found. Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.693203 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1671871628 could not be found. Jul 18 12:50:51.694563 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.696756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1671871628 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:51.698113 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd780c04-3366-4598-af5b-50b84bdd0e17 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.110930 Jul 18 12:50:51.699268 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 180/346] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:50:51.715233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08e7da1d-7c66-419f-944f-eeeaba976454 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:51.718755 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.718755 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.783457 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08e7da1d-7c66-419f-944f-eeeaba976454 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.076302 Jul 18 12:50:51.784054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 181/347] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:51 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:51.808032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38776736-f810-47d5-ad79-f309575f14a3 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38776736-f810-47d5-ad79-f309575f14a3 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 283 Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:51.811716 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:51.813066 n-d-850003-3 devstack@n-api.service[131367]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 12:50:51.813680 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:50:51.814363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:50:51.815398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:50:51.816099 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 12:50:51.816099 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.820631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38776736-f810-47d5-ad79-f309575f14a3 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:51.830692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38776736-f810-47d5-ad79-f309575f14a3 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.025594 Jul 18 12:50:51.831732 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 182/348] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:50:51.847348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aca46df2-6db3-49ff-8a4b-56c48afad011 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aca46df2-6db3-49ff-8a4b-56c48afad011 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 27 Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:50:51.850522 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: {"aggregate": {"name": ""}} Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:51.852054 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '' Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:51.853008 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 12:50:51.854797 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.861917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aca46df2-6db3-49ff-8a4b-56c48afad011 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:51.863371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aca46df2-6db3-49ff-8a4b-56c48afad011 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.020865 Jul 18 12:50:51.865628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 183/349] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 12:50:51.881306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4003e5a5-7e30-44bb-823b-df61fdb18967 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-550164486"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:51.884124 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:51.884124 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:50:51.888731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4003e5a5-7e30-44bb-823b-df61fdb18967 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4003e5a5-7e30-44bb-823b-df61fdb18967 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 59 Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:50:51.895721 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: {"aggregate": {"name": "tempest-test_aggregate-550164486"}} Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:50:51.896951 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-550164486'}}} Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:51.897944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:51.899050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 12:50:51.900189 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:50:51.901808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4003e5a5-7e30-44bb-823b-df61fdb18967 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:51.903012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4003e5a5-7e30-44bb-823b-df61fdb18967 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.027170 Jul 18 12:50:51.903790 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 184/350] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:50:52.399960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:52.402103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:52.403121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:52.403883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:52.405441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:52.461405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:52.463829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:52.466678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:52.468716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:52.589474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Getting quotas for project a1a035a2d693426b92f077b3c30f3ddd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:52.603060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Getting quotas for user a3c09e4bb55c4c2caa739a62118e60ee and project a1a035a2d693426b92f077b3c30f3ddd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:52.642844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:50:52.649720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:50:52.829556 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7071750-9e66-4b05-810f-0091ecad729d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875928 Jul 18 12:50:52.831595 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 167/351] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:50:52.872629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30c78213-7749-4b8a-93d3-05fec21158a8 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1841879444"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:52.874794 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:52.874794 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:52.875794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-30c78213-7749-4b8a-93d3-05fec21158a8 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid f4efb0cd-323e-42db-917d-8ed8622ae58a for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:52.957053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30c78213-7749-4b8a-93d3-05fec21158a8 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.123165 Jul 18 12:50:52.976271 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 168/352] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:52.997408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-110372146", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "de298d9c-e7c4-4212-8e1a-869417573018"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:53.003850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-48b38d85-2149-4445-91bc-89c3ee82c0fa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:53.004968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-48b38d85-2149-4445-91bc-89c3ee82c0fa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:53.162939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] validate_networks() for [('de298d9c-e7c4-4212-8e1a-869417573018', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:50:53.347115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48b38d85-2149-4445-91bc-89c3ee82c0fa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:53.363338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-48b38d85-2149-4445-91bc-89c3ee82c0fa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1218 microversion: 2.1 time: 0.385420 Jul 18 12:50:53.364568 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 169/353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:52 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:53.375963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1841879444"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:53.380268 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.380268 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.381271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid 7b42cb2e-d2e0-44ce-9ed1-9a022fa76531 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:53.419276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1841879444 already exists. Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 60 Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:53.426482 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: {"aggregate": {"name": "tempest-test_aggregate-1841879444"}} Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:53.427958 n-d-850003-3 devstack@n-api.service[131366]: exception: Aggregate tempest-test_aggregate-1841879444 already exists. Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1841879444'}}} Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 18 12:50:53.428849 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1841879444 already exists. Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:53.430074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1841879444 already exists. Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1841879444 already exists. Jul 18 12:50:53.431189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.464646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1841879444 already exists. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:53.469178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e15e86a-aff0-4884-ab3e-2b85d297a18e tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.102559 Jul 18 12:50:53.475161 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 170/354] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:53 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:53.480736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0437287-7076-40c7-a3fe-f63e59c167fe tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:53.481889 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.481889 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.586857 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0437287-7076-40c7-a3fe-f63e59c167fe tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.110090 Jul 18 12:50:53.612688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 171/355] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:53.632681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-476a1576-fc5d-4b14-84ba-0c5f5cfabc4d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1055558784"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:53.637621 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.637621 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.641737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-476a1576-fc5d-4b14-84ba-0c5f5cfabc4d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid dd015f00-b07b-45da-977b-45cd4de9cc6e for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:53.670002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:53.744221 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-476a1576-fc5d-4b14-84ba-0c5f5cfabc4d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.129531 Jul 18 12:50:53.748024 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 172/356] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:53.763190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15c7aa88-7ae9-43e1-880f-3be34be88a77 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:53.766535 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.766535 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.769623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15c7aa88-7ae9-43e1-880f-3be34be88a77 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15c7aa88-7ae9-43e1-880f-3be34be88a77 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:53.775967 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 12:50:53.777423 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '15'} Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:53.778376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 12:50:53.779781 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.781818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15c7aa88-7ae9-43e1-880f-3be34be88a77 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:53.782892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15c7aa88-7ae9-43e1-880f-3be34be88a77 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024789 Jul 18 12:50:53.786058 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 173/357] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:53.799098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-55261675-78a5-4baf-b4f6-1f897e984471 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:53.852289 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-55261675-78a5-4baf-b4f6-1f897e984471 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.058942 Jul 18 12:50:53.864015 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 174/358] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 12:50:53.872255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3b40cb-624e-4a88-89c5-b15b06c57d5d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:53.875858 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.875858 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.917883 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1f3b40cb-624e-4a88-89c5-b15b06c57d5d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3b40cb-624e-4a88-89c5-b15b06c57d5d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:53.921523 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: exception: Aggregate -1 could not be found. Jul 18 12:50:53.924649 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '-1'} Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:53.935489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.937956 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3b40cb-624e-4a88-89c5-b15b06c57d5d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f3b40cb-624e-4a88-89c5-b15b06c57d5d tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.057330 Jul 18 12:50:53.941775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 175/359] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:53 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:53.955272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0f2e826-2d26-4f00-8ef0-2b0dbe615efb tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1417418448"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:53.960992 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:53.960992 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:53.968317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-b0f2e826-2d26-4f00-8ef0-2b0dbe615efb tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid 6783a7ca-bc52-4929-9a94-fcbe911b47ef for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:54.038434 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0f2e826-2d26-4f00-8ef0-2b0dbe615efb tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093525 Jul 18 12:50:54.057584 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 176/360] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:54.068259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-604811d9-8b53-4f87-804c-bff7823cecad tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:54.070337 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.070337 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:54.076130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-604811d9-8b53-4f87-804c-bff7823cecad tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-604811d9-8b53-4f87-804c-bff7823cecad tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:54.082117 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 12:50:54.085183 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '16'} Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:54.087331 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.091309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-604811d9-8b53-4f87-804c-bff7823cecad tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:54.095843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-604811d9-8b53-4f87-804c-bff7823cecad tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025264 Jul 18 12:50:54.095843 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 177/361] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:54 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:54.100546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e749853b-1e39-4f6a-b2d8-71c9bf5c2018 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:54.128282 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.128282 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:54.224490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e749853b-1e39-4f6a-b2d8-71c9bf5c2018 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.130603 Jul 18 12:50:54.225102 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 178/362] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:54.244110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b014a00-9ea9-4a1c-ba4c-4ade00075322 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:54.245216 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.245216 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:54.260773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3b014a00-9ea9-4a1c-ba4c-4ade00075322 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b014a00-9ea9-4a1c-ba4c-4ade00075322 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:54.269885 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: exception: Aggregate -1 could not be found. Jul 18 12:50:54.282792 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '-1'} Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.285344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 12:50:54.289447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b014a00-9ea9-4a1c-ba4c-4ade00075322 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b014a00-9ea9-4a1c-ba4c-4ade00075322 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034772 Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 179/363] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:50:54 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b5fbd7-2472-445b-b1db-6ac76ca39a87 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.292128 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6b5fbd7-2472-445b-b1db-6ac76ca39a87 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b5fbd7-2472-445b-b1db-6ac76ca39a87 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:54.298611 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 12:50:54.301465 n-d-850003-3 devstack@n-api.service[131366]: action_args: {} Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:54.302897 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:54.305519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b5fbd7-2472-445b-b1db-6ac76ca39a87 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:54.310713 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6b5fbd7-2472-445b-b1db-6ac76ca39a87 tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008957 Jul 18 12:50:54.310713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 180/364] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:50:54 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:50:54.310713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea29f4fc-557d-4b89-8b2a-4e8ae415ca64 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-577350037"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:54.310713 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.310713 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:54.315289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-ea29f4fc-557d-4b89-8b2a-4e8ae415ca64 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid 6c26a77d-3014-43ba-ba33-e00a0324300c for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:54.413898 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea29f4fc-557d-4b89-8b2a-4e8ae415ca64 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111082 Jul 18 12:50:54.417795 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 181/365] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:54.440621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e3ddd2f-630a-4eb8-a1a2-0670503d9afa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:54.443220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e3ddd2f-630a-4eb8-a1a2-0670503d9afa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:54.925371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e3ddd2f-630a-4eb8-a1a2-0670503d9afa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:54.958930 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e3ddd2f-630a-4eb8-a1a2-0670503d9afa tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1218 microversion: 2.1 time: 0.536024 Jul 18 12:50:54.967559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 182/366] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:54 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1218 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:54.990989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65bbb4a0-14af-4b13-8aef-82ce22f69475 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:54.999863 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:54.999863 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:55.049161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65bbb4a0-14af-4b13-8aef-82ce22f69475 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:55.051619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65bbb4a0-14af-4b13-8aef-82ce22f69475 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:55.442506 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65bbb4a0-14af-4b13-8aef-82ce22f69475 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.471557 Jul 18 12:50:55.455017 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 183/367] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:54 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:55.477104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a6adc6-01a7-4876-b85a-1922ec8c34ba tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:55.483896 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:55.483896 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:55.491956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57a6adc6-01a7-4876-b85a-1922ec8c34ba tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'db4b7b1d166d4946a735784dd9ae0792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c647eb06e81e40d180a4fc834b75a58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a6adc6-01a7-4876-b85a-1922ec8c34ba tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Request method failure captured: Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 42 Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vckny6gqh6yu3gThMxgi5MBuqMj3voCcCLlIkQB1d65_IF4XKl4MIDwI3osODC85JqTDjnqUoAJgXv1qpQg0JfydSdVcbltYGKOjy8BI67maxr625MY1lB8QOCuaYPAyGEhsBKtRGjB3jgTdkU8tqpIvV60MeRpMW3AjrxHFU6kXtk Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:50:55.503755 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c647eb06e81e40d180a4fc834b75a58c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c647eb06e81e40d180a4fc834b75a58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c647eb06e81e40d180a4fc834b75a58c Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-783359467 Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: db4b7b1d166d4946a735784dd9ae0792 Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-783359467-project Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: {"remove_host": {"host": "n-h2-850003-3"}} Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:55.507612 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-850003-3'}}} Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:55.509080 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 12:50:55.515578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:55.519568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a6adc6-01a7-4876-b85a-1922ec8c34ba tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:55.520850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57a6adc6-01a7-4876-b85a-1922ec8c34ba tempest-AggregatesAdminNegativeTestJSON-783359467 tempest-AggregatesAdminNegativeTestJSON-783359467-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.063535 Jul 18 12:50:55.524763 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 184/368] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:50:55.542735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee55933f-786c-4650-b42e-22446d1f3a67 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:55.594632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee55933f-786c-4650-b42e-22446d1f3a67 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:55.595789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee55933f-786c-4650-b42e-22446d1f3a67 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:55.872986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee55933f-786c-4650-b42e-22446d1f3a67 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.339903 Jul 18 12:50:55.877333 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 185/369] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:55.900532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f2c85ae5-c6de-48da-b84c-f9d727da837c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:55.916707 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:55.916707 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:56.002966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f2c85ae5-c6de-48da-b84c-f9d727da837c tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.118155 Jul 18 12:50:56.006561 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 186/370] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 12:50:56.022684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:56.024831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:56.040093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:56.043094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:56.044631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:56.047988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:56.244816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:56.276782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-161cf6a1-5d2f-4da7-b88a-b48d2d8857a4 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1278 microversion: 2.1 time: 0.265503 Jul 18 12:50:56.280078 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 187/371] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:56 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:56.306957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51c5348e-6ad2-4baf-a31f-6f7727a07c9f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2004947517"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:56.311129 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:56.311129 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:56.315558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-51c5348e-6ad2-4baf-a31f-6f7727a07c9f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Generated uuid d57d7a7c-4c18-4772-98ae-8804595eb239 for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 12:50:56.372875 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51c5348e-6ad2-4baf-a31f-6f7727a07c9f tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084006 Jul 18 12:50:56.374336 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 188/372] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 12:50:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:50:56.392170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:50:56.404386 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:56.404386 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:56.433606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:56.434229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:56.460624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:56.461619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:56.480158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.compute.aggregates [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 12:50:56.480878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Request method failure captured: Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 42 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcnGHm9syz1qG_qd3378jUHashr6krz7ei07YVv8qblVz69TZa4VvsQoQU97-e5RQ00b0UvX_7oqBTcyvE0n_GT0DT6fh_Up2Mufe6hLlcOQIS1QTRPtz_xnCWwmRUVCck1yHWVdVkPpWwKRvTCUr1M_x5EQmdOZiCPzJPETK6eQgE Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:50:56.484826 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e4ef973553ae4aa09410fbaa70dbbcae", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e4ef973553ae4aa09410fbaa70dbbcae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e4ef973553ae4aa09410fbaa70dbbcae Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446 Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 715e700d7876412e9d2ffb74cc80752d Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: {"remove_host": {"host": "nonexist_host"}} Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:50:56.487489 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 12:50:56.489292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 18 12:50:56.493156 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.497387 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a0ffc4f-e954-4f6f-b1e1-35eb5b366337 tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.102122 Jul 18 12:50:56.502949 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 189/373] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 12:50:56 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:50:56.505970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27c6343a-da5f-42b0-8073-d93576424eed tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:56.506974 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:50:56.506974 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:50:56.562850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27c6343a-da5f-42b0-8073-d93576424eed tempest-AggregatesAdminNegativeTestJSON-2014947446 tempest-AggregatesAdminNegativeTestJSON-2014947446-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.060585 Jul 18 12:50:56.564037 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 190/374] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:50:56 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 12:50:57.312363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:57.314949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:57.348041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:57.348501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:57.349562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:57.350017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:57.447839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:57.460254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6dae4b4c-a26e-44ac-8acc-9b78f6d85685 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1276 microversion: 2.1 time: 0.156535 Jul 18 12:50:57.472747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 191/375] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:57 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:57.542407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:50:57.545960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:50:57.547789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:50:57.549133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:50:57.550380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:50:57.578746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:57.580330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:57.586311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:57.587324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:57.612299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=88 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:50:57.647911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:50:57.670171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for user 64cdfc77cf92451c84c873df41bc422f and project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:50:57.716520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:50:57.724480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:50:57.925017 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f502b27c-fc60-4ab2-bbe3-39e5219fc12b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.011358 Jul 18 12:50:57.927641 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 185/376] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 6022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:50:57.943234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd60b059-0a26-4e29-ad33-9510edbe0971 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:57.945207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd60b059-0a26-4e29-ad33-9510edbe0971 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:58.105707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd60b059-0a26-4e29-ad33-9510edbe0971 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:58.116577 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd60b059-0a26-4e29-ad33-9510edbe0971 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1210 microversion: 2.1 time: 0.179235 Jul 18 12:50:58.121940 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 192/377] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:57 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1210 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:58.481822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:58.482503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:58.506960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:58.507458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:58.508364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:58.514881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:58.893924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:58.905747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aaba9694-76e8-42fc-b936-a93cb6799088 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1276 microversion: 2.1 time: 0.429880 Jul 18 12:50:58.917050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 186/378] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:58 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1276 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:50:59.142674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-314284f2-115f-400f-868e-b4d6fe20d63a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:59.144129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-314284f2-115f-400f-868e-b4d6fe20d63a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:59.570332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-314284f2-115f-400f-868e-b4d6fe20d63a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:50:59.585394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-314284f2-115f-400f-868e-b4d6fe20d63a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1210 microversion: 2.1 time: 0.443639 Jul 18 12:50:59.587272 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 193/379] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:59 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1210 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:50:59.925715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:50:59.926372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:50:59.967839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:59.974819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:50:59.978057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:50:59.993771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:00.621178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:00.622125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:00.642523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:00.646311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:00.647744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:00.649449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:00.963862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:00.978490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b5acc6e-33ed-49a9-a1c5-9626bcb79c57 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1280 microversion: 2.1 time: 0.361423 Jul 18 12:51:00.990721 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 194/380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:00 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1280 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:01.329219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:01.368114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 1.440810 Jul 18 12:51:01.370246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 187/381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:50:59 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:01.997403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:01.998085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:02.012229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:02.015308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:02.017474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:02.018652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:02.091559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:02.093010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bdd818b3-d012-410c-aed0-8858fd566362 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001855 Jul 18 12:51:02.093487 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 188/382] 10.222.0.88 () {56 vars in 885 bytes} [Mon Jul 18 12:51:02 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 12:51:02.413685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:02.415124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:02.432671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:02.434039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:02.435465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:02.437694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:02.452057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:02.469886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20cf502d-7c3e-4ee9-a65b-44501b07337a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.476978 Jul 18 12:51:02.471343 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 195/383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:01 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:03.380115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-553137115", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:03.493144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:51:03.564121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:03.576014 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ab67543c-4eff-40fb-8b23-b9568d304272 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 1.177113 Jul 18 12:51:03.579788 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 189/384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:02 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:04.078751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4d66a13-3c53-422f-b5db-ec41351239b8 tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-147799487", "id": 533719727, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:04.081194 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:04.081194 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:04.129047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4d66a13-3c53-422f-b5db-ec41351239b8 tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.547932 Jul 18 12:51:04.139292 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 190/385] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:51:03 2022] POST /compute/v2.1/flavors => generated 467 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:04.144592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:04.147063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:04.166491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:04.169340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:04.170927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:04.173169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:04.638469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:04.662709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9d27d622-3ca0-4256-b367-33a8a71a169a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.527105 Jul 18 12:51:04.663466 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 191/386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:04 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:04.672104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-93da5cc8-01e7-45c3-82dc-c29e35305bd1 req-4b328362-3101-4d00-a2ac-1a935cf5ab95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:04.679323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:51:04.682127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:51:04.682542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:51:04.683033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:51:04.683457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:51:04.707248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:04.708398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:04.709852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:04.710568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:04.716228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-93da5cc8-01e7-45c3-82dc-c29e35305bd1 req-4b328362-3101-4d00-a2ac-1a935cf5ab95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:04.716724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-93da5cc8-01e7-45c3-82dc-c29e35305bd1 req-4b328362-3101-4d00-a2ac-1a935cf5ab95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:04.742174 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-93da5cc8-01e7-45c3-82dc-c29e35305bd1 req-4b328362-3101-4d00-a2ac-1a935cf5ab95 service nova] Creating event network-changed:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h1-850003-3 Jul 18 12:51:04.750851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-93da5cc8-01e7-45c3-82dc-c29e35305bd1 req-4b328362-3101-4d00-a2ac-1a935cf5ab95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085816 Jul 18 12:51:04.759461 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 192/387] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:04.770771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65b68583-de12-47f4-9c42-3f3fe42d951a tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:04.775119 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:04.775119 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:04.810524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Getting quotas for project 005a12b5723947b7beab68c6a0adfdc5. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:51:04.845903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Getting quotas for user 92d496d25f8349ed92dadd8347d7608d and project 005a12b5723947b7beab68c6a0adfdc5. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:51:04.920165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:51:04.932794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:51:05.090280 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79df9192-b718-45e5-8a66-ec94c12b5c62 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095223 Jul 18 12:51:05.099242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 196/388] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:51:05.104488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:05.105120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:05.113809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:05.114322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:05.115812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:05.116292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:05.355014 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65b68583-de12-47f4-9c42-3f3fe42d951a tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/533719727/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.592996 Jul 18 12:51:05.358702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 193/389] 10.222.0.88 () {62 vars in 1261 bytes} [Mon Jul 18 12:51:04 2022] POST /compute/v2.1/flavors/533719727/os-extra_specs => generated 62 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:05.375130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bb477619-81a6-4177-a08a-d6c3035859c1 req-d8197746-6037-4fc5-9842-87251ae2e800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37258af4-4835-415f-a4a9-2956838d2fb4", "tag": "ca0849d2-50dc-4567-911e-9b3d5d457115"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:05.395378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb477619-81a6-4177-a08a-d6c3035859c1 req-d8197746-6037-4fc5-9842-87251ae2e800 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:05.395949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb477619-81a6-4177-a08a-d6c3035859c1 req-d8197746-6037-4fc5-9842-87251ae2e800 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:05.435271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bb477619-81a6-4177-a08a-d6c3035859c1 req-d8197746-6037-4fc5-9842-87251ae2e800 service nova] Creating event network-changed:ca0849d2-50dc-4567-911e-9b3d5d457115 for instance 37258af4-4835-415f-a4a9-2956838d2fb4 on n-h2-850003-3 Jul 18 12:51:05.449800 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bb477619-81a6-4177-a08a-d6c3035859c1 req-d8197746-6037-4fc5-9842-87251ae2e800 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083831 Jul 18 12:51:05.453345 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 194/390] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:05.479151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-209000d1-c7b9-44d4-9b88-2e17d05bad0f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:05.482022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-209000d1-c7b9-44d4-9b88-2e17d05bad0f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:05.674133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-209000d1-c7b9-44d4-9b88-2e17d05bad0f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:05.705913 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-209000d1-c7b9-44d4-9b88-2e17d05bad0f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1213 microversion: 2.1 time: 0.249108 Jul 18 12:51:05.708087 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 195/391] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:05 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1213 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:05.745378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ae5fd6b-29d6-47a8-9b7c-2ce93a67acd8 tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:05.748363 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:05.748363 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:05.800915 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ae5fd6b-29d6-47a8-9b7c-2ce93a67acd8 tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/533719727" status: 202 len: 0 microversion: 2.86 time: 0.090643 Jul 18 12:51:05.806763 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 196/392] 10.222.0.88 () {60 vars in 1198 bytes} [Mon Jul 18 12:51:05 2022] DELETE /compute/v2.1/flavors/533719727 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:51:05.811576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:05.812215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:05.855202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:05.855664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:05.856492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:05.857031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:06.001924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:06.031693 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-637a11f4-5802-4332-b381-4370640a2228 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.930035 Jul 18 12:51:06.033213 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 197/393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:05 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:06.050941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-394c9c51-ecbb-483f-9c86-0466ffcbaf1b tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:06.168416 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-394c9c51-ecbb-483f-9c86-0466ffcbaf1b tempest-FlavorMetadataValidation-479792338 tempest-FlavorMetadataValidation-479792338-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6679 microversion: 2.86 time: 0.126778 Jul 18 12:51:06.169373 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 198/394] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:51:06 2022] GET /compute/v2.1/flavors/detail => generated 6679 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:51:06.435486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:06.452799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71f0bc49-1a64-4d5f-8740-e2448712560e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.644169 Jul 18 12:51:06.454953 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 197/395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:05 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:06.726242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:06.727864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:06.737063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:06.737968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:06.739693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:06.740363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:06.933794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:06.962508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-757242be-0835-4dc0-a2bf-213e6933b471 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1265 microversion: 2.1 time: 0.240752 Jul 18 12:51:06.964381 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 198/396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:06 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:07.074683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:07.078015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:07.085153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e376eba5-64a2-4ed9-9375-ae910614bfbd tempest-AZAdminNegativeTestJSON-263089634 tempest-AZAdminNegativeTestJSON-263089634-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:07.089363 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:07.089363 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:07.101241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e376eba5-64a2-4ed9-9375-ae910614bfbd tempest-AZAdminNegativeTestJSON-263089634 tempest-AZAdminNegativeTestJSON-263089634-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '6989dc1c263c4a03b28124168a349b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361566deb1c04d8dbf4f42f33c075996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:07.103882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:07.114700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:07.116422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:07.117168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e376eba5-64a2-4ed9-9375-ae910614bfbd tempest-AZAdminNegativeTestJSON-263089634 tempest-AZAdminNegativeTestJSON-263089634-project] Request method failure captured: Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vc4i87TjJuPSUcIDgLCVGCF87FlunLhnw6P4OVnavGmFssE59vOOzcq0pnib1WdcJqsgtJX-h-9-L7APKovMRYsnjEVGKSPl9Lg64WpW0OErD2YwST2zoraB-8Jh_sV0KEP5xgdwcMpp9blv5kbVg0oDb6DSbVLu54CKriYYsl9KpA Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 361566deb1c04d8dbf4f42f33c075996 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AZAdminNegativeTestJSON-263089634 Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:51:07.119558 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/361566deb1c04d8dbf4f42f33c075996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/361566deb1c04d8dbf4f42f33c075996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_361566deb1c04d8dbf4f42f33c075996", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/361566deb1c04d8dbf4f42f33c075996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AZAdminNegativeTestJSON-263089634 Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 361566deb1c04d8dbf4f42f33c075996 Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-263089634 Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AZAdminNegativeTestJSON-263089634-project Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6989dc1c263c4a03b28124168a349b05 Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AZAdminNegativeTestJSON-263089634-project Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 12:51:07.122426 n-d-850003-3 devstack@n-api.service[131366]: action_args: {} Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:51:07.125467 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 12:51:07.129799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:07.133171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e376eba5-64a2-4ed9-9375-ae910614bfbd tempest-AZAdminNegativeTestJSON-263089634 tempest-AZAdminNegativeTestJSON-263089634-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:51:07.139031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e376eba5-64a2-4ed9-9375-ae910614bfbd tempest-AZAdminNegativeTestJSON-263089634 tempest-AZAdminNegativeTestJSON-263089634-project] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.645651 Jul 18 12:51:07.147828 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 199/397] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:51:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 651 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:51:07.485072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:07.485729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:07.492182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=83,nova_api:DELETE=9 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:07.500453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:07.502521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:07.503831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:07.504442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:07.613245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:07.754937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:07.764421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03e08ca7-27f9-48a8-aa3e-c900c95b9a1b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.284408 Jul 18 12:51:07.765004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 200/398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:07 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:07.942448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:07.958976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4132a354-f3f8-42a7-907c-f49cb887cd20 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.911224 Jul 18 12:51:07.959592 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 199/399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:07 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:08.004779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:08.009588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:08.021683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:08.022877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:08.024280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:08.025064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:08.174801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:08.194269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-980d0e7c-3b6d-437e-9e45-e858926d2ea7 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1265 microversion: 2.1 time: 0.202637 Jul 18 12:51:08.197830 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 201/400] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:07 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:08.792116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:08.792984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:08.806858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:08.807292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:08.808103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:08.808574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:08.988969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:08.990286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:09.002409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:09.004556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:09.005828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:09.006510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:09.543704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:09.583011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a15965ca-80c8-4139-adc0-52de696037fd tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.585435 Jul 18 12:51:09.587084 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 202/401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:08 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:09.607804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:09.609944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:09.624340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:09.626190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:09.628119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:09.628895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:09.678065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:09.698979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:09.701896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-713120c1-8009-4dd0-93a0-98313ae94358 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.902779 Jul 18 12:51:09.703019 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 200/402] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:08 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:10.023187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:10.035383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4d06786-05cc-45f7-a73b-802d6f823219 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1271 microversion: 2.1 time: 0.445033 Jul 18 12:51:10.036766 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 203/403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:09 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1271 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:10.603045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:10.604104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:10.622579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:10.623813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:10.624901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:10.625617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:10.721011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:10.721863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:10.732002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:10.732908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:10.734274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:10.735708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:11.333285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:11.381185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:11.391821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b3cc38ee-d708-40db-bb9f-7ca0c51aaab5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.791825 Jul 18 12:51:11.393470 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 201/404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:10 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:11.395812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c36c4f33-91b4-4e25-bdce-ddc401bcbf9d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.679805 Jul 18 12:51:11.399320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 204/405] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:10 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:11.409301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:11.410580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:11.442534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:11.445319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:11.453745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:11.455994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:12.284833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:12.318597 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23beca5f-ff77-48fb-a805-9b4b7beffccd tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.917434 Jul 18 12:51:12.319800 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 202/406] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:11 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:12.450725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:12.451968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:12.486201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:12.489535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:12.492887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:12.493560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:12.877706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:12.893052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-787968bd-0c1a-4015-a383-9ffb561e5f3a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.471182 Jul 18 12:51:12.897921 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 205/407] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:12 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:12.911495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:12.912132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:12.919521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:12.920273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:12.921522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:12.922249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.125948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e4e970d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.136618 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.136618 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:13.139071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.142464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.144402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.147349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.166644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:13.179578 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ab8d195-01ca-41e5-b8d8-6708a0da871e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.283338 Jul 18 12:51:13.180618 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 206/408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:12 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:13.211806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27714394-cfad-4062-9ea9-87e3f7d7e962 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.789765 Jul 18 12:51:13.212777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 203/409] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:51:12 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:13.230466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e55b6af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.236666 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.236666 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.243010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.252233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.259274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.260629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.300930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=17 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:13.353826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.354791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:13.357786 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8437f874-3876-4a45-a88d-0fb3e19193f2 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.131618 Jul 18 12:51:13.359721 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 207/410] 10.222.0.88 () {58 vars in 1138 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:51:13.365140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.365771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.366772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.367521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.380254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e5266e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.385099 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.385099 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.389518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.391158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.395581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.396971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.452586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97d55b6a-3ce6-4eab-905f-0aa2c3d6f0dc tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.081879 Jul 18 12:51:13.456307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 208/411] 10.222.0.88 () {58 vars in 1144 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:51:13.472281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e50e0820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.481235 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.481235 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.483582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.485026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.486863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.487604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.534750 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c714456-c821-4ec8-ab3c-c0702b4256a6 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.068423 Jul 18 12:51:13.536471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 209/412] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:13.559832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e50e70d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.565536 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.565536 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.569848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.571081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.573187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.575021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.635540 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-54930df6-921f-4eab-a175-06fa042d6e05 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.084051 Jul 18 12:51:13.637459 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 210/413] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:13.653804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e50e7b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.655908 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.655908 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.658751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.660197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.662703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.664055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.743441 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a01612c0-9c05-478a-835b-ca250baf59cb tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.086425 Jul 18 12:51:13.744938 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 211/414] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:13.758236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e50e7040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:13.759792 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:13.759792 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:13.783545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.794952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.845251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:13.845994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:13.945973 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb47290a-748b-407e-bbe4-d687d57f0b4e tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-h2-850003-3" status: 200 len: 598 microversion: 2.1 time: 0.180034 Jul 18 12:51:13.947265 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 212/415] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/os-hosts/n-h2-850003-3 => generated 598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:51:13.968174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b4443965-a309-48a3-a877-314f345ebcb5 req-9541e14a-fd21-48cc-afef-e5102c6eed94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a137167-d823-4c95-ad1e-0438774e2b90", "tag": "62c23b67-3965-4150-8af1-9465d9f73945"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:14.006298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:14.024078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b4443965-a309-48a3-a877-314f345ebcb5 req-9541e14a-fd21-48cc-afef-e5102c6eed94 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.024537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b4443965-a309-48a3-a877-314f345ebcb5 req-9541e14a-fd21-48cc-afef-e5102c6eed94 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.047494 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71978004-3a1a-473b-a0ff-f3929cd0a6ca tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.701730 Jul 18 12:51:14.048789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b4443965-a309-48a3-a877-314f345ebcb5 req-9541e14a-fd21-48cc-afef-e5102c6eed94 service nova] Creating event network-changed:62c23b67-3965-4150-8af1-9465d9f73945 for instance 4a137167-d823-4c95-ad1e-0438774e2b90 on n-h2-850003-3 Jul 18 12:51:14.050785 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 204/416] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:13 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:14.056820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b4443965-a309-48a3-a877-314f345ebcb5 req-9541e14a-fd21-48cc-afef-e5102c6eed94 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107434 Jul 18 12:51:14.057743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 213/417] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:14.064271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Calling method '.version_select at 0x7f96e51363a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:14.071771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:14.076593 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:14.076593 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:14.080750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:14.101610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.102162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.117606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.126596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.126596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.126596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.174493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.174955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.218287 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a72f6baa-cc06-41b0-9b5c-b36fb65c4123 tempest-HostsAdminTestJSON-1171838494 tempest-HostsAdminTestJSON-1171838494-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-h1-850003-3" status: 200 len: 598 microversion: 2.1 time: 0.156273 Jul 18 12:51:14.230822 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 214/418] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 12:51:14 2022] GET /compute/v2.1/os-hosts/n-h1-850003-3 => generated 598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:14.233157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:14.234636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:14.260288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.260731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.261615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.262129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.573112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:14.591056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-381a1435-9957-4c81-91cb-57c9d4068bf7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.368384 Jul 18 12:51:14.592618 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 215/419] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:14 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:14.601948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-29710388-cab4-4378-b77b-97b67a0dffea req-eda3f4f8-84eb-4052-a533-f7ac02b1d05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37258af4-4835-415f-a4a9-2956838d2fb4", "name": "network-vif-plugged", "status": "completed", "tag": "ca0849d2-50dc-4567-911e-9b3d5d457115"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:14.618557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-29710388-cab4-4378-b77b-97b67a0dffea req-eda3f4f8-84eb-4052-a533-f7ac02b1d05b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:14.619566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-29710388-cab4-4378-b77b-97b67a0dffea req-eda3f4f8-84eb-4052-a533-f7ac02b1d05b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:14.647658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-29710388-cab4-4378-b77b-97b67a0dffea req-eda3f4f8-84eb-4052-a533-f7ac02b1d05b service nova] Creating event network-vif-plugged:ca0849d2-50dc-4567-911e-9b3d5d457115 for instance 37258af4-4835-415f-a4a9-2956838d2fb4 on n-h2-850003-3 Jul 18 12:51:14.661358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-29710388-cab4-4378-b77b-97b67a0dffea req-eda3f4f8-84eb-4052-a533-f7ac02b1d05b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064780 Jul 18 12:51:14.663328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 216/420] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:14.763106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:14.793825 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f10c4528-f462-48a0-b2ab-b89a4eff436d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.738272 Jul 18 12:51:14.806182 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 205/421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:14 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:15.080595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=20 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:15.094767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:15.096538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:15.109261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.110078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.111569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.112348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.375382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:15.389883 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6981767-f44a-4891-8783-f7f0c2658c07 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.313216 Jul 18 12:51:15.391614 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 217/422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:15 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:15.614604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:15.616839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:15.627602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.628059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.629523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.630187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.705507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:15.823856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:15.824886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:15.835620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.836755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.838205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:15.839235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:15.876699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:15.890738 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73ad332f-4aa7-461b-8fff-9251b849e9ff tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.284480 Jul 18 12:51:15.891505 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 206/423] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:15 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:16.418720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:16.420141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:16.430853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:16.431583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:16.433174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:16.434141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:16.535309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:16.557839 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6765888-9758-4234-b679-c8a888650765 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.740531 Jul 18 12:51:16.564169 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 218/424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:15 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:16.708202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-642b82c9-0432-4ac2-8f00-3b450ab6cab1 req-4258d894-214f-471d-a41a-173833c758aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "name": "network-vif-plugged", "status": "completed", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:16.728125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-642b82c9-0432-4ac2-8f00-3b450ab6cab1 req-4258d894-214f-471d-a41a-173833c758aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:16.728590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-642b82c9-0432-4ac2-8f00-3b450ab6cab1 req-4258d894-214f-471d-a41a-173833c758aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:16.741912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:16.755722 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-199398fd-3328-4902-9afa-6f9f7aad5f01 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.341202 Jul 18 12:51:16.757806 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 207/425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:16 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:16.770310 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-642b82c9-0432-4ac2-8f00-3b450ab6cab1 req-4258d894-214f-471d-a41a-173833c758aa service nova] Creating event network-vif-plugged:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h1-850003-3 Jul 18 12:51:16.793436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-642b82c9-0432-4ac2-8f00-3b450ab6cab1 req-4258d894-214f-471d-a41a-173833c758aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089648 Jul 18 12:51:16.798439 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 219/426] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:16.911083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:16.913033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:16.922233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:16.923008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:16.924205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:16.924818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.183981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:17.197195 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e65c257a-f9ad-43be-bb24-a81e99e478ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 0.290270 Jul 18 12:51:17.198607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 220/427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:16 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:17.388596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Calling method '.version_select at 0x7f96e4ed5790>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:17.391227 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:17.391227 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:17.394325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.395493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.435332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.436381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.458683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.459791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.472054 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f478e48-0a18-4985-bd30-25aae202cacf tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.644830 Jul 18 12:51:17.473825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 208/428] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 12:51:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:17.490723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Calling method '.version_select at 0x7f96e4ed5550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:17.492541 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:17.492541 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:17.495853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.496634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.533495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.534410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.540309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:17.549641 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ed81169-adb1-4221-9792-1e9a33196892 tempest-HypervisorAdminV228Test-1948885199 tempest-HypervisorAdminV228Test-1948885199-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.065498 Jul 18 12:51:17.551761 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 209/429] 10.222.0.88 () {60 vars in 1192 bytes} [Mon Jul 18 12:51:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 12:51:17.586399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:17.589886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:17.625173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.630984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.635133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.635693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.799467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e50e7f70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:17.802481 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:17.802481 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:17.812259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.813461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.865382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.866404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.893474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.894709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.906675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6ee4528-1200-449a-ad05-208af08e0a2c tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.694225 Jul 18 12:51:17.908171 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 221/430] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:51:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:17.917735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:17.920195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:17.932096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.933314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:17.935598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:17.936502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.034567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:18.057982 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68e15c98-9612-444b-bec9-0c34ae593309 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1318 microversion: 2.1 time: 0.479270 Jul 18 12:51:18.073750 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 210/431] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:17 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:18.082654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e4f0baf0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.103977 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.103977 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:51:18.106884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.107527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.159441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.160469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.186041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.195646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.226759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-910cd038-f3fc-4787-b764-6df83b204bf7 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.150923 Jul 18 12:51:18.242189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 211/432] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:18.259863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.261755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:18.271844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.272492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.273417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.274134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.283347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:18.296262 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d01761a-9dde-42e9-8c62-99e83bb97861 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.386283 Jul 18 12:51:18.298965 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 222/433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:17 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:18.312213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e5067d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.316040 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.316040 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.320366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.324040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.350022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.350900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.366642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.367481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.377694 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40da778f-e6bd-475e-be54-e5ed5bd51552 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074403 Jul 18 12:51:18.389233 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 223/434] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.394745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e5067ca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.395995 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.395995 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.397580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.398353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.415711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.416533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.425145 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69e6ffa6-640a-46a9-b5db-62b01bd6ed2e tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.034374 Jul 18 12:51:18.435883 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 224/435] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.444138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbf01ff7-581f-41c2-b681-af6bf936c36b tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e5067b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.445630 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.445630 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.447697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbf01ff7-581f-41c2-b681-af6bf936c36b tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.448407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbf01ff7-581f-41c2-b681-af6bf936c36b tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.480668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dbf01ff7-581f-41c2-b681-af6bf936c36b tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.042465 Jul 18 12:51:18.482976 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 225/436] 10.222.0.88 () {58 vars in 1178 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.498669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e5067dc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.500642 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.500642 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.503391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.504373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.511421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:18.534794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.535385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.556532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.557799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.571369 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7154137-5141-47d9-a08f-9ccc6b449003 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080515 Jul 18 12:51:18.573173 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 226/437] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.585303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e50c4310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.587598 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.587598 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.590620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.591798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.618775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.619555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.635734 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e7f3b7b0-3984-48f3-95be-972ace444e51 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.055913 Jul 18 12:51:18.637451 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 227/438] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.652492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e5067e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.656211 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.656211 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.659238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.665315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.688277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.689048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.705773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12b1d89a-82b8-46e9-b5f3-1af4c0589543 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.059033 Jul 18 12:51:18.707390 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 228/439] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:18.723006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Calling method '.version_select at 0x7f96e51d4430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:18.723893 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:18.723893 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:18.725717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.726632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.751709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.752834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.774791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:18.775256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:18.815693 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dcd79637-3202-4a8d-8a1f-209265f3abe4 tempest-HypervisorAdminTestJSON-592474118 tempest-HypervisorAdminTestJSON-592474118-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.099307 Jul 18 12:51:18.816339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 229/440] 10.222.0.88 () {58 vars in 1172 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:51:19.091323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:19.092344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:19.109955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:19.117758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:19.119429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:19.122225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:19.224398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:19.260320 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-374a5e4d-a7fc-464c-aab9-9490ee51f5bc tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1310 microversion: 2.1 time: 1.013337 Jul 18 12:51:19.260960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 212/441] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:18 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1310 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:19.330586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:19.331279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:19.333763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:19.360846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:19.367162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:19.369742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:19.370521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:19.661301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:19.681609 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e0c6436-e06d-4ae0-8876-bb502145d86d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1468 microversion: 2.1 time: 0.593766 Jul 18 12:51:19.694215 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 230/442] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:19 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1468 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:19.765042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:19.795260 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25a40fc0-0208-437f-afc6-2b91f13652cf tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.468985 Jul 18 12:51:19.813880 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 213/443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:19 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:20.447381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:20.451585 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:20.451585 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:20.454643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.456166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.458446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.461276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.532886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58a64396-5618-4a19-865d-b10bbb2a03a0 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.845196 Jul 18 12:51:20.535391 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 231/444] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:51:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:20.546101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:20.548139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:20.561637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.563498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.566541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.571182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.836870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2107151589", "block_migration": true, "disk_over_commit": false}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:20.841276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:20.853099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.853545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.854776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.855129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:20.855526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.879364 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43313bc9-c40e-4bf3-a9f3-cd2995b28aaa tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1493 microversion: 2.1 time: 0.341648 Jul 18 12:51:20.899063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 232/445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:20 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1493 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:20.913238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:20.915729 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:20.915729 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:20.918443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.919293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.921348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.922102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:20.973008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lazy-loading 'flavor' on Instance uuid 37258af4-4835-415f-a4a9-2956838d2fb4 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:51:20.976934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4b365ba-a208-47d7-a63b-6f6ddda3f549 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-850003-3" status: 200 len: 578 microversion: 2.1 time: 0.074705 Jul 18 12:51:20.978505 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 233/446] 10.222.0.88 () {58 vars in 1171 bytes} [Mon Jul 18 12:51:20 2022] GET /compute/v2.1/os-services?host=n-d-850003-3 => generated 578 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:20.991318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:20.991942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:20.999142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:20.999597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.000403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.000828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.063479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Going to try to live migrate instance to tempest-host-2107151589 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:51:21.081671 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] HTTP exception thrown: Compute host tempest-host-2107151589 could not be found. Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Request method failure captured: Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4/action HTTP/1.1 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 107 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcqYJCwkNnqJj2IZ_nVxDX2IWyavKkqFpLtGmhFBtxjLaE7cZEgNlUgMUEm_dZkLjtW4wYh3OoOX-UZYgzOPvFOWKRYkD9MD_J0p43mc8EC9ugjkXiNZqtdoX0Y2bYCilPpgLN1Y-xL0lgfL-cWSNcdMZp9JujL-cO5oMtl2pK1RJE Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4184b783883c4b208a998a05d2280338 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:51:21.089222 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4184b783883c4b208a998a05d2280338"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4184b783883c4b208a998a05d2280338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4184b783883c4b208a998a05d2280338", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4184b783883c4b208a998a05d2280338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4184b783883c4b208a998a05d2280338 Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveMigrationNegativeTest-2126555925-project-admin Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6c890ba5b4fe4ba8adfd9ea5feec8b8c Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveMigrationNegativeTest-2126555925-project-admin Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: {"os-migrateLive": {"host": "tempest-host-2107151589", "block_migration": true, "disk_over_commit": false}} Jul 18 12:51:21.092248 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: exception: Compute host tempest-host-2107151589 could not be found. Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '37258af4-4835-415f-a4a9-2956838d2fb4', 'body': {'os-migrateLive': {'host': 'tempest-host-2107151589', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:21.094273 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2107151589 could not be found. Jul 18 12:51:21.098807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2107151589 could not be found. Jul 18 12:51:21.102986 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2107151589 could not be found. Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Returning 400 to user: Compute host tempest-host-2107151589 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9e131db-e325-45ea-a874-2a16361bf9b6 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4/action" status: 400 len: 100 microversion: 2.1 time: 1.275163 Jul 18 12:51:21.105494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 214/447] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 18 12:51:19 2022] POST /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4/action => generated 100 bytes in 1279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:51:21.259360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:21.269206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8dfded8-5987-4ffd-a55a-9cd81371432f tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.289423 Jul 18 12:51:21.270205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 234/448] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:20 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:21.290063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:21.292360 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:21.292360 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:21.303067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.303827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.304910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.305356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.367106 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ae66659-330d-4610-b414-1222a4c741c3 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095628 Jul 18 12:51:21.367807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 235/449] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:51:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:21.379574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:21.380597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:21.392866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.393507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.397587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.398229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.677447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:21.678592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:21.698581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.699141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.700213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.701533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.751546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:21.767842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94074a71-9dbe-44e0-95f2-b01ab696c770 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1468 microversion: 2.1 time: 0.394165 Jul 18 12:51:21.768566 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 236/450] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:21 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1468 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:21.773799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:21.781027 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:21.781027 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:21.782467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.782921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.783744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.784190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.807982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:21.849224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c14f4c3-761c-410d-abc4-1180ca009c20 tempest-ServicesAdminTestJSON-1638101171 tempest-ServicesAdminTestJSON-1638101171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.079044 Jul 18 12:51:21.851098 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 237/451] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:51:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:21.861198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-eda5c7f7-8e15-4ca2-9271-bd581f35da09 req-86be0c41-ee45-4dd0-ab26-07f5808b6103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a137167-d823-4c95-ad1e-0438774e2b90", "name": "network-vif-plugged", "status": "completed", "tag": "62c23b67-3965-4150-8af1-9465d9f73945"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:21.879808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eda5c7f7-8e15-4ca2-9271-bd581f35da09 req-86be0c41-ee45-4dd0-ab26-07f5808b6103 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:21.880947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eda5c7f7-8e15-4ca2-9271-bd581f35da09 req-86be0c41-ee45-4dd0-ab26-07f5808b6103 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:21.905720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-eda5c7f7-8e15-4ca2-9271-bd581f35da09 req-86be0c41-ee45-4dd0-ab26-07f5808b6103 service nova] Creating event network-vif-plugged:62c23b67-3965-4150-8af1-9465d9f73945 for instance 4a137167-d823-4c95-ad1e-0438774e2b90 on n-h2-850003-3 Jul 18 12:51:21.917732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-eda5c7f7-8e15-4ca2-9271-bd581f35da09 req-86be0c41-ee45-4dd0-ab26-07f5808b6103 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062808 Jul 18 12:51:21.920050 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 238/452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:22.044068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2117491919", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:22.182457 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fc16bed2-e650-4580-9470-1f007cd68455 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1644 microversion: 2.1 time: 1.086966 Jul 18 12:51:22.197398 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 215/453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:21 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1644 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:22.204545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:22.205571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:22.214939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.215589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.217655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.218280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.227248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:51:22.549928 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7f7753bb-1447-4ffd-b341-47e604e6cf15 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1644 microversion: 2.1 time: 0.347996 Jul 18 12:51:22.552220 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 216/454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:22 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1644 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:22.576506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:22.578798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:22.594649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.595888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.597626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.598856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.643037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:51:22.643037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:51:22.643452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:51:22.644208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:51:22.644893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:51:22.675196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.675655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.676507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.676961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.699111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Getting quotas for project a1a035a2d693426b92f077b3c30f3ddd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:51:22.704850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Getting quotas for user a3c09e4bb55c4c2caa739a62118e60ee and project a1a035a2d693426b92f077b3c30f3ddd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:51:22.721993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:51:22.728134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:51:22.790974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b7e7f7fc-14d7-4d1b-ac2b-26dcfce4ca02 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756480 Jul 18 12:51:22.800012 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 239/455] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:51:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:51:22.808921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:22.812255 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:22.812255 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:22.815267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.816040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.818895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:22.820057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:22.882731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8042957d-680b-4375-9424-a5a5484e43cc tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088408 Jul 18 12:51:22.884593 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 240/456] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:51:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:22.911387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ea60d68-8ce4-480d-9b79-c57fce46a5b5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:22.918793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ea60d68-8ce4-480d-9b79-c57fce46a5b5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:22.937040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:22.960920 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca533a11-d355-4903-bf43-7d3090abfe83 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.406509 Jul 18 12:51:22.965697 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 217/457] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:22 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:22.982881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:22.985276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:22.999761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:23.000885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:23.003435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:23.004805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:23.091148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lazy-loading 'flavor' on Instance uuid 72844d7c-a36e-417d-ab3e-a2e92819dc0f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:51:23.099636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ea60d68-8ce4-480d-9b79-c57fce46a5b5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:23.116110 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ea60d68-8ce4-480d-9b79-c57fce46a5b5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1219 microversion: 2.1 time: 0.229404 Jul 18 12:51:23.122245 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 241/458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:22 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:23.137102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:51:23.180933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:23.994262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:23.997503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:24.021476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:24.022242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:24.023916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:24.024918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:24.374319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:24.398107 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-692fda7b-07b1-4e45-b3f8-28fb49b86c6b tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1313 microversion: 2.1 time: 0.411200 Jul 18 12:51:24.399299 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 242/459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:23 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:24.411140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:24.412963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:24.429272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:24.430334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:24.432114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:24.432992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:24.567942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:24.585250 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5e6d242-0e27-4499-b597-adc08bbb6acb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1271 microversion: 2.1 time: 0.182877 Jul 18 12:51:24.587112 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 243/460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:24 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:25.436463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:25.441175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:25.460888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:25.463432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:25.465820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:25.468033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:26.382033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:26.401439 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ac95551-3cc9-4176-bef9-4f06150e67a1 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1462 microversion: 2.1 time: 0.976130 Jul 18 12:51:26.411797 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 244/461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:25 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1462 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:26.434872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:26.440759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:26.464044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:26.464905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:26.466922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:26.468693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:26.609958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:26.625852 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46af2a3c-e69b-4908-b9cd-20f654497989 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1277 microversion: 2.1 time: 0.219619 Jul 18 12:51:26.628410 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 245/462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:26 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:27.652927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70e78fa0-77ba-4b65-944a-a2974cb2d112 tempest-InstanceUsageAuditLogTestJSON-325192778 tempest-InstanceUsageAuditLogTestJSON-325192778-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:27.655747 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:27.655747 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:27.699311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70e78fa0-77ba-4b65-944a-a2974cb2d112 tempest-InstanceUsageAuditLogTestJSON-325192778 tempest-InstanceUsageAuditLogTestJSON-325192778-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 12:51:25" status: 200 len: 318 microversion: 2.1 time: 1.068279 Jul 18 12:51:27.700607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 246/463] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 12:51:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2012%3A51%3A25 => generated 318 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:28.142259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Calling method '.version_select at 0x7f96e4febca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:28.172883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:28.173768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:28.273319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:28.276087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:28.317135 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d4d2b8a-14c0-435a-b279-9ef0cda2e070 tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/005a12b5723947b7beab68c6a0adfdc5?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935" status: 200 len: 694 microversion: 2.1 time: 0.614297 Jul 18 12:51:28.318919 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 247/464] 10.222.0.88 () {58 vars in 1411 bytes} [Mon Jul 18 12:51:27 2022] GET /compute/v2.1/os-simple-tenant-usage/005a12b5723947b7beab68c6a0adfdc5?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935 => generated 694 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:28.329164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:28.330647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:28.343812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:28.344597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:28.346400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:28.347928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:28.871768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:28.896864 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25af0049-0cc1-468c-bbf2-af8f6fe56b57 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.575921 Jul 18 12:51:28.918934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 248/465] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:28 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:28.937235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e67eb0de-f9d7-4e23-8858-f1209bc27b48 tempest-InstanceUsageAuditLogTestJSON-325192778 tempest-InstanceUsageAuditLogTestJSON-325192778-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:28.941688 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:28.941688 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:28.977873 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e67eb0de-f9d7-4e23-8858-f1209bc27b48 tempest-InstanceUsageAuditLogTestJSON-325192778 tempest-InstanceUsageAuditLogTestJSON-325192778-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.057025 Jul 18 12:51:28.986831 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 249/466] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:51:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:29.005211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '.version_select at 0x7f96e4fe3a60>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:29.031947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.033524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.072598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.074127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.117377 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7b7b213-353e-4b5a-bdf0-49bc52828f1e tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/005a12b5723947b7beab68c6a0adfdc5?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935" status: 200 len: 694 microversion: 2.1 time: 0.128392 Jul 18 12:51:29.120753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 250/467] 10.222.0.88 () {58 vars in 1411 bytes} [Mon Jul 18 12:51:28 2022] GET /compute/v2.1/os-simple-tenant-usage/005a12b5723947b7beab68c6a0adfdc5?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:29.137138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3bd87003-91c6-4aa4-9b19-16345c62fafa req-95a55948-9945-4a13-bb75-6bf09694a69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3c6395-9dff-44be-ab77-9753cd420b77", "tag": "343fdbb8-ca91-441e-8e59-1f1ea14c5266"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:29.192903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3bd87003-91c6-4aa4-9b19-16345c62fafa req-95a55948-9945-4a13-bb75-6bf09694a69c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.193575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3bd87003-91c6-4aa4-9b19-16345c62fafa req-95a55948-9945-4a13-bb75-6bf09694a69c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.218334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3bd87003-91c6-4aa4-9b19-16345c62fafa req-95a55948-9945-4a13-bb75-6bf09694a69c service nova] Creating event network-changed:343fdbb8-ca91-441e-8e59-1f1ea14c5266 for instance ad3c6395-9dff-44be-ab77-9753cd420b77 on n-h1-850003-3 Jul 18 12:51:29.233972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3bd87003-91c6-4aa4-9b19-16345c62fafa req-95a55948-9945-4a13-bb75-6bf09694a69c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108665 Jul 18 12:51:29.237085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 251/468] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:29.251096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Calling method '.version_select at 0x7f96e4fe30d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:29.268266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.269062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.300224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.301020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.377334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-789fc4c1-0f76-44b6-b441-8eb060be48da tempest-TenantUsagesTestJSON-1034186959 tempest-TenantUsagesTestJSON-1034186959-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935&detailed=1" status: 200 len: 4578 microversion: 2.1 time: 0.137694 Jul 18 12:51:29.380099 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 252/469] 10.222.0.88 () {58 vars in 1334 bytes} [Mon Jul 18 12:51:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T12%3A51%3A26.428935&end=2022-07-19T12%3A51%3A26.428935&detailed=1 => generated 4578 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:29.409696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:29.410513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:29.421574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.422078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.423140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:29.423886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:29.479260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:51:29.485325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:29.640962 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ebdfc1f-27b0-4976-8fd8-48cedf261024 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 204 len: 0 microversion: 2.1 time: 0.239127 Jul 18 12:51:29.642307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 253/470] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:51:29 2022] DELETE /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 12:51:30.276982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Action: 'update', calling method: .version_select at 0x7f96e5136040>, body: {"quota_set": {"ram": "5120"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:30.464166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.466988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:30.469270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.471620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:30.638780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d443b45-d4d1-458a-8b64-e3221c615ac5 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e" status: 200 len: 240 microversion: 2.36 time: 0.993744 Jul 18 12:51:30.642036 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 254/471] 10.222.0.88 () {62 vars in 1302 bytes} [Mon Jul 18 12:51:29 2022] PUT /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e => generated 240 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:30.648501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:30.651110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:30.673617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.673617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:30.674003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9bde4a8-9338-4fb3-a813-3c3d87113360 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f/action" status: 202 len: 0 microversion: 2.1 time: 7.702215 Jul 18 12:51:30.674716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.674716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:30.677440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 218/472] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:51:22 2022] POST /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f/action => generated 0 bytes in 7710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:51:30.689296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:30.690703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:30.706424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.707160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:30.709111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:30.710325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:31.028155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:31.035603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:31.045869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-629d8f23-8a86-4818-b595-f4255410a27d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.366458 Jul 18 12:51:31.054241 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 219/473] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:30 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:31.073340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30734998-82f4-4c5f-9465-7d052f2d7508 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1468 microversion: 2.1 time: 0.428254 Jul 18 12:51:31.077854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 255/474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:30 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:31.113165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Calling method '.version_select at 0x7f96e4fe3430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:31.745394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2056969103", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:31.932037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:51:32.256975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.257882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.258956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.259744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.298606 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99f74df4-ffe0-4465-9d1e-d46a3f922344 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e/detail" status: 200 len: 672 microversion: 2.36 time: 1.211371 Jul 18 12:51:32.299917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 256/475] 10.222.0.88 () {60 vars in 1303 bytes} [Mon Jul 18 12:51:31 2022] GET /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e/detail => generated 672 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:32.330707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:32.332143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:32.350786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.352297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.356217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.362218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.667671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:51:32.669406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:51:32.670835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:51:32.671888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:51:32.673434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:51:32.700825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.702458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.705624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.707997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.760526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Getting quotas for project 5187f2e68acc478b93ef75dc1466c683. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:51:32.770830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Getting quotas for user bda2b920aca542f0ae8fac9f374d7a2e and project 5187f2e68acc478b93ef75dc1466c683. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:51:32.821238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:51:32.832854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:51:32.929065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a36296c3-2233-4ca8-b485-04e6c9b6aa14 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879688 Jul 18 12:51:32.930328 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 220/476] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:51:32.941157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:32.942938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:32.960041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.962230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:32.964766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:32.966352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:33.259224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:33.277927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0a378d1-3cb2-4df9-b27d-24104ac39716 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.975611 Jul 18 12:51:33.295048 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 257/477] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:32 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:33.324514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:33.325632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:33.346526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:33.347327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:33.348757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:33.349546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:33.714565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:33.724520 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbca2ab8-5be4-4796-8edc-9bbc177cb0d5 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.792263 Jul 18 12:51:33.725977 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 221/478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:32 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:33.737153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4ed5af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:34.202675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:34.234742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ece9327d-497b-49a0-a085-53921607fe7c tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1468 microversion: 2.1 time: 0.915255 Jul 18 12:51:34.256207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 258/479] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:33 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1468 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:34.281979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.282799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.286361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.288758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:34.289504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.292381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:34.306810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.308144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.310261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.311319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.444242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.444960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.446922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.449409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.542481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:34.585821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-465bd1dc-57b5-4dc4-a2ba-e66dffc071d0 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1227 microversion: 2.1 time: 0.327343 Jul 18 12:51:34.626797 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 259/480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:34 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1227 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:34.673244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:34.674361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:34.706338 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4880cf3a-2876-43a5-82ff-0ceaaa64c4b1 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e?user_id=f602b39b8362460ab1523cf1ade54237" status: 200 len: 240 microversion: 2.36 time: 0.962199 Jul 18 12:51:34.723769 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 222/481] 10.222.0.88 () {62 vars in 1383 bytes} [Mon Jul 18 12:51:33 2022] PUT /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e?user_id=f602b39b8362460ab1523cf1ade54237 => generated 240 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:34.730868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.738471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.741815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:34.742370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:34.766096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc0ad1d0-1366-4e87-aca4-d1efdfe9c6a0 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] Calling method '.version_select at 0x7f96e4eb0160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:35.447929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:35.476970 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e11cce72-5741-43b2-a748-897e712f558d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.847768 Jul 18 12:51:35.489036 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 260/482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:34 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:35.500200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:35.507981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:35.536012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:35.539127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:35.546319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:35.547442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:35.683640 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc0ad1d0-1366-4e87-aca4-d1efdfe9c6a0 tempest-QuotasAdminTestV236-211184033 tempest-QuotasAdminTestV236-211184033-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e?user_id=f602b39b8362460ab1523cf1ade54237" status: 200 len: 282 microversion: 2.36 time: 0.956012 Jul 18 12:51:35.692698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 223/483] 10.222.0.88 () {60 vars in 1363 bytes} [Mon Jul 18 12:51:34 2022] GET /compute/v2.1/os-quota-sets/282dceaeab584724b37f9fdaa169ca8e?user_id=f602b39b8362460ab1523cf1ade54237 => generated 282 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:51:35.699985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2e949f0a-8c91-495c-b3d4-a5e270bbe631 req-017314bf-670d-4b85-b34c-e6ff94341a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a137167-d823-4c95-ad1e-0438774e2b90", "name": "network-vif-deleted", "tag": "62c23b67-3965-4150-8af1-9465d9f73945"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:35.742287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2e949f0a-8c91-495c-b3d4-a5e270bbe631 req-017314bf-670d-4b85-b34c-e6ff94341a3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:35.747547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2e949f0a-8c91-495c-b3d4-a5e270bbe631 req-017314bf-670d-4b85-b34c-e6ff94341a3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:35.807571 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2e949f0a-8c91-495c-b3d4-a5e270bbe631 req-017314bf-670d-4b85-b34c-e6ff94341a3c service nova] Creating event network-vif-deleted:62c23b67-3965-4150-8af1-9465d9f73945 for instance 4a137167-d823-4c95-ad1e-0438774e2b90 on n-h2-850003-3 Jul 18 12:51:35.836331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2e949f0a-8c91-495c-b3d4-a5e270bbe631 req-017314bf-670d-4b85-b34c-e6ff94341a3c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137341 Jul 18 12:51:35.838945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 224/484] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:35.881236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:35.885195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:35.933161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:35.933991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:35.939885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:35.940893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.073517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:36.080004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.080943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lazy-loading 'fault' on Instance uuid 4a137167-d823-4c95-ad1e-0438774e2b90 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:51:36.130713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:36.166937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36637f71-82a6-43fc-937b-290b7770d64d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.672822 Jul 18 12:51:36.170004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 261/485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:35 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:36.204426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:36.210738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:36.240402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:36.241674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.245866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:36.247235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.421169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:36.432419 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03f2c195-80f3-4e99-84b1-9b7669d1bcb3 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1281 microversion: 2.1 time: 0.257177 Jul 18 12:51:36.450533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 262/486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:36 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:36.513805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:36.518906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:36.570951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:36.572299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.578863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:36.582396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:36.749277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d496d25f8349ed92dadd8347d7608d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a12b5723947b7beab68c6a0adfdc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:36.760019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8114660c-8228-4a3c-bbb9-8db571e461ef tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 200 len: 1303 microversion: 2.1 time: 0.914679 Jul 18 12:51:36.782904 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 225/487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:35 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 1303 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:36.978184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:37.013776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5aea64b-ea80-4e02-b230-1e09ba9a2f10 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.503568 Jul 18 12:51:37.016127 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 263/488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:36 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:37.197910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:37.198856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:37.219633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.226717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.231231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.237804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.254624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:37.471378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:37.476539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:37.507641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.518352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.520293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.521417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.706991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:37.721847 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e0fafee-d59c-4549-8c64-dbc0e7c3c8d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1281 microversion: 2.1 time: 0.260047 Jul 18 12:51:37.727116 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 264/489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:37 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:37.796922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:37.799661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] [instance: 4a137167-d823-4c95-ad1e-0438774e2b90] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:37.829630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.830503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.831606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:37.832340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:37.850032 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] HTTP exception thrown: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Request method failure captured: Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 HTTP/1.1 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vc0sIZJnnavzDzJuR8_3My_jL1SAIQhD9nTMrF6YRso9f9R6LaFTElQPVmSr0ki52yXYpqtX12nfjhoq3DhtAbIqmgi24fCfBSit5r4B4u1jurYsmm3tr8Jczwv7-ooMmeBdBxCxWU-hE4zQu0PQh4e3eEqhG9SenlKbcEQB44E3uM Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 005a12b5723947b7beab68c6a0adfdc5 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TenantUsagesTestJSON-1966812163 Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:51:37.852258 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/005a12b5723947b7beab68c6a0adfdc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/005a12b5723947b7beab68c6a0adfdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_005a12b5723947b7beab68c6a0adfdc5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/005a12b5723947b7beab68c6a0adfdc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TenantUsagesTestJSON-1966812163 Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 005a12b5723947b7beab68c6a0adfdc5 Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1966812163 Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TenantUsagesTestJSON-1966812163-project Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 92d496d25f8349ed92dadd8347d7608d Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TenantUsagesTestJSON-1966812163-project Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. Jul 18 12:51:37.853973 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4a137167-d823-4c95-ad1e-0438774e2b90'} Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:51:37.855053 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. Jul 18 12:51:37.857193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:51:37.860831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] Returning 404 to user: Instance 4a137167-d823-4c95-ad1e-0438774e2b90 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:51:37.862021 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00562d00-900d-4abf-8c1c-cef750317358 tempest-TenantUsagesTestJSON-1966812163 tempest-TenantUsagesTestJSON-1966812163-project] 10.222.0.88 "GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90" status: 404 len: 111 microversion: 2.1 time: 0.074553 Jul 18 12:51:37.866595 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 265/490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:37 2022] GET /compute/v2.1/servers/4a137167-d823-4c95-ad1e-0438774e2b90 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:51:38.036270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:38.037570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:38.077454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:38.078355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:38.088189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:38.089049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:38.146961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:38.187075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecf70c80-92bf-47c5-9bac-68b574fe15d8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.998177 Jul 18 12:51:38.204600 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 226/491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:37 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:38.583670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:38.608977 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-85f1a8ec-92f5-4d0d-8604-328fe5c66975 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.578222 Jul 18 12:51:38.610027 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 266/492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:38 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:38.655201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-497f3f4e-ec54-4b9b-829a-2f8e9973d4a2 req-cd3a9ce8-f272-4c7c-beb5-3931ecc6fa6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3c6395-9dff-44be-ab77-9753cd420b77", "name": "network-vif-plugged", "status": "completed", "tag": "343fdbb8-ca91-441e-8e59-1f1ea14c5266"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:38.693257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-497f3f4e-ec54-4b9b-829a-2f8e9973d4a2 req-cd3a9ce8-f272-4c7c-beb5-3931ecc6fa6a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:38.694074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-497f3f4e-ec54-4b9b-829a-2f8e9973d4a2 req-cd3a9ce8-f272-4c7c-beb5-3931ecc6fa6a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:38.730576 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-497f3f4e-ec54-4b9b-829a-2f8e9973d4a2 req-cd3a9ce8-f272-4c7c-beb5-3931ecc6fa6a service nova] Creating event network-vif-plugged:343fdbb8-ca91-441e-8e59-1f1ea14c5266 for instance ad3c6395-9dff-44be-ab77-9753cd420b77 on n-h1-850003-3 Jul 18 12:51:38.753356 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-497f3f4e-ec54-4b9b-829a-2f8e9973d4a2 req-cd3a9ce8-f272-4c7c-beb5-3931ecc6fa6a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105119 Jul 18 12:51:38.757425 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 227/493] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:51:38.759131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:38.760277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:38.787654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:38.788463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:38.795407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:38.796543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:38.959289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:38.967612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcc719e1-208b-4b39-b0ce-fe3041038745 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1281 microversion: 2.1 time: 0.215905 Jul 18 12:51:38.968206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 267/494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:38 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:39.235928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:39.237264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:39.267981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:39.269184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:39.270629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:39.271615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:39.635344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:39.636906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:39.644314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:39.654944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:39.655728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:39.657440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:39.658518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:40.059473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:40.089847 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b3d5f12f-db5e-426c-9f63-3ead08274fd2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.463387 Jul 18 12:51:40.108795 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 268/495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:39 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:40.112784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:40.126289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-cf94e410-69de-4b1f-a770-45a4a91bc5af req-6ab192b8-2e95-488b-aaab-66f0a7f87690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "name": "network-vif-unplugged", "status": "completed", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:40.146923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6cfe4c3b-a72f-4814-b66c-5112b0928b58 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1319 microversion: 2.1 time: 0.924173 Jul 18 12:51:40.147750 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 228/496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:39 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1319 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:40.170654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:40.172134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:40.180288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:40.180926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:40.182336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:40.182783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:40.198207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-cf94e410-69de-4b1f-a770-45a4a91bc5af req-6ab192b8-2e95-488b-aaab-66f0a7f87690 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:40.202532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-cf94e410-69de-4b1f-a770-45a4a91bc5af req-6ab192b8-2e95-488b-aaab-66f0a7f87690 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:40.248919 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-cf94e410-69de-4b1f-a770-45a4a91bc5af req-6ab192b8-2e95-488b-aaab-66f0a7f87690 service nova] Creating event network-vif-unplugged:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h1-850003-3 Jul 18 12:51:40.266854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-cf94e410-69de-4b1f-a770-45a4a91bc5af req-6ab192b8-2e95-488b-aaab-66f0a7f87690 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161373 Jul 18 12:51:40.268353 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 269/497] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:40.988979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:41.007706 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d510a6f0-2978-4539-8aca-73d9ae4f1550 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1281 microversion: 2.1 time: 0.842818 Jul 18 12:51:41.008695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 229/498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:40 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1281 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:41.135463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:41.139690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:41.176269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:41.184530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:41.194883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:41.196039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:41.198936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:41.204393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:41.222026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:41.225303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:41.233217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:41.237645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:41.764443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:41.805563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-466b4207-623e-4f5e-8478-9046cfb6e120 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 0.684172 Jul 18 12:51:41.811385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 270/499] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:41 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:42.042946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:42.045333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:42.084796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:42.087120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:42.093397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:42.097442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:42.198650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:42.261147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=26 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:42.300970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=31 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:42.375490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:42.414676 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60b2a832-c5a5-4f02-ad7d-b5e94ec8452d tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1469 microversion: 2.1 time: 1.252234 Jul 18 12:51:42.430245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 230/500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:41 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1469 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:51:42.457937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:42.463497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:42.487536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:42.495407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:42.500461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:42.501364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:42.609738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lazy-loading 'flavor' on Instance uuid ad3c6395-9dff-44be-ab77-9753cd420b77 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:51:42.690548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:42.730797 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5178992-afc2-4a6b-8898-f8dd70dcb5d5 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 0.697655 Jul 18 12:51:42.740685 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 271/501] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:42 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:42.778648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-76588c73-eae6-40c6-8644-3d4a5a895ae0 req-13ea9aad-5a69-4fe5-8c7c-35788d3f8899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:42.864281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76588c73-eae6-40c6-8644-3d4a5a895ae0 req-13ea9aad-5a69-4fe5-8c7c-35788d3f8899 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:42.870238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76588c73-eae6-40c6-8644-3d4a5a895ae0 req-13ea9aad-5a69-4fe5-8c7c-35788d3f8899 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:42.951192 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-76588c73-eae6-40c6-8644-3d4a5a895ae0 req-13ea9aad-5a69-4fe5-8c7c-35788d3f8899 service nova] Creating event network-changed:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h1-850003-3 Jul 18 12:51:42.983540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cae4564d-cbf8-4c29-ae7f-d8256af6e3f7 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77/action" status: 202 len: 0 microversion: 2.1 time: 0.526173 Jul 18 12:51:42.986692 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 231/502] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:51:42 2022] POST /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:51:42.988565 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-76588c73-eae6-40c6-8644-3d4a5a895ae0 req-13ea9aad-5a69-4fe5-8c7c-35788d3f8899 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241217 Jul 18 12:51:42.992621 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 272/503] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:43.017901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:43.023598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:43.024764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:43.029465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:43.058017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.061158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.061979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:43.063195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:43.064462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.065179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:43.067037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.068429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:43.489490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:43.509227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5628a8b8-e1aa-4830-abe5-a48191165c29 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1477 microversion: 2.1 time: 0.510899 Jul 18 12:51:43.509900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 273/504] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:42 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1477 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:43.759922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:43.760448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:43.776959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.777557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:43.778740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:43.779432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:44.420159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:44.438606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e40b9eb2-c690-437d-951a-67410ef633ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 1.447751 Jul 18 12:51:44.460996 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 232/505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:42 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:44.516563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:44.522107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:44.522910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:44.550784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:44.551471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:44.552762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:44.553448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:44.680299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:51:44.860266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:44.908557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10866e7f-6026-4253-ae6e-ad4b2cad215f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 204 len: 0 microversion: 2.1 time: 0.391728 Jul 18 12:51:44.908988 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-547f68ce-f053-42dd-a7f6-3e3c85befba9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 1.148742 Jul 18 12:51:44.913170 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 233/506] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:51:44 2022] DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:51:44.919497 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 274/507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:43 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:44.938462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:44.940313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:44.954116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:44.955497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:44.958705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:44.959563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:45.355786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2114445290", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "411795138", "adminPass": "***", "networks": [{"uuid": "be0aed87-b9e9-42c3-af6e-9e2325a79318"}], "security_groups": [{"name": "tempest-securitygroup--1086590509"}], "key_name": "tempest-keypair-39912689", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:45.648734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=22 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:46.443852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] validate_networks() for [('be0aed87-b9e9-42c3-af6e-9e2325a79318', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:51:47.082122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:47.100566 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4a95bd1d-98a8-473c-9834-ea799511d20f tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1460 microversion: 2.1 time: 2.184703 Jul 18 12:51:47.102126 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 234/508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:44 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1460 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:47.113010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:47.115154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:47.132637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:47.134390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:47.136509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:47.138019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:48.834616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:51:48.835410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:51:48.836301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:51:48.837191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:51:48.837980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:51:48.875001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:48.876189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:48.878075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:48.879264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:48.941219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:51:48.957382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Getting quotas for user ab603aa7a37344fc8e71e4b6d6fc32c0 and project 21c34421b2324ed3b3f15ccb5139e78b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:51:49.010953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:51:49.016801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:51:49.023239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:49.068229 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a8d8dfa-b598-4a93-af0a-79b76bc7b855 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 1.963550 Jul 18 12:51:49.072195 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 235/509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:47 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:49.099147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:49.100303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:49.145301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:49.158688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:49.160222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:49.161838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:49.260973 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80763d12-e0b8-465d-a4e1-22bf47b5e3e6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.911401 Jul 18 12:51:49.271963 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 275/510] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:51:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:51:49.290778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:49.298303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:49.328138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:49.329147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:49.343240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:49.344243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:50.727818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:50.762741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f5c1e23-ef66-481d-a629-aaffeafd1787 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 1.676547 Jul 18 12:51:50.766920 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 236/511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:49 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:50.791488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:50.793565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:50.801449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:50.830196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:50.838622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:50.840893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:50.841953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.073657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:51.122283 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f5c0f78-8b1b-48bc-aab3-e2236bcdbc39 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1257 microversion: 2.1 time: 0.352898 Jul 18 12:51:51.129051 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 237/512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:50 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1257 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:51.151259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:51.154973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:51.200086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.201655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.209775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.211706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.644973 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-684fa888-3c57-4762-b14e-7060aec68bdd tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1611 microversion: 2.1 time: 2.370654 Jul 18 12:51:51.658183 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 276/513] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:49 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1611 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:51.664122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-bb1083ab-9af9-48d9-9e64-2e83e67ce386 req-6f4826c8-ef04-462e-bda4-8670dc4f7159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5f02e2-6e54-4cee-af8f-f5581fc5108f", "tag": "df8c67a1-bac1-477a-a408-171274824fa9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:51.692770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bb1083ab-9af9-48d9-9e64-2e83e67ce386 req-6f4826c8-ef04-462e-bda4-8670dc4f7159 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.693615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bb1083ab-9af9-48d9-9e64-2e83e67ce386 req-6f4826c8-ef04-462e-bda4-8670dc4f7159 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.753680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-bb1083ab-9af9-48d9-9e64-2e83e67ce386 req-6f4826c8-ef04-462e-bda4-8670dc4f7159 service nova] Creating event network-changed:df8c67a1-bac1-477a-a408-171274824fa9 for instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f on n-h2-850003-3 Jul 18 12:51:51.764782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-bb1083ab-9af9-48d9-9e64-2e83e67ce386 req-6f4826c8-ef04-462e-bda4-8670dc4f7159 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112084 Jul 18 12:51:51.766103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 277/514] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:51.777587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:51.780996 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:51:51.780996 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:51:51.784213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.785466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.787428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.788622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.859943 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38789e52-493e-4fff-8438-f80995673940 tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091157 Jul 18 12:51:51.861595 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 278/515] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:51:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:51.886862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:51.888550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:51.930774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.931626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:51.933172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:51.934058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:52.365412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:52.410831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8250b04-30e7-4d71-a772-ad379348f538 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 1.278935 Jul 18 12:51:52.430195 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 238/516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:51 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:52.438858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:52.442579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:52.458925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:52.460356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:52.462274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:52.463468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:52.515551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Lazy-loading 'flavor' on Instance uuid ad3c6395-9dff-44be-ab77-9753cd420b77 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:51:52.543823 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ad3c6395-9dff-44be-ab77-9753cd420b77 while it is in vm_state suspended Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Request method failure captured: Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77/action HTTP/1.1 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 97 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcqYJCwkNnqJj2IZ_nVxDX2IWyavKkqFpLtGmhFBtxjLaE7cZEgNlUgMUEm_dZkLjtW4wYh3OoOX-UZYgzOPvFOWKRYkD9MD_J0p43mc8EC9ugjkXiNZqtdoX0Y2bYCilPpgLN1Y-xL0lgfL-cWSNcdMZp9JujL-cO5oMtl2pK1RJE Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4184b783883c4b208a998a05d2280338 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:51:52.548238 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4184b783883c4b208a998a05d2280338"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4184b783883c4b208a998a05d2280338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4184b783883c4b208a998a05d2280338", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4184b783883c4b208a998a05d2280338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4184b783883c4b208a998a05d2280338 Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2126555925 Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveMigrationNegativeTest-2126555925-project-admin Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6c890ba5b4fe4ba8adfd9ea5feec8b8c Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveMigrationNegativeTest-2126555925-project-admin Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": true, "disk_over_commit": false}} Jul 18 12:51:52.550740 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'os-migrateLive' instance ad3c6395-9dff-44be-ab77-9753cd420b77 while it is in vm_state suspended Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ad3c6395-9dff-44be-ab77-9753cd420b77', 'body': {'os-migrateLive': {'host': 'n-h2-850003-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 12:51:52.551907 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:52.554027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ad3c6395-9dff-44be-ab77-9753cd420b77 while it is in vm_state suspended Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ad3c6395-9dff-44be-ab77-9753cd420b77 while it is in vm_state suspended Jul 18 12:51:52.557839 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:51:52.563717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ad3c6395-9dff-44be-ab77-9753cd420b77 while it is in vm_state suspended {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:51:52.565407 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9c8f56e-1765-4c6f-b711-2acf5857730c tempest-LiveMigrationNegativeTest-2126555925 tempest-LiveMigrationNegativeTest-2126555925-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77/action" status: 409 len: 155 microversion: 2.1 time: 0.144073 Jul 18 12:51:52.569884 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 239/517] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:51:52 2022] POST /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:51:52.591165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:52.592522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:52.615969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:52.616880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:52.618726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:52.622806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:52.641886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:52.957738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:52.979047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-622321f7-c799-4607-a4c5-95dc8edf149d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1319 microversion: 2.1 time: 0.404837 Jul 18 12:51:52.990853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 240/518] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:52 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:53.001952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-be3ddcae-08f1-439a-8b18-c0f1c71f91db req-7234acdd-4db3-4bee-8d4f-d2c9e9d9ff10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b147194b-0153-47c3-b2ed-1f398764e2d6", "name": "network-vif-unplugged", "status": "completed", "tag": "8623e45a-b41b-491e-9309-51d84fa4dfc1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:53.022199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be3ddcae-08f1-439a-8b18-c0f1c71f91db req-7234acdd-4db3-4bee-8d4f-d2c9e9d9ff10 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.023822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be3ddcae-08f1-439a-8b18-c0f1c71f91db req-7234acdd-4db3-4bee-8d4f-d2c9e9d9ff10 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.052358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-be3ddcae-08f1-439a-8b18-c0f1c71f91db req-7234acdd-4db3-4bee-8d4f-d2c9e9d9ff10 service nova] Creating event network-vif-unplugged:8623e45a-b41b-491e-9309-51d84fa4dfc1 for instance b147194b-0153-47c3-b2ed-1f398764e2d6 on n-h1-850003-3 Jul 18 12:51:53.064836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-be3ddcae-08f1-439a-8b18-c0f1c71f91db req-7234acdd-4db3-4bee-8d4f-d2c9e9d9ff10 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071457 Jul 18 12:51:53.065688 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 241/519] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:53.076747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:53.077828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:53.089505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.089944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.091213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.091670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.128837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:51:53.293799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7eb68d7e-591f-489e-92b8-dd82b518ab06 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 204 len: 0 microversion: 2.1 time: 0.225422 Jul 18 12:51:53.299395 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 242/520] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:51:53 2022] DELETE /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:51:53.307881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d831a8c3-3fda-4514-9da5-0cf75d75dc1f req-5340f5f0-08b2-4fe9-8db5-1f7fad139ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "name": "network-vif-unplugged", "status": "completed", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:53.328727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d831a8c3-3fda-4514-9da5-0cf75d75dc1f req-5340f5f0-08b2-4fe9-8db5-1f7fad139ce7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.330912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d831a8c3-3fda-4514-9da5-0cf75d75dc1f req-5340f5f0-08b2-4fe9-8db5-1f7fad139ce7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.355041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d831a8c3-3fda-4514-9da5-0cf75d75dc1f req-5340f5f0-08b2-4fe9-8db5-1f7fad139ce7 service nova] Creating event network-vif-unplugged:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h1-850003-3 Jul 18 12:51:53.364898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d831a8c3-3fda-4514-9da5-0cf75d75dc1f req-5340f5f0-08b2-4fe9-8db5-1f7fad139ce7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062831 Jul 18 12:51:53.365821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 243/521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:53.374925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:53.375970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:53.386493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.387276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.388384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.389260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.524217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:53.551253 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-744b826b-0a02-4da6-b4c2-503a03e7657f tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 1.676507 Jul 18 12:51:53.552275 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 279/522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:51 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:53.587442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:53.588604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:53.623376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.624731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:53.626607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:53.627924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:54.877978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:54.920185 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a467be2a-ef5d-4197-97e8-e3a39b06edc7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 1.337586 Jul 18 12:51:54.926201 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 280/523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:53 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:54.936970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:54.938465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:54.981680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:54.982431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:54.983563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:54.987520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:55.054976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:55.083589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04cf68f9-4f25-44b6-b6cf-254999148702 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1466 microversion: 2.1 time: 1.716429 Jul 18 12:51:55.084859 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 244/524] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:53 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1466 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:55.110550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:55.111906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:55.134211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:55.134964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:55.157785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:55.158279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:55.949012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:55.970400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-583edbcd-103b-4274-9649-e2537f7386ac tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1319 microversion: 2.1 time: 1.042225 Jul 18 12:51:55.971015 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 281/525] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:54 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1319 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:55.983252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:55.995216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:56.008054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:56.019466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:56.021436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:56.022677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:56.383283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:56.420506 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cfb680ae-2c74-4754-8fb4-396ebb6995a9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 1.327493 Jul 18 12:51:56.424070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 245/526] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:55 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:56.443999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:56.449859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:56.481424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:56.484375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:56.488787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:56.493342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:58.360791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:58.446972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eb4b0683-ac24-4006-aa73-43e00341d24a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 2.469266 Jul 18 12:51:58.455770 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 282/527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:55 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:58.515397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:58.519156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:58.559389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:58.559846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:58.564624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:58.578240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:58.984642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:51:59.708728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:51:59.737639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a45630ea-202a-4418-b06e-6c8919476391 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 200 len: 1466 microversion: 2.1 time: 3.311130 Jul 18 12:51:59.738992 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 246/528] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:56 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 1466 bytes in 3314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:51:59.763632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7e819878-9d01-40e0-869c-d8afbd4a63cf req-dbf29715-1735-4a33-bd30-d2cc1169a28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b147194b-0153-47c3-b2ed-1f398764e2d6", "name": "network-vif-deleted", "tag": "8623e45a-b41b-491e-9309-51d84fa4dfc1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:51:59.787336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7e819878-9d01-40e0-869c-d8afbd4a63cf req-dbf29715-1735-4a33-bd30-d2cc1169a28d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:59.789410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7e819878-9d01-40e0-869c-d8afbd4a63cf req-dbf29715-1735-4a33-bd30-d2cc1169a28d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:59.813664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7e819878-9d01-40e0-869c-d8afbd4a63cf req-dbf29715-1735-4a33-bd30-d2cc1169a28d service nova] Creating event network-vif-deleted:8623e45a-b41b-491e-9309-51d84fa4dfc1 for instance b147194b-0153-47c3-b2ed-1f398764e2d6 on n-h1-850003-3 Jul 18 12:51:59.829596 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7e819878-9d01-40e0-869c-d8afbd4a63cf req-dbf29715-1735-4a33-bd30-d2cc1169a28d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088477 Jul 18 12:51:59.831729 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 247/529] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:51:59.853840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:51:59.859278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:51:59.885215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:59.893703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:59.899637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:51:59.900880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:51:59.957724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:00.001512 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa75e701-867e-4702-b303-9aaa6f2d62a7 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 1.521265 Jul 18 12:52:00.017518 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 283/530] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:58 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:00.449181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8bb53ce-cf28-4d25-b7a0-76d083a5355f tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Action: 'create', calling method: .version_select at 0x7f96e4f5e310>, body: {"pool": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:01.814288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:02.193107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:02.238240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1bb18dea-8a1c-48e0-8ddb-dcfa61bed580 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 2.403949 Jul 18 12:52:02.239940 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 248/531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:51:59 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:02.255716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:02.257324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:02.281320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:02.284402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:02.286696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:02.287689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:04.407390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:04.455268 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff26e663-277e-4480-897f-dfe6b96374ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1503 microversion: 2.1 time: 2.210400 Jul 18 12:52:04.457966 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 249/532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:02 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1503 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:04.496752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:04.502762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: ad3c6395-9dff-44be-ab77-9753cd420b77] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:04.552129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:04.557204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:04.559831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:04.561076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:04.639485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] HTTP exception thrown: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Request method failure captured: Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 HTTP/1.1 Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VclH6Z4S4Pd42Uk_5p_rlrfOGhEqCXb9Th7RV04SI_nvq0rs8iOxFxu2_K8VVIR1GYl7cBLP5OIztT7BzWlxLoBoltJ1qkJokkVs2w9cq6G7BeqtmRJLN-piyjy8rpiYbDC32IX5-P1CvLztkskWz9uxSClaljHDG3W1tYmH5yquIo Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a1a035a2d693426b92f077b3c30f3ddd Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:52:04.644315 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a1a035a2d693426b92f077b3c30f3ddd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a1a035a2d693426b92f077b3c30f3ddd Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveMigrationNegativeTest-213497304-project Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: a3c09e4bb55c4c2caa739a62118e60ee Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveMigrationNegativeTest-213497304-project Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. Jul 18 12:52:04.647306 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ad3c6395-9dff-44be-ab77-9753cd420b77'} Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:52:04.648728 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. Jul 18 12:52:04.651237 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:04.657837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Returning 404 to user: Instance ad3c6395-9dff-44be-ab77-9753cd420b77 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:52:04.659017 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04be5e17-1781-4c75-8a9a-c665845d8104 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77" status: 404 len: 111 microversion: 2.1 time: 0.197453 Jul 18 12:52:04.660812 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 250/533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:04 2022] GET /compute/v2.1/servers/ad3c6395-9dff-44be-ab77-9753cd420b77 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:52:04.680708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:04.691219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:04.705160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:04.706331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:04.708094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:04.708983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:06.509454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:06.526755 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d5519d0-cbba-4728-91e8-d08aad8f1fd6 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 1.864000 Jul 18 12:52:06.528636 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 251/534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:04 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:06.534189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-cf013471-a173-4657-8031-7e53388bb952 req-c6458339-8d4b-425f-b29b-ed4ac5e34826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3c6395-9dff-44be-ab77-9753cd420b77", "name": "network-vif-deleted", "tag": "343fdbb8-ca91-441e-8e59-1f1ea14c5266"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:06.547092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cf013471-a173-4657-8031-7e53388bb952 req-c6458339-8d4b-425f-b29b-ed4ac5e34826 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:06.548102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cf013471-a173-4657-8031-7e53388bb952 req-c6458339-8d4b-425f-b29b-ed4ac5e34826 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:06.576910 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-cf013471-a173-4657-8031-7e53388bb952 req-c6458339-8d4b-425f-b29b-ed4ac5e34826 service nova] Creating event network-vif-deleted:343fdbb8-ca91-441e-8e59-1f1ea14c5266 for instance ad3c6395-9dff-44be-ab77-9753cd420b77 on n-h1-850003-3 Jul 18 12:52:06.590329 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-cf013471-a173-4657-8031-7e53388bb952 req-c6458339-8d4b-425f-b29b-ed4ac5e34826 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059474 Jul 18 12:52:06.594279 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 252/535] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:06.604348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:06.606957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:06.615805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:06.622056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:06.624759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:06.626586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:07.460968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:07.501735 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6409cbac-54c5-41f8-ba7e-92acb4785199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 0.905009 Jul 18 12:52:07.529834 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 253/536] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:06 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:07.568586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:07.577470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:07.603727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:07.605075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:07.607148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:07.608139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:07.669926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:52:07.979528 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09878069-51d3-48a7-9be5-7ceb09687cfb tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "DELETE /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 204 len: 0 microversion: 2.1 time: 0.441947 Jul 18 12:52:07.994767 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 254/537] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:52:07 2022] DELETE /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:52:08.020363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:08.042224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:08.094930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.096685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.103615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.104393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.494198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8bb53ce-cf28-4d25-b7a0-76d083a5355f tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.471431 Jul 18 12:52:08.507079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 284/538] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:52:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:08.507079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4cf4accf-2b4b-4133-8dea-4c86cfe9fc09 req-8b2145e8-a2b4-4c53-bc6b-fb743095ae5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6951dad0-6630-4237-80ef-3a88c7cd8b2b", "tag": "fce0e40a-0335-487b-8ee2-fa4056074422"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:08.523440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4cf4accf-2b4b-4133-8dea-4c86cfe9fc09 req-8b2145e8-a2b4-4c53-bc6b-fb743095ae5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.525163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4cf4accf-2b4b-4133-8dea-4c86cfe9fc09 req-8b2145e8-a2b4-4c53-bc6b-fb743095ae5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.552628 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4cf4accf-2b4b-4133-8dea-4c86cfe9fc09 req-8b2145e8-a2b4-4c53-bc6b-fb743095ae5d service nova] Creating event network-changed:fce0e40a-0335-487b-8ee2-fa4056074422 for instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b on n-h2-850003-3 Jul 18 12:52:08.564365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4cf4accf-2b4b-4133-8dea-4c86cfe9fc09 req-8b2145e8-a2b4-4c53-bc6b-fb743095ae5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066381 Jul 18 12:52:08.578580 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 285/539] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:08.590999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:08.592330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:08.621411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.623257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.625056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.626175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.831424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:08.866480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-66207df1-64e3-4822-ac8e-74e48ec05acf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1493 microversion: 2.1 time: 0.867922 Jul 18 12:52:08.885534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 255/540] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:07 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1493 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:08.900079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:08.901520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:08.919272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.920292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:08.922233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:08.923273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:09.180259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:09.235731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcb72099-a212-4892-b497-d9e0f925c55e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 0.650780 Jul 18 12:52:09.237720 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 286/541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:08 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:09.277176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34f57ea8-57fd-4c0e-bcf7-4881fe6dcf12 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Action: 'create', calling method: .version_select at 0x7f96e4fe3ca0>, body: {"pool": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:09.440924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:09.447912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:09.458516 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a2270d23-ad6a-4ee2-8ab3-8bb6cda06671 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1474 microversion: 2.1 time: 0.569861 Jul 18 12:52:09.459956 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 256/542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:08 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1474 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:09.466932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:09.467750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:09.480660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:09.481149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:09.483014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:09.483884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:10.049994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:10.081141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-303a9aa8-06ea-46ed-862c-41d7158bb6d9 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 0.619468 Jul 18 12:52:10.082291 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 257/543] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:09 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:10.125482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0493e485-b8eb-4e39-ae59-90baf88680d9 req-cb281d27-c79e-40df-97bb-6c5dd34057b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5f02e2-6e54-4cee-af8f-f5581fc5108f", "name": "network-vif-plugged", "status": "completed", "tag": "df8c67a1-bac1-477a-a408-171274824fa9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:10.159421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0493e485-b8eb-4e39-ae59-90baf88680d9 req-cb281d27-c79e-40df-97bb-6c5dd34057b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:10.160279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0493e485-b8eb-4e39-ae59-90baf88680d9 req-cb281d27-c79e-40df-97bb-6c5dd34057b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:10.231408 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0493e485-b8eb-4e39-ae59-90baf88680d9 req-cb281d27-c79e-40df-97bb-6c5dd34057b3 service nova] Creating event network-vif-plugged:df8c67a1-bac1-477a-a408-171274824fa9 for instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f on n-h2-850003-3 Jul 18 12:52:10.258187 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0493e485-b8eb-4e39-ae59-90baf88680d9 req-cb281d27-c79e-40df-97bb-6c5dd34057b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144934 Jul 18 12:52:10.266622 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 258/544] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:10.308181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73a04d68-09d3-4560-9473-20137ebfdd71 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '.version_select at 0x7f96e4ce8310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:10.324795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73a04d68-09d3-4560-9473-20137ebfdd71 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:10.325584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73a04d68-09d3-4560-9473-20137ebfdd71 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:10.464731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73a04d68-09d3-4560-9473-20137ebfdd71 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.195072 Jul 18 12:52:10.470994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 259/545] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:52:10 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:10.498689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:10.500885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:10.530792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:10.532119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:10.533855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:10.537184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:11.400150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:11.437282 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-43dfb62f-7a6a-425b-bfa7-8779180789af tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 0.964662 Jul 18 12:52:11.443852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 260/546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:10 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:11.461470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:11.461470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:11.495276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:11.507221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:11.508814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:11.509611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:12.595177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:12.628334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a1be3ba-2236-40fc-b454-fb781a9cb79a tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1474 microversion: 2.1 time: 1.182348 Jul 18 12:52:12.654192 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 261/547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:11 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1474 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:12.664568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:12.664568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:12.683837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:12.687671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:12.707990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:12.715294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:13.124031 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed77ebe3-47a3-402a-bcce-8cffb545186f tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1644 microversion: 2.1 time: 0.477322 Jul 18 12:52:13.139431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 262/548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:12 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1644 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:13.164460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:13.165723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:13.181336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:13.182632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:13.184731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:13.185706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:13.592480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:13.626984 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2586425-3f11-4920-ac78-02397fc6c199 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1323 microversion: 2.1 time: 0.485430 Jul 18 12:52:13.639806 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 263/549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:13 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:13.653834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:13.654914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:13.662476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:13.674827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:13.678798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:13.682976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:14.175340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:14.195814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12b92570-f341-4f69-a175-6cefd5c1ff7d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 0.547191 Jul 18 12:52:14.214638 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 264/550] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:13 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:14.236242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-207848923", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "de298d9c-e7c4-4212-8e1a-869417573018"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:14.356619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] validate_networks() for [('de298d9c-e7c4-4212-8e1a-869417573018', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:52:15.709322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:52:15.710372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:52:15.710372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:52:15.710817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:52:15.711159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:52:15.729752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:15.730257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:15.731120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:15.741500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:15.792372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:52:15.807063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for user 64cdfc77cf92451c84c873df41bc422f and project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:52:15.852646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:52:15.862016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:52:16.028505 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a85e2d8-19b2-4d13-b8ca-3d4037327c38 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.811306 Jul 18 12:52:16.033277 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 265/551] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:52:16.046832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:16.050047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:16.077309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:16.087466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:16.089534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:16.090738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:16.738833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:16.764440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8637711-d06a-4e0c-a8f7-5365653bd5e8 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1432 microversion: 2.1 time: 0.727664 Jul 18 12:52:16.778566 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 266/552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:16 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1432 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:16.810078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:16.812996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:16.835307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:16.836127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:16.837691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:16.838515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:17.281692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:17.321739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-697c6776-c928-4ee0-a84a-0a219b51dde6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1471 microversion: 2.1 time: 0.551140 Jul 18 12:52:17.337734 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 267/553] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:16 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1471 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:17.362030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:17.363631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:17.384432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:17.388488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:17.390543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:17.410328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:17.980145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:18.000369 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb6e8b23-850e-4842-8da9-5d4dd8f5df61 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 0.657883 Jul 18 12:52:18.022625 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 268/554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:17 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:18.039715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:18.040742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:18.059135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.063640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.064948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.065975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.191025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:18.202574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b06a7f8-eb50-4628-884e-2e323af7ab29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1262 microversion: 2.1 time: 0.178161 Jul 18 12:52:18.206313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 269/555] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:18 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1262 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:18.216758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0863a2b6-30b3-4d9e-90ee-95dea7e41c25 req-ba9cb599-ea0d-40a8-87f9-9e02298a0bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37258af4-4835-415f-a4a9-2956838d2fb4", "name": "network-vif-deleted", "tag": "ca0849d2-50dc-4567-911e-9b3d5d457115"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:18.235365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0863a2b6-30b3-4d9e-90ee-95dea7e41c25 req-ba9cb599-ea0d-40a8-87f9-9e02298a0bee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.237114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0863a2b6-30b3-4d9e-90ee-95dea7e41c25 req-ba9cb599-ea0d-40a8-87f9-9e02298a0bee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.277933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0863a2b6-30b3-4d9e-90ee-95dea7e41c25 req-ba9cb599-ea0d-40a8-87f9-9e02298a0bee service nova] Creating event network-vif-deleted:ca0849d2-50dc-4567-911e-9b3d5d457115 for instance 37258af4-4835-415f-a4a9-2956838d2fb4 on n-h2-850003-3 Jul 18 12:52:18.288635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0863a2b6-30b3-4d9e-90ee-95dea7e41c25 req-ba9cb599-ea0d-40a8-87f9-9e02298a0bee service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079053 Jul 18 12:52:18.290426 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 270/556] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:18.311459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:18.314546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:18.333823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.334814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.336527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.337498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.416680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Request method failure captured: Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f/diagnostics HTTP/1.1 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VdOML977kW4jhoDlDMV-5qQ2VIARdRb7BwNdXbXnOA9GAK35kHJIILUrznX4T8MGnW_ugD43demVU_MY7fwWA0RjVTwXt5fwvbtZIv21zb1g9kh6pXhFv3yhy6KrgPFGNRWVJW95NQVRrXRCjchHmLCwe2hrPEjmoieLSQ4UGLcnZY Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5187f2e68acc478b93ef75dc1466c683 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:52:18.425532 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5187f2e68acc478b93ef75dc1466c683", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5187f2e68acc478b93ef75dc1466c683 Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiagnosticsNegativeTest-951534629-project Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bda2b920aca542f0ae8fac9f374d7a2e Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-951534629-project Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:52:18.427988 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': 'bc5f02e2-6e54-4cee-af8f-f5581fc5108f'} Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:52:18.429514 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 12:52:18.431421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:18.433582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:52:18.435802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-431a32ba-90c9-4d22-adab-d6b6d9fdb6f6 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.143084 Jul 18 12:52:18.446325 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 271/557] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:52:18 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f/diagnostics => generated 117 bytes in 149 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:52:18.460789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:18.462684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:18.482213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.483351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.486856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.487688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.569497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.570619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.571661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lazy-loading 'fault' on Instance uuid 37258af4-4835-415f-a4a9-2956838d2fb4 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:52:18.607021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:18.678725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c09e4bb55c4c2caa739a62118e60ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a035a2d693426b92f077b3c30f3ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:18.693041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c6eddb6-2433-4cc7-8150-617b23356c74 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 200 len: 1308 microversion: 2.1 time: 0.250240 Jul 18 12:52:18.695844 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 272/558] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:18 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:18.713551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:18.715746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:18.731766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.732520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.736537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:18.736537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:18.789257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:52:19.080207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:19.187449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=67 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:19.189500 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ebe058f8-1dd0-4146-97d5-0098ad3ed266 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 204 len: 0 microversion: 2.1 time: 0.489715 Jul 18 12:52:19.197657 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 273/559] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:52:18 2022] DELETE /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:52:19.246134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:19.250979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:19.286699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:19.288264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:19.295824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:19.299480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:19.375461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:20.565767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:20.587326 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75bc9f2f-51c1-42dd-b0a3-f0e048e15b96 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1387 microversion: 2.1 time: 1.389700 Jul 18 12:52:20.588887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 274/560] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:19 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1387 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:20.598420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:20.600242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:20.613162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:20.614489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:20.616331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:20.617422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.101913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda2b920aca542f0ae8fac9f374d7a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5187f2e68acc478b93ef75dc1466c683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:21.115149 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97bab26a-f365-49fe-9d17-3fbf89958337 tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 200 len: 1477 microversion: 2.1 time: 0.524385 Jul 18 12:52:21.116583 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 275/561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:20 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 1477 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:21.122516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:21.123169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:21.136996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:21.138360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.139635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:21.140170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.275010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34f57ea8-57fd-4c0e-bcf7-4881fe6dcf12 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 12.031408 Jul 18 12:52:21.282237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 287/562] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:52:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 12039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:21.295155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:21.295877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] [instance: 37258af4-4835-415f-a4a9-2956838d2fb4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:21.315732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:21.316194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.317029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:21.317570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.346632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] HTTP exception thrown: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Request method failure captured: Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 HTTP/1.1 Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VclH6Z4S4Pd42Uk_5p_rlrfOGhEqCXb9Th7RV04SI_nvq0rs8iOxFxu2_K8VVIR1GYl7cBLP5OIztT7BzWlxLoBoltJ1qkJokkVs2w9cq6G7BeqtmRJLN-piyjy8rpiYbDC32IX5-P1CvLztkskWz9uxSClaljHDG3W1tYmH5yquIo Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a1a035a2d693426b92f077b3c30f3ddd Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:52:21.348269 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a1a035a2d693426b92f077b3c30f3ddd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1a035a2d693426b92f077b3c30f3ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a1a035a2d693426b92f077b3c30f3ddd Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-213497304 Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-LiveMigrationNegativeTest-213497304-project Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: a3c09e4bb55c4c2caa739a62118e60ee Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-LiveMigrationNegativeTest-213497304-project Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. Jul 18 12:52:21.349785 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '37258af4-4835-415f-a4a9-2956838d2fb4'} Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:52:21.350786 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. Jul 18 12:52:21.352213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:52:21.353448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] Returning 404 to user: Instance 37258af4-4835-415f-a4a9-2956838d2fb4 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:52:21.353448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ce4486e-0a33-451a-bbb0-981979c8eff1 tempest-LiveMigrationNegativeTest-213497304 tempest-LiveMigrationNegativeTest-213497304-project] 10.222.0.88 "GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4" status: 404 len: 111 microversion: 2.1 time: 0.061045 Jul 18 12:52:21.357819 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 288/563] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:21 2022] GET /compute/v2.1/servers/37258af4-4835-415f-a4a9-2956838d2fb4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:52:21.373660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-770f87ac-a3a2-4e73-9479-5c350e85af58 req-1370e843-0129-446b-914c-01a64232a84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6951dad0-6630-4237-80ef-3a88c7cd8b2b", "name": "network-vif-plugged", "status": "completed", "tag": "fce0e40a-0335-487b-8ee2-fa4056074422"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:21.404318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-770f87ac-a3a2-4e73-9479-5c350e85af58 req-1370e843-0129-446b-914c-01a64232a84b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:21.405916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-770f87ac-a3a2-4e73-9479-5c350e85af58 req-1370e843-0129-446b-914c-01a64232a84b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:21.439084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-770f87ac-a3a2-4e73-9479-5c350e85af58 req-1370e843-0129-446b-914c-01a64232a84b service nova] Creating event network-vif-plugged:fce0e40a-0335-487b-8ee2-fa4056074422 for instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b on n-h2-850003-3 Jul 18 12:52:21.455146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-770f87ac-a3a2-4e73-9479-5c350e85af58 req-1370e843-0129-446b-914c-01a64232a84b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095536 Jul 18 12:52:21.463404 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 289/564] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:21.477623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e8d6d39-9a1d-40e8-9a3f-4fdc371a53d0 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Action: 'create', calling method: .version_select at 0x7f96e54aab80>, body: {"pool": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:21.638990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:21.654619 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7acabe76-bc28-4e6a-ad4d-13bb58d0fd0b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1268 microversion: 2.1 time: 0.536489 Jul 18 12:52:21.662981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 276/565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:21 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1268 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:22.325349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1591819250", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "bd2a104e-bbe4-4792-86d3-b0cc8ebc45b3"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:22.449784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] validate_networks() for [('bd2a104e-bbe4-4792-86d3-b0cc8ebc45b3', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:52:25.766097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:25.832035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:25.865788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:52:25.867112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:52:25.868221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:52:25.868828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:52:25.869415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:52:25.904787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:25.908620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:25.913922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:25.914828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:26.024947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Getting quotas for project 1a8993082a204beaaf79ed57f3547236. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:52:26.053529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Getting quotas for user 024bda6a1eed40cb8a3f82481c5c478e and project 1a8993082a204beaaf79ed57f3547236. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:52:26.127443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:52:26.143522 n-d-850003-3 devstack@n-api.service[131367]: WARNING nova.utils [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1591819250 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-159181925 Jul 18 12:52:26.144845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:52:26.424423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e2faaee7-c1b5-4375-a050-3de5513f425a tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.757964 Jul 18 12:52:26.433409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 277/566] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:52:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:52:26.462710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:26.464071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:26.518109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:26.519599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:26.530757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:26.532080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:28.280307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:28.297391 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d0a6050-6a03-48a7-a7ed-8d0afe2995df tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1585 microversion: 2.1 time: 1.861965 Jul 18 12:52:28.304847 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 278/567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:26 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1585 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:28.325977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:28.347791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] [instance: bc5f02e2-6e54-4cee-af8f-f5581fc5108f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:28.357251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:28.358314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:28.359396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:28.360717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:28.404590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] HTTP exception thrown: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Request method failure captured: Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f HTTP/1.1 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VdOML977kW4jhoDlDMV-5qQ2VIARdRb7BwNdXbXnOA9GAK35kHJIILUrznX4T8MGnW_ugD43demVU_MY7fwWA0RjVTwXt5fwvbtZIv21zb1g9kh6pXhFv3yhy6KrgPFGNRWVJW95NQVRrXRCjchHmLCwe2hrPEjmoieLSQ4UGLcnZY Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5187f2e68acc478b93ef75dc1466c683 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:52:28.411473 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5187f2e68acc478b93ef75dc1466c683", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5187f2e68acc478b93ef75dc1466c683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5187f2e68acc478b93ef75dc1466c683 Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-951534629 Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiagnosticsNegativeTest-951534629-project Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bda2b920aca542f0ae8fac9f374d7a2e Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-951534629-project Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. Jul 18 12:52:28.414200 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bc5f02e2-6e54-4cee-af8f-f5581fc5108f'} Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:52:28.415619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. Jul 18 12:52:28.417836 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:52:28.423373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] Returning 404 to user: Instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:52:28.431370 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6625a6d2-92dd-4f37-a90a-8acb4a1e8eab tempest-ServerDiagnosticsNegativeTest-951534629 tempest-ServerDiagnosticsNegativeTest-951534629-project] 10.222.0.88 "GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f" status: 404 len: 111 microversion: 2.1 time: 0.117431 Jul 18 12:52:28.444329 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 279/568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:28 2022] GET /compute/v2.1/servers/bc5f02e2-6e54-4cee-af8f-f5581fc5108f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:52:28.461170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:28.462308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:28.485627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:28.486613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:28.490138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:28.497607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:29.533687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:29.569565 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f3444b87-683a-4500-8e06-f04d1d34b5c9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 1.123599 Jul 18 12:52:29.570205 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 280/569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:28 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:29.605286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4b8f0092-4a46-47c3-a17f-3bfd9bb13681 req-4d164b7e-0c39-4d17-94dd-bfb63cc8f5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5f02e2-6e54-4cee-af8f-f5581fc5108f", "name": "network-vif-deleted", "tag": "df8c67a1-bac1-477a-a408-171274824fa9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:29.632581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4b8f0092-4a46-47c3-a17f-3bfd9bb13681 req-4d164b7e-0c39-4d17-94dd-bfb63cc8f5a9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:29.633347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4b8f0092-4a46-47c3-a17f-3bfd9bb13681 req-4d164b7e-0c39-4d17-94dd-bfb63cc8f5a9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:29.662379 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4b8f0092-4a46-47c3-a17f-3bfd9bb13681 req-4d164b7e-0c39-4d17-94dd-bfb63cc8f5a9 service nova] Creating event network-vif-deleted:df8c67a1-bac1-477a-a408-171274824fa9 for instance bc5f02e2-6e54-4cee-af8f-f5581fc5108f on n-h2-850003-3 Jul 18 12:52:29.687188 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4b8f0092-4a46-47c3-a17f-3bfd9bb13681 req-4d164b7e-0c39-4d17-94dd-bfb63cc8f5a9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109105 Jul 18 12:52:29.704297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 281/570] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:29.712338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:29.713212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:29.755697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:29.756322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:29.758910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:29.759249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:29.980671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:30.051872 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c431943e-8ca6-4f6f-a27e-ab55af8a6c2c tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1290 microversion: 2.1 time: 0.344185 Jul 18 12:52:30.071986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 282/571] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:29 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1290 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:30.114540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:30.115671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:30.149152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:30.158273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:30.164080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:30.170932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:30.599675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e8d6d39-9a1d-40e8-9a3f-4fdc371a53d0 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.133537 Jul 18 12:52:30.609368 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 290/572] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:52:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:30.618355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-193b6264-03c7-4126-b5b1-906fbb936510 req-ede4519d-7518-48f5-a393-737282b03e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:30.631567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-193b6264-03c7-4126-b5b1-906fbb936510 req-ede4519d-7518-48f5-a393-737282b03e4e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:30.632326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-193b6264-03c7-4126-b5b1-906fbb936510 req-ede4519d-7518-48f5-a393-737282b03e4e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:30.655816 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-193b6264-03c7-4126-b5b1-906fbb936510 req-ede4519d-7518-48f5-a393-737282b03e4e service nova] Creating event network-changed:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h1-850003-3 Jul 18 12:52:30.664727 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-193b6264-03c7-4126-b5b1-906fbb936510 req-ede4519d-7518-48f5-a393-737282b03e4e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052611 Jul 18 12:52:30.665984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 291/573] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:30.678115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:30.683064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:30.691708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:30.692399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:30.693587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:30.697021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:30.858939 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0640ea86-8e30-4db0-8fb9-dd9cc91c2405 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.784514 Jul 18 12:52:30.859801 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 283/574] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 12:52:30 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b/os-interface => generated 284 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:30.879537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bb248b2f-6815-40b2-a1e9-e3ad58a95ae2 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Action: 'create', calling method: .version_select at 0x7f96e4c7a1f0>, body: {"pool": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:32.131357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:32.209764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3cb0a3fc-ddb6-430e-a7b5-7d078d0eb6c1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 1.535557 Jul 18 12:52:32.226965 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 292/575] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:30 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:32.285014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:32.294969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:32.324603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:32.325705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:32.335199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:32.336032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:32.991214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:33.064597 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8dd01d5-8189-481b-926f-096ca020a85d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1290 microversion: 2.1 time: 0.833176 Jul 18 12:52:33.073848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 293/576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:32 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1290 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:33.253838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:33.259199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:33.286855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:33.293627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:33.299341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:33.309576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:34.241373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:34.279477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9bb637d8-0826-4b42-82cf-137efdae3892 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 1.027932 Jul 18 12:52:34.301437 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 294/577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:33 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:34.337476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:34.341019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:34.360626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:34.369893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:34.375375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:34.375925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:35.962079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:36.102585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:36.197089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:36.216301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da801e32-39ec-4993-9a49-3d03ddf7cb28 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 1.918185 Jul 18 12:52:36.220541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 295/578] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:34 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:36.582786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d104b16-489e-4797-b9c2-c054ba922fdd tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] Calling method '.version_select at 0x7f96e4f5e1f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:36.585422 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:36.585422 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:36.615411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d104b16-489e-4797-b9c2-c054ba922fdd tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.392828 Jul 18 12:52:36.617084 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 296/579] 10.222.0.88 () {60 vars in 1225 bytes} [Mon Jul 18 12:52:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:52:36.627626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:36.629325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:36.645748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:36.647259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:36.649279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:36.651263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:37.460514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:37.492710 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c435cbac-9116-4c68-ac26-f3c07b316532 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 0.873113 Jul 18 12:52:37.493755 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 297/580] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:36 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:37.519056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e8f6bdcc-110d-45e9-a541-b0e7a43207ee tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4fe3dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:37.532454 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:37.532454 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:38.281922 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e8f6bdcc-110d-45e9-a541-b0e7a43207ee tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.779881 Jul 18 12:52:38.285065 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 298/581] 10.222.0.88 () {62 vars in 1246 bytes} [Mon Jul 18 12:52:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:52:38.305242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:38.306108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:38.337587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:38.338654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:38.342413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:38.343319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:39.217476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:39.251210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1614e938-bd04-4142-94af-0f99388e2734 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.961883 Jul 18 12:52:39.254687 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 299/582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:38 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:39.274267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09745505-b8c1-43c6-a1bf-83b97a8884ac tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] Calling method '.version_select at 0x7f96e4f0a9d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:39.282842 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:39.282842 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:39.328323 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09745505-b8c1-43c6-a1bf-83b97a8884ac tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.068837 Jul 18 12:52:39.330238 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 300/583] 10.222.0.88 () {60 vars in 1225 bytes} [Mon Jul 18 12:52:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:52:39.344750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:39.347266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:39.375561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:39.381907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:39.385953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:39.389712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:39.730035 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bb248b2f-6815-40b2-a1e9-e3ad58a95ae2 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.868933 Jul 18 12:52:39.731395 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 284/584] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:52:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:39.749325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3044b8cb-b61d-4a7d-aeff-752c3cca43b8 tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4c7a820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:39.754918 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:39.754918 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:52:39.965769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3044b8cb-b61d-4a7d-aeff-752c3cca43b8 tempest-QuotaClassesAdmin257Test-934663382 tempest-QuotaClassesAdmin257Test-934663382-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.231838 Jul 18 12:52:39.973042 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 285/585] 10.222.0.88 () {62 vars in 1246 bytes} [Mon Jul 18 12:52:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:52:39.981514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ad8b961-b1e8-4149-950f-1254eb3933b2 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4c334c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:40.307731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=42 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:40.464959 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ad8b961-b1e8-4149-950f-1254eb3933b2 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/a8f0a6e0-beba-4030-b601-83c3c1ed26da" status: 200 len: 141 microversion: 2.1 time: 0.489995 Jul 18 12:52:40.473362 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 286/586] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:52:39 2022] GET /compute/v2.1/os-floating-ips/a8f0a6e0-beba-4030-b601-83c3c1ed26da => generated 141 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:40.485892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:40.487008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:40.500741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:40.506983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:40.508123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:40.508749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:40.966309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:41.018412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ddafe8fd-47b2-4992-af68-c85debf0694d tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1585 microversion: 2.1 time: 0.525890 Jul 18 12:52:41.025643 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 287/587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:40 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1585 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:41.035593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c805a11a-fa21-4a32-a8fb-ddeb9a1a9a35 req-c74abb12-ae68-4c4f-9625-0dc8787394dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6951dad0-6630-4237-80ef-3a88c7cd8b2b", "tag": "fce0e40a-0335-487b-8ee2-fa4056074422"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:41.081195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c805a11a-fa21-4a32-a8fb-ddeb9a1a9a35 req-c74abb12-ae68-4c4f-9625-0dc8787394dc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:41.083820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c805a11a-fa21-4a32-a8fb-ddeb9a1a9a35 req-c74abb12-ae68-4c4f-9625-0dc8787394dc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:41.132796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c805a11a-fa21-4a32-a8fb-ddeb9a1a9a35 req-c74abb12-ae68-4c4f-9625-0dc8787394dc service nova] Creating event network-changed:fce0e40a-0335-487b-8ee2-fa4056074422 for instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b on n-h2-850003-3 Jul 18 12:52:41.171413 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c805a11a-fa21-4a32-a8fb-ddeb9a1a9a35 req-c74abb12-ae68-4c4f-9625-0dc8787394dc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137993 Jul 18 12:52:41.173475 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 288/588] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:41.198256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:41.199523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:41.217107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:41.231622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:41.233304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:41.234342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:41.379838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:41.412364 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c117415-1e42-44a4-a210-a21e63cdf8ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 2.079896 Jul 18 12:52:41.440900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 301/589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:39 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:41.449846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28781139-a1be-4ee3-bfb5-62d0ca825d92 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4ffbe50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:41.724363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:41.738925 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aaf2ce74-4af5-4f3b-a96c-d6532d655219 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.563214 Jul 18 12:52:41.740615 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 289/590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:41 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:42.816339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2105474989", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b247f390-7473-4edc-b6bf-63b08a11384c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:43.031056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] validate_networks() for [('b247f390-7473-4edc-b6bf-63b08a11384c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:52:44.149912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:52:44.152712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:52:44.153924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:52:44.154925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:52:44.155926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:52:44.178367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:44.178689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:44.179813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:44.180017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:44.209846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:52:44.216730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for user f604cd53dad44c39944c7e7a57737941 and project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:52:44.233622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:52:44.236803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:52:44.312783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-227cfb4b-3749-4df2-a58f-4d07e0a32668 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.570120 Jul 18 12:52:44.370289 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 290/591] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 12:52:44.390392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:44.391630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:44.423121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:44.424110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:44.425932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:44.427452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:44.881574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:44.917526 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7c1cf10-b082-4d8e-8cc3-1ef0fabe8977 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 0.538884 Jul 18 12:52:44.930940 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 291/592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:44 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:45.667499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2049621173", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:45.844136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:52:46.501420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:52:46.503542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:52:46.504848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:52:46.505885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:52:46.508268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:52:46.538944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:46.540422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:46.542466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:46.544330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:46.595729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:52:46.618898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:52:46.649193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:52:46.654705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:52:46.779647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3b3c4fa9-f493-4407-a06b-40a2be52d376 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835042 Jul 18 12:52:46.785308 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 292/593] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:52:46.811174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:46.812546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:46.842962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:46.843382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:46.844480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:46.845266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:47.461075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:47.482821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17453279-fc32-4f17-8e87-a2bf8379e358 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.695408 Jul 18 12:52:47.484776 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 293/594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:46 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:47.503417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5356198c-1838-49ab-b9bc-6d92bffd6cc3 req-39431fd0-0541-4b52-9bd4-aa64d32f6078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9261085e-34cb-47d6-aaec-55379309343d", "tag": "51bfd0ad-cfc3-4816-a5e6-602334013370"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:47.577377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5356198c-1838-49ab-b9bc-6d92bffd6cc3 req-39431fd0-0541-4b52-9bd4-aa64d32f6078 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:47.579691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5356198c-1838-49ab-b9bc-6d92bffd6cc3 req-39431fd0-0541-4b52-9bd4-aa64d32f6078 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:47.634874 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5356198c-1838-49ab-b9bc-6d92bffd6cc3 req-39431fd0-0541-4b52-9bd4-aa64d32f6078 service nova] Creating event network-changed:51bfd0ad-cfc3-4816-a5e6-602334013370 for instance 9261085e-34cb-47d6-aaec-55379309343d on n-h1-850003-3 Jul 18 12:52:47.648547 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5356198c-1838-49ab-b9bc-6d92bffd6cc3 req-39431fd0-0541-4b52-9bd4-aa64d32f6078 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161572 Jul 18 12:52:47.654340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 294/595] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:47.663904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:47.667478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:47.676850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=8,nova_api:INSERT=9 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:47.693915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:47.696263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:47.699867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:47.701209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.173331 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28781139-a1be-4ee3-bfb5-62d0ca825d92 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/a8f0a6e0-beba-4030-b601-83c3c1ed26da" status: 202 len: 0 microversion: 2.1 time: 6.730490 Jul 18 12:52:48.179494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 302/596] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:52:41 2022] DELETE /compute/v2.1/os-floating-ips/a8f0a6e0-beba-4030-b601-83c3c1ed26da => generated 0 bytes in 6738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:52:48.185242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7535367d-bb2e-49d9-97ff-7dd9e9974b56 req-56e1ad42-c2a4-4ba5-8c48-c4bd246499e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "name": "network-vif-plugged", "status": "completed", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:48.224021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7535367d-bb2e-49d9-97ff-7dd9e9974b56 req-56e1ad42-c2a4-4ba5-8c48-c4bd246499e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.225245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7535367d-bb2e-49d9-97ff-7dd9e9974b56 req-56e1ad42-c2a4-4ba5-8c48-c4bd246499e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.263215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:48.283015 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7535367d-bb2e-49d9-97ff-7dd9e9974b56 req-56e1ad42-c2a4-4ba5-8c48-c4bd246499e2 service nova] Creating event network-vif-plugged:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h1-850003-3 Jul 18 12:52:48.292978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:48.295413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:48.295946 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7535367d-bb2e-49d9-97ff-7dd9e9974b56 req-56e1ad42-c2a4-4ba5-8c48-c4bd246499e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114522 Jul 18 12:52:48.297714 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57c8eb83-2f9c-402b-9809-f448175db02d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1320 microversion: 2.25 time: 0.641806 Jul 18 12:52:48.301379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 303/597] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:48.303281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 295/598] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:52:47 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:52:48.310413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:48.311657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:48.315700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:48.316695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:48.341247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.345005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.346440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.347231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.347357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.347817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.348826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.349287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.539428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:48.553697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-21f93d00-0e50-43d7-8333-b02f1271ca84 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1221 microversion: 2.1 time: 0.247523 Jul 18 12:52:48.555829 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 296/599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:48 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1221 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:48.563462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce838fa8-d8a4-4bbb-a64d-c7da54df2c9b tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4c7aca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:48.853132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:48.861181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41bd79f4-b0ad-445a-93bc-7a549916b303 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 0.558286 Jul 18 12:52:48.862256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 304/600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:48 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:48.867170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:48.868022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:48.877725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=7,nova_api:INSERT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:48.881451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.882552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.883933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:48.885278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:48.943090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce838fa8-d8a4-4bbb-a64d-c7da54df2c9b tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.385059 Jul 18 12:52:48.944262 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 297/601] 10.222.0.88 () {58 vars in 1163 bytes} [Mon Jul 18 12:52:48 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:52:48.956218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e679e0f-68ec-4aa3-bbbd-93e7f255f28b tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4c61820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:49.326633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:49.446140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:49.448972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=61 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:49.465280 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9650cb5-b7c2-44cb-baba-e260842f50d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.601558 Jul 18 12:52:49.468173 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 305/602] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:48 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:49.511113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:49.517746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:49.536315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:49.540694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:49.543301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:49.545104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:49.701747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e679e0f-68ec-4aa3-bbbd-93e7f255f28b tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.750586 Jul 18 12:52:49.703779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 298/603] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:52:48 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:52:49.709362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:49.710463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:49.721110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:49.721958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:49.723013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:49.723766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:49.868597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:49.881056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-173fe36f-172e-466f-9118-1888bff3d322 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1269 microversion: 2.1 time: 0.175967 Jul 18 12:52:49.893311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 299/604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:49 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:49.901078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf84cec6-a5e6-4353-879a-9dff7cdaf538 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4d2e4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:50.149626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:50.172308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:50.193171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:50.195834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e99ddf49-bce7-4721-b3e1-1f9cedbbfc1d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.725430 Jul 18 12:52:50.202745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 306/605] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:52:49 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:52:50.219767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:50.220493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:50.248588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:50.252533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:50.263948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:50.265188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:50.686468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:50.705012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-570b451a-e4c3-4e6a-b1ab-cc20d6ba55e2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1310 microversion: 2.1 time: 0.500177 Jul 18 12:52:50.719481 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 307/606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:50 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1310 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:50.734609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:50.736085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:50.772402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:50.773467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:50.784192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:50.787450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:51.620502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:51.630321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-901510bc-308f-48b2-9bb1-8f6b4d840981 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.909241 Jul 18 12:52:51.643922 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 308/607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:50 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:51.651440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:51.663321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:51.680669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:51.681996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:51.683375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:51.684072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:51.816586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:51.840299 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4931c17e-39ab-46e6-b1ed-b33d53db52ff tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1275 microversion: 2.1 time: 0.192522 Jul 18 12:52:51.841396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 309/608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:51 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:51.876327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:51.879150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:51.900243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:51.901821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:51.903619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:51.904542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:52.636480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:52.670634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:52.682286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:52.688167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eae165a5-6e14-4d4d-9431-d7f688b2b3d8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.830628 Jul 18 12:52:52.693541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 310/609] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:52:51 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:52:52.958974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e39673d5-44a1-453e-b787-d45897fd98d4 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] Calling method '.version_select at 0x7f96e50e0430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:52.960698 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:52.960698 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:52.975149 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e39673d5-44a1-453e-b787-d45897fd98d4 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.279468 Jul 18 12:52:52.977837 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 311/610] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:52:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:52.986778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:52.988511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:53.021591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.023245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.034076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.035186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.418377 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf84cec6-a5e6-4353-879a-9dff7cdaf538 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/64a99591-d700-45d4-b32e-e5aafea11425" status: 202 len: 0 microversion: 2.1 time: 3.523464 Jul 18 12:52:53.419310 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 300/611] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:52:49 2022] DELETE /compute/v2.1/os-floating-ips/64a99591-d700-45d4-b32e-e5aafea11425 => generated 0 bytes in 3525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:52:53.428050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:53.428596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:53.444191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.449849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.453939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.456223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.660669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:53.676989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34602114-6f38-41f7-ab89-82fac5b5fc8f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1493 microversion: 2.1 time: 0.695961 Jul 18 12:52:53.678237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 312/612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:52 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1493 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:53.683484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:53.684938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:53.692281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.693653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.695749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:53.696450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:53.850097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:53.864583 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4018a2ba-75e1-46e2-9b2e-872b9a7d05dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1275 microversion: 2.1 time: 0.184973 Jul 18 12:52:53.878007 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 313/613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:53 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:53.883978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f120ab7d-f43b-4901-9f87-70dc039dbd75 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4f1b790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:53.886448 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:53.886448 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:54.406856 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f120ab7d-f43b-4901-9f87-70dc039dbd75 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.526703 Jul 18 12:52:54.409327 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 314/614] 10.222.0.88 () {60 vars in 1205 bytes} [Mon Jul 18 12:52:53 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:54.425244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:54.433024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-652b6df8-6dd2-459c-885b-b90b10e70b1d req-880ed541-70ac-46a9-994f-32133b6d47a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:54.439806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c4d09ba0-277f-42aa-a263-aeaa72b998bf tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 1.019049 Jul 18 12:52:54.441055 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 301/615] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:53 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:54.455929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0abed270-4b30-4980-a7ce-d4012cdab3da tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4c7a310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:54.479452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-652b6df8-6dd2-459c-885b-b90b10e70b1d req-880ed541-70ac-46a9-994f-32133b6d47a3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:54.486034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-652b6df8-6dd2-459c-885b-b90b10e70b1d req-880ed541-70ac-46a9-994f-32133b6d47a3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:54.532071 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-652b6df8-6dd2-459c-885b-b90b10e70b1d req-880ed541-70ac-46a9-994f-32133b6d47a3 service nova] Creating event network-changed:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:52:54.555496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-652b6df8-6dd2-459c-885b-b90b10e70b1d req-880ed541-70ac-46a9-994f-32133b6d47a3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139027 Jul 18 12:52:54.559337 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 315/616] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:54.579772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:54.596322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:54.609172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:54.622614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:54.624098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:54.624978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:55.050328 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a568eeae-ce07-4371-84ef-9246c610d847 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1644 microversion: 2.1 time: 0.488645 Jul 18 12:52:55.054282 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 316/617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:54 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1644 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:55.061619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:55.068144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:55.090483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:55.091678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:55.093916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:55.098798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:55.471030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:55.488581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:55.492248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:55.494935 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b2416c9-9b38-4f2d-9822-94a169de3cb5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.438714 Jul 18 12:52:55.508472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 317/618] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:52:55 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:52:55.521279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90b04d23-54e1-4488-a042-5d47ddced7c0 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] Calling method '.version_select at 0x7f96e4efa700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:55.523134 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:55.523134 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:55.543708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90b04d23-54e1-4488-a042-5d47ddced7c0 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.033528 Jul 18 12:52:55.544758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 318/619] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 12:52:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:55.552325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:55.553614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:55.576788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:55.577871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:55.584515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:55.585205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.012233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:56.041671 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bc4dd2ed-07eb-42ed-9b92-34bf93b9dc62 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 0.495072 Jul 18 12:52:56.046070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 319/620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:55 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:56.085763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:56.087138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:56.134934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:56.136490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.143078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:56.145896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.420453 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a42fc9b6-cf63-4fb6-8d10-b7c9f58e29c3 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1644 microversion: 2.1 time: 0.367362 Jul 18 12:52:56.422201 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 320/621] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:56 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1644 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:56.429749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d1b2dc79-f4b7-45ef-b904-74fe1df2bf50 req-26690b7c-5d8d-4fb4-aedc-754ce4364fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9261085e-34cb-47d6-aaec-55379309343d", "name": "network-vif-plugged", "status": "completed", "tag": "51bfd0ad-cfc3-4816-a5e6-602334013370"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:56.447046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1b2dc79-f4b7-45ef-b904-74fe1df2bf50 req-26690b7c-5d8d-4fb4-aedc-754ce4364fea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:56.448033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1b2dc79-f4b7-45ef-b904-74fe1df2bf50 req-26690b7c-5d8d-4fb4-aedc-754ce4364fea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.471194 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d1b2dc79-f4b7-45ef-b904-74fe1df2bf50 req-26690b7c-5d8d-4fb4-aedc-754ce4364fea service nova] Creating event network-vif-plugged:51bfd0ad-cfc3-4816-a5e6-602334013370 for instance 9261085e-34cb-47d6-aaec-55379309343d on n-h1-850003-3 Jul 18 12:52:56.483070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d1b2dc79-f4b7-45ef-b904-74fe1df2bf50 req-26690b7c-5d8d-4fb4-aedc-754ce4364fea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058214 Jul 18 12:52:56.484179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 321/622] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:56.495518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:56.496702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:56.506879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:56.507423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.508279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:56.508718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:56.572629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:56.641613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:56.847503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:56.880459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c539020f-c02c-4eaf-bca2-87f738f6e9a5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1332 microversion: 2.1 time: 0.393479 Jul 18 12:52:56.881496 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 322/623] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:56 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1332 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:56.897697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abe1dc4b-0991-4b70-9d5f-31bdea2d2cc4 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4f36820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:56.912253 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:56.912253 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:57.135028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=22,nova_api:INSERT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:57.185701 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abe1dc4b-0991-4b70-9d5f-31bdea2d2cc4 tempest-QuotaClassesAdminTestJSON-1100170837 tempest-QuotaClassesAdminTestJSON-1100170837-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.302521 Jul 18 12:52:57.186893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 323/624] 10.222.0.88 () {60 vars in 1205 bytes} [Mon Jul 18 12:52:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:57.377184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b17b37f-8f18-4337-944e-8f0307d56869 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Action: 'create', calling method: .version_select at 0x7f96e4ffb3a0>, body: {"keypair": {"name": "tempest-keypair-1777650310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANUG6shyhj3pbLQD7Tb+LyVWFv9IONYTE9dijNgZSkIaAeDNHB2YZeJRHcNMWNCeXgLkO4ZWLCslAvUp6181Tj6fFGRsRjuwA1edFaX6filGd7BGFVowJa4wdzMlljh8w=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:57.409768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1b17b37f-8f18-4337-944e-8f0307d56869 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:52:57.421386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1b17b37f-8f18-4337-944e-8f0307d56869 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for user 62315c008374414f8616584494d03573 and project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:52:57.467486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b17b37f-8f18-4337-944e-8f0307d56869 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279294 Jul 18 12:52:57.469524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 324/625] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 12:52:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:57.481999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:57.487618 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:52:57.487618 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:52:57.493352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.495587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:57.498817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.500516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:57.568002 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0abed270-4b30-4980-a7ce-d4012cdab3da tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/e23d0b2a-e8e9-4785-9043-d9a37787cc09" status: 202 len: 0 microversion: 2.1 time: 3.124766 Jul 18 12:52:57.569007 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 302/626] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:52:54 2022] DELETE /compute/v2.1/os-floating-ips/e23d0b2a-e8e9-4785-9043-d9a37787cc09 => generated 0 bytes in 3127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:52:57.577937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:57.579389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:57.595899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.602136 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-324e94ec-ea9a-4776-93bf-602d8f02411d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128988 Jul 18 12:52:57.602630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:57.613079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 325/627] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:52:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:52:57.626983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.627480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:57.629302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:57.634921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:57.659346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.660381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:57.661995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:57.662989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:58.319285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:58.333595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:58.337405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:58.346303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e6e15a54-58e3-4d0a-9cfa-c47f5a0627b0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.771435 Jul 18 12:52:58.347601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 303/628] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:52:57 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:52:58.365701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80b8a924-2f72-4c2e-8ada-059f118b9b76 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] Calling method '.version_select at 0x7f96e4cc0670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:58.715804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:58.727739 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0099b78f-f8e6-4631-9350-b483d200fdba tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 1.118675 Jul 18 12:52:58.729350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 326/629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:57 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:58.736219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:52:58.737616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:58.747071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:58.749280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:58.751743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:58.753683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:59.016972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bdcd4147-856c-430b-bba1-2d7acc14498c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb/action" status: 202 len: 0 microversion: 2.1 time: 0.285931 Jul 18 12:52:59.021801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 327/630] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:52:58 2022] POST /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:52:59.085598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:59.092486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:59.120393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:59.126501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:59.129669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:59.135659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:59.217073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:52:59.800976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:52:59.816764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f3bcd03-530c-4b5d-b380-00886f5c9e57 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1536 microversion: 2.1 time: 0.795721 Jul 18 12:52:59.819404 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 328/631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:59 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1536 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:52:59.827875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:52:59.829510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:52:59.842855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:59.844216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:52:59.846120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:52:59.847543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:00.332907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f451f27-dad4-4392-84e9-3f2ffb888836 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1629 microversion: 2.1 time: 0.500694 Jul 18 12:53:00.334439 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 329/632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:52:59 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1629 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:00.354463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:00.355828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:00.380121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:00.381570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:00.383793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:00.386714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:01.066007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:01.081689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:01.084519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:01.085664 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7447c0ba-ea7a-425f-bd22-2ff04720af5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.749230 Jul 18 12:53:01.086616 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 330/633] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:00 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:01.092849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:01.093928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:01.104203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:01.105507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:01.107366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:01.109005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:01.558794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:01.590598 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3f0907e-1558-47b8-b2c1-8ef6e8b23de8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 0.501172 Jul 18 12:53:01.591453 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 331/634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:01 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:01.614731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23e272ec-d4be-4f0c-a06f-cb8bb2848910 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'create', calling method: .version_select at 0x7f96e4ef8ca0>, body: {"pool": "fae3a6a5-0ff2-4f06-b214-fc03fff2005b"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:02.991387 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80b8a924-2f72-4c2e-8ada-059f118b9b76 tempest-FloatingIPDetailsTestJSON-803407155 tempest-FloatingIPDetailsTestJSON-803407155-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/ae2cea38-d177-4495-988d-fff38deddf1a" status: 202 len: 0 microversion: 2.1 time: 4.639932 Jul 18 12:53:02.998026 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 304/635] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:52:58 2022] DELETE /compute/v2.1/os-floating-ips/ae2cea38-d177-4495-988d-fff38deddf1a => generated 0 bytes in 4646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:03.010359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:03.012905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:03.028221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:03.029455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:03.031275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:03.032408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:03.124365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lazy-loading 'flavor' on Instance uuid 80f0acbf-0cde-4244-9dac-a799ee8607bb {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:03.159669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:53:05.314858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23e272ec-d4be-4f0c-a06f-cb8bb2848910 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.709665 Jul 18 12:53:05.316459 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 332/636] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:53:01 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:05.325094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-bd29453b-6766-4c2d-9435-e86d9f0dee8f req-ddb3bf9a-43b2-490a-816b-ec91f3b6631a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b23f64-8625-4abc-b8a7-29a85519282b", "tag": "e7beb172-55f8-414a-9c23-dc67e6eea635"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:05.341714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bd29453b-6766-4c2d-9435-e86d9f0dee8f req-ddb3bf9a-43b2-490a-816b-ec91f3b6631a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:05.342532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bd29453b-6766-4c2d-9435-e86d9f0dee8f req-ddb3bf9a-43b2-490a-816b-ec91f3b6631a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:05.360637 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-bd29453b-6766-4c2d-9435-e86d9f0dee8f req-ddb3bf9a-43b2-490a-816b-ec91f3b6631a service nova] Creating event network-changed:e7beb172-55f8-414a-9c23-dc67e6eea635 for instance a2b23f64-8625-4abc-b8a7-29a85519282b on n-h1-850003-3 Jul 18 12:53:05.366784 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-bd29453b-6766-4c2d-9435-e86d9f0dee8f req-ddb3bf9a-43b2-490a-816b-ec91f3b6631a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049328 Jul 18 12:53:05.367743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 333/637] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:05.375380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e61962bb-1e6c-4ede-bfa2-06f6dd811fce req-c295d455-69f9-48ec-841d-397e386fadce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "name": "network-vif-plugged", "status": "completed", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:05.387339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e61962bb-1e6c-4ede-bfa2-06f6dd811fce req-c295d455-69f9-48ec-841d-397e386fadce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:05.388086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e61962bb-1e6c-4ede-bfa2-06f6dd811fce req-c295d455-69f9-48ec-841d-397e386fadce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:05.406756 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e61962bb-1e6c-4ede-bfa2-06f6dd811fce req-c295d455-69f9-48ec-841d-397e386fadce service nova] Creating event network-vif-plugged:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:53:05.412303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e61962bb-1e6c-4ede-bfa2-06f6dd811fce req-c295d455-69f9-48ec-841d-397e386fadce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042814 Jul 18 12:53:05.413472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 334/638] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:05.420125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:05.420833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:05.428678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:05.430378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:05.431547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:05.432095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:05.970535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:05.994452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:05.997381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:06.010370 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28c311e9-76dc-4f54-b86a-9063c57787f8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1362 microversion: 2.25 time: 0.594547 Jul 18 12:53:06.033504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 335/639] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:05 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:06.049244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:06.050193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:06.099016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:06.100128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:06.101767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:06.102859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:06.971898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6dd7c537-b4cf-4b97-b4bb-3304ef191598 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb/action" status: 202 len: 0 microversion: 2.1 time: 3.971599 Jul 18 12:53:06.972730 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 305/640] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:02 2022] POST /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb/action => generated 0 bytes in 3974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:06.982863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-570884284", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "8763719c-9c6d-4355-baba-ad89c169db90"}], "security_groups": [{"name": "tempest-securitygroup--2082237100"}], "key_name": "tempest-keypair-1777650310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:07.093506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:07.128323 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bf104b1-2887-410e-8791-3e2b004ab51a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 1.087538 Jul 18 12:53:07.130354 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 336/641] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:06 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:07.258004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] validate_networks() for [('8763719c-9c6d-4355-baba-ad89c169db90', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:53:07.294700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Action: 'update', calling method: .version_select at 0x7f96e50e0820>, body: {"quota_set": {"ram": "5120"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:07.434795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:07.435248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:07.436135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:07.437285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:07.558218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-044711d9-9f20-4958-8c59-be9887fa92ea tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf" status: 200 len: 148 microversion: 2.57 time: 0.424960 Jul 18 12:53:07.560115 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 337/642] 10.222.0.88 () {62 vars in 1302 bytes} [Mon Jul 18 12:53:07 2022] PUT /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf => generated 148 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:53:07.574233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: .version_select at 0x7f96e7408160>, body: {"addFloatingIp": {"address": "172.25.1.2"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:07.576784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:07.588075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:07.588942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:07.590753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:07.592846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:07.783562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Acquired lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:53:08.578100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:08.579023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:08.579723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:08.580456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:08.581206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:08.619142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:08.624303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:08.626732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:08.627581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:08.703568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:08.732063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for user 62315c008374414f8616584494d03573 and project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:08.788470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:53:08.800668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:08.981464 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05586df1-321f-4c5c-bf85-5e0e894dafa2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.000556 Jul 18 12:53:08.985664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 306/643] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:53:09.008162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:09.009393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:09.043659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:09.044440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:09.045902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:09.046718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:09.898059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:09.922425 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d56a570-bb70-471c-923b-fd3d9de21e99 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.933237 Jul 18 12:53:09.939641 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 307/644] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:08 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:09.956594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:09.960383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:09.979164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:09.980192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:09.982377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:09.984141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:10.319175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Building network info cache for instance {{(pid=131366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 12:53:10.471294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:10.477587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:10.500299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:10.507275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:10.510356 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c64cb66-3bfb-4d98-8550-0e7052b8b6ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1557 microversion: 2.25 time: 0.568161 Jul 18 12:53:10.512757 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 308/645] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:09 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1557 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:10.529276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Calling method '.version_select at 0x7f96e4bf2280>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:10.722970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:10.724466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:10.727928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:10.729234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:10.792603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61c4a613-958f-4799-8175-c8d4d2b337d2 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf/detail" status: 200 len: 463 microversion: 2.57 time: 0.277897 Jul 18 12:53:10.793824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 309/646] 10.222.0.88 () {60 vars in 1303 bytes} [Mon Jul 18 12:53:10 2022] GET /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf/detail => generated 463 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:53:10.800153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:10.801470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:10.814260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:10.814906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:10.816416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:10.816416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:11.482210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:11.506334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c4043c1-8057-4efb-8940-e33d9c208cab tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 0.710897 Jul 18 12:53:11.508024 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 310/647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:10 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:11.514009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:11.515266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:11.529176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:11.530354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:11.531563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:11.532416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:11.742595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Updating instance_info_cache with network_info: [{"id": "51bfd0ad-cfc3-4816-a5e6-602334013370", "address": "fa:16:3e:7f:08:2a", "network": {"id": "bd2a104e-bbe4-4792-86d3-b0cc8ebc45b3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1425697923-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a8993082a204beaaf79ed57f3547236", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap51bfd0ad-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 12:53:11.763617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:11.781531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Releasing lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:53:11.786658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-83f2b3b6-cc31-48c3-b2e1-48aef8e459d5 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 202 len: 0 microversion: 2.1 time: 4.216896 Jul 18 12:53:11.793650 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 338/648] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:07 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 0 bytes in 4230 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 12:53:11.800534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-243f99e0-bc7a-4810-9137-299d78b7ec25 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1299 microversion: 2.1 time: 0.290071 Jul 18 12:53:11.815789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e6f640fe-d49e-467c-bb67-f64f507f3174 req-f7c22539-9ec8-4251-b193-7f79289da7ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9261085e-34cb-47d6-aaec-55379309343d", "tag": "51bfd0ad-cfc3-4816-a5e6-602334013370"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:11.818925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 311/649] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:11 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:11.859398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e6f640fe-d49e-467c-bb67-f64f507f3174 req-f7c22539-9ec8-4251-b193-7f79289da7ba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:11.869312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e6f640fe-d49e-467c-bb67-f64f507f3174 req-f7c22539-9ec8-4251-b193-7f79289da7ba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:11.922447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e6f640fe-d49e-467c-bb67-f64f507f3174 req-f7c22539-9ec8-4251-b193-7f79289da7ba service nova] Creating event network-changed:51bfd0ad-cfc3-4816-a5e6-602334013370 for instance 9261085e-34cb-47d6-aaec-55379309343d on n-h1-850003-3 Jul 18 12:53:11.945340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e6f640fe-d49e-467c-bb67-f64f507f3174 req-f7c22539-9ec8-4251-b193-7f79289da7ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144974 Jul 18 12:53:11.950445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 339/650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:11.973124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:11.974131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:12.009555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.010352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.011624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.023126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.334233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:12.336232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:12.372769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.374602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.377428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.378569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.549683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:12.594848 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2817c5f9-a1d0-4a16-b1e3-0b284ced357a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.642003 Jul 18 12:53:12.601918 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 340/651] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:11 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:12.620349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Action: 'update', calling method: .version_select at 0x7f96e5136dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:12.812247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.814602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.817240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.818064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.911911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.914797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:12.922059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:12.922059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:13.108343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c42b4d20-762c-468d-b7a2-3c55db2431bd tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf?user_id=8cd4560d275c410eba754d750bfd9e2d" status: 200 len: 148 microversion: 2.57 time: 0.503700 Jul 18 12:53:13.110500 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 341/652] 10.222.0.88 () {62 vars in 1383 bytes} [Mon Jul 18 12:53:12 2022] PUT /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf?user_id=8cd4560d275c410eba754d750bfd9e2d => generated 148 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:53:13.120522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2fa84665-de66-4d77-9b42-f09962a99a22 req-7236746b-783c-45b4-af36-6672935d880e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b23f64-8625-4abc-b8a7-29a85519282b", "name": "network-vif-plugged", "status": "completed", "tag": "e7beb172-55f8-414a-9c23-dc67e6eea635"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:13.137237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2fa84665-de66-4d77-9b42-f09962a99a22 req-7236746b-783c-45b4-af36-6672935d880e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:13.138275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2fa84665-de66-4d77-9b42-f09962a99a22 req-7236746b-783c-45b4-af36-6672935d880e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:13.163950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2fa84665-de66-4d77-9b42-f09962a99a22 req-7236746b-783c-45b4-af36-6672935d880e service nova] Creating event network-vif-plugged:e7beb172-55f8-414a-9c23-dc67e6eea635 for instance a2b23f64-8625-4abc-b8a7-29a85519282b on n-h1-850003-3 Jul 18 12:53:13.173804 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2fa84665-de66-4d77-9b42-f09962a99a22 req-7236746b-783c-45b4-af36-6672935d880e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060664 Jul 18 12:53:13.181744 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 342/653] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:13.194497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ea82ee3-3b1b-4073-a02f-b20312317554 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'create', calling method: .version_select at 0x7f96e4efaca0>, body: {"pool": "fae3a6a5-0ff2-4f06-b214-fc03fff2005b"} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:13.377103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:13.706271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd476157-554e-4789-9247-8ee5b36ecfd5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 2050 microversion: 2.25 time: 1.884356 Jul 18 12:53:13.739777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 312/654] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:11 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 2050 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:13.761074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6c32b210-5624-4987-a560-e8801949a638 req-2233143a-6d20-4f15-9d26-12b82832d9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "name": "network-vif-unplugged", "status": "completed", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:13.799179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6c32b210-5624-4987-a560-e8801949a638 req-2233143a-6d20-4f15-9d26-12b82832d9c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:13.800278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6c32b210-5624-4987-a560-e8801949a638 req-2233143a-6d20-4f15-9d26-12b82832d9c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:13.829155 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6c32b210-5624-4987-a560-e8801949a638 req-2233143a-6d20-4f15-9d26-12b82832d9c6 service nova] Creating event network-vif-unplugged:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h1-850003-3 Jul 18 12:53:13.840183 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6c32b210-5624-4987-a560-e8801949a638 req-2233143a-6d20-4f15-9d26-12b82832d9c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097526 Jul 18 12:53:13.841516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 313/655] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:13.851396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:13.853138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:13.870357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:13.871602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:13.875965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:13.888501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:14.286577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:14.302501 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c7bacf6-8520-410a-a744-b39fe937bb86 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 0.457505 Jul 18 12:53:14.318199 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 314/656] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:13 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:14.318199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:14.318199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:14.329828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:14.330727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:14.332218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:14.333044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:14.791183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:14.804590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5783435-8671-446f-8935-3098ca70aa1e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.496695 Jul 18 12:53:14.821671 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 315/657] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:14 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:14.829316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e27c7875-bb74-499c-b357-ea63e4003217 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] Calling method '.version_select at 0x7f96e4d2fb80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:15.094460 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e27c7875-bb74-499c-b357-ea63e4003217 tempest-QuotasAdminTestV257-1989343455 tempest-QuotasAdminTestV257-1989343455-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf?user_id=8cd4560d275c410eba754d750bfd9e2d" status: 200 len: 190 microversion: 2.57 time: 0.271875 Jul 18 12:53:15.104410 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 316/658] 10.222.0.88 () {60 vars in 1363 bytes} [Mon Jul 18 12:53:14 2022] GET /compute/v2.1/os-quota-sets/f676653623c7415396fb33e0977602bf?user_id=8cd4560d275c410eba754d750bfd9e2d => generated 190 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:53:15.112594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:15.113745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:15.131069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.132255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:15.133910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.135023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:15.469048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:15.487545 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c5e82a6-70c3-4d4e-8c0e-6dcf84ae5a4b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.380946 Jul 18 12:53:15.502188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 317/659] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:15 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:15.502188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:15.502188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:15.517793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.519308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:15.521979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.523852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:15.865085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:15.904988 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4652dd33-0572-48a1-b632-518e00b905a0 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 2050 microversion: 2.25 time: 0.412891 Jul 18 12:53:15.906441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 318/660] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:15 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 2050 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:15.913699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:15.915630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:15.927412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.928323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:15.931487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:15.932927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.288452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:16.317879 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-890ed755-e427-466a-a241-fee2c565ce92 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1317 microversion: 2.1 time: 0.408640 Jul 18 12:53:16.321954 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 319/661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:15 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:16.338758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:16.340882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:16.362079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.363326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.365040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.366084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.670854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:16.690236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f83088a4-178e-4c4d-a20f-2a215adbeaeb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.362995 Jul 18 12:53:16.691360 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 320/662] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:16 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:16.701625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0e097052-18d4-4b53-bd87-03969b4c10d6 req-3a0334e5-71aa-4ad2-a334-ef87a6189b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:16.733927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0e097052-18d4-4b53-bd87-03969b4c10d6 req-3a0334e5-71aa-4ad2-a334-ef87a6189b27 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.735274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0e097052-18d4-4b53-bd87-03969b4c10d6 req-3a0334e5-71aa-4ad2-a334-ef87a6189b27 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.770793 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0e097052-18d4-4b53-bd87-03969b4c10d6 req-3a0334e5-71aa-4ad2-a334-ef87a6189b27 service nova] Creating event network-changed:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h1-850003-3 Jul 18 12:53:16.784165 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0e097052-18d4-4b53-bd87-03969b4c10d6 req-3a0334e5-71aa-4ad2-a334-ef87a6189b27 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090347 Jul 18 12:53:16.786023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 321/663] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:16.808805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:16.812611 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:53:16.812611 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:53:16.815389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.816311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.818134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.818971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.948611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d30c394-6e70-455f-a299-1d98e117ee44 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.147729 Jul 18 12:53:16.951361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 322/664] 10.222.0.88 () {60 vars in 1216 bytes} [Mon Jul 18 12:53:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:53:16.969991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:16.975277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:16.990250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.990827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:16.992650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:16.993809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:17.721311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:17.739296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e71353b-b7a7-4ef6-8f38-f234e4a9f6ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.785604 Jul 18 12:53:17.742001 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 323/665] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:16 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:17.771411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850003-3", "block_migration": "auto"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:17.779524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:17.809762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:17.811350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:17.813681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:17.815039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:17.879359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'flavor' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:17.934821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Going to try to live migrate instance to n-h1-850003-3 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:53:17.965665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:19.710767 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ea82ee3-3b1b-4073-a02f-b20312317554 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.525565 Jul 18 12:53:19.722705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 343/666] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:53:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:19.745833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:19.748843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:19.771573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:19.772673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:19.774978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:19.777422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:20.266564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:20.280998 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07b5b7f4-7222-402f-b8cf-25d8669d84f4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1467 microversion: 2.1 time: 0.556938 Jul 18 12:53:20.282699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 344/667] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:19 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1467 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:20.292894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:20.298902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:20.338393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:20.339839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:20.341711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:20.344677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:20.744932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:20.760171 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02f9e0db-36fc-495e-92ad-6ea828e8cc3d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.474311 Jul 18 12:53:20.761462 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 345/668] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:20 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:20.769164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f1312f53-809d-4051-acce-1ab194b918df req-71291afc-d511-48cf-838e-a94f15209fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c36dc80-89d0-4801-88f2-2e74b3245ec2", "tag": "053f4e21-28a4-4e59-b5f6-9ca5c33f510a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:20.786471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f1312f53-809d-4051-acce-1ab194b918df req-71291afc-d511-48cf-838e-a94f15209fd9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:20.787461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f1312f53-809d-4051-acce-1ab194b918df req-71291afc-d511-48cf-838e-a94f15209fd9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:20.809924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f1312f53-809d-4051-acce-1ab194b918df req-71291afc-d511-48cf-838e-a94f15209fd9 service nova] Creating event network-changed:053f4e21-28a4-4e59-b5f6-9ca5c33f510a for instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 on n-h1-850003-3 Jul 18 12:53:20.820812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f1312f53-809d-4051-acce-1ab194b918df req-71291afc-d511-48cf-838e-a94f15209fd9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057413 Jul 18 12:53:20.822265 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 346/669] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:20.831752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:20.832872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:20.844814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:20.845359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:20.846882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:20.847924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:21.121590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:21.136618 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-453694e3-60c2-4e78-b7ce-1de298fb02df tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.310914 Jul 18 12:53:21.137950 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 347/670] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:20 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:21.146095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3d5e7418-6bb4-461c-8165-76b2765353c4 req-574a133b-edbc-463d-827e-e1458c2a609c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "name": "network-vif-unplugged", "status": "completed", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:21.171684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3d5e7418-6bb4-461c-8165-76b2765353c4 req-574a133b-edbc-463d-827e-e1458c2a609c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:21.172610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3d5e7418-6bb4-461c-8165-76b2765353c4 req-574a133b-edbc-463d-827e-e1458c2a609c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:21.209993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3d5e7418-6bb4-461c-8165-76b2765353c4 req-574a133b-edbc-463d-827e-e1458c2a609c service nova] Creating event network-vif-unplugged:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h1-850003-3 Jul 18 12:53:21.218707 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3d5e7418-6bb4-461c-8165-76b2765353c4 req-574a133b-edbc-463d-827e-e1458c2a609c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078313 Jul 18 12:53:21.219641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 348/671] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:21.236323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.197"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:21.238352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:21.250857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:21.251602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:21.252747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:21.253551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:21.305079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Acquired lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:53:21.988002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b.", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:53:21.988954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Releasing lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:53:21.989148 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:21.989148 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Request method failure captured: Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action HTTP/1.1 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 46 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeFJri9JmvY0g7cy_CrBE2e1KUVcoUvkc3ubjXBQIjW6pJvB1WHV7mTEaFILHF2c3bnUpdiYHurzSvfDhwjk5LM1UXGDxA6OLJy8Dsppl3-FJ7EfXaTRbxnowg423hpsmz1Bn-qnw9pE2oVJkOlKm_nYv_mJqz1iMdyQHoB6VWXQZc Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:22.032852 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a8993082a204beaaf79ed57f3547236", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 024bda6a1eed40cb8a3f82481c5c478e Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: {"addFloatingIp": {"address": "172.25.1.197"}} Jul 18 12:53:22.035615 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9261085e-34cb-47d6-aaec-55379309343d', 'body': {'addFloatingIp': {'address': '172.25.1.197'}}} Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.037355 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:53:22.039814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.042068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.044832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Returning 400 to user: Cannot associate floating IP 172.25.1.197 (fdb8b18f-7323-4bca-b73b-91e8eae2e9bf) with port 51bfd0ad-cfc3-4816-a5e6-602334013370 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network fae3a6a5-0ff2-4f06-b214-fc03fff2005b. Jul 18 12:53:22.047465 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-14c1e8e7-4782-4893-8a0c-2b8560b4f116'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:22.048966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9f614cb-4ecb-4cdc-a8bd-652f54c80ac6 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 400 len: 381 microversion: 2.1 time: 0.812989 Jul 18 12:53:22.048966 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 349/672] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:21 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 381 bytes in 818 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:53:22.684405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:22.685530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:22.689251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:22.702759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:22.703696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:22.705442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:22.706274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:22.961413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=9 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:23.095512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=53,nova_cell0:UPDATE=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:23.172729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a53c1188-a06b-4eb9-8f4c-23c01d2257b2 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1618 microversion: 2.1 time: 1.132466 Jul 18 12:53:23.176055 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 350/673] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:22 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1618 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:23.717427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ba3b504-4ccd-4712-8420-7345d8c583f2 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Calling method '.version_select at 0x7f96e4dc4280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:23.755569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-4ba3b504-4ccd-4712-8420-7345d8c583f2 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ba3b504-4ccd-4712-8420-7345d8c583f2 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/c291f56b-3dfc-456e-9437-882f12ec4861/metadata/os_distro HTTP/1.1 Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:23.769294 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'image_id': 'c291f56b-3dfc-456e-9437-882f12ec4861', 'id': 'os_distro'} Jul 18 12:53:23.772630 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:23.776185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c291f56b-3dfc-456e-9437-882f12ec4861 Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:23.781114 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c291f56b-3dfc-456e-9437-882f12ec4861 could not be found. Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:23.787593 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:23.793353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ba3b504-4ccd-4712-8420-7345d8c583f2 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:23.797713 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ba3b504-4ccd-4712-8420-7345d8c583f2 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "DELETE /compute/v2.1/images/c291f56b-3dfc-456e-9437-882f12ec4861/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.593412 Jul 18 12:53:23.797713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 351/674] 10.222.0.88 () {58 vars in 1292 bytes} [Mon Jul 18 12:53:23 2022] DELETE /compute/v2.1/images/c291f56b-3dfc-456e-9437-882f12ec4861/metadata/os_distro => generated 62 bytes in 600 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:23.797713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:23.797713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:23.797713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:23.799221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:23.799221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:23.799818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:23.828345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:24.047413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:24.066993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d842218-4525-43ca-a545-d2e3416505d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.287526 Jul 18 12:53:24.067979 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 352/675] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:23 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:24.075791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbf30c26-8f70-4991-b692-050c0cd83ec7 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '.version_select at 0x7f96e4dc4430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:24.334745 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-101071c8-91b6-4b04-ad32-d35129ed487b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea/action" status: 202 len: 0 microversion: 2.25 time: 6.588958 Jul 18 12:53:24.341946 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 324/676] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:53:17 2022] POST /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea/action => generated 0 bytes in 6599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:53:24.354082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:24.368450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:24.383975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:24.384771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:24.386295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:24.387144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:24.903930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:24.927768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f0bd321-2786-4e37-804c-5116e74a5d81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1503 microversion: 2.1 time: 0.580284 Jul 18 12:53:24.929936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 325/677] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:24 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1503 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:24.940779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: .version_select at 0x7f96e4c611f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2131214453", "policies": ["affinity"]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:25.005901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:25.021265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:25.177809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:25.189436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:25.218821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9712b68d-d396-44f6-88b8-6891b942be3e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.285564 Jul 18 12:53:25.220562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 326/678] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 18 12:53:24 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:25.229162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d731a23-afa2-4332-9028-d463300e7c1b tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Calling method '.version_select at 0x7f96e4c61670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:25.270954 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9d731a23-afa2-4332-9028-d463300e7c1b tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d731a23-afa2-4332-9028-d463300e7c1b tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/images/cfc000ba-3161-4b4c-8a0b-0a6113d8fa48/metadata/os_version HTTP/1.1 Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:25.278402 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'image_id': 'cfc000ba-3161-4b4c-8a0b-0a6113d8fa48', 'id': 'os_version'} Jul 18 12:53:25.280799 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:25.283068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cfc000ba-3161-4b4c-8a0b-0a6113d8fa48 Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:25.286755 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cfc000ba-3161-4b4c-8a0b-0a6113d8fa48 could not be found. Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:25.289188 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:25.291679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:25.298172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d731a23-afa2-4332-9028-d463300e7c1b tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:25.298172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9d731a23-afa2-4332-9028-d463300e7c1b tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "GET /compute/v2.1/images/cfc000ba-3161-4b4c-8a0b-0a6113d8fa48/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.074868 Jul 18 12:53:25.298953 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 327/679] 10.222.0.88 () {58 vars in 1292 bytes} [Mon Jul 18 12:53:25 2022] GET /compute/v2.1/images/cfc000ba-3161-4b4c-8a0b-0a6113d8fa48/metadata/os_version => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:25.457505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-66304668", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:25.621942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:25.621942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:25.621942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:25.621942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:25.621942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:25.640086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:25.640878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:25.642551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:25.643327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:25.676990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Getting quotas for project ea3c62e2be6346d09e661a3fb51cd7bd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:25.686637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Getting quotas for user 67e97a4f3627483d899597b4e7995333 and project ea3c62e2be6346d09e661a3fb51cd7bd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:25.712466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:53:25.716347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:25.795665 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d679636c-7d74-4c1e-9790-c5c4b000c972 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.494797 Jul 18 12:53:25.797412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 328/680] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 12:53:25.807382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:25.809408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:25.821809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:25.823132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:25.824137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:25.825038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:25.833542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:26.073685 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dbf30c26-8f70-4991-b692-050c0cd83ec7 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/fdb8b18f-7323-4bca-b73b-91e8eae2e9bf" status: 202 len: 0 microversion: 2.1 time: 2.000939 Jul 18 12:53:26.074805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 353/681] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:53:24 2022] DELETE /compute/v2.1/os-floating-ips/fdb8b18f-7323-4bca-b73b-91e8eae2e9bf => generated 0 bytes in 2006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:26.082708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:26.083910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:26.097915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.098749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:26.100320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.101007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:26.150550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:53:26.298849 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97433f0d-48bc-40b9-b723-d2d5ac8e3647 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 204 len: 0 microversion: 2.1 time: 0.221132 Jul 18 12:53:26.300254 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 354/682] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:53:26 2022] DELETE /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:53:26.313611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:26.315397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:26.328722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.334356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:26.334356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.334356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:26.350035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.379785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.384445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.408409 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0435324-ab28-427f-a60e-d3688dceebac tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 0.588358 Jul 18 12:53:26.411879 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 329/683] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:25 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:26.438175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e558d257-15bd-4e2c-a403-df1475e45592 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Calling method '.version_select at 0x7f96e4bf2310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:26.501958 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e558d257-15bd-4e2c-a403-df1475e45592 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e558d257-15bd-4e2c-a403-df1475e45592 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/images/c999aa77-a191-4ac0-b185-42e6a171f6b0/metadata HTTP/1.1 Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:26.506454 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'image_id': 'c999aa77-a191-4ac0-b185-42e6a171f6b0'} Jul 18 12:53:26.509800 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:26.519703 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c999aa77-a191-4ac0-b185-42e6a171f6b0 Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:26.525512 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c999aa77-a191-4ac0-b185-42e6a171f6b0 could not be found. Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:26.530924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:26.536795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e558d257-15bd-4e2c-a403-df1475e45592 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:26.543874 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e558d257-15bd-4e2c-a403-df1475e45592 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "GET /compute/v2.1/images/c999aa77-a191-4ac0-b185-42e6a171f6b0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.094421 Jul 18 12:53:26.543874 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 330/684] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:53:26 2022] GET /compute/v2.1/images/c999aa77-a191-4ac0-b185-42e6a171f6b0/metadata => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:26.543874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-728169490", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8f8cee9b-f8dc-440e-b51c-cb72dad35532"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:26.636336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:53:26.641746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.653997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-994d433d-511e-4a38-8437-aa3009b349c6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.350878 Jul 18 12:53:26.656085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 355/685] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:26 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:26.668477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:26.671534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:26.815139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.828500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.831943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:26.843526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5d39649-cdea-46af-bb7a-b362239e6e87 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "PUT /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1357 microversion: 2.75 time: 0.184104 Jul 18 12:53:26.844242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 356/686] 10.222.0.88 () {62 vars in 1296 bytes} [Mon Jul 18 12:53:26 2022] PUT /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:26.853145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:26.854780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:26.868035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.869363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:26.871236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:26.872699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:27.158885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:27.176151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b59a64f-9c49-4fd5-9609-7018d285fc61 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1478 microversion: 2.1 time: 0.330148 Jul 18 12:53:27.177696 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 357/687] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:26 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1478 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:27.188365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: .version_select at 0x7f96e74081f0>, body: {"removeFloatingIp": {"address": "172.25.1.2"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:27.259730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:27.260570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:27.261496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:27.262312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:27.263071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:27.323852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:27.324604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:27.325543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:27.325991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:27.369240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:27.382523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:27.405242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 2 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:53:27.410188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:27.444851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:27.454561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:27.456578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:27.457629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:27.458291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:27.476617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131367) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 12:53:27.524041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:27.537730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:27.625256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:27.635998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:27.668755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=fa2edb7d-b8d6-479d-9120-62ceae4df679,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:27.766717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:27.781544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:27.792301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:27.909918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:27.921929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:27.940497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Acquired lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:53:28.000316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91c40e61-e45f-417a-9c17-4cf25af5805e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.487727 Jul 18 12:53:28.006004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 331/688] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:53:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1492 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 12:53:28.023455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:28.025536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:28.092671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:28.094178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:28.095436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:28.096249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:28.433417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:28.454059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1055c4cc-9a37-4370-b630-ff1ae871d35b tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1708 microversion: 2.1 time: 0.448441 Jul 18 12:53:28.456940 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 332/689] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:28 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1708 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:28.472105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-365f8fa1-e956-42fa-9e2d-09b91a3df0b3 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Action: 'update_all', calling method: .version_select at 0x7f96e4b89040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:28.550365 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-365f8fa1-e956-42fa-9e2d-09b91a3df0b3 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-365f8fa1-e956-42fa-9e2d-09b91a3df0b3 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/images/9095d11d-5131-4a1b-a5cf-c78e5464f8ad/metadata HTTP/1.1 Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 57 Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:28.554561 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 12:53:28.556871 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'image_id': '9095d11d-5131-4a1b-a5cf-c78e5464f8ad', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:28.561511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9095d11d-5131-4a1b-a5cf-c78e5464f8ad Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:28.567698 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9095d11d-5131-4a1b-a5cf-c78e5464f8ad could not be found. Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:28.572685 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:28.575645 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:28.580942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-365f8fa1-e956-42fa-9e2d-09b91a3df0b3 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:28.580942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-365f8fa1-e956-42fa-9e2d-09b91a3df0b3 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "PUT /compute/v2.1/images/9095d11d-5131-4a1b-a5cf-c78e5464f8ad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.095650 Jul 18 12:53:28.580942 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 333/690] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:53:28 2022] PUT /compute/v2.1/images/9095d11d-5131-4a1b-a5cf-c78e5464f8ad/metadata => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:28.589622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:28.591773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:28.617924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:28.618739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:28.620109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:28.630940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:28.893518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:28.918290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:28.922298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:28.938532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8893f5e-9bcc-4d21-8840-e637def1bcf3 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1353 microversion: 2.75 time: 0.355810 Jul 18 12:53:28.940339 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 334/691] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:28 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1353 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:28.972629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fb7e7283-a6ea-426c-bceb-bae53fc96112 req-86cc7188-8903-4533-ad95-054077802ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c36dc80-89d0-4801-88f2-2e74b3245ec2", "name": "network-vif-plugged", "status": "completed", "tag": "053f4e21-28a4-4e59-b5f6-9ca5c33f510a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:28.996698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fb7e7283-a6ea-426c-bceb-bae53fc96112 req-86cc7188-8903-4533-ad95-054077802ba8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:28.998231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fb7e7283-a6ea-426c-bceb-bae53fc96112 req-86cc7188-8903-4533-ad95-054077802ba8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:29.033157 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fb7e7283-a6ea-426c-bceb-bae53fc96112 req-86cc7188-8903-4533-ad95-054077802ba8 service nova] Creating event network-vif-plugged:053f4e21-28a4-4e59-b5f6-9ca5c33f510a for instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 on n-h1-850003-3 Jul 18 12:53:29.044362 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fb7e7283-a6ea-426c-bceb-bae53fc96112 req-86cc7188-8903-4533-ad95-054077802ba8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101132 Jul 18 12:53:29.045633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 335/692] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:29.058189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eaebafca-b4b0-42bd-b002-336d299ff963 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '.version_select at 0x7f96e4dc0940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:29.063282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaebafca-b4b0-42bd-b002-336d299ff963 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:29.064073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaebafca-b4b0-42bd-b002-336d299ff963 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:29.081732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eaebafca-b4b0-42bd-b002-336d299ff963 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1164 microversion: 2.1 time: 0.032437 Jul 18 12:53:29.083071 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 336/693] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:53:29 2022] GET /compute/v2.1/os-migrations => generated 1164 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:29.113242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d3cac8b8-01dd-4f87-ab96-16026427cb22 req-e9c94470-9c71-4a81-8f8a-7c9c6f733e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:29.135824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d3cac8b8-01dd-4f87-ab96-16026427cb22 req-e9c94470-9c71-4a81-8f8a-7c9c6f733e6f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:29.137567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d3cac8b8-01dd-4f87-ab96-16026427cb22 req-e9c94470-9c71-4a81-8f8a-7c9c6f733e6f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:29.173236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d3cac8b8-01dd-4f87-ab96-16026427cb22 req-e9c94470-9c71-4a81-8f8a-7c9c6f733e6f service nova] Creating event network-vif-unplugged:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:53:29.183418 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d3cac8b8-01dd-4f87-ab96-16026427cb22 req-e9c94470-9c71-4a81-8f8a-7c9c6f733e6f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082913 Jul 18 12:53:29.192348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 337/694] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:29.207778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:29.208915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:29.232277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:29.232624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:29.235588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:29.235962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:29.664967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Building network info cache for instance {{(pid=131366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 12:53:29.932073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:29.972205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:29.976420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:29.980336 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5b85629-38f3-48f8-97ca-144aef127290 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 0.786129 Jul 18 12:53:29.994815 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 338/695] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:29 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:30.012315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:30.013976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:30.045476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:30.046375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:30.047862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:30.048734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:30.684986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:30.711580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20e4f253-b64f-484c-9fe7-72ef7e2a3798 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1367 microversion: 2.1 time: 0.709589 Jul 18 12:53:30.713738 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 339/696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:29 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:30.732864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:30.752007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:30.753929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Searching by: {'deleted': False, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:53:30.787961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:30.790027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:30.791950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:30.793035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.074461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:53:31.112501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Updating instance_info_cache with network_info: [{"id": "51bfd0ad-cfc3-4816-a5e6-602334013370", "address": "fa:16:3e:7f:08:2a", "network": {"id": "bd2a104e-bbe4-4792-86d3-b0cc8ebc45b3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1425697923-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a8993082a204beaaf79ed57f3547236", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap51bfd0ad-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 12:53:31.140530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Releasing lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:53:31.143060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-984c6be1-33c5-4737-8fd3-00964501da06 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 202 len: 0 microversion: 2.1 time: 3.963056 Jul 18 12:53:31.144931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 358/697] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:27 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 0 bytes in 3966 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 12:53:31.151413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c357d863-0658-460c-8da5-53c0e84ede2d tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Action: 'update', calling method: .version_select at 0x7f96e4d2d5e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:31.215914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c357d863-0658-460c-8da5-53c0e84ede2d tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c357d863-0658-460c-8da5-53c0e84ede2d tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/images/81931742-8767-4052-a4c6-f4bb366eddf6/metadata/os_distro HTTP/1.1 Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 30 Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:31.224410 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: {"meta": {"os_distro": "alt"}} Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:53:31.226189 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'image_id': '81931742-8767-4052-a4c6-f4bb366eddf6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:31.227643 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 81931742-8767-4052-a4c6-f4bb366eddf6 Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:31.229195 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81931742-8767-4052-a4c6-f4bb366eddf6 could not be found. Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:31.231122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:31.233074 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:31.240805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c357d863-0658-460c-8da5-53c0e84ede2d tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:31.243587 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c357d863-0658-460c-8da5-53c0e84ede2d tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "PUT /compute/v2.1/images/81931742-8767-4052-a4c6-f4bb366eddf6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.096008 Jul 18 12:53:31.249157 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 359/698] 10.222.0.88 () {60 vars in 1309 bytes} [Mon Jul 18 12:53:31 2022] PUT /compute/v2.1/images/81931742-8767-4052-a4c6-f4bb366eddf6/metadata/os_distro => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:31.263553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:31.265206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:31.276955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.278851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.280243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.281219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.322629 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a26eb6c5-24b7-4220-a271-43a4eb6dc293 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.597172 Jul 18 12:53:31.333853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 340/699] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 12:53:30 2022] GET /compute/v2.1/servers => generated 1002 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:31.343300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:31.345188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:31.354559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.355566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.356565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.357083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.505360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:31.525481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-355030c6-eb81-4875-8df8-5c8c2df2e0c4 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1640 microversion: 2.1 time: 0.189275 Jul 18 12:53:31.528749 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 341/700] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:31 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1640 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:31.537441 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b126a5de-587c-448f-8119-43a2cecd9b18 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1629 microversion: 2.1 time: 0.285071 Jul 18 12:53:31.546946 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 360/701] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:31 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1629 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:31.549713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-97e3bbd7-0c73-4bed-8e35-3c7729027df7 req-98fd48be-46b9-4d77-9a71-e5eb4571bb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9261085e-34cb-47d6-aaec-55379309343d", "tag": "51bfd0ad-cfc3-4816-a5e6-602334013370"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:31.580910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:31.582077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:31.585063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-97e3bbd7-0c73-4bed-8e35-3c7729027df7 req-98fd48be-46b9-4d77-9a71-e5eb4571bb06 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.591028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-97e3bbd7-0c73-4bed-8e35-3c7729027df7 req-98fd48be-46b9-4d77-9a71-e5eb4571bb06 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.593664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.594799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.596513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.597571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.637675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-97e3bbd7-0c73-4bed-8e35-3c7729027df7 req-98fd48be-46b9-4d77-9a71-e5eb4571bb06 service nova] Creating event network-changed:51bfd0ad-cfc3-4816-a5e6-602334013370 for instance 9261085e-34cb-47d6-aaec-55379309343d on n-h1-850003-3 Jul 18 12:53:31.658754 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-97e3bbd7-0c73-4bed-8e35-3c7729027df7 req-98fd48be-46b9-4d77-9a71-e5eb4571bb06 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127453 Jul 18 12:53:31.659893 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 342/702] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:31.673437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:31.675175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:31.700568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.701818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.703664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:31.704765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:31.948878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:32.000981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:32.012690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:32.035995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f037f54-558d-40e8-9152-6269904bc56c tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1415 microversion: 2.75 time: 0.487428 Jul 18 12:53:32.039068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 361/703] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:31 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1415 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:32.068466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-718de7db-d1ef-497e-9ffe-ad334ddac77d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '.version_select at 0x7f96e4db6820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:33.271452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:33.288262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:33.294241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:33.298586 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a59e6be3-7163-48b1-9074-68267ac824c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 1.635988 Jul 18 12:53:33.318190 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 343/704] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:31 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:33.318190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12a8de52-d2e1-486b-af46-835bce86ac92 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Action: 'create', calling method: .version_select at 0x7f96e4962d30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:33.381677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-12a8de52-d2e1-486b-af46-835bce86ac92 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] HTTP exception thrown: Image not found. Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12a8de52-d2e1-486b-af46-835bce86ac92 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Request method failure captured: Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/images/7836694e-54c9-41f0-b062-cd42ec7e9148/metadata HTTP/1.1 Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 57 Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfBJdhnHTOZ2MotrXTl68C_LmqANk_Z5nKLQsNXIEA1mipTgVg1plhK5w0gOf10kdgYI6SIxk-RfBGzF2gLspJ_ASOBSCP9On6iMkwfQBIlrU7NyALNMjkNnSGwZG6xp7X7jHq3hXBOUJKS07sB5AiZw6dXchawcVyA2TPy74NGhtI Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:33.386629 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fcbcb79d87a042728710143d6c96ad5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fcbcb79d87a042728710143d6c96ad5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: fcbcb79d87a042728710143d6c96ad5f Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-585793117 Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f468d55c35fd4a0d8fa6891caaf78f51 Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-585793117-project Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 12:53:33.388395 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'image_id': '7836694e-54c9-41f0-b062-cd42ec7e9148', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:33.389288 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7836694e-54c9-41f0-b062-cd42ec7e9148 Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 12:53:33.391180 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7836694e-54c9-41f0-b062-cd42ec7e9148 could not be found. Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:33.392619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:53:33.394335 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:33.396037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12a8de52-d2e1-486b-af46-835bce86ac92 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:33.396037 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12a8de52-d2e1-486b-af46-835bce86ac92 tempest-ImagesMetadataNegativeTestJSON-585793117 tempest-ImagesMetadataNegativeTestJSON-585793117-project] 10.222.0.88 "POST /compute/v2.1/images/7836694e-54c9-41f0-b062-cd42ec7e9148/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086063 Jul 18 12:53:33.396037 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 344/705] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 18 12:53:33 2022] POST /compute/v2.1/images/7836694e-54c9-41f0-b062-cd42ec7e9148/metadata => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:33.402224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-48e7b526-2d5a-4c25-b496-94d4b0bd118c req-57d788f2-ea0e-45c6-b6f2-c6b47e25f714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:33.424046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-48e7b526-2d5a-4c25-b496-94d4b0bd118c req-57d788f2-ea0e-45c6-b6f2-c6b47e25f714 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:33.425835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-48e7b526-2d5a-4c25-b496-94d4b0bd118c req-57d788f2-ea0e-45c6-b6f2-c6b47e25f714 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:33.457139 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-48e7b526-2d5a-4c25-b496-94d4b0bd118c req-57d788f2-ea0e-45c6-b6f2-c6b47e25f714 service nova] Creating event network-changed:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:53:33.470637 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-48e7b526-2d5a-4c25-b496-94d4b0bd118c req-57d788f2-ea0e-45c6-b6f2-c6b47e25f714 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075678 Jul 18 12:53:33.472633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 345/706] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:33.486018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:33.489712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:33.512843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:33.513555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:33.515096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:33.529343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.126586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-718de7db-d1ef-497e-9ffe-ad334ddac77d tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/d120ba82-eb1b-4881-a52f-1b6d9fd5e794" status: 202 len: 0 microversion: 2.1 time: 2.061825 Jul 18 12:53:34.128523 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 362/707] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:53:32 2022] DELETE /compute/v2.1/os-floating-ips/d120ba82-eb1b-4881-a52f-1b6d9fd5e794 => generated 0 bytes in 2089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:34.149173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c86c409-3cd3-453e-8acf-ad27c56062ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: .version_select at 0x7f96e4d2d550>, body: {"keypair": {"name": "tempest-keypair-391544092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINFj8VlkTfaP+tLmPagTiP592xswgpYwG6ZGAot8zWGglWbUsiqEBvsNLafwcSjgO85hCisaMIOIw1/zv0Vhd8NNW3QPt/8mYI7eaQTlFo5YWTeuLllSjThpNZ098EQpw=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:34.173708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.185129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3ffd954-c527-41b8-b453-3f6689db9b5b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1270 microversion: 2.1 time: 0.710132 Jul 18 12:53:34.186837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 346/708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:33 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1270 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:34.200828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3c86c409-3cd3-453e-8acf-ad27c56062ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:34.212714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:34.213820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:34.219272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3c86c409-3cd3-453e-8acf-ad27c56062ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for user 64cdfc77cf92451c84c873df41bc422f and project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:34.224271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.224980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.227057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.227640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.296359 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c86c409-3cd3-453e-8acf-ad27c56062ce tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166013 Jul 18 12:53:34.298620 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 363/709] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 12:53:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:34.326711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:34.330613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:34.347583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.348731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.349901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.350667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.439554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.441166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.442408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lazy-loading 'fault' on Instance uuid 6951dad0-6630-4237-80ef-3a88c7cd8b2b {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:34.553314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab603aa7a37344fc8e71e4b6d6fc32c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c34421b2324ed3b3f15ccb5139e78b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.578863 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5544049e-88a1-49bd-97f5-f4b020387faf tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 200 len: 1351 microversion: 2.1 time: 0.278412 Jul 18 12:53:34.579903 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 364/710] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:34 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:34.623630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:34.629453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:34.661134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.661905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.665691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.670614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.679118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.699443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bbad6cd0-8741-404b-83c5-ad79bf6de43d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1556 microversion: 2.1 time: 0.510481 Jul 18 12:53:34.700058 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 347/711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:34 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1556 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:34.709329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fef62018-d655-4246-b42f-1f682ff4ce32 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: .version_select at 0x7f96e7602a60>, body: {"addFloatingIp": {"address": ""}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fef62018-d655-4246-b42f-1f682ff4ce32 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Request method failure captured: Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action HTTP/1.1 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 34 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeFJri9JmvY0g7cy_CrBE2e1KUVcoUvkc3ubjXBQIjW6pJvB1WHV7mTEaFILHF2c3bnUpdiYHurzSvfDhwjk5LM1UXGDxA6OLJy8Dsppl3-FJ7EfXaTRbxnowg423hpsmz1Bn-qnw9pE2oVJkOlKm_nYv_mJqz1iMdyQHoB6VWXQZc Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:34.714949 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a8993082a204beaaf79ed57f3547236", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 024bda6a1eed40cb8a3f82481c5c478e Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: {"addFloatingIp": {"address": ""}} Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:53:34.717666 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '9261085e-34cb-47d6-aaec-55379309343d', 'body': {'addFloatingIp': {'address': ''}}} Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '' Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:34.720368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 12:53:34.727300 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 12:53:34.731004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 12:53:34.731004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:34.731004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fef62018-d655-4246-b42f-1f682ff4ce32 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:34.731004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fef62018-d655-4246-b42f-1f682ff4ce32 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 400 len: 142 microversion: 2.1 time: 0.015930 Jul 18 12:53:34.731004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 348/712] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:34 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:53:34.744285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:34.747024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:34.765515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.766552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.768245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.769700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.855543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.877651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.881197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:34.893282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b0c4c5b-a372-4328-a282-f739fcceabe5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1415 microversion: 2.75 time: 0.293254 Jul 18 12:53:34.921022 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 365/713] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:34 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1415 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:34.934806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:34.936236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:34.959003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.960470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:34.963398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:34.964573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:35.193091 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9da98d5-eb5b-43ef-a6b1-87ac52ec5ce7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.269421 Jul 18 12:53:35.194074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 366/714] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 12:53:34 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:35.216475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:35.220809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:35.240896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:35.242236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:35.243952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:35.245199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:35.313110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Acquired lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 12:53:35.566606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Releasing lock "refresh_cache-9261085e-34cb-47d6-aaec-55379309343d" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 12:53:35.569139 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] HTTP exception thrown: floating IP not found Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Request method failure captured: Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action HTTP/1.1 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 41 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeFJri9JmvY0g7cy_CrBE2e1KUVcoUvkc3ubjXBQIjW6pJvB1WHV7mTEaFILHF2c3bnUpdiYHurzSvfDhwjk5LM1UXGDxA6OLJy8Dsppl3-FJ7EfXaTRbxnowg423hpsmz1Bn-qnw9pE2oVJkOlKm_nYv_mJqz1iMdyQHoB6VWXQZc Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:35.571425 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a8993082a204beaaf79ed57f3547236", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 024bda6a1eed40cb8a3f82481c5c478e Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:53:35.572845 n-d-850003-3 devstack@n-api.service[131366]: exception: floating IP not found Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9261085e-34cb-47d6-aaec-55379309343d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:35.573743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 18 12:53:35.575271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:35.581673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Returning 404 to user: floating IP not found {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:35.581673 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-127cf1f2-c4f3-475b-bbee-49b21c2046dc tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 404 len: 67 microversion: 2.1 time: 0.369106 Jul 18 12:53:35.583916 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 367/715] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:35 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 67 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:35.595913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:35.597056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:35.643216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:35.645521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:35.647482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:35.651992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:35.935883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:35.979139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:35.994458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:36.012749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:36.025807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15b35d3a-97cf-44b4-93cb-f728cef266cb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 1.302642 Jul 18 12:53:36.029707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 349/716] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:34 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:36.042003 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-028fb661-a1b7-4955-98be-422dab1ca85f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1276 microversion: 2.1 time: 0.441183 Jul 18 12:53:36.054425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 368/717] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:35 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1276 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:36.063863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f8cf6a89-6027-40b4-aab0-dfd082edde3e req-21ed86e2-a053-4731-bf6f-1bda577dfc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6951dad0-6630-4237-80ef-3a88c7cd8b2b", "name": "network-vif-deleted", "tag": "fce0e40a-0335-487b-8ee2-fa4056074422"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:36.078628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9494203-f738-4846-9c53-7b026ef28563 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:36.107206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f8cf6a89-6027-40b4-aab0-dfd082edde3e req-21ed86e2-a053-4731-bf6f-1bda577dfc75 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.109358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f8cf6a89-6027-40b4-aab0-dfd082edde3e req-21ed86e2-a053-4731-bf6f-1bda577dfc75 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.153133 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f8cf6a89-6027-40b4-aab0-dfd082edde3e req-21ed86e2-a053-4731-bf6f-1bda577dfc75 service nova] Creating event network-vif-deleted:fce0e40a-0335-487b-8ee2-fa4056074422 for instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b on n-h2-850003-3 Jul 18 12:53:36.183496 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f8cf6a89-6027-40b4-aab0-dfd082edde3e req-21ed86e2-a053-4731-bf6f-1bda577dfc75 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150663 Jul 18 12:53:36.195014 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 350/718] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:36.223636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.226286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.239316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e9494203-f738-4846-9c53-7b026ef28563 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9494203-f738-4846-9c53-7b026ef28563 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Request method failure captured: Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action HTTP/1.1 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 44 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeFJri9JmvY0g7cy_CrBE2e1KUVcoUvkc3ubjXBQIjW6pJvB1WHV7mTEaFILHF2c3bnUpdiYHurzSvfDhwjk5LM1UXGDxA6OLJy8Dsppl3-FJ7EfXaTRbxnowg423hpsmz1Bn-qnw9pE2oVJkOlKm_nYv_mJqz1iMdyQHoB6VWXQZc Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:36.249388 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a8993082a204beaaf79ed57f3547236", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 024bda6a1eed40cb8a3f82481c5c478e Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:53:36.253959 n-d-850003-3 devstack@n-api.service[131366]: exception: Floating IP not found for address 0.0.0.0. Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9261085e-34cb-47d6-aaec-55379309343d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:36.255510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 18 12:53:36.261831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.274295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.274295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.274295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.275385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.281166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9494203-f738-4846-9c53-7b026ef28563 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:36.283421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9494203-f738-4846-9c53-7b026ef28563 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action" status: 404 len: 88 microversion: 2.1 time: 0.216045 Jul 18 12:53:36.284916 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 369/719] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:53:36 2022] POST /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d/action => generated 88 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:53:36.300034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.302388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.337945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.340351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:36.345776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b HTTP/1.1 Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:36.348301 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:36.351155 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6951dad0-6630-4237-80ef-3a88c7cd8b2b'} Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:36.353332 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:36.357927 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.360425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.363833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:36.364152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.369137 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c92ff05-a676-4df2-b74e-cea9b12e8fd1 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 404 len: 111 microversion: 2.1 time: 0.167443 Jul 18 12:53:36.374476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 351/720] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:36 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:36.401174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.403070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.427218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.428027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.429519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.434033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.522885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:53:36.591585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:36.631324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:36.640321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:36.664673 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3a1cbb0-483f-4148-ae21-9eb2713208d5 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1436 microversion: 2.75 time: 0.371121 Jul 18 12:53:36.665789 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 370/721] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:36 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1436 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:36.710490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.711935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.741677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.742914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.754540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.755349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.818052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 HTTP/1.1 Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:36.839699 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.842376 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b147194b-0153-47c3-b2ed-1f398764e2d6'} Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:36.843835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.847375 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.853390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:36.853390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7fb151b-71ea-4b7f-a669-a1e07936bb24 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 404 len: 111 microversion: 2.1 time: 0.145720 Jul 18 12:53:36.853390 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 371/722] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:53:36 2022] DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:36.864195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:36.871407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.873523 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-662f2e89-6234-45aa-84c6-b1596b62caea tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 204 len: 0 microversion: 2.1 time: 0.496388 Jul 18 12:53:36.875371 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 352/723] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:53:36 2022] DELETE /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:53:36.888001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.889908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:36.903464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.904858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.906663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.907858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.917218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:36.935157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.935958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.942638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 HTTP/1.1 Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:36.948470 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.952191 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b147194b-0153-47c3-b2ed-1f398764e2d6'} Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:36.953775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:36.957644 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:36.961966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:36.961966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:36.966818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:36.969121 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60a8b68f-2328-457b-a4cc-c6c3845dbb5f tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 404 len: 111 microversion: 2.1 time: 0.091319 Jul 18 12:53:36.971386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 353/724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:36 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:36.982649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:36.984786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:37.000008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:37.002062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:37.005343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:37.007272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:37.288773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:37.291177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:37.293032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:37.294502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:37.295600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:37.352736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:37.449800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:37.462403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:37.464002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:37.465901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:37.467241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:37.941722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=48 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:38.304490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.308622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.323777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2444c9c-933b-4fa2-af1c-6e4bedb2b3af tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1542 microversion: 2.1 time: 1.349896 Jul 18 12:53:38.326226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.330064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.334755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 354/725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:36 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1542 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:38.341890 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4cf09dc-7e37-482f-a99a-f90202ffce2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "POST /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c/action" status: 202 len: 1493 microversion: 2.75 time: 1.491285 Jul 18 12:53:38.344002 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 372/726] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:53:36 2022] POST /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c/action => generated 1493 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 12:53:38.353632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:38.355219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:38.357132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4951c90e-8d0e-498e-b3d9-4dbc982c8dce tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '.version_select at 0x7f96e4b89940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:38.384442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.393346 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4951c90e-8d0e-498e-b3d9-4dbc982c8dce tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39912689" status: 202 len: 0 microversion: 2.1 time: 0.056370 Jul 18 12:53:38.395588 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 355/727] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 12:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39912689 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:38.405127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.406009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:38.407398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:38.409033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.409862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.421466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.422448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.424130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.425466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.624418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.641115 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e42f0dee-f327-4c27-8000-7c3ce4c5bc87 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1276 microversion: 2.1 time: 0.243171 Jul 18 12:53:38.642750 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 356/728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:38 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:38.652610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e928fc50-6b74-4b9e-9b70-6a2b99403c30 req-bb6c8ecc-2d3b-47cb-bab3-3cac5d1b1ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:38.674574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e928fc50-6b74-4b9e-9b70-6a2b99403c30 req-bb6c8ecc-2d3b-47cb-bab3-3cac5d1b1ea6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.676343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e928fc50-6b74-4b9e-9b70-6a2b99403c30 req-bb6c8ecc-2d3b-47cb-bab3-3cac5d1b1ea6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.708833 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e928fc50-6b74-4b9e-9b70-6a2b99403c30 req-bb6c8ecc-2d3b-47cb-bab3-3cac5d1b1ea6 service nova] Creating event network-vif-unplugged:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:53:38.719724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e928fc50-6b74-4b9e-9b70-6a2b99403c30 req-bb6c8ecc-2d3b-47cb-bab3-3cac5d1b1ea6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074280 Jul 18 12:53:38.722076 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 357/729] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:38.841162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.869028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.872144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:38.884239 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e2f80a0-4984-4885-84e7-77d1b8d5222d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 0.528301 Jul 18 12:53:38.885283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 373/730] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:38 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:38.891081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c475805-27f8-4b94-bfa4-795a8d77745d tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] Calling method '.version_select at 0x7f96e4918ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:38.918541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:38.920091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:38.935409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.936632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:38.938365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:38.939104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:39.000990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c475805-27f8-4b94-bfa4-795a8d77745d tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] 10.222.0.88 "GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344" status: 200 len: 784 microversion: 2.1 time: 0.275288 Jul 18 12:53:39.015676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 358/731] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:53:38 2022] GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344 => generated 784 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:39.025589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e7b1485f-0148-4d3f-925f-12182269cf2f req-51ec6d17-b765-4353-b9f8-30dbec229c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:39.043768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e7b1485f-0148-4d3f-925f-12182269cf2f req-51ec6d17-b765-4353-b9f8-30dbec229c5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:39.044968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e7b1485f-0148-4d3f-925f-12182269cf2f req-51ec6d17-b765-4353-b9f8-30dbec229c5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:39.067083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e7b1485f-0148-4d3f-925f-12182269cf2f req-51ec6d17-b765-4353-b9f8-30dbec229c5e service nova] Creating event network-vif-unplugged:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h2-850003-3 Jul 18 12:53:39.084228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e7b1485f-0148-4d3f-925f-12182269cf2f req-51ec6d17-b765-4353-b9f8-30dbec229c5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065942 Jul 18 12:53:39.086303 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 359/732] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:39.102446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07dbc6e8-f47d-4723-a884-150bf15dff2b tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] Calling method '.version_select at 0x7f96e4b04ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:39.143061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:39.181550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:39.188407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:39.206733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c337c211-79ad-4d93-a1d5-c6ec36de2ca4 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.295727 Jul 18 12:53:39.220043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 374/733] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:38 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:39.289392 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07dbc6e8-f47d-4723-a884-150bf15dff2b tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] 10.222.0.88 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.200022 Jul 18 12:53:39.291197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 360/734] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jul 18 12:53:39 2022] GET /compute/v2.1/images => generated 445 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:39.307641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-150a7717-b346-4186-9233-16c38c95101d tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] Calling method '.version_select at 0x7f96e4d2db80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:39.361393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:39.375779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:39.399301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:39.402749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:39.406138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:39.407408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:39.417229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-150a7717-b346-4186-9233-16c38c95101d tempest-ListImagesTestJSON-1944706185 tempest-ListImagesTestJSON-1944706185-project] 10.222.0.88 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.116396 Jul 18 12:53:39.434904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 375/735] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:53:39 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:39.630622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-186667008", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "de298d9c-e7c4-4212-8e1a-869417573018"}], "security_groups": [{"name": "tempest-securitygroup--1216899763"}], "key_name": "tempest-keypair-391544092", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:39.833110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] validate_networks() for [('de298d9c-e7c4-4212-8e1a-869417573018', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:53:40.861068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:40.866943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:40.867496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:40.868018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:40.869374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:40.884111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:40.884558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:40.886020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:40.886020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:40.923736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:40.938499 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dba91f53-c461-45d4-8c03-b1cb54d09668 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1542 microversion: 2.1 time: 1.583967 Jul 18 12:53:40.944202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:40.958282 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 361/736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:39 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1542 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:40.966783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:40.968479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:40.979568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for user 64cdfc77cf92451c84c873df41bc422f and project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:40.980151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:40.983703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:40.984393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:40.986645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:40.987302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:41.037015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:53:41.043297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:41.159604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d72809a1-9222-4eba-b958-943bede045e0 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.537912 Jul 18 12:53:41.162059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 376/737] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:53:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 12:53:41.172813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:41.174129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:41.187653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:41.188773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:41.190699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:41.191977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:41.217338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:41.239998 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-936368b1-de38-4240-93e7-c628713b898e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1276 microversion: 2.1 time: 0.279873 Jul 18 12:53:41.246188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 362/738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:40 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:41.246468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:41.247090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:41.265131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:41.265858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:41.266992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:41.267595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:41.839151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:41.871360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:41.877387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:41.879985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1cc953fc-d2c8-4467-b7e0-6299b63872f9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 0.715707 Jul 18 12:53:41.882395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 377/739] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:41 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:41.892160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4c4da6a9-8a15-4ded-bf0c-3a34db40d384 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:41.894211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c4da6a9-8a15-4ded-bf0c-3a34db40d384 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:41.905879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:41.981198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:42.004997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:42.010376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:42.022080 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0fdb537f-bb38-46af-bf0d-4ba7436f989a tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.779556 Jul 18 12:53:42.025347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 363/740] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:41 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:42.050280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c95090f-2ed7-4b98-9443-602e428afa62 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.053465 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:53:42.053465 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:53:42.060200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4c4da6a9-8a15-4ded-bf0c-3a34db40d384 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:42.078432 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4c4da6a9-8a15-4ded-bf0c-3a34db40d384 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1233 microversion: 2.1 time: 0.193140 Jul 18 12:53:42.080280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 378/741] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:41 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1233 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:42.106650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.108257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:42.120664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c95090f-2ed7-4b98-9443-602e428afa62 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/2143769661" status: 202 len: 0 microversion: 2.1 time: 0.089143 Jul 18 12:53:42.122478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.122776 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 364/742] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:53:42 2022] DELETE /compute/v2.1/flavors/2143769661 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:53:42.124033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.126768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.127789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.145012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76ef2af7-b48b-4155-b648-54f185156af3 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.213095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76ef2af7-b48b-4155-b648-54f185156af3 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.084331 Jul 18 12:53:42.215086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 365/743] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:42.239916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c013aae4-5c36-4163-9e2f-a5a5124528a3 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.269955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:42.281592 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c013aae4-5c36-4163-9e2f-a5a5124528a3 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/411795138" status: 202 len: 0 microversion: 2.1 time: 0.046689 Jul 18 12:53:42.282301 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 366/744] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:53:42 2022] DELETE /compute/v2.1/flavors/411795138 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:53:42.297217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.297865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:42.319115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.320984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.323014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.324721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.493092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:42.520590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75b7393d-164a-46ca-b5a6-c9316883d955 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1542 microversion: 2.1 time: 0.437487 Jul 18 12:53:42.526497 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 379/745] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:42.544697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5632f512-1df6-4d64-acc8-add0348aee07 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.619139 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5632f512-1df6-4d64-acc8-add0348aee07 tempest-ServersWithSpecificFlavorTestJSON-1010279575 tempest-ServersWithSpecificFlavorTestJSON-1010279575-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093519 Jul 18 12:53:42.622829 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 380/746] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:42.675021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.675342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:42.701961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.703108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.704878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.706196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.772165 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b HTTP/1.1 Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:42.780100 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.783528 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '6951dad0-6630-4237-80ef-3a88c7cd8b2b'} Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:42.787088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.792659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.803627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:42.807966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-495bbe03-8951-4cbe-a9a6-c9b8f7d8cb4a tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 404 len: 111 microversion: 2.1 time: 0.154153 Jul 18 12:53:42.809807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 381/747] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:53:42 2022] DELETE /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:42.825582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.828504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: 6951dad0-6630-4237-80ef-3a88c7cd8b2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:42.845855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.848919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.851002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.852958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.913374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b HTTP/1.1 Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:42.921491 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.924044 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '6951dad0-6630-4237-80ef-3a88c7cd8b2b'} Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:42.925484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. Jul 18 12:53:42.932168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:42.941457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance 6951dad0-6630-4237-80ef-3a88c7cd8b2b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:42.944612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-370bea58-634b-4866-8966-8b1c7e52b49e tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b" status: 404 len: 111 microversion: 2.1 time: 0.128038 Jul 18 12:53:42.947274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 382/748] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/servers/6951dad0-6630-4237-80ef-3a88c7cd8b2b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:53:42.963769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:42.967434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:42.987557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.988891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:42.992957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:42.994603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:43.314798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:43.348492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0188e0cd-c52d-4793-aeed-8191449f1d37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 1.055467 Jul 18 12:53:43.377603 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 367/749] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:43.391262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:43.393447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:43.427153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:43.432238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:43.438615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:43.439839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:43.485372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 HTTP/1.1 Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:43.490187 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:43.493624 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b147194b-0153-47c3-b2ed-1f398764e2d6'} Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:43.495257 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:43.498813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:43.504922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:43.507059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ed7cccc-3ae4-405e-ab47-fceb45322e35 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 404 len: 111 microversion: 2.1 time: 0.124800 Jul 18 12:53:43.509498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 368/750] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:53:43 2022] DELETE /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:43.521680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:43.524018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:43.539814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:43.540731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:43.542575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:43.544441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:43.980586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.010367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.022888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.029826 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bff20cf8-6714-4b9e-b125-5376a3d6e888 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 1.079608 Jul 18 12:53:44.031707 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 383/751] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:42 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:44.041886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:44.043506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:44.070911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.074407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.075226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.076651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.086934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.128954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.146050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.207370 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-618de113-2f31-41cf-9ac7-c6e563920069 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.690231 Jul 18 12:53:44.212054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 369/752] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:43 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:44.236206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:44.245471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] [instance: b147194b-0153-47c3-b2ed-1f398764e2d6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:44.264213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.265181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.267241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.271070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.312658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] HTTP exception thrown: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Request method failure captured: Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 HTTP/1.1 Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VbSGKL9OuxMRiZiWz4xckBHd3DYsZpMzN66Ug7WV_G5vVBYQbCPv0-md3l_xVkH_1mEzJ_sGZ5XexgApfvcGdj4aKpUTtd13uXZLuzSRD48Ciuvwr6Y5X7cSqOWy4jTEhJVPgyEet4upiphogLNXJMNfgNndlduFdd_7xaPnZk2RQw Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:53:44.316415 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21c34421b2324ed3b3f15ccb5139e78b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21c34421b2324ed3b3f15ccb5139e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21c34421b2324ed3b3f15ccb5139e78b Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101 Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ab603aa7a37344fc8e71e4b6d6fc32c0 Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1492138101-project Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:44.320098 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b147194b-0153-47c3-b2ed-1f398764e2d6'} Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:44.322381 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. Jul 18 12:53:44.326460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:53:44.333464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] Returning 404 to user: Instance b147194b-0153-47c3-b2ed-1f398764e2d6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:44.333464 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-faacef6e-d469-49a7-ac8a-b379d073c2c3 tempest-ServersWithSpecificFlavorTestJSON-1492138101 tempest-ServersWithSpecificFlavorTestJSON-1492138101-project] 10.222.0.88 "GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6" status: 404 len: 111 microversion: 2.1 time: 0.112599 Jul 18 12:53:44.333464 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 370/753] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:44 2022] GET /compute/v2.1/servers/b147194b-0153-47c3-b2ed-1f398764e2d6 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:44.342380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:44.344626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.345182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:44.353442 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-acf0894b-3921-47e5-b4ba-006b7b66283d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1291 microversion: 2.1 time: 0.319846 Jul 18 12:53:44.354039 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 384/754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:44 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1291 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:44.359952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.361198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.364280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.367683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.376369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6cc33a4a-2add-4f0f-a9e9-d843de7d367d req-6ac77ebc-2cf0-4d9e-932e-dcec72a3f8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c36dc80-89d0-4801-88f2-2e74b3245ec2", "tag": "053f4e21-28a4-4e59-b5f6-9ca5c33f510a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:44.401801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6cc33a4a-2add-4f0f-a9e9-d843de7d367d req-6ac77ebc-2cf0-4d9e-932e-dcec72a3f8fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.402336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6cc33a4a-2add-4f0f-a9e9-d843de7d367d req-6ac77ebc-2cf0-4d9e-932e-dcec72a3f8fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.426704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6cc33a4a-2add-4f0f-a9e9-d843de7d367d req-6ac77ebc-2cf0-4d9e-932e-dcec72a3f8fd service nova] Creating event network-changed:053f4e21-28a4-4e59-b5f6-9ca5c33f510a for instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 on n-h1-850003-3 Jul 18 12:53:44.438997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6cc33a4a-2add-4f0f-a9e9-d843de7d367d req-6ac77ebc-2cf0-4d9e-932e-dcec72a3f8fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073836 Jul 18 12:53:44.442590 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 385/755] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:44.453126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:44.460008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:44.469375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.469845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.470922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:44.471793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:44.752302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024bda6a1eed40cb8a3f82481c5c478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8993082a204beaaf79ed57f3547236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:44.761276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-938b637d-06a0-4f9f-8c7d-7a831ee912ff tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 200 len: 1500 microversion: 2.1 time: 0.430847 Jul 18 12:53:44.779922 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 371/756] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:44 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 1500 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:45.063680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:45.064403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:45.078471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:45.079016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:45.079914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:45.081177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:45.559213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:45.604484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7f177c3-5eea-4b34-b925-71eb7275d39e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 1.159702 Jul 18 12:53:45.605762 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 386/757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:44 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:45.643151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:45.645897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:45.663958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:45.665375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:45.667378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:45.668523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:45.916662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:45.970101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:45.981809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:46.001187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10acbfd9-1142-4b38-9814-b1aa80f977f1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.368978 Jul 18 12:53:46.002712 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 387/758] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:45 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:46.015459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:46.017113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:46.035419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.039126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.041439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.055988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.636302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:46.649496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:46.687031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dab59fc7-dec7-48cd-8e8d-772437676fb1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1291 microversion: 2.1 time: 0.677557 Jul 18 12:53:46.693295 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 388/759] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:46 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1291 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:46.711955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:46.719384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:46.720715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:46.722130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1dd6f525-288e-4971-935d-11e96e7d443d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1567 microversion: 2.25 time: 1.662074 Jul 18 12:53:46.722562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] [instance: 9261085e-34cb-47d6-aaec-55379309343d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:46.735086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.736316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.736856 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 372/760] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:45 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1567 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:46.738995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.740038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.761705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9261085e-34cb-47d6-aaec-55379309343d", "name": "network-vif-deleted", "tag": "51bfd0ad-cfc3-4816-a5e6-602334013370"}, {"name": "network-changed", "server_uuid": "fa2edb7d-b8d6-479d-9120-62ceae4df679", "tag": "16cf2a24-d295-40c6-b85e-57c3c5f6b20b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:46.782729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] HTTP exception thrown: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Request method failure captured: Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d HTTP/1.1 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeFJri9JmvY0g7cy_CrBE2e1KUVcoUvkc3ubjXBQIjW6pJvB1WHV7mTEaFILHF2c3bnUpdiYHurzSvfDhwjk5LM1UXGDxA6OLJy8Dsppl3-FJ7EfXaTRbxnowg423hpsmz1Bn-qnw9pE2oVJkOlKm_nYv_mJqz1iMdyQHoB6VWXQZc Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:53:46.786462 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a8993082a204beaaf79ed57f3547236", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a8993082a204beaaf79ed57f3547236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a8993082a204beaaf79ed57f3547236 Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 024bda6a1eed40cb8a3f82481c5c478e Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. Jul 18 12:53:46.789843 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9261085e-34cb-47d6-aaec-55379309343d'} Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:53:46.792484 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. Jul 18 12:53:46.795210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:53:46.803990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] Returning 404 to user: Instance 9261085e-34cb-47d6-aaec-55379309343d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:53:46.807485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa5a2051-e4b5-46cf-8de6-d76b6b0a49d3 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594 tempest-FloatingIPsAssociationNegativeTestJSON-2115408594-project] 10.222.0.88 "GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d" status: 404 len: 111 microversion: 2.1 time: 0.109963 Jul 18 12:53:46.809696 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 389/761] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:46 2022] GET /compute/v2.1/servers/9261085e-34cb-47d6-aaec-55379309343d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:53:46.812941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.818620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.828789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:46.831683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:46.850326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.852317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.855182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:46.856593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:46.857623 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] Creating event network-vif-deleted:51bfd0ad-cfc3-4816-a5e6-602334013370 for instance 9261085e-34cb-47d6-aaec-55379309343d on n-h1-850003-3 Jul 18 12:53:46.858911 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] Creating event network-changed:16cf2a24-d295-40c6-b85e-57c3c5f6b20b for instance fa2edb7d-b8d6-479d-9120-62ceae4df679 on n-h2-850003-3 Jul 18 12:53:46.885057 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b566bd1d-d326-439b-b3c1-038404808e6e req-e48f5700-163b-4d6e-825a-2e485cc2dbb4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.145981 Jul 18 12:53:46.892523 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 373/762] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:47.054456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:47.057834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:47.073339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.074508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.082621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.083650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.295122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:47.331739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:47.337403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:47.350129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f5aad78-65f8-4d7a-a523-a8fbad1bece1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.306315 Jul 18 12:53:47.354819 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 374/763] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:47 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:47.707165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:47.719442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:47.724486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:47.740703 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65a366e3-3301-4241-b687-b2545f300476 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.927959 Jul 18 12:53:47.742217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 390/764] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:46 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:47.745596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.746731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.748374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.749113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.760653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:47.761603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:47.792128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.794819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.796600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:47.797579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:47.938579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:47.955847 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b16c123-3e5e-46a0-aeb4-2cb352c03194 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1291 microversion: 2.1 time: 0.245786 Jul 18 12:53:47.962629 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 375/765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:47 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1291 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:48.391420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:48.393398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:48.418548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.420209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.421949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.424051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.456845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.499936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.503594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.506220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ac8d71c-81cf-42bd-8230-b631403a3858 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1557 microversion: 2.25 time: 0.751752 Jul 18 12:53:48.507310 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 391/766] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:47 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1557 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:48.545680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffe6a224-5dad-4b29-81a1-683c4ca9b4f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '.version_select at 0x7f96e4cc00d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:48.551087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffe6a224-5dad-4b29-81a1-683c4ca9b4f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.557256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffe6a224-5dad-4b29-81a1-683c4ca9b4f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.623985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ffe6a224-5dad-4b29-81a1-683c4ca9b4f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.089616 Jul 18 12:53:48.638661 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 392/767] 10.222.0.88 () {60 vars in 1183 bytes} [Mon Jul 18 12:53:48 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:48.649175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:48.650839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:48.666625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.667750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.669960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.671343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.765216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.808389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.824288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:48.847482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d1cce923-72f7-49a0-bf40-4e3955fb5af0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.464665 Jul 18 12:53:48.849480 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 376/768] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:48 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:48.869697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:48.871295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:48.893065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.894343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:48.896046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:48.897088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:49.572042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:53:49.651830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:49.662401 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f997925-939c-47a5-8c80-e2eac7a736d9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.810734 Jul 18 12:53:49.674959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 377/769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:48 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:49.677099 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03418fe2-2515-4b6c-b4be-9e337fc3deec tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 2050 microversion: 2.25 time: 1.035994 Jul 18 12:53:49.678775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 393/770] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:48 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 2050 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:49.682739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f842cc2a-9ce3-42f6-bac4-d92432f7f331 req-196e9b68-8e3d-47b9-a540-209e8170f68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0361ad1-b767-4167-a7ac-46b828a3f89b", "tag": "7c9e36a3-77dd-4fe4-99bb-5a51c2238080"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:49.688046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:49.689547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:49.702575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:49.705721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:49.708162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:49.709201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:49.718286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f842cc2a-9ce3-42f6-bac4-d92432f7f331 req-196e9b68-8e3d-47b9-a540-209e8170f68f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:49.719013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f842cc2a-9ce3-42f6-bac4-d92432f7f331 req-196e9b68-8e3d-47b9-a540-209e8170f68f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:49.755247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:49.769214 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f842cc2a-9ce3-42f6-bac4-d92432f7f331 req-196e9b68-8e3d-47b9-a540-209e8170f68f service nova] Creating event network-changed:7c9e36a3-77dd-4fe4-99bb-5a51c2238080 for instance f0361ad1-b767-4167-a7ac-46b828a3f89b on n-h2-850003-3 Jul 18 12:53:49.790581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f842cc2a-9ce3-42f6-bac4-d92432f7f331 req-196e9b68-8e3d-47b9-a540-209e8170f68f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109904 Jul 18 12:53:49.791472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 378/771] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:49.883429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:49.886724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:49.911446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:49.913165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:49.914103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:49.914725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:50.213317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:50.244361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:50.250432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:50.265314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e94a2b71-2a68-4dc2-9945-727933b6a087 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.389705 Jul 18 12:53:50.268400 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 379/772] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:49 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:50.288323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1503466609", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b247f390-7473-4edc-b6bf-63b08a11384c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:50.459284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] validate_networks() for [('b247f390-7473-4edc-b6bf-63b08a11384c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:53:50.609958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:50.639751 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-adf0f9a5-5931-4bca-928b-700aaf9b1739 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.958241 Jul 18 12:53:50.640978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 394/773] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:49 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:50.710602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:50.713142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:50.723535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:50.724720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:50.727247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:50.728896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:50.902462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:51.482188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:51.494550 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b50e64f-ef65-40d7-a016-8458b0afb745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.790084 Jul 18 12:53:51.497169 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 395/774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:50 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:51.504620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:51.506136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:51.521717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:51.523901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:51.525894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:51.527559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:51.650198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:51.664916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:51.668071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:51.676050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37cb4136-77b5-4689-ae0b-ce2b3fa468d2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.176847 Jul 18 12:53:51.690546 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 396/775] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:51 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:51.713258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:51.714842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:51.724130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:51.725133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:51.738061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:51.738840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:52.077861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:52.219935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:52.243865 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f2b6e78-07e2-4e65-ab43-1181e3432e2c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.543453 Jul 18 12:53:52.245619 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 397/776] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:51 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:52.519058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:52.520122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:52.527996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:52.529182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:52.530810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:52.531864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:53.165784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:53.188188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2b5bd04-fceb-4534-bbb5-95fa9b6626e2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.672686 Jul 18 12:53:53.206811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 398/777] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:52 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:53.230411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:53.231879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:53.246331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:53.247396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:53.249218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:53.250689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:53.560709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:53.577362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:53.580104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:53.593615 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e6d973e-cb5c-4d70-ac64-eda468520cc0 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.383622 Jul 18 12:53:53.595230 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 399/778] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:53 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:53.603433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dc8ccd9f-19a9-40bc-bc8d-240a3575d987 req-85e093d8-9690-4f1a-aaf8-6acdee8a05f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:53.621974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc8ccd9f-19a9-40bc-bc8d-240a3575d987 req-85e093d8-9690-4f1a-aaf8-6acdee8a05f5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:53.623897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc8ccd9f-19a9-40bc-bc8d-240a3575d987 req-85e093d8-9690-4f1a-aaf8-6acdee8a05f5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:53.649766 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dc8ccd9f-19a9-40bc-bc8d-240a3575d987 req-85e093d8-9690-4f1a-aaf8-6acdee8a05f5 service nova] Creating event network-changed:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:53:53.661325 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dc8ccd9f-19a9-40bc-bc8d-240a3575d987 req-85e093d8-9690-4f1a-aaf8-6acdee8a05f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062737 Jul 18 12:53:53.663385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 400/779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:53.676613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:53.677970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:53.693291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:53.694046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:53.697122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:53.697554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.456674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:54.487815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c83f9a4-6512-4bec-8c11-ae8afd49dfbe tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.821387 Jul 18 12:53:54.489761 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 401/780] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:53 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:54.499348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:54.501532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:54.515707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.516848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.518587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.519630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.660153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:53:54.660994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:53:54.661747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:53:54.662600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:53:54.663612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:53:54.700162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.700966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.702579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.703518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.756138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:53:54.770014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for user f604cd53dad44c39944c7e7a57737941 and project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:53:54.806427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:53:54.811065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:53:54.917729 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bff5ae22-aa20-461a-89e4-374c7c094076 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.644577 Jul 18 12:53:54.921745 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 380/781] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 12:53:54.949568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:54.953219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:54.986563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.989316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:54.995426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:54.996390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:55.111390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.134888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d187a14a-acd0-418b-b5fc-aa8002579372 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.642634 Jul 18 12:53:55.147278 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 402/782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:54 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:55.171726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:55.172032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:53:55.187664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:55.402301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.422297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.448402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.451299 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f70db2c-a089-4c00-b146-a1f1220aca8f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1262 microversion: 2.25 time: 0.293734 Jul 18 12:53:55.453293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 403/783] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:55 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1262 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:55.517207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:55.520318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:55.546464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:55.549715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:55.552686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:55.558475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:55.773229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.814471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.824874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:55.846255 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-107be7fd-a5ec-43bd-be0c-4ac7ff695a38 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.918786 Jul 18 12:53:55.849900 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 381/784] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:54 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:55.864785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-10db6798-9612-4206-b5a5-17a23d52b8dd req-5c9673af-64e0-4686-9ecc-30b2a4252d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2edb7d-b8d6-479d-9120-62ceae4df679", "name": "network-vif-plugged", "status": "completed", "tag": "16cf2a24-d295-40c6-b85e-57c3c5f6b20b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:55.896793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-10db6798-9612-4206-b5a5-17a23d52b8dd req-5c9673af-64e0-4686-9ecc-30b2a4252d95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:55.897697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-10db6798-9612-4206-b5a5-17a23d52b8dd req-5c9673af-64e0-4686-9ecc-30b2a4252d95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:55.945826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-10db6798-9612-4206-b5a5-17a23d52b8dd req-5c9673af-64e0-4686-9ecc-30b2a4252d95 service nova] Creating event network-vif-plugged:16cf2a24-d295-40c6-b85e-57c3c5f6b20b for instance fa2edb7d-b8d6-479d-9120-62ceae4df679 on n-h2-850003-3 Jul 18 12:53:55.974018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-10db6798-9612-4206-b5a5-17a23d52b8dd req-5c9673af-64e0-4686-9ecc-30b2a4252d95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119133 Jul 18 12:53:55.976361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 382/785] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:56.181952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:56.183821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:56.199148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.205612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:56.207815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.213341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:56.396003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:56.424210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32358b3a-8d1d-42a0-901c-3cafe5c4ea82 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.914800 Jul 18 12:53:56.426684 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 404/786] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:55 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:56.504846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:56.506468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:56.519502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.521584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:56.523494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.524589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:56.753232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:56.783733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:56.787689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:56.791376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6717b353-344c-403b-98e1-23a577dc3eab tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1266 microversion: 2.25 time: 0.310633 Jul 18 12:53:56.796840 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 405/787] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:56 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:56.888630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:56.891572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:56.918931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.923388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:56.925255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:56.931174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:57.192831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:57.210202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:57.213940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:57.225629 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1eaec4c-706e-4fd9-b261-71dad684e023 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.345649 Jul 18 12:53:57.227217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 406/788] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:56 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:53:57.453233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:57.454336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:57.462804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:57.463713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:57.465052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:57.465799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:57.493593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:57.509229 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c736722-44f0-440e-b1bf-4514be2457b5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 1.341466 Jul 18 12:53:57.527625 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 383/789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:56 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:53:57.831011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:57.836839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:57.864356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:57.869159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:57.876531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:57.877781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:58.147237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.191113 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63c7fb44-5aa4-4e69-9aa9-5240d96345a7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.743305 Jul 18 12:53:58.191848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 407/790] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:57 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:53:58.259572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:58.261440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:58.291503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:58.292578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:58.293747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:58.294797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:58.297623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.320896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.339725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.343568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e267144-5680-46a8-9574-d6926b012683 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1266 microversion: 2.25 time: 0.522706 Jul 18 12:53:58.348874 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 384/791] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:57 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1266 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:53:58.546038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:58.548910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:58.573830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:58.575184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:58.576809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:58.579894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:58.661790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.702271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.707797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:53:58.727604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75df3a19-b685-4bee-a5b9-e5595e065846 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.476863 Jul 18 12:53:58.728220 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 408/792] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:53:58 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:53:59.122593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4da52e9c-84eb-415b-a7d8-c675c81936ec req-0566db6e-0dfc-4d26-9e7a-fd840ed8808a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0361ad1-b767-4167-a7ac-46b828a3f89b", "name": "network-vif-plugged", "status": "completed", "tag": "7c9e36a3-77dd-4fe4-99bb-5a51c2238080"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:53:59.153113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4da52e9c-84eb-415b-a7d8-c675c81936ec req-0566db6e-0dfc-4d26-9e7a-fd840ed8808a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:59.154660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4da52e9c-84eb-415b-a7d8-c675c81936ec req-0566db6e-0dfc-4d26-9e7a-fd840ed8808a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:59.195732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4da52e9c-84eb-415b-a7d8-c675c81936ec req-0566db6e-0dfc-4d26-9e7a-fd840ed8808a service nova] Creating event network-vif-plugged:7c9e36a3-77dd-4fe4-99bb-5a51c2238080 for instance f0361ad1-b767-4167-a7ac-46b828a3f89b on n-h2-850003-3 Jul 18 12:53:59.206525 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4da52e9c-84eb-415b-a7d8-c675c81936ec req-0566db6e-0dfc-4d26-9e7a-fd840ed8808a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093507 Jul 18 12:53:59.209332 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 409/793] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:53:59.240772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:53:59.244074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:53:59.274773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:59.275649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:53:59.282815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:53:59.284731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:00.052944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.090604 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b0a33c1a-1f76-44ec-8599-a28d8bfd5267 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 1.554321 Jul 18 12:54:00.118252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 385/794] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:58 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:00.144120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:00.145900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:00.162005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:00.163661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:00.165534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:00.167724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:00.490878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.508720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.519966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.531430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.533469 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7210b5f-51c7-40ad-9ff0-519f6d360ba9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1320 microversion: 2.25 time: 0.412682 Jul 18 12:54:00.540276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 386/795] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:00 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:00.550815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-952f0c7e-6374-4d2f-85ea-ccbe68b8b9ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 1.331186 Jul 18 12:54:00.557984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 410/796] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:53:59 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:00.559157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:00.568538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:00.589809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:00.590913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:00.592764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:00.593784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:00.801101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.833252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.846525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:00.859760 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04d45e1e-55cb-4590-980f-15f2c4f4390d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.317135 Jul 18 12:54:00.862252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 387/797] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:00 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:01.128819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:01.130832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:01.147328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.149332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.151060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.152065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.569317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:01.572198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:01.586584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.587825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.589815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.590968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.805093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:01.847164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:01.854916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:01.858727 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b627a4d-020b-4620-a52a-fc131defb6e7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1320 microversion: 2.25 time: 0.296740 Jul 18 12:54:01.861587 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 388/798] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:01 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:01.872207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:01.875486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:01.898204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.899516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.901282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.902569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.927766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:01.952501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d8dee18-1eab-4d51-8c26-505a105d2475 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1318 microversion: 2.1 time: 0.832992 Jul 18 12:54:01.953201 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 411/799] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:01 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:01.972498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:01.973557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:01.996297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.997067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:01.998068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:01.998720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:02.251616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:02.271522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d79f7a9b-fc24-4ff7-aad1-b920e37057ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.407753 Jul 18 12:54:02.288301 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 389/800] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:01 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:02.487122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:02.517909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:02.521112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:02.536813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d789205f-3aad-458b-a292-e950048fee2d tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.581730 Jul 18 12:54:02.540586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 412/801] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:01 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:02.905260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:02.907004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:02.938079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:02.941471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:02.947195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:02.950031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:02.986918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:02.995779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:03.021349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:03.022980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:03.022980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:03.022980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:03.080018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:03.770710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:03.821268 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ce9d4e5-fc13-419d-930b-0202259347dd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1468 microversion: 2.1 time: 0.841722 Jul 18 12:54:03.823978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 413/802] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:02 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1468 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:03.859426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:03.860464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:03.893170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:03.894032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:03.897159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:03.898013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:04.080628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.108503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.111797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.125148 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34b030e6-6d58-4892-91c4-91bd3da72bc7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 1.226886 Jul 18 12:54:04.129570 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 390/803] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:02 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:04.152134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:04.153508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:04.181244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:04.184054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:04.202459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:04.205509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:04.394455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.426298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.430230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:04.451446 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc1f4bde-7939-46bf-8295-26fa4a34f4f2 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1445 microversion: 2.75 time: 0.313137 Jul 18 12:54:04.455966 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 391/804] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:04 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1445 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:04.479333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:04.481217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:04.510108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:04.512261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:04.523981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:04.524670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:04.728078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:04.785867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:05.043012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:05.058529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50e45381-ff3f-40a8-9535-6b2945136212 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 1.221485 Jul 18 12:54:05.074830 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 414/805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:03 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:05.081214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:05.095649 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ab965b7b-e0d0-4db1-8f41-7dd6349e5908 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 200 len: 1467 microversion: 2.1 time: 0.637436 Jul 18 12:54:05.098475 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 392/806] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:04 2022] GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 1467 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:05.128433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:05.136994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:05.139364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Searching by: {'reservation_id': 'r-4x4lqh04', 'deleted': False, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:54:05.153208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:05.154452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:05.156302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:05.157378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:05.169797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:05.175875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:05.202461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:05.203667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:05.205581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:05.207146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:05.414441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:05.475577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:54:05.701309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:05.715123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:05.716295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:05.975035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.010381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.016613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.019938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00dc6431-2992-4d71-9546-65a0d59a9f9d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.857710 Jul 18 12:54:06.027455 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 393/807] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:05 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:06.056556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:06.057801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:06.089019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:06.090134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:06.091455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:06.092711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:06.518417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.554947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.569275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:06.592786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ebd6c847-1641-4618-947e-d617c1999ab7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1451 microversion: 2.75 time: 0.563212 Jul 18 12:54:06.594439 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 394/808] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:06 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1451 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:06.625589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:06.632319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:06.678692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:06.681381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:06.682724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:06.687602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:06.810300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-432b4989-9bb7-4ef3-925c-85e73dd8f16f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?reservation_id=r-4x4lqh04" status: 200 len: 2928 microversion: 2.1 time: 1.686332 Jul 18 12:54:06.813358 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 415/809] 10.222.0.88 () {58 vars in 1196 bytes} [Mon Jul 18 12:54:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4x4lqh04 => generated 2928 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:06.823313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f479323d-5ecd-4346-b4e2-4ddb6f34478a req-70c232a2-8c80-4ce7-882d-2c264c15296c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "name": "network-vif-plugged", "status": "completed", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:07.209178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:07.244275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00a81883-9b65-414e-97ac-6066fe7e4f23 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.646180 Jul 18 12:54:07.247290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 395/810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:06 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:07.254239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f479323d-5ecd-4346-b4e2-4ddb6f34478a req-70c232a2-8c80-4ce7-882d-2c264c15296c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.254683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f479323d-5ecd-4346-b4e2-4ddb6f34478a req-70c232a2-8c80-4ce7-882d-2c264c15296c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:07.265550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2901d54-b0f9-40c1-8866-920898db0670 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:07.298842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f479323d-5ecd-4346-b4e2-4ddb6f34478a req-70c232a2-8c80-4ce7-882d-2c264c15296c service nova] Creating event network-vif-plugged:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:54:07.313439 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f479323d-5ecd-4346-b4e2-4ddb6f34478a req-70c232a2-8c80-4ce7-882d-2c264c15296c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493093 Jul 18 12:54:07.315053 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 416/811] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:07.322835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_groups [None req-b2901d54-b0f9-40c1-8866-920898db0670 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Querying cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) for 2 instances {{(pid=131367) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 12:54:07.325289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2901d54-b0f9-40c1-8866-920898db0670 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.326176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2901d54-b0f9-40c1-8866-920898db0670 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:07.331753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:07.333203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:07.368484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.372531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:07.377875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.392550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:07.529172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2901d54-b0f9-40c1-8866-920898db0670 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/8f8cee9b-f8dc-440e-b51c-cb72dad35532" status: 200 len: 266 microversion: 2.1 time: 0.278958 Jul 18 12:54:07.530736 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 396/812] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:54:07 2022] GET /compute/v2.1/os-server-groups/8f8cee9b-f8dc-440e-b51c-cb72dad35532 => generated 266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:07.551371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:07.562823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:07.579414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.583391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:07.585755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:07.587427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.255052 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-747cf808-78a3-4cae-b250-d5504bb719cd tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 200 len: 1619 microversion: 2.1 time: 0.710091 Jul 18 12:54:08.258503 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 397/813] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:07 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 1619 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:08.273126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:08.275321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:08.298697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.300196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.302561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.304440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.338906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.364064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.368248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.371729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53dc50e7-cffd-4e01-8207-fbb474c9b34d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 1.049745 Jul 18 12:54:08.373715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 417/814] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:07 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:08.399120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:08.400852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:08.427580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.430603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.441395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.442573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.620417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.627908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:08.648415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.652584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:08.663505 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97d178ec-90fc-4d6e-9fdc-879a00670c98 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1451 microversion: 2.75 time: 0.401176 Jul 18 12:54:08.665255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 398/815] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:08 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1451 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:08.675170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:08.676715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:08.683438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:08.693124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.694366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:08.696052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:08.697142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:09.091274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aac3fa6e-2a37-4788-a422-f5f1e5e48d28 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 200 len: 1618 microversion: 2.1 time: 0.423699 Jul 18 12:54:09.092871 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 399/816] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:08 2022] GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 1618 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:09.334897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:09.373338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec6c07b9-794b-4485-93f8-bc2a08f0a0c2 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1359 microversion: 2.1 time: 0.997352 Jul 18 12:54:09.376352 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 418/817] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:08 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1359 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:09.398352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: .version_select at 0x7f96e4c53700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1507984676", "policies": ["anti-affinity"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:09.443121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:09.471410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:09.492880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:09.635285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-968acaee-47fe-438f-8c6e-46deccb51400 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e48ef040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-330235255", "description": "tempest-description-694251632"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:09.701402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:09.732889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:09.778398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc647fc9-9bae-40b5-9c2d-2e35d90b0094 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.397621 Jul 18 12:54:09.780486 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 419/818] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 18 12:54:09 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:09.794662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:09.796627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:09.811464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:09.812293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:09.813944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:09.814614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:10.651195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:10.689765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:10.703143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:10.707690 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3327bd2a-b205-4bc4-a748-9a5cc0b96559 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.923683 Jul 18 12:54:10.729922 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 420/819] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:09 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:10.733364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b4598ae4-7065-49c9-9a3c-e5f4b68d3e4a req-29bf43ea-b6e0-4002-bfb9-4934ea269346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:10.774805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b4598ae4-7065-49c9-9a3c-e5f4b68d3e4a req-29bf43ea-b6e0-4002-bfb9-4934ea269346 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:10.775602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b4598ae4-7065-49c9-9a3c-e5f4b68d3e4a req-29bf43ea-b6e0-4002-bfb9-4934ea269346 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:10.822605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b4598ae4-7065-49c9-9a3c-e5f4b68d3e4a req-29bf43ea-b6e0-4002-bfb9-4934ea269346 service nova] Creating event network-changed:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h1-850003-3 Jul 18 12:54:10.855978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b4598ae4-7065-49c9-9a3c-e5f4b68d3e4a req-29bf43ea-b6e0-4002-bfb9-4934ea269346 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131973 Jul 18 12:54:10.860110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 421/820] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:10.872811 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-968acaee-47fe-438f-8c6e-46deccb51400 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.777898 Jul 18 12:54:10.886025 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 400/821] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:54:09 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:10.886713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:10.893728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-240893202", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "061c90c0-2682-4356-9b3d-2be66a61f3af"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:10.901709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:10.925438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:10.926255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:10.927539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:10.928428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:11.065453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:54:11.082926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:11.092287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:11.094653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:11.110238 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0361cfa5-3e2d-497e-9652-a418092ff651 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1436 microversion: 2.75 time: 0.243552 Jul 18 12:54:11.127896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 422/822] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:10 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1436 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:11.152875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:11.154081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:11.169926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:11.170758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:11.172177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:11.173203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:11.720144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:54:11.721244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:54:11.722392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:54:11.723619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:54:11.724600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:54:11.770384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:11.771052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:11.773508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:11.779266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:11.866329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:11.895740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:11.957806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:11.958698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 2 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:54:11.962678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:54:12.001955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3c6188d-03f8-4813-9c01-4b4d12ff9579 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1543 microversion: 2.1 time: 0.871862 Jul 18 12:54:12.003020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 423/823] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:11 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1543 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:12.016765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58b76e37-522d-486c-acc7-101b14ad7bb0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e4db6670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-828578108", "description": "tempest-description-1896771604"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:12.138551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:12.173767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:12.309016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:12.320909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:12.354494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=698ab691-827e-41f4-8c06-c2c64f15f51b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:54:12.597290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:12.617412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:12.769051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:12.790609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'server_group_members'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:13.000790 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3efa1a40-69f4-495a-9eab-ba5362d716b0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.123214 Jul 18 12:54:13.016901 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 401/824] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2140 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 12:54:13.604141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:13.617135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:13.644226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:13.648015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:13.649518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:13.650334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:13.777472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58b76e37-522d-486c-acc7-101b14ad7bb0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.772606 Jul 18 12:54:13.779813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 424/825] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:54:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:13.827808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:13.833670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:13.895731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:13.899692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:13.901215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:13.902857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:14.030042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:54:14.030953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:54:14.032075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:54:14.033109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:54:14.034073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:54:14.290674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:14.304538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:14.310263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:14.312935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:14.314525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:14.643568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:14.698831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:14.703497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:14.706589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d09a8770-d471-4835-80f0-5e8219e6a8be tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.917915 Jul 18 12:54:14.708005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 425/826] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:13 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:14.721017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:14.722193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:14.742724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:14.744129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:14.746674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:14.747966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:15.304361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:15.359467 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9f8a22a-fcb0-4f20-8408-be1f15f0a564 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.649192 Jul 18 12:54:15.361075 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 426/827] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 12:54:14 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-interface => generated 285 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:15.380264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:15.398312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:15.406052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Searching by: {'deleted': False, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:54:15.503488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:15.504131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:15.505620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:15.520928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:16.003757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:54:16.352553 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d8d5d5a-920b-43d7-b6b9-ea94ceebf881 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.963321 Jul 18 12:54:16.358526 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 427/828] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 12:54:15 2022] GET /compute/v2.1/servers => generated 1662 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:16.407490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1729878608", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b8b5ef0a-21b3-40e6-b6df-8593469ff26c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:16.651704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] validate_networks() for [('b8b5ef0a-21b3-40e6-b6df-8593469ff26c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:54:16.776315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:16.877305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff9a90c1-3aa0-4785-98fe-4ca01025bbf0 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c/action" status: 202 len: 1938 microversion: 2.75 time: 3.858389 Jul 18 12:54:16.882957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 402/829] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:54:13 2022] POST /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c/action => generated 1938 bytes in 3865 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 12:54:16.901771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:16.908060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:16.970609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:16.976973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:16.981546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:16.995969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:18.879241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:18.905212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:18.908530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:18.911020 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74c5f2ee-8fb9-46ef-973a-294f1a5d2d30 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 2.025634 Jul 18 12:54:18.935004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 403/830] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:16 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:18.945470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:18.952247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:18.965825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:18.969147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:18.971585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:18.972556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:19.144417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:54:19.145236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:54:19.145974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:54:19.146839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:54:19.147607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:54:19.194798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:19.196065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:19.198941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:19.200103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:19.264089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Getting quotas for project 49607e75db52424788c6fd28b64a4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:19.277656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Getting quotas for user 77b8ecd2ffb045fc8cc2585be2852c48 and project 49607e75db52424788c6fd28b64a4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:19.359334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:54:19.368966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:54:19.525715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:19.531042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62d5ed8b-ac4a-4bf3-8aba-16de4738ff31 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.169185 Jul 18 12:54:19.534441 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 428/831] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:54:19.544189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:19.545882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:19.561550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:19.562838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:19.564438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:19.565558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:19.597590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1772452e-21f9-4e54-ab23-e4f9f5081df4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1276 microversion: 2.1 time: 0.646906 Jul 18 12:54:19.627655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 404/832] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:18 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1276 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:19.686325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-225db401-be62-4ad9-97d1-6f84d69393f0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:19.689880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-225db401-be62-4ad9-97d1-6f84d69393f0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:20.100678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:20.137411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfb9303b-b6c8-4173-9106-8e52b859258b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.600317 Jul 18 12:54:20.150249 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 429/833] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:19 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:20.167277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:20.167439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:20.180317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:20.181613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:20.182588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:20.183452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:20.284812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-225db401-be62-4ad9-97d1-6f84d69393f0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:20.322055 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-225db401-be62-4ad9-97d1-6f84d69393f0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1216 microversion: 2.1 time: 0.692129 Jul 18 12:54:20.328809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 405/834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:19 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1216 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:20.676350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:20.678081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:20.717575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:20.721186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:20.724322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:20.725779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:20.733574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:20.764065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:20.769473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:20.777027 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e329a45-8199-449a-aadd-1f4fd26de3b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.631656 Jul 18 12:54:20.781016 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 430/835] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:20 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:21.102687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:21.133547 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a603deb-aa42-4ff5-b00e-72a6d568641e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1276 microversion: 2.1 time: 0.505043 Jul 18 12:54:21.135060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 406/836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:20 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1276 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:21.186837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:21.197290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:21.228001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.229223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:21.232102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.234405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:21.368109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:21.370461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:21.406881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.410433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:21.415964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.417240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:21.635323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:21.711084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-502f22b4-87ab-43ac-88f5-8c1ed44a85f9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.534028 Jul 18 12:54:21.714130 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 431/837] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:21 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:21.812879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:21.816248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:21.817550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:21.831274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.832449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:21.834041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:21.835260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:22.087353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:22.108416 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af8a346a-149c-48f6-9638-3277742c461b tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1220 microversion: 2.1 time: 0.753826 Jul 18 12:54:22.129731 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 407/838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:21 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1220 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:22.171263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:22.172880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:22.186999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:22.188261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:22.190174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:22.191319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:22.238807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:22.246941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:22.262838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:22.268265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:22.269444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7859df9-d3db-401a-904e-dd6665ad7d04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.465924 Jul 18 12:54:22.271241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 432/839] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:21 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:22.346296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:22.368698 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb0350a3-6dd2-46a1-bffb-a8bc50a0df4f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1276 microversion: 2.1 time: 0.208160 Jul 18 12:54:22.369724 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 408/840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:22 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:22.747777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:22.749004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:22.765998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:22.767884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:22.772226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:22.773741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:22.982921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:23.058897 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65b83c6f-b318-414d-a0f2-495ef4510667 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.319833 Jul 18 12:54:23.061270 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 433/841] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:22 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:23.150252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:23.152023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:23.159754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-955e64bd-9f14-4509-8ffe-793844a992d8 req-57a4d391-9440-44f8-95b6-cb3ff9460f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "name": "network-vif-plugged", "status": "completed", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:23.165619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.166941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.169019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.170208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.193300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-955e64bd-9f14-4509-8ffe-793844a992d8 req-57a4d391-9440-44f8-95b6-cb3ff9460f5a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.194667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-955e64bd-9f14-4509-8ffe-793844a992d8 req-57a4d391-9440-44f8-95b6-cb3ff9460f5a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.229630 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-955e64bd-9f14-4509-8ffe-793844a992d8 req-57a4d391-9440-44f8-95b6-cb3ff9460f5a service nova] Creating event network-vif-plugged:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h1-850003-3 Jul 18 12:54:23.257525 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-955e64bd-9f14-4509-8ffe-793844a992d8 req-57a4d391-9440-44f8-95b6-cb3ff9460f5a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102815 Jul 18 12:54:23.260547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 434/842] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:54:23.304386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:23.311014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:23.337727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.338575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.340038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.340835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.461566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:23.494103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-745573c2-6ec7-40f5-89c8-73ef8334242d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1274 microversion: 2.1 time: 0.351611 Jul 18 12:54:23.496440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 409/843] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:23 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1274 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:23.503931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:23.505464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:23.532324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.533560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.535597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:23.536556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:23.798114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:23.828221 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-849b8f73-11f8-4e01-8a20-c197418657f5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1276 microversion: 2.1 time: 0.329385 Jul 18 12:54:23.829981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 410/844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:23 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:24.092756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:24.093933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:24.115764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:24.130957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.134082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:24.135771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.136805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:24.140855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:24.145682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:24.161962 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca52029e-7592-440d-813a-c0514a11ef22 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1362 microversion: 2.25 time: 0.865110 Jul 18 12:54:24.164546 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 435/845] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:23 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1362 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:24.394440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:24.510228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:24.516050 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7802122e-f2a5-49a3-8c17-c47af62e1644 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.430436 Jul 18 12:54:24.530202 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 411/846] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:24 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:24.543735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:24.550107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:24.584455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.584455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:24.584455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.596111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:24.872896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:24.874200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:24.908685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.909507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:24.911051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:24.911839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:25.749276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:25.789926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12d0c740-00ce-453e-9f67-87bcc02d5ed5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 1.245304 Jul 18 12:54:25.791130 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 436/847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:24 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:25.809453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:25.818245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:25.850072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:25.850974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:25.857228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:25.858637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.028961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:26.050880 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72f9f0c4-2701-47ac-b816-119f9cf2ce2e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 1.195704 Jul 18 12:54:26.072753 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 412/848] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:24 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:26.083183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:26.084513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:26.097824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:26.098669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.101919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:26.103608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.427503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:26.516223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46e27461-8b16-4557-824f-4896073ede48 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.440391 Jul 18 12:54:26.518438 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 413/849] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:26 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:26.539583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4a563218-7c27-488a-8f3c-27ebe2e17bda req-31339c89-8072-4088-8380-676999f06b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:26.574067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4a563218-7c27-488a-8f3c-27ebe2e17bda req-31339c89-8072-4088-8380-676999f06b17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:26.575494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4a563218-7c27-488a-8f3c-27ebe2e17bda req-31339c89-8072-4088-8380-676999f06b17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.646325 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4a563218-7c27-488a-8f3c-27ebe2e17bda req-31339c89-8072-4088-8380-676999f06b17 service nova] Creating event network-changed:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:54:26.665518 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4a563218-7c27-488a-8f3c-27ebe2e17bda req-31339c89-8072-4088-8380-676999f06b17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144098 Jul 18 12:54:26.667520 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 414/850] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:26.835703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:26.837260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:26.852118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:26.854398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.856321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:26.857590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:26.922679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:27.405561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:27.437904 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d58179a-ee45-4778-ad1b-0bc3f02ba47f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.612488 Jul 18 12:54:27.447067 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 415/851] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:26 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:27.468545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:27.470624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:27.512609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:27.518373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:27.520514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:27.522131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.036020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:28.072052 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1bda32dd-5fe4-484b-9b5d-9807fd998a7b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.621700 Jul 18 12:54:28.075970 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 416/852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:27 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:28.101021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:28.105875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:28.137679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.138929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.140704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.141805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.505874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:28.538661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:28.573265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:28.576149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:28.579021 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-89612563-d250-4e4f-8661-fb119260c052 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1556 microversion: 2.25 time: 2.786207 Jul 18 12:54:28.580265 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 437/853] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:25 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1556 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:28.599480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:28.606658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:28.611683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-defea091-6509-43dd-b2ed-54fe7326dab5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.530338 Jul 18 12:54:28.619099 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 417/854] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:28 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:28.638758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:28.639934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.640749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.641935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:28.647260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.648259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.662543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.663349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:28.664207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:28.664670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:29.221232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:29.302136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:29.423095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:29.497929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d19e1400-cb65-4425-99a8-02ac242130f3 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 2049 microversion: 2.25 time: 0.876279 Jul 18 12:54:29.509146 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 418/855] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:28 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 2049 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:29.519714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-cf133e3b-7e05-48ba-8577-289a14443116 req-d1b72085-f642-437f-b73b-9f74ca1397fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888b28f5-3b97-4218-9811-a82ebdf63f27", "tag": "87a0a8f3-d59b-430d-b1a3-f8daaf528f86"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:29.560005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cf133e3b-7e05-48ba-8577-289a14443116 req-d1b72085-f642-437f-b73b-9f74ca1397fe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:29.563857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cf133e3b-7e05-48ba-8577-289a14443116 req-d1b72085-f642-437f-b73b-9f74ca1397fe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:29.614294 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-cf133e3b-7e05-48ba-8577-289a14443116 req-d1b72085-f642-437f-b73b-9f74ca1397fe service nova] Creating event network-changed:87a0a8f3-d59b-430d-b1a3-f8daaf528f86 for instance 888b28f5-3b97-4218-9811-a82ebdf63f27 on n-h2-850003-3 Jul 18 12:54:29.630786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-cf133e3b-7e05-48ba-8577-289a14443116 req-d1b72085-f642-437f-b73b-9f74ca1397fe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117696 Jul 18 12:54:29.633179 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 419/856] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:29.650078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:29.652606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:29.678641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:29.679702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:29.681275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:29.682270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.024602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:30.043412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63f28e4e-9a92-4ebe-9b7f-7de130965002 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.406815 Jul 18 12:54:30.054276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 420/857] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:29 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:30.070752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:30.072588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:30.100188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.102863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.111827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.113131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.320947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=24 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:30.501678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:30.558872 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3dc2e2fe-f90d-41c0-a6ad-cf36779c495c tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 2049 microversion: 2.25 time: 0.508843 Jul 18 12:54:30.561731 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 421/858] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:30 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 2049 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:30.571681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:30.574701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:30.601190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.602884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.604630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.605511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.767679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:30.801568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb5be3de-82c5-400d-8753-794e6f1054d9 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.237078 Jul 18 12:54:30.804707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 422/859] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:30 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:30.813621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:30.817750 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:30.817750 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:30.821743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.823448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.826025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.827532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.896826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0867ffaf-b091-40c3-8c3d-787c9a9f56a7 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.086594 Jul 18 12:54:30.905867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:30.910189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 423/860] 10.222.0.88 () {60 vars in 1216 bytes} [Mon Jul 18 12:54:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:54:30.933448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-743cfdc4-d1c3-4c30-ba86-51f06e4d668a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 2.342942 Jul 18 12:54:30.937211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:30.946790 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 438/861] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:28 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:30.947195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:30.961682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.962747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:30.965157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:30.966029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.083573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:31.085082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:31.103818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.104821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.106592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.107671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.141983 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f2fdac1-a9cc-447f-a563-ff08d4de79d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d/action" status: 202 len: 0 microversion: 2.25 time: 0.224695 Jul 18 12:54:31.149004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 424/862] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:54:30 2022] POST /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:54:31.160555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:31.164183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:31.176201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.177329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.179600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.180529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.606758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:31.666611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca1548f3-3aa9-44e6-adb6-0f387bf22497 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 2054 microversion: 2.25 time: 0.514925 Jul 18 12:54:31.669891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 425/863] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:31 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 2054 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:31.819120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7d6f1bea-74f7-4b38-b59e-b63324ea10f4 req-a3ad36f3-0203-41bd-8bff-3994bc10b590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698ab691-827e-41f4-8c06-c2c64f15f51b", "tag": "d4b6277e-6bbc-4a96-a867-4bed21ef4e50"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:31.883709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d6f1bea-74f7-4b38-b59e-b63324ea10f4 req-a3ad36f3-0203-41bd-8bff-3994bc10b590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.886711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d6f1bea-74f7-4b38-b59e-b63324ea10f4 req-a3ad36f3-0203-41bd-8bff-3994bc10b590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.941057 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7d6f1bea-74f7-4b38-b59e-b63324ea10f4 req-a3ad36f3-0203-41bd-8bff-3994bc10b590 service nova] Creating event network-changed:d4b6277e-6bbc-4a96-a867-4bed21ef4e50 for instance 698ab691-827e-41f4-8c06-c2c64f15f51b on n-h1-850003-3 Jul 18 12:54:31.953855 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7d6f1bea-74f7-4b38-b59e-b63324ea10f4 req-a3ad36f3-0203-41bd-8bff-3994bc10b590 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141238 Jul 18 12:54:31.955060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 426/864] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:54:31.980351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:31.984954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:31.998004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:31.998587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:31.999589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:32.000348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:32.236473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:32.272000 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b6203f4-ec1e-4063-b836-b7dfa5f62a0d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.310477 Jul 18 12:54:32.272777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 427/865] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:31 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:32.282279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:32.284156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:32.305747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:32.306708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:32.308254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:32.309130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:32.496532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:32.520076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fce80950-e00c-46a3-b5ef-1549ccef0696 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 1.446037 Jul 18 12:54:32.520947 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 439/866] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:31 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:32.715181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:32.715861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:32.722497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:32.737011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:32.738491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:32.739577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:32.740673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:32.748259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f349e07a-55df-4ae6-9157-6970f42192e3 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.471117 Jul 18 12:54:32.750423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 428/867] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:32 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:33.310727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:33.315410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:33.350120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.353027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.355812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.357390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.537628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:33.581144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee82a6b5-c47e-4611-a673-11956058e830 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.278483 Jul 18 12:54:33.596113 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 429/868] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:33 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:33.616650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:33.616650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:33.623592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:33.628211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.629137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.631260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.631956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.650991 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b8ffd17-1f81-4856-af6d-a1629cc58050 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 2034 microversion: 2.25 time: 0.951117 Jul 18 12:54:33.652047 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 440/869] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:32 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 2034 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:33.679343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": "auto"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:33.682990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:33.695780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.696683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.698094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:33.698749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:33.902091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'flavor' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:34.018738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131366) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:54:34.056771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:34.063304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:34.104915 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6ac419e-93ac-4e26-a942-3ae9c8cdb4eb tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.506303 Jul 18 12:54:34.142612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 430/870] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:33 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:34.161307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:34.163834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:34.189925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:34.193769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:34.203414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:34.204855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:34.724836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:34.754783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-400bbba1-0167-484c-9e68-1245fd133b32 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.610345 Jul 18 12:54:34.756372 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 431/871] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:34 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:34.766967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-56ef6330-950b-480e-89a6-0986b2a97371 req-3846ca38-250d-459f-ade9-6931439d56bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1288ac7c-9233-4c87-94a6-cd6bcab877eb", "tag": "bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:34.792931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-56ef6330-950b-480e-89a6-0986b2a97371 req-3846ca38-250d-459f-ade9-6931439d56bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:34.793466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-56ef6330-950b-480e-89a6-0986b2a97371 req-3846ca38-250d-459f-ade9-6931439d56bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:34.831759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-56ef6330-950b-480e-89a6-0986b2a97371 req-3846ca38-250d-459f-ade9-6931439d56bf service nova] Creating event network-changed:bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 for instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb on n-h1-850003-3 Jul 18 12:54:34.855667 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-56ef6330-950b-480e-89a6-0986b2a97371 req-3846ca38-250d-459f-ade9-6931439d56bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092045 Jul 18 12:54:34.857891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 432/872] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:34.892679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:34.894512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:34.926065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:34.926854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:34.929505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:34.932920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:35.131825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:35.181280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e5b18e3b-74b0-4b19-ae19-e36f7e02ea4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.313161 Jul 18 12:54:35.198644 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 433/873] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:34 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:35.206375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:35.215458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:35.251551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:35.252915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:35.253831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:35.254704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:35.596844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:35.630103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-606fbef6-1a84-4e84-ab3b-c3906e4a7056 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.414601 Jul 18 12:54:35.644293 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 434/874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:35 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:35.804096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:35.809921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:35.826450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:35.827067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:35.828412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:35.829123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:36.203647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:36.220713 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b7b3c78b-b094-4c49-9d0f-d103ea017f33 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.438586 Jul 18 12:54:36.221899 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 435/875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:35 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:36.235729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-62bf2403-5e37-4a6b-a660-f211f9549b8f req-54ee01b9-6c99-4cee-bc2f-32dfa91b66e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888b28f5-3b97-4218-9811-a82ebdf63f27", "name": "network-vif-plugged", "status": "completed", "tag": "87a0a8f3-d59b-430d-b1a3-f8daaf528f86"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:36.268929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-62bf2403-5e37-4a6b-a660-f211f9549b8f req-54ee01b9-6c99-4cee-bc2f-32dfa91b66e4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:36.269654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-62bf2403-5e37-4a6b-a660-f211f9549b8f req-54ee01b9-6c99-4cee-bc2f-32dfa91b66e4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:36.296355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-62bf2403-5e37-4a6b-a660-f211f9549b8f req-54ee01b9-6c99-4cee-bc2f-32dfa91b66e4 service nova] Creating event network-vif-plugged:87a0a8f3-d59b-430d-b1a3-f8daaf528f86 for instance 888b28f5-3b97-4218-9811-a82ebdf63f27 on n-h2-850003-3 Jul 18 12:54:36.309563 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-62bf2403-5e37-4a6b-a660-f211f9549b8f req-54ee01b9-6c99-4cee-bc2f-32dfa91b66e4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081826 Jul 18 12:54:36.309563 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 436/876] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:36.320893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:36.324173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:36.341438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:36.342091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:36.346812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:36.348012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:36.606712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:36.651885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8a66c6d-7967-4c2a-9bb5-26e7e7f4d3a2 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.340388 Jul 18 12:54:36.652972 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 437/877] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:36 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:36.679345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:36.680531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:36.701031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:36.701526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:36.702967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:36.704142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:37.090369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:37.116836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20382a5b-ac2a-4f4b-843e-19804542f745 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.460827 Jul 18 12:54:37.118462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 438/878] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:36 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:37.255254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:37.255254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:37.276854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:37.277793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:37.279897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:37.280747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:37.559001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:37.571719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65d4e52a-76d8-40be-9522-291082624203 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.326819 Jul 18 12:54:37.582250 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 439/879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:37 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:37.977475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] Calling method '.version_select at 0x7f96e4e0cf70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:38.056411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 596c2ade-73b6-4d7b-b396-3d1470fc1230 could not be found", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:54:38.058350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] HTTP exception thrown: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] Request method failure captured: Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-floating-ips/596c2ade-73b6-4d7b-b396-3d1470fc1230 HTTP/1.1 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VgNRvRmWU39TkBqIT5GhyyTe1w8YD9KEY0kZWzhQMue1g8OKPt1hf6eRTioouN-7vqHv_ZgXrlptFYNeb0k4OrO2ABO2UjY4SNYnUS9h4TabtBA4XskVNb1kArmyD4W13857jBdJFUt58wsHkMhNjYfDvAKbbMx01kDcs5LHpy9_VI Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 73935071b75a47f49eea48a13e5ccd65 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072544125 Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:54:38.076719 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/73935071b75a47f49eea48a13e5ccd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73935071b75a47f49eea48a13e5ccd65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_73935071b75a47f49eea48a13e5ccd65", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73935071b75a47f49eea48a13e5ccd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1072544125 Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 73935071b75a47f49eea48a13e5ccd65 Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072544125 Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2e56d6780a344fc49e5e4558bc9344dc Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: exception: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230 Jul 18 12:54:38.082891 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '596c2ade-73b6-4d7b-b396-3d1470fc1230'} Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:54:38.085761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 596c2ade-73b6-4d7b-b396-3d1470fc1230 could not be found Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5712938-c265-4957-bd1a-793ab5ce4de7'] Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230. Jul 18 12:54:38.090817 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230 Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:54:38.095004 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230 Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] Returning 404 to user: Floating IP not found for ID 596c2ade-73b6-4d7b-b396-3d1470fc1230 {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f511db4c-c92c-4795-aca3-46a53cbc2c9d tempest-FloatingIPDetailsNegativeTestJSON-1072544125 tempest-FloatingIPDetailsNegativeTestJSON-1072544125-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/596c2ade-73b6-4d7b-b396-3d1470fc1230" status: 404 len: 111 microversion: 2.1 time: 0.504892 Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 440/880] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:54:37 2022] GET /compute/v2.1/os-floating-ips/596c2ade-73b6-4d7b-b396-3d1470fc1230 => generated 111 bytes in 508 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:54:38.101106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:38.102764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:38.113805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:38.117351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:38.125716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:38.132554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:38.769693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:38.818817 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-884ec8db-8b2b-4578-b6b6-c8cdb9a48ebf tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.735761 Jul 18 12:54:38.826257 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 441/881] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:38 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:38.854124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:38.855156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:38.873191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:38.873695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:38.878891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:38.879738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:39.446929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:39.471814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c05a22d1-ddbe-42ec-a868-ee76c23c3531 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1318 microversion: 2.1 time: 0.643342 Jul 18 12:54:39.473782 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 442/882] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:38 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:39.498510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:39.500346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:39.519163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:39.520307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:39.521821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:39.523241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:40.029692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:40.057099 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0b6edbb-a541-4c18-bee6-6e263e4815c6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.580426 Jul 18 12:54:40.059738 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 443/883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:39 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:40.379603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c9f0db12-3ccf-4a89-9bba-dc783292c60a tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1683339545", "id": 1858519441, "os-flavor-access:is_public": "False"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:40.384189 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:40.384189 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:40.410772 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c9f0db12-3ccf-4a89-9bba-dc783292c60a tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.348381 Jul 18 12:54:40.412408 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 444/884] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:40 2022] POST /compute/v2.1/flavors => generated 431 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:40.433103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:40.433103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:40.440208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:40.440695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:40.441512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:40.441976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:40.690737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:40.732784 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92ae9c89-a9aa-4d47-908c-07dec8d4a167 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.308372 Jul 18 12:54:40.746823 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 445/885] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:40 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:40.758103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c96505ab-7f94-4c15-8953-96d1f2ab9fe1 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dca5aec536c844a2a240b19550ca05b1"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:40.761062 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:40.761062 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:40.853724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:40.914461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c96505ab-7f94-4c15-8953-96d1f2ab9fe1 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1858519441/action" status: 200 len: 97 microversion: 2.1 time: 0.164696 Jul 18 12:54:40.915722 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 446/886] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:54:40 2022] POST /compute/v2.1/flavors/1858519441/action => generated 97 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:54:40.924758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:40.926431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:40.939666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:40.940826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:40.942793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:40.943862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:42.231766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:42.246305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6120d271-11fc-4f75-94a8-102c9585acf1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1468 microversion: 2.1 time: 1.328932 Jul 18 12:54:42.262657 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 447/887] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:40 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1468 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:42.571790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93533abc-e5d7-4370-8c3b-0240cb61cb08 tempest-FlavorsAccessTestJSON-190060526 tempest-FlavorsAccessTestJSON-190060526-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:42.613630 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93533abc-e5d7-4370-8c3b-0240cb61cb08 tempest-FlavorsAccessTestJSON-190060526 tempest-FlavorsAccessTestJSON-190060526-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.349050 Jul 18 12:54:42.631346 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 448/888] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:54:42 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:42.646769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:42.648689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:42.654803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:42.667799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:42.669048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:42.670919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:42.672109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:42.877674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4358ac40-26ea-4457-82ad-9c52ae276397 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d/action" status: 202 len: 0 microversion: 2.25 time: 9.205566 Jul 18 12:54:42.885996 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 441/889] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:54:33 2022] POST /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d/action => generated 0 bytes in 9209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:54:42.904021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:42.913738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:42.939201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:42.957472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:42.962277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:42.964658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:42.971928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:43.082958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:43.103921 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c75be9ac-b0e3-415c-bf18-b870356d339c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.469356 Jul 18 12:54:43.105082 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 449/890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:42 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:43.120862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:43.122678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:43.137184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:43.138335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:43.140274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:43.141454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:43.233660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:43.287488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b3f6f99f-0e79-4fc6-9c79-edf68075c332 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.405379 Jul 18 12:54:43.288863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 442/891] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:42 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:43.297016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b4aee3-ff5a-449d-80ce-ccaea029a3b5 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dca5aec536c844a2a240b19550ca05b1"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:43.300269 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:43.300269 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:54:43.520179 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6b4aee3-ff5a-449d-80ce-ccaea029a3b5 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1858519441/action" status: 200 len: 21 microversion: 2.1 time: 0.229228 Jul 18 12:54:43.528896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 443/892] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:54:43 2022] POST /compute/v2.1/flavors/1858519441/action => generated 21 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:54:43.538603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:43.540056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:43.554770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:43.555970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:43.560151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:43.561568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:43.960228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:43.990676 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7a37856a-6ce0-47eb-8be2-188c6c962dd3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1318 microversion: 2.1 time: 0.880575 Jul 18 12:54:43.995502 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 450/893] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:43 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:44.014106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8da98fb2-e476-4d60-bf88-f75b704218e1 tempest-FlavorsAccessTestJSON-190060526 tempest-FlavorsAccessTestJSON-190060526-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.102990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8da98fb2-e476-4d60-bf88-f75b704218e1 tempest-FlavorsAccessTestJSON-190060526 tempest-FlavorsAccessTestJSON-190060526-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102601 Jul 18 12:54:44.106534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 451/894] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:54:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:44.118504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b5405dd3-793d-4c4b-8a74-08c6e4eee37e req-7504c713-6712-47a4-9a9d-177b72f5b6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698ab691-827e-41f4-8c06-c2c64f15f51b", "name": "network-vif-plugged", "status": "completed", "tag": "d4b6277e-6bbc-4a96-a867-4bed21ef4e50"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:44.144361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b5405dd3-793d-4c4b-8a74-08c6e4eee37e req-7504c713-6712-47a4-9a9d-177b72f5b6a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:44.147475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b5405dd3-793d-4c4b-8a74-08c6e4eee37e req-7504c713-6712-47a4-9a9d-177b72f5b6a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:44.195235 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b5405dd3-793d-4c4b-8a74-08c6e4eee37e req-7504c713-6712-47a4-9a9d-177b72f5b6a5 service nova] Creating event network-vif-plugged:d4b6277e-6bbc-4a96-a867-4bed21ef4e50 for instance 698ab691-827e-41f4-8c06-c2c64f15f51b on n-h1-850003-3 Jul 18 12:54:44.222873 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b5405dd3-793d-4c4b-8a74-08c6e4eee37e req-7504c713-6712-47a4-9a9d-177b72f5b6a5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113571 Jul 18 12:54:44.225220 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 452/895] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:44.244221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.246358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:44.260101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:44.261683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:44.264077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:44.266985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:44.325776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:44.496011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:44.523799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:44.528151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:44.531210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b12d73e-99c9-433b-a4d3-6c434f256e63 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.999544 Jul 18 12:54:44.533286 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 444/896] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:43 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:44.556347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dc266606-4516-4435-89c9-be2308b95369 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.557917 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:44.557917 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:54:44.611886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dc266606-4516-4435-89c9-be2308b95369 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1858519441" status: 202 len: 0 microversion: 2.1 time: 0.074773 Jul 18 12:54:44.616132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 445/897] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:54:44 2022] DELETE /compute/v2.1/flavors/1858519441 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:54:44.628214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.629915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:44.645751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:44.647440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:44.649502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:44.650959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:44.733230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:44.760201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e70260cd-8efc-44cc-974e-038d90950ab1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.530770 Jul 18 12:54:44.762318 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 453/898] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:44 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:44.773577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-44915303-5c01-4c5f-91f2-05fdf9c6970a tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.858946 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-44915303-5c01-4c5f-91f2-05fdf9c6970a tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090985 Jul 18 12:54:44.874708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 454/899] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:44.894214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82bdd18d-5c89-430e-a4f2-6437108ad2e6 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1948941417", "id": 1151505171, "os-flavor-access:is_public": "False"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:44.898522 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:44.898522 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:44.947215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82bdd18d-5c89-430e-a4f2-6437108ad2e6 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.059977 Jul 18 12:54:44.955804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 455/900] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:44 2022] POST /compute/v2.1/flavors => generated 431 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:54:44.961428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:44.979372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2309b2bf-c209-4d76-a51f-f8e5afcf4df7 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:44.984343 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:44.984343 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:45.019776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e404d09-add0-4560-a2da-be7e3d9c5615 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.401088 Jul 18 12:54:45.029495 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2309b2bf-c209-4d76-a51f-f8e5afcf4df7 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/1151505171/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.062762 Jul 18 12:54:45.034840 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 456/902] 10.222.0.88 () {58 vars in 1208 bytes} [Mon Jul 18 12:54:44 2022] GET /compute/v2.1/flavors/1151505171/os-flavor-access => generated 21 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 12:54:45.040104 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 446/901] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:44 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:45.059152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95efc7be-d0f6-42c5-9951-55633f63cbd2 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:45.061244 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:45.061244 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:54:45.064593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:45.075459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:45.091018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.091973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:45.093131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.094236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:45.095791 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95efc7be-d0f6-42c5-9951-55633f63cbd2 tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1151505171" status: 202 len: 0 microversion: 2.1 time: 0.044181 Jul 18 12:54:45.098705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 447/903] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:54:45 2022] DELETE /compute/v2.1/flavors/1151505171 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:54:45.126698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-31e6d799-6921-4835-9694-26edcf597cad tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:45.180074 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-31e6d799-6921-4835-9694-26edcf597cad tempest-FlavorsAccessTestJSON-422924714 tempest-FlavorsAccessTestJSON-422924714-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071006 Jul 18 12:54:45.194952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 448/904] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:54:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:54:45.573897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:45.575889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:45.593020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.597157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:45.600757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.602529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:45.680119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:45.704716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac9952df-2a2f-4ebe-b8ca-a8a2ff1712a8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1318 microversion: 2.1 time: 0.664959 Jul 18 12:54:45.705762 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 457/905] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:45 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1318 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:45.894038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:45.896921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:45.922753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.929263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:45.934478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:45.935651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:46.259956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:46.287430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:46.291038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:46.298369 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6206d675-4bbf-4d4e-9577-f1b7a3babbbb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.736919 Jul 18 12:54:46.303957 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 449/906] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:45 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:46.321903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:46.324302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:46.338331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:46.342491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:46.345945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:46.347942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:46.459219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:46.476147 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f4273cf-d821-4572-903e-f2db8bc00a04 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 0.586969 Jul 18 12:54:46.478115 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 458/907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:45 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:46.495865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-14c5cea6-6e66-463e-85eb-77e70b88f269 req-c1553932-968c-459d-aa7b-97694eaa307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1288ac7c-9233-4c87-94a6-cd6bcab877eb", "name": "network-vif-plugged", "status": "completed", "tag": "bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:46.512925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14c5cea6-6e66-463e-85eb-77e70b88f269 req-c1553932-968c-459d-aa7b-97694eaa307b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:46.515044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14c5cea6-6e66-463e-85eb-77e70b88f269 req-c1553932-968c-459d-aa7b-97694eaa307b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:46.535021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:46.563157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:46.572262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-14c5cea6-6e66-463e-85eb-77e70b88f269 req-c1553932-968c-459d-aa7b-97694eaa307b service nova] Creating event network-vif-plugged:bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 for instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb on n-h1-850003-3 Jul 18 12:54:46.594245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-14c5cea6-6e66-463e-85eb-77e70b88f269 req-c1553932-968c-459d-aa7b-97694eaa307b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112811 Jul 18 12:54:46.596486 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 459/908] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:46.631716 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f06e4be3-ee81-4032-94ef-fbd6a9450181 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.323863 Jul 18 12:54:46.634531 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 450/909] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:46 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:46.746109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:46.747599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:46.764388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:46.765085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:46.766781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:46.768125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:47.185260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e40866b5-bf84-4305-8ae9-42332bd6c712 req-f1af204c-3da6-405b-80bc-78993cc9fbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "name": "network-vif-unplugged", "status": "completed", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:47.218384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e40866b5-bf84-4305-8ae9-42332bd6c712 req-f1af204c-3da6-405b-80bc-78993cc9fbca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:47.219182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e40866b5-bf84-4305-8ae9-42332bd6c712 req-f1af204c-3da6-405b-80bc-78993cc9fbca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:47.269492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e40866b5-bf84-4305-8ae9-42332bd6c712 req-f1af204c-3da6-405b-80bc-78993cc9fbca service nova] Creating event network-vif-unplugged:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h1-850003-3 Jul 18 12:54:47.283130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e40866b5-bf84-4305-8ae9-42332bd6c712 req-f1af204c-3da6-405b-80bc-78993cc9fbca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.554957 Jul 18 12:54:47.288837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 460/910] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:47.355989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:47.355989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:47.383147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:47.384145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:47.385659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:47.386649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:47.451252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:47.481625 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-520353b2-6893-4843-9108-fb3805b062f1 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1468 microversion: 2.1 time: 0.751563 Jul 18 12:54:47.498590 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 451/911] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:46 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1468 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:47.509649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:47.510949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:47.541085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:47.544838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:47.546087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:47.547463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:48.005216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.053231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.056709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.059381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bacc45a6-c7cd-4be9-aabe-d59d2fa79b8c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.727675 Jul 18 12:54:48.060767 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 461/912] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:47 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:48.071333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:48.079819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.081996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Searching by: {'reservation_id': 'r-138gz6y9', 'deleted': False, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:54:48.101543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:48.102434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:48.104061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:48.104842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:48.457375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:54:48.700617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.724774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:48.726051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:48.786129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:48.808914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59b86d93-d795-404f-8f27-368b6dd4ce72 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1316 microversion: 2.1 time: 1.308103 Jul 18 12:54:48.809734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 452/913] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:47 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1316 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:48.837175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:48.839047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:48.879220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:48.883797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:48.885730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:48.889260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.059093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b3dabd3-c9b2-421e-8de5-ceb2c3ea998e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?reservation_id=r-138gz6y9" status: 200 len: 2929 microversion: 2.1 time: 0.995303 Jul 18 12:54:49.063902 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 462/914] 10.222.0.88 () {58 vars in 1196 bytes} [Mon Jul 18 12:54:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-138gz6y9 => generated 2929 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:49.092729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:49.093643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:49.117172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.120346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.122765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.124118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.142871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:49.251768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d4e67da-2784-4e79-8984-5a0ddeb96051 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.438843 Jul 18 12:54:49.256674 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 453/915] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:48 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:49.279059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1213c61-24b7-4e06-9bf5-0ebb625c3ecd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:49.389826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.server_groups [None req-d1213c61-24b7-4e06-9bf5-0ebb625c3ecd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Querying cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) for 2 instances {{(pid=131366) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 12:54:49.391401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1213c61-24b7-4e06-9bf5-0ebb625c3ecd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.418608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1213c61-24b7-4e06-9bf5-0ebb625c3ecd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.538957 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1213c61-24b7-4e06-9bf5-0ebb625c3ecd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/061c90c0-2682-4356-9b3d-2be66a61f3af" status: 200 len: 271 microversion: 2.1 time: 0.279736 Jul 18 12:54:49.543034 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 454/916] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:54:49 2022] GET /compute/v2.1/os-server-groups/061c90c0-2682-4356-9b3d-2be66a61f3af => generated 271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:49.555575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-589b77bf-1db6-4d77-b45f-f15870c5406b req-8b5b270e-f290-4ce6-955b-d1069252f3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:49.578689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-589b77bf-1db6-4d77-b45f-f15870c5406b req-8b5b270e-f290-4ce6-955b-d1069252f3de service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.580269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-589b77bf-1db6-4d77-b45f-f15870c5406b req-8b5b270e-f290-4ce6-955b-d1069252f3de service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.624598 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-589b77bf-1db6-4d77-b45f-f15870c5406b req-8b5b270e-f290-4ce6-955b-d1069252f3de service nova] Creating event network-changed:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h1-850003-3 Jul 18 12:54:49.659466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-589b77bf-1db6-4d77-b45f-f15870c5406b req-8b5b270e-f290-4ce6-955b-d1069252f3de service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112737 Jul 18 12:54:49.663266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 455/917] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:49.690208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:49.733669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:49.735043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:49.755848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:49.760946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:49.764365 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-67ba41f9-542d-44fd-bc0c-c249058d23df tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.678588 Jul 18 12:54:49.778187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.778187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.778187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.778187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.781275 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 463/918] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:49 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:49.844086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:49.845556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:49.866790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.869192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:49.871695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:49.873030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:50.526961 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43f355fb-ccb3-483d-be9a-b2dbe4924563 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1619 microversion: 2.1 time: 0.859181 Jul 18 12:54:50.538645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 456/919] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:49 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1619 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:50.555818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:50.557635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:50.572224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:50.574046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:50.576890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:50.578514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:50.708080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:50.725806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5bc0e43-9027-4aa0-b9e4-2a5f34ea58b8 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1505 microversion: 2.1 time: 0.890174 Jul 18 12:54:50.727146 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 464/920] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:49 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:50.736392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:50.737570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:50.750877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:50.751419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:50.752852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:50.753641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:50.917652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:50.989905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a2e7008-bc4e-42d9-bec5-c4e6c21ddc9d tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.449057 Jul 18 12:54:50.992247 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 457/921] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:50 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:51.004881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-330235255"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:51.006295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:51.023019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:51.023879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:51.027175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:51.027959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:51.164564 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09f8c7b5-a1a3-4ec5-896c-1c28641a83c3 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1619 microversion: 2.1 time: 0.435329 Jul 18 12:54:51.166239 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 465/922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:50 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1619 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:51.175686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:51.177374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:51.190124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:51.191469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:51.193945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:51.195034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:51.530237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:51.547364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:51.549947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:51.551886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f6ec2c9-b744-4c01-b524-bb88c29ef128 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.383769 Jul 18 12:54:51.553635 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 466/923] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:51 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:51.607116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-873437797", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a2b23f64-8625-4abc-b8a7-29a85519282b"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:51.612410 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.network.security_group_api [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Adding security group 0489f8a9-9beb-4b06-a8b3-affbdd9cf3c0 to port bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 Jul 18 12:54:51.765055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:54:52.465496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:54:52.466363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:54:52.467191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:54:52.467720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:54:52.468321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:54:52.490582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.492037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:52.493367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.493942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:52.534239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:52.546534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:54:52.581061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:54:52.586407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:54:52.695915 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6d2046f-25dc-4466-b7d5-5b8d82494123 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095350 Jul 18 12:54:52.706959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 467/924] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:54:52.717985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:52.719499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:52.754860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.756227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:52.757968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.758966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:52.803462 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5492e8ac-dba0-48c0-8a06-c5b92e97cac1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/action" status: 202 len: 0 microversion: 2.1 time: 1.808004 Jul 18 12:54:52.806136 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 458/925] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:54:50 2022] POST /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/action => generated 0 bytes in 1813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:54:52.832387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:52.835789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:52.876439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.888065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:52.897720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:52.901817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:53.064739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:53.150559 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-86e3618d-58a6-4357-93c8-be9b1639ad4b tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.441109 Jul 18 12:54:53.151993 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 468/926] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:52 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:53.173564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6dc1a61-945f-44f9-97b7-a14dda7c1b1c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:53.174604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6dc1a61-945f-44f9-97b7-a14dda7c1b1c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:53.352467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6dc1a61-945f-44f9-97b7-a14dda7c1b1c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:53.385600 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6dc1a61-945f-44f9-97b7-a14dda7c1b1c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1216 microversion: 2.1 time: 0.231641 Jul 18 12:54:53.407430 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 469/927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:53 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1216 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:53.425850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-828578108"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:53.427294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:53.445530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:53.446256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:53.447524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:53.448456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:53.565194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:53.593438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:53.596960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:53.604603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-006f1fb4-5409-4976-9ed6-94ad84c6a4c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.796042 Jul 18 12:54:53.605790 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 459/928] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:52 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:53.650393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-71907197-68fc-407d-bc74-94016b858830 req-1f0f6d89-d027-4cb2-b0ef-c65b7a014e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1288ac7c-9233-4c87-94a6-cd6bcab877eb", "tag": "bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:53.683394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-71907197-68fc-407d-bc74-94016b858830 req-1f0f6d89-d027-4cb2-b0ef-c65b7a014e90 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:53.690142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-71907197-68fc-407d-bc74-94016b858830 req-1f0f6d89-d027-4cb2-b0ef-c65b7a014e90 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:53.720496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-71907197-68fc-407d-bc74-94016b858830 req-1f0f6d89-d027-4cb2-b0ef-c65b7a014e90 service nova] Creating event network-changed:bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 for instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb on n-h1-850003-3 Jul 18 12:54:53.744555 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-71907197-68fc-407d-bc74-94016b858830 req-1f0f6d89-d027-4cb2-b0ef-c65b7a014e90 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122062 Jul 18 12:54:53.748518 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 460/929] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:54.096210 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Adding security group c8f2f6c4-93aa-4a3a-9632-29d8f8bb244c to port bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 Jul 18 12:54:54.205928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:54.213032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:54.244053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:54.247839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:54.251769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:54.258489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:54.640107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:54.682247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52b1cd7b-7b96-4065-936a-56b94651e818 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.488978 Jul 18 12:54:54.684726 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 461/930] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:54 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:54:54.721022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:54.723411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:54.760206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:54.767452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:54.769438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:54.773791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:55.013457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:55.035469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00585d1f-cf51-48bb-a7cf-a9e64bf41328 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1268 microversion: 2.1 time: 0.347895 Jul 18 12:54:55.039492 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 462/931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:54 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:55.048611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:55.049738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:55.081287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:55.082043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:55.083566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:55.084357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:55.269003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6c708902-6aa2-47f9-bad5-faa4ef5cc3be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/action" status: 202 len: 0 microversion: 2.1 time: 1.859851 Jul 18 12:54:55.270809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 470/932] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:54:53 2022] POST /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/action => generated 0 bytes in 1863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:54:55.285923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:55.292495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:55.351670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:55.353111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:55.353909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:55.354814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:55.934764 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c017fa67-495d-4f30-a170-edda79cbf613 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.656752 Jul 18 12:54:55.937017 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 471/933] 10.222.0.88 () {58 vars in 1292 bytes} [Mon Jul 18 12:54:55 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb/os-security-groups => generated 1156 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:55.949925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ac9c2f51-9394-43cd-a261-3f5c13e55b91 req-9f6e6caf-faea-4942-a763-485013d19eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1288ac7c-9233-4c87-94a6-cd6bcab877eb", "tag": "bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:55.969884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ac9c2f51-9394-43cd-a261-3f5c13e55b91 req-9f6e6caf-faea-4942-a763-485013d19eba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:55.972377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ac9c2f51-9394-43cd-a261-3f5c13e55b91 req-9f6e6caf-faea-4942-a763-485013d19eba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:56.004166 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ac9c2f51-9394-43cd-a261-3f5c13e55b91 req-9f6e6caf-faea-4942-a763-485013d19eba service nova] Creating event network-changed:bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 for instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb on n-h1-850003-3 Jul 18 12:54:56.037004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ac9c2f51-9394-43cd-a261-3f5c13e55b91 req-9f6e6caf-faea-4942-a763-485013d19eba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095512 Jul 18 12:54:56.042184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 472/934] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:56.062422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:56.077651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:56.093668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:56.095027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:56.097081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:56.099216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:56.122825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:56.165251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:56.170787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:56.173145 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-835ae079-cf01-4a50-a3e9-0e486af5bc6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 1.131645 Jul 18 12:54:56.201409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 463/935] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:55 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:56.209836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-44943c93-f9f2-49bc-9c5a-f8b117ff1c00 req-84c29f80-9ed4-4b42-bcd4-b7074577c0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "name": "network-vif-unplugged", "status": "completed", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:56.253140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44943c93-f9f2-49bc-9c5a-f8b117ff1c00 req-84c29f80-9ed4-4b42-bcd4-b7074577c0b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:56.257202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44943c93-f9f2-49bc-9c5a-f8b117ff1c00 req-84c29f80-9ed4-4b42-bcd4-b7074577c0b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:56.293746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-44943c93-f9f2-49bc-9c5a-f8b117ff1c00 req-84c29f80-9ed4-4b42-bcd4-b7074577c0b8 service nova] Creating event network-vif-unplugged:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h1-850003-3 Jul 18 12:54:56.295492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:56.318339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-44943c93-f9f2-49bc-9c5a-f8b117ff1c00 req-84c29f80-9ed4-4b42-bcd4-b7074577c0b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107674 Jul 18 12:54:56.320046 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 464/936] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:56.333481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f74df63-b5e8-45f0-8330-4d6af57f0f53 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e4f1b550>, body: {"security_group": {"name": " tempest-securitygroup -753848487 ", "description": "tempest-description-1706500443"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:56.381530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10c82a51-a7a1-44c0-bce2-0ceb1d4a05da tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.332319 Jul 18 12:54:56.383414 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 473/937] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:56 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:56.435133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:56.436336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:56.469520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:56.470774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:56.473407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:56.475184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:57.021683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:57.078527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36d07506-22d7-4b84-9c45-e86407ce171a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1276 microversion: 2.1 time: 0.663217 Jul 18 12:54:57.088370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 474/938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:56 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1276 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:57.221986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:57.223309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:57.245587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:57.250643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:57.253700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:57.257264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:57.564461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f74df63-b5e8-45f0-8330-4d6af57f0f53 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.241973 Jul 18 12:54:57.566238 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 465/939] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:54:56 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:57.584045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:57.587567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:57.599914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:57.601108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:57.602494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:57.603415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:57.878248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:57.977117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be303185-35cb-4045-a76f-2baa9b2708b7 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.409087 Jul 18 12:54:57.979731 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 466/940] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:57 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:58.238778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:58.244530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:54:58.287363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:58.294512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:58.297232 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d238d770-b515-4c21-8950-fe9b88e097d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 1.090182 Jul 18 12:54:58.299825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 475/941] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:57 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:58.323495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1edb753f-ee4a-4e1f-9d90-34d2fe805f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e48c83a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:58.645818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74a0c325-a4cb-42da-a78d-edc771888510 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-286978285", "id": 1454523639, "os-flavor-access:is_public": "False"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:58.658814 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:58.658814 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:54:58.700425 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74a0c325-a4cb-42da-a78d-edc771888510 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.718014 Jul 18 12:54:58.701791 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 467/942] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:54:57 2022] POST /compute/v2.1/flavors => generated 438 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:58.720873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:58.722251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:58.738651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:58.740395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:58.742376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:58.743426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:58.980254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:54:58.999942 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3729bbc-f732-44f7-be04-731003da30e5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1274 microversion: 2.1 time: 0.294824 Jul 18 12:54:59.010970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 468/943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:54:58 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1274 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:54:59.051795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d919323-f46c-4e58-bb71-00a9e6fb033e tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e4bf5040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:59.062641 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1edb753f-ee4a-4e1f-9d90-34d2fe805f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e" status: 200 len: 223 microversion: 2.1 time: 0.760342 Jul 18 12:54:59.063634 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 476/944] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:54:58 2022] GET /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e => generated 223 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:59.087523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-051f8b04-c2bf-45b0-8d72-83785a709b0f tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:59.099377 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:54:59.099377 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:54:59.159471 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d919323-f46c-4e58-bb71-00a9e6fb033e tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d" status: 200 len: 636 microversion: 2.1 time: 0.138436 Jul 18 12:54:59.169750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 469/945] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:54:59 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d => generated 636 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:54:59.182000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:59.208793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:54:59.232027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:59.232754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:59.234042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:54:59.234772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:54:59.442719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-051f8b04-c2bf-45b0-8d72-83785a709b0f tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1454523639/action" status: 200 len: 97 microversion: 2.1 time: 0.371279 Jul 18 12:54:59.450212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 477/946] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:54:59 2022] POST /compute/v2.1/flavors/1454523639/action => generated 97 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:54:59.485201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82cf4065-0ddf-4386-8876-86bb6e6b29ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4f183a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:54:59.533059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:54:59.580776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50e34973-2e52-4be6-8005-411e2ba9c071 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.407490 Jul 18 12:54:59.595231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 470/947] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:54:59 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:54:59.618756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-774de3fe-dc92-4f73-9a1c-87b59612fd89 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e4d26670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:54:59.847333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-774de3fe-dc92-4f73-9a1c-87b59612fd89 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:54:59.861054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-774de3fe-dc92-4f73-9a1c-87b59612fd89 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:00.947813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-774de3fe-dc92-4f73-9a1c-87b59612fd89 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.333210 Jul 18 12:55:00.947813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 471/948] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:54:59 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:00.962047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:00.964647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:00.985161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:00.986251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:00.990629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:00.992603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:01.001144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:01.326969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:01.344581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:01.348085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:01.350752 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5b8bb88-9905-4841-bf59-0a15dae0cc97 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.402933 Jul 18 12:55:01.351041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82cf4065-0ddf-4386-8876-86bb6e6b29ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e" status: 202 len: 0 microversion: 2.1 time: 1.885459 Jul 18 12:55:01.352128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 472/949] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:00 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:01.359941 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 478/950] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:54:59 2022] DELETE /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e => generated 0 bytes in 1897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:01.369550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:01.370998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:01.379023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73576479-697b-42d9-80e1-6a9e66974c32 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:01.382110 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:01.382110 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:01.409557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:01.411026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:01.412758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:01.413854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:01.554361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:01.558681 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-73576479-697b-42d9-80e1-6a9e66974c32 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73576479-697b-42d9-80e1-6a9e66974c32 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Request method failure captured: Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/flavors/1454523639/action HTTP/1.1 Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 67 Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VgfCWFFgHDnCmw9kiyQGNmPxSBaDvCxdF93BAwy-NMdmczeBiPvKBt5zoWWCykvGtnjrhPlBnWBpiNn2E_0AsgqVY02BXk_OKgqYkyAWdTedmlD90ET5emdmzwovLsmT4I7Gvy7Q6tv8ReB9mfKg_-3Zq3LwfOQDoK0JE4D6fWdZ3c Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:55:01.578199 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5cb0796813c4d5992b35b36069fb93a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: eca61504d115488fb39810338ee5c045 Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} Jul 18 12:55:01.580931 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1454523639', 'body': {'addTenantAccess': {'tenant': '0df226f2880f42a9a399eb14f7dc04ca'}}} Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result.read() Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 12:55:01.585093 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-0df226f2880f42a9a399eb14f7dc04ca' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 12:55:01.588578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 12:55:01.595879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 12:55:01.600534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result.read() Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-0df226f2880f42a9a399eb14f7dc04ca' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 12, 55, 1, 550474), 'updated_at': None, 'flavor_id': 35, 'project_id': '0df226f2880f42a9a399eb14f7dc04ca'}] Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.608408 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.611683 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:01.617396 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73576479-697b-42d9-80e1-6a9e66974c32 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 0df226f2880f42a9a399eb14f7dc04ca combination. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73576479-697b-42d9-80e1-6a9e66974c32 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1454523639/action" status: 409 len: 152 microversion: 2.1 time: 0.226237 Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 473/951] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:55:01 2022] POST /compute/v2.1/flavors/1454523639/action => generated 152 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:55:01.623184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:01.625254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:01.625254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:01.625254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:01.626042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:01.626716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:01.796787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:01.813267 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-860d2f8b-a8ea-48e5-b69f-10fff189f667 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.451427 Jul 18 12:55:01.813953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:01.814571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 479/952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:01 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:01.825546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd2934f6-a0ab-4164-9576-83c4e1583be0 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e4d2dee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:01.858858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be5bf46a-79e8-4c9d-a9bc-6867ddbb5d07 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1925 microversion: 2.75 time: 0.275684 Jul 18 12:55:01.859645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 474/953] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:01 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1925 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:01.869668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e47818b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:01.927501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:55:01.934443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:55:01.935496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.935496 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e HTTP/1.1 Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:55:01.940417 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: exception: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.943575 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c6a73004-2f6f-47e4-87d9-4516d7a84b6e'} Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:01.945527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:55:01.948723 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.955787 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-f78305ba-6411-4ab6-9d93-2c8aa72f7bc9'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:01.958903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27bdcdf8-4ea2-4b2f-b93a-79e774ceb212 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e" status: 404 len: 194 microversion: 2.1 time: 0.092431 Jul 18 12:55:01.961784 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 475/954] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:55:01 2022] GET /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:01.972619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64f0b33e-c4da-46e9-932b-16065b4e999e tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:01.975874 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:01.975874 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:02.159267 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64f0b33e-c4da-46e9-932b-16065b4e999e tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1454523639/action" status: 200 len: 21 microversion: 2.1 time: 0.195288 Jul 18 12:55:02.160135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 476/955] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:55:01 2022] POST /compute/v2.1/flavors/1454523639/action => generated 21 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:02.170604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da0eab8b-baa2-416e-8033-7e087cc986e4 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e47813a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-467590474", "description": "tempest-description-635448300"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:02.509288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:02.583424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da0eab8b-baa2-416e-8033-7e087cc986e4 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.420883 Jul 18 12:55:02.584736 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 477/956] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:55:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:02.606251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8ed1dbc-ee7b-48b9-bffa-45366b1db54c tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:02.610108 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:02.610108 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:02.667794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8ed1dbc-ee7b-48b9-bffa-45366b1db54c tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1454523639" status: 202 len: 0 microversion: 2.1 time: 0.079950 Jul 18 12:55:02.669537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 478/957] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:55:02 2022] DELETE /compute/v2.1/flavors/1454523639 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:02.685974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:02.687233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:02.716753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:02.717690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:02.719672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:02.720893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:02.760285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd2934f6-a0ab-4164-9576-83c4e1583be0 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "DELETE /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.942879 Jul 18 12:55:02.766936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 480/958] 10.222.0.88 () {58 vars in 1295 bytes} [Mon Jul 18 12:55:01 2022] DELETE /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_version => generated 0 bytes in 946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:55:02.775985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92d96d0d-a245-4239-8272-6f26c757e77c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e490b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2067114085", "description": "tempest-description-143775662"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:03.132062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:03.168598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:03.170190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:03.172529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25a883f6-fb1c-414e-8508-e427646955c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.501300 Jul 18 12:55:03.173600 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 479/959] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:02 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:03.193590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5fea4538-169a-43a5-8610-f10e417f39e6 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:03.247264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5fea4538-169a-43a5-8610-f10e417f39e6 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069468 Jul 18 12:55:03.249225 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 480/960] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:55:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:03.257035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3b12799-87aa-4452-8f8b-7a30b06de92f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e54aae50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:03.373923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3b12799-87aa-4452-8f8b-7a30b06de92f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.122884 Jul 18 12:55:03.385543 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 481/961] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:55:03 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 37 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:03.385826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:03.393737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:03.396404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:03.416850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:03.418732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:03.420716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:03.422431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:03.732594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:03.752471 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1036336c-166d-4d55-aee8-228d2c34705f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.369714 Jul 18 12:55:03.753458 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 482/962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:03 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:03.775496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:03.776833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:03.793359 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92d96d0d-a245-4239-8272-6f26c757e77c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.024292 Jul 18 12:55:03.795391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 481/963] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:55:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:03.809102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6824df7e-416a-4388-aef1-12eb03761d29 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-493400786", "id": 1324086263, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:03.810881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:03.814054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:03.815021 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:03.815021 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:03.816540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:03.818185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:03.865457 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6824df7e-416a-4388-aef1-12eb03761d29 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.066431 Jul 18 12:55:03.867016 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 482/964] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:03 2022] POST /compute/v2.1/flavors => generated 437 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:03.890750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc7b1d11-e171-4eff-b02d-62a2b94b12b6 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e47b9d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:03.999318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cc7b1d11-e171-4eff-b02d-62a2b94b12b6 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:04.012749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cc7b1d11-e171-4eff-b02d-62a2b94b12b6 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:04.034073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:04.079673 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cca8371-bbc8-4719-835c-5f7682995bc5 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1931 microversion: 2.75 time: 0.324319 Jul 18 12:55:04.082583 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 483/965] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:03 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1931 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:04.096547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8f7982e-4250-4191-84e9-2acf6b166dbe tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e4781040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1314740177", "description": "tempest-description-842991104"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:04.420610 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8f7982e-4250-4191-84e9-2acf6b166dbe tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.331183 Jul 18 12:55:04.421506 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 484/966] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:55:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:04.436102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7003d5de-4f0e-45f7-a89e-dfbda5c09907 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:04.443439 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:04.443439 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:04.460820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7003d5de-4f0e-45f7-a89e-dfbda5c09907 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7003d5de-4f0e-45f7-a89e-dfbda5c09907 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Request method failure captured: Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/flavors/1324086263/os-flavor-access HTTP/1.1 Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VgfCWFFgHDnCmw9kiyQGNmPxSBaDvCxdF93BAwy-NMdmczeBiPvKBt5zoWWCykvGtnjrhPlBnWBpiNn2E_0AsgqVY02BXk_OKgqYkyAWdTedmlD90ET5emdmzwovLsmT4I7Gvy7Q6tv8ReB9mfKg_-3Zq3LwfOQDoK0JE4D6fWdZ3c Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:55:04.463991 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5cb0796813c4d5992b35b36069fb93a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: eca61504d115488fb39810338ee5c045 Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: exception: Access list not available for public flavors. Jul 18 12:55:04.466009 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'flavor_id': '1324086263'} Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 18 12:55:04.467286 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:04.475185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7003d5de-4f0e-45f7-a89e-dfbda5c09907 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:04.476740 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7003d5de-4f0e-45f7-a89e-dfbda5c09907 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/1324086263/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.047156 Jul 18 12:55:04.478350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 485/967] 10.222.0.88 () {58 vars in 1208 bytes} [Mon Jul 18 12:55:04 2022] GET /compute/v2.1/flavors/1324086263/os-flavor-access => generated 91 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:55:04.494416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03594638-dcaf-4986-9b3f-0c38da64d2c8"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:04.496788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:04.511728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:04.512552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:04.517657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:04.517657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:04.845408 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc7b1d11-e171-4eff-b02d-62a2b94b12b6 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.975248 Jul 18 12:55:04.846586 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 483/968] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:03 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:04.871494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:04.873359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:04.880492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:04.899656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:04.900480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:04.901861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:04.902706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:05.343913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30773148-aa6f-433b-a2bf-5334e7afe893 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "POST /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862663 Jul 18 12:55:05.345779 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 486/969] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 12:55:04 2022] POST /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:05.380416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-faa2f851-b0f5-404f-bc15-358e1562b32f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e46fa3a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:05.650316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:05.670452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:05.675371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:05.679038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecb83db5-c694-4921-b4b6-e77eec48a2de tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1566 microversion: 2.25 time: 0.822378 Jul 18 12:55:05.681075 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 484/970] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:04 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1566 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:05.697027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b3a01e26-d5f2-4daf-a001-bb78e9f31f67 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:05.703183 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:05.703183 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:05.751257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b3a01e26-d5f2-4daf-a001-bb78e9f31f67 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1324086263" status: 202 len: 0 microversion: 2.1 time: 0.067313 Jul 18 12:55:05.752084 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 485/971] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:55:05 2022] DELETE /compute/v2.1/flavors/1324086263 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:05.760065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:05.761773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:05.774327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:05.776143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:05.777725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:05.778918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:06.026219 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-faa2f851-b0f5-404f-bc15-358e1562b32f tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.677207 Jul 18 12:55:06.034641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 487/972] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:55:05 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:06.045101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b9d595-d503-4563-b80c-632bdd38daee tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e46fef70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:06.186987 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6b9d595-d503-4563-b80c-632bdd38daee tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.146832 Jul 18 12:55:06.191949 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 488/973] 10.222.0.88 () {58 vars in 1289 bytes} [Mon Jul 18 12:55:06 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_distro => generated 33 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:06.205079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c817a673-5ae8-4f5e-baab-92d181a01592 req-a7b2ef47-ec1c-4021-92fd-357f8dc66eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd149fd-6a6e-4fdb-9532-a0d005c941a1", "tag": "d39e1676-ab9f-4436-9bac-3d2487b343c0"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:06.228455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c817a673-5ae8-4f5e-baab-92d181a01592 req-a7b2ef47-ec1c-4021-92fd-357f8dc66eea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:06.229898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c817a673-5ae8-4f5e-baab-92d181a01592 req-a7b2ef47-ec1c-4021-92fd-357f8dc66eea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:06.254411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c817a673-5ae8-4f5e-baab-92d181a01592 req-a7b2ef47-ec1c-4021-92fd-357f8dc66eea service nova] Creating event network-changed:d39e1676-ab9f-4436-9bac-3d2487b343c0 for instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 on n-h2-850003-3 Jul 18 12:55:06.262424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c817a673-5ae8-4f5e-baab-92d181a01592 req-a7b2ef47-ec1c-4021-92fd-357f8dc66eea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065607 Jul 18 12:55:06.263841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 489/974] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:06.275095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:06.276895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:06.293401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:06.294769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:06.296977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:06.298134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:06.832019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:06.875063 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9734f45d-2e1f-476d-825b-898b26499223 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1931 microversion: 2.75 time: 0.608956 Jul 18 12:55:06.886783 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 490/975] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:06 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1931 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:06.886783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19570f34-ac74-4a01-b454-e8d45057825e tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:06.925428 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19570f34-ac74-4a01-b454-e8d45057825e tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046516 Jul 18 12:55:06.927012 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 491/976] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:55:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:06.945699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9a2f1fd-789b-40a2-96b1-a34acd9a55eb tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e46a0b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:06.990590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:07.012121 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62301631-270c-440b-8f28-f7f18e454662 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 1.256976 Jul 18 12:55:07.014336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 486/977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:05 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:07.038644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1cacfcb5-debf-4e5b-bda4-0f1b52e9af1d tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e4b044c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:07.203816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1cacfcb5-debf-4e5b-bda4-0f1b52e9af1d tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:07.216823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1cacfcb5-debf-4e5b-bda4-0f1b52e9af1d tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:07.573919 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9a2f1fd-789b-40a2-96b1-a34acd9a55eb tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc" status: 202 len: 0 microversion: 2.1 time: 0.645054 Jul 18 12:55:07.575379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 492/978] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:55:06 2022] DELETE /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:07.591877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:07.597843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:07.627300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:07.628082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:07.634945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:07.638438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:08.090258 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1cacfcb5-debf-4e5b-bda4-0f1b52e9af1d tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.073256 Jul 18 12:55:08.091253 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 487/979] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:07 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:08.104777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d367c531-726b-4811-bc3e-ca88c812d472 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1651295965", "id": 264056211, "os-flavor-access:is_public": "False"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:08.111095 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:08.111095 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:08.166730 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d367c531-726b-4811-bc3e-ca88c812d472 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.073154 Jul 18 12:55:08.167750 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 488/980] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:08 2022] POST /compute/v2.1/flavors => generated 436 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:08.188453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e5f7fb80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:08.233666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:55:08.236294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 5a11b405-5947-45bf-a8f5-270964c73dfc not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:55:08.236294 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.236294 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc HTTP/1.1 Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:55:08.240705 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.243149 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5a11b405-5947-45bf-a8f5-270964c73dfc'} Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:08.244785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:55:08.248929 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.252431 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-b956f236-86da-4517-9683-eebddcf28a8d'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-67869fb3-8827-4e13-9583-ef17df33f5bc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc" status: 404 len: 194 microversion: 2.1 time: 0.073889 Jul 18 12:55:08.254786 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 489/981] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:55:08 2022] GET /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:08.258931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:08.260196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:08.274426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:08.275382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:08.277263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:08.278524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:08.354993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:08.388786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:08.394675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:08.398774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8bf06411-5bc1-487d-9f71-1fe5667d135b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1541 microversion: 2.25 time: 0.821319 Jul 18 12:55:08.400128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 493/982] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:07 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1541 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:08.425201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:08.426234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:08.456644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:08.458107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:08.459741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:08.460615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:08.482073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] Lazy-loading 'services' on Instance uuid 32981020-3877-4017-bd68-824faf06136c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:08.534710 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d0e57ab9-5cc5-425f-90b8-572d56778f01 tempest-ServersAdmin275Test-1527297845 tempest-ServersAdmin275Test-1527297845-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1916 microversion: 2.75 time: 0.287767 Jul 18 12:55:08.536842 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 490/983] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:08 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1916 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:08.559917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9b565f7-7907-4c88-b864-9d242d4cf58c tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e4d2d280>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:08.625401 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9b565f7-7907-4c88-b864-9d242d4cf58c tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.086240 Jul 18 12:55:08.629017 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 491/984] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:55:08 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:08.830238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:08.888210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-680d9698-72a1-45ef-b545-cf7f0eb3284d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.478421 Jul 18 12:55:08.889354 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 494/985] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:08 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:08.910414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f30f145-684e-49ba-a6b3-1637c6674d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e46b0b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:08.948623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b0859f4-f817-4379-b86a-fba940d740f4 tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:08.951292 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:08.951292 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:08.956662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6b0859f4-f817-4379-b86a-fba940d740f4 tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '088a24f7ff024762b3e0883a818cf170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df226f2880f42a9a399eb14f7dc04ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b0859f4-f817-4379-b86a-fba940d740f4 tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Request method failure captured: Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/flavors/264056211/action HTTP/1.1 Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 67 Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VgddNWmHcnKEUhr-BirRtsI73fBOfsEaEG0rdeuy2dbSXmmdUx1PLXr2zgnoEIcqznjmvANnXZvaoNfyXTKPW7lYV7rxD6QAeTxph9YI3hPjl22qfrkiBYG_er34I_xIC57mbRUZP8CZMC1TDUwyKUWWVdQ9VcFkbHbHN-MrXsSXYo Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0df226f2880f42a9a399eb14f7dc04ca Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:55:08.964759 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0df226f2880f42a9a399eb14f7dc04ca", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0df226f2880f42a9a399eb14f7dc04ca Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FlavorsAccessNegativeTestJSON-1193330064-project Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 088a24f7ff024762b3e0883a818cf170 Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064-project Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} Jul 18 12:55:08.967703 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '264056211', 'body': {'addTenantAccess': {'tenant': '0df226f2880f42a9a399eb14f7dc04ca'}}} Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:55:08.969460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 12:55:08.972506 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:08.976029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b0859f4-f817-4379-b86a-fba940d740f4 tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:08.987394 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b0859f4-f817-4379-b86a-fba940d740f4 tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] 10.222.0.88 "POST /compute/v2.1/flavors/264056211/action" status: 403 len: 130 microversion: 2.1 time: 0.347778 Jul 18 12:55:08.987394 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 492/986] 10.222.0.88 () {60 vars in 1196 bytes} [Mon Jul 18 12:55:08 2022] POST /compute/v2.1/flavors/264056211/action => generated 130 bytes in 354 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:09.002295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c47917e8-f12f-48f8-9824-54bb361b0104 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '.version_select at 0x7f96e47501f0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:09.006691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c47917e8-f12f-48f8-9824-54bb361b0104 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:09.013290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c47917e8-f12f-48f8-9824-54bb361b0104 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:09.037559 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c47917e8-f12f-48f8-9824-54bb361b0104 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.052232 Jul 18 12:55:09.057319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 493/987] 10.222.0.88 () {60 vars in 1183 bytes} [Mon Jul 18 12:55:08 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:09.072038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:09.073875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:09.085623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:09.086887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:09.089207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:09.090423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:09.162737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:55:09.374142 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56823a93-c87f-49e1-a8b8-40ceb6c85fed tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 204 len: 0 microversion: 2.75 time: 0.313135 Jul 18 12:55:09.375288 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 494/988] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:09 2022] DELETE /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 12:55:09.393657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aec0dc40-ec22-4ce5-8ffe-27db455d0105 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e48c8a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:09.500030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-aec0dc40-ec22-4ce5-8ffe-27db455d0105 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:09.514827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-aec0dc40-ec22-4ce5-8ffe-27db455d0105 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:09.537661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f30f145-684e-49ba-a6b3-1637c6674d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce" status: 202 len: 0 microversion: 2.1 time: 0.644316 Jul 18 12:55:09.539260 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 495/989] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:55:08 2022] DELETE /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:09.550714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07bd6ef0-052c-4ce9-acb1-b5ee471141fd tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:09.557645 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:09.557645 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:09.614536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07bd6ef0-052c-4ce9-acb1-b5ee471141fd tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/264056211" status: 202 len: 0 microversion: 2.1 time: 0.072575 Jul 18 12:55:09.615732 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 496/990] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:55:09 2022] DELETE /compute/v2.1/flavors/264056211 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:09.626829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:09.627492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:09.637705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:09.651482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:09.652889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:09.653787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:09.881673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:09.970265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ac89aacc-32a4-4e77-bdff-005c2b85de0d {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:10.000344 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7fca658-9c83-4065-8f6e-6aada859ad1a tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 2034 microversion: 2.25 time: 0.381221 Jul 18 12:55:10.006922 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 497/991] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:09 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 2034 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:10.018001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:10.019820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:10.032322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:10.033618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:10.034570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:10.035317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:10.110726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aec0dc40-ec22-4ce5-8ffe-27db455d0105 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.732746 Jul 18 12:55:10.113511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 495/992] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:09 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:10.126753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e47503a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:10.194424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:55:10.195665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 5228e68d-c671-4622-b0fc-87619bb2a4ce not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:55:10.196762 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.196762 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.202629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce HTTP/1.1 Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:55:10.203205 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.206285 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5228e68d-c671-4622-b0fc-87619bb2a4ce'} Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:10.208877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:55:10.210760 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.212933 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] Jul 18 12:55:10.215545 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:10.223414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:10.224981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:55:10.224981 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-9d049c54-53bb-4213-9942-64a918062d4b'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:10.226868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:10.230543 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bb70cc1-0c52-4c50-b041-9cf076049a8c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce" status: 404 len: 194 microversion: 2.1 time: 0.114526 Jul 18 12:55:10.236928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 496/993] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:55:10 2022] GET /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:10.238309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-66118968-67ee-418e-b306-31bec26c60a9 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1442 microversion: 2.75 time: 0.232037 Jul 18 12:55:10.239942 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 498/994] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:10 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1442 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:10.250336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:10.253344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:10.257764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f5011e2-b174-4729-91ca-ac87124ff94b tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:10.284922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:10.285849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:10.287463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:10.289299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:10.331370 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f5011e2-b174-4729-91ca-ac87124ff94b tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092231 Jul 18 12:55:10.333969 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 497/995] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:55:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:10.343739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24020856-8f20-4944-946b-80d2183a4762 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: .version_select at 0x7f96e490b550>, body: {"keypair": {"name": "tempest-keypair-463633431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCU8/gststbbFys+NyZnB3IrFyBVD06VAwcbewHxkPMjcDf14lhf1umvEArX/cVudM9HppSXYLHuj85kAB6UOduw7NYZ2+P2tuIa/wujY2D4VCeBsu2fPQa41UajgYi4g=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:10.389169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-24020856-8f20-4944-946b-80d2183a4762 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for project 788a3068f3ed4ccb84c3899673be6934. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:10.406182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-24020856-8f20-4944-946b-80d2183a4762 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for user f604cd53dad44c39944c7e7a57737941 and project 788a3068f3ed4ccb84c3899673be6934. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:10.494077 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24020856-8f20-4944-946b-80d2183a4762 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.157264 Jul 18 12:55:10.496018 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 498/996] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 12:55:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 12:55:10.516079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8349108-e092-42a7-8c86-01290cf78f6f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e48c80d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:10.699560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c8349108-e092-42a7-8c86-01290cf78f6f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:10.715227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c8349108-e092-42a7-8c86-01290cf78f6f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:10.732728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:10.762603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0563594-7de7-4b2d-9dec-dd451b4cc13e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.519760 Jul 18 12:55:10.779810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 499/997] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:10 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:10.779810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc4105d2-ac66-4a8d-ac19-1b2599f639ef tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4700820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:11.421368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bc4105d2-ac66-4a8d-ac19-1b2599f639ef tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd" status: 202 len: 0 microversion: 2.1 time: 0.653036 Jul 18 12:55:11.424068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 500/998] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:55:10 2022] DELETE /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:11.439813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58750f9f-ea0c-413f-a48b-dee52d13b2b9 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1449336279", "id": 1028882895, "os-flavor-access:is_public": "False"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:11.444779 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:11.444779 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:11.532532 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58750f9f-ea0c-413f-a48b-dee52d13b2b9 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.105999 Jul 18 12:55:11.543819 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 501/999] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:11 2022] POST /compute/v2.1/flavors => generated 439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:11.580676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:11.581908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:11.600717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:11.601670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:11.603139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:11.603879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:11.609944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8349108-e092-42a7-8c86-01290cf78f6f tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 64 microversion: 2.1 time: 1.111627 Jul 18 12:55:11.612088 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 499/1000] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:10 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 64 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:11.627674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4889430>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:11.694355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:55:11.695629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 39d82597-3392-4914-adfe-9408de7b20dd not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:55:11.697210 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.697210 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd HTTP/1.1 Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:55:11.702757 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.705087 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '39d82597-3392-4914-adfe-9408de7b20dd'} Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:11.706628 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:55:11.711085 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.716423 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:55:11.719615 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-c3704777-a74e-4be3-bfef-b8bf2a626b75'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:11.732316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d40f9ded-feca-45c5-9891-c5d91370eabc tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd" status: 404 len: 194 microversion: 2.1 time: 0.118072 Jul 18 12:55:11.733548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 500/1001] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:55:11 2022] GET /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:11.743962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b566456f-2329-487f-b475-9ba43bf52add tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:11.746187 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:11.746187 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:11.805748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:11.830239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:11.835618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:11.850599 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df089bb5-b1cc-44d2-bdaf-698e723dfcb1 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1442 microversion: 2.75 time: 0.301560 Jul 18 12:55:11.858475 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 502/1002] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:11 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1442 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:11.878405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e69a645-dabc-4e18-aec8-0981566882ff tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e4700670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:11.925027 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b566456f-2329-487f-b475-9ba43bf52add tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1028882895/action" status: 200 len: 97 microversion: 2.1 time: 0.188873 Jul 18 12:55:11.930484 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 501/1003] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:55:11 2022] POST /compute/v2.1/flavors/1028882895/action => generated 97 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:11.944141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c789afde-87f7-41ac-950e-ef75fb25645e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4e97ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:12.047175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e69a645-dabc-4e18-aec8-0981566882ff tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.185384 Jul 18 12:55:12.047175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 503/1004] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:55:11 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 64 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:12.065820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:12.067814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:12.080137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:12.080962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:12.082516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:12.083339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:12.413225 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c789afde-87f7-41ac-950e-ef75fb25645e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.479860 Jul 18 12:55:12.433792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 502/1005] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:55:11 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:12.444485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45edf2ee-aa82-4503-b303-a94df72e0f9a tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:12.444948 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:12.444948 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:12.447616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45edf2ee-aa82-4503-b303-a94df72e0f9a tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '088a24f7ff024762b3e0883a818cf170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df226f2880f42a9a399eb14f7dc04ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45edf2ee-aa82-4503-b303-a94df72e0f9a tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Request method failure captured: Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/flavors/1028882895/action HTTP/1.1 Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 70 Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VgddNWmHcnKEUhr-BirRtsI73fBOfsEaEG0rdeuy2dbSXmmdUx1PLXr2zgnoEIcqznjmvANnXZvaoNfyXTKPW7lYV7rxD6QAeTxph9YI3hPjl22qfrkiBYG_er34I_xIC57mbRUZP8CZMC1TDUwyKUWWVdQ9VcFkbHbHN-MrXsSXYo Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0df226f2880f42a9a399eb14f7dc04ca Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:55:12.451411 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0df226f2880f42a9a399eb14f7dc04ca", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0df226f2880f42a9a399eb14f7dc04ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0df226f2880f42a9a399eb14f7dc04ca Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064 Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FlavorsAccessNegativeTestJSON-1193330064-project Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 088a24f7ff024762b3e0883a818cf170 Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1193330064-project Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: {"removeTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} Jul 18 12:55:12.456657 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1028882895', 'body': {'removeTenantAccess': {'tenant': '0df226f2880f42a9a399eb14f7dc04ca'}}} Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can( Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:55:12.459625 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 12:55:12.464742 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:12.467696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45edf2ee-aa82-4503-b303-a94df72e0f9a tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:12.467696 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45edf2ee-aa82-4503-b303-a94df72e0f9a tempest-FlavorsAccessNegativeTestJSON-1193330064 tempest-FlavorsAccessNegativeTestJSON-1193330064-project] 10.222.0.88 "POST /compute/v2.1/flavors/1028882895/action" status: 403 len: 133 microversion: 2.1 time: 0.024516 Jul 18 12:55:12.467696 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 503/1006] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:55:12 2022] POST /compute/v2.1/flavors/1028882895/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:12.476746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4322c8ee-495e-4c0d-855e-73a31df57b59 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e4d12670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:12.604268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-4322c8ee-495e-4c0d-855e-73a31df57b59 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:12.639332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-4322c8ee-495e-4c0d-855e-73a31df57b59 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:12.698455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:12.723169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:12.732134 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1aea44e2-cbe2-49f5-a2c7-3afd5bef7082 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.673370 Jul 18 12:55:12.745995 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 504/1007] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:12 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:12.755911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02a83c4a-342b-486c-bc0f-1656eca4efe7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e46b0310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-946314193", "description": "tempest-description-1238292495"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:13.517104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02a83c4a-342b-486c-bc0f-1656eca4efe7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.768711 Jul 18 12:55:13.518229 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 505/1008] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:55:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:13.539375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5cc2f13-aa0e-4d8c-9136-593c5e54a2c9 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0df226f2880f42a9a399eb14f7dc04ca"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:13.542474 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:13.542474 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:13.691126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4322c8ee-495e-4c0d-855e-73a31df57b59 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.225568 Jul 18 12:55:13.693861 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 504/1009] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:12 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:13.707127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:13.709446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:13.725319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:13.728147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:13.731131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:13.732731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:13.868916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5cc2f13-aa0e-4d8c-9136-593c5e54a2c9 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1028882895/action" status: 200 len: 21 microversion: 2.1 time: 0.339106 Jul 18 12:55:13.872519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 506/1010] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 18 12:55:13 2022] POST /compute/v2.1/flavors/1028882895/action => generated 21 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:13.892580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5b645fe-ded0-4883-878c-8306dc23850c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e4650280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1994912106", "description": "tempest-description-1739155291"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:14.016685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:14.044536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:14.048559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67e97a4f3627483d899597b4e7995333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c62e2be6346d09e661a3fb51cd7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:14.059944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c0ec7b6-9aae-4468-918b-229c37eb29a6 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 200 len: 1442 microversion: 2.75 time: 0.362846 Jul 18 12:55:14.061557 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 505/1011] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:13 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 1442 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:14.072212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3dd3fe59-06de-446a-a2cf-62917187f348 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update', calling method: .version_select at 0x7f96e490b5e0>, body: {"meta": {"os_version": "alt"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:14.177463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3dd3fe59-06de-446a-a2cf-62917187f348 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:14.189706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3dd3fe59-06de-446a-a2cf-62917187f348 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:14.505621 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5b645fe-ded0-4883-878c-8306dc23850c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.627932 Jul 18 12:55:14.507416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 507/1012] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:55:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:14.517911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:14.527207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:14.549594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:14.550762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:14.553058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:14.554828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:15.075427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3dd3fe59-06de-446a-a2cf-62917187f348 tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.011700 Jul 18 12:55:15.077705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 506/1013] 10.222.0.88 () {60 vars in 1312 bytes} [Mon Jul 18 12:55:14 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata/os_version => generated 31 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:15.100280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46e126ef-f221-4fb0-85bb-0f8703b465ea tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:15.102314 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:15.102314 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:55:15.144366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46e126ef-f221-4fb0-85bb-0f8703b465ea tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1028882895" status: 202 len: 0 microversion: 2.1 time: 0.064379 Jul 18 12:55:15.146396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 507/1014] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 12:55:15 2022] DELETE /compute/v2.1/flavors/1028882895 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:15.154739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:15.173808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1198298274", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b8b5ef0a-21b3-40e6-b6df-8593469ff26c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:15.208088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d62a3155-7745-4b5f-917a-d71bea68a956 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.697866 Jul 18 12:55:15.209541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 508/1015] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:14 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:15.218898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:15.220044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] [instance: 32981020-3877-4017-bd68-824faf06136c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:15.269697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:15.271112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:15.272660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:15.273464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:15.327216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] validate_networks() for [('b8b5ef0a-21b3-40e6-b6df-8593469ff26c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:15.330339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] HTTP exception thrown: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Request method failure captured: Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c HTTP/1.1 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfCvnu9k0Usaj4n6o5bdpXiddfeDcDPeFuPvQVKrTOytQckZK8asu4DyR-2BTXxOYz6d5uFOOW2ohc2LJKpg6Q47JG9rLGYT024Cz820fcYQ89pLaWeOUNaYhD5IN1RatBB_CFr3SY6tlyv1gsp5iDKR1uWLdx9Rwrz_9QpiQjq1qo Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.75 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ea3c62e2be6346d09e661a3fb51cd7bd Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdmin275Test-607587400 Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:55:15.334323 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ea3c62e2be6346d09e661a3fb51cd7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ea3c62e2be6346d09e661a3fb51cd7bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ea3c62e2be6346d09e661a3fb51cd7bd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ea3c62e2be6346d09e661a3fb51cd7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdmin275Test-607587400 Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ea3c62e2be6346d09e661a3fb51cd7bd Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdmin275Test-607587400 Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdmin275Test-607587400-project Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 67e97a4f3627483d899597b4e7995333 Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdmin275Test-607587400-project Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. Jul 18 12:55:15.336672 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '32981020-3877-4017-bd68-824faf06136c'} Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:15.337825 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. Jul 18 12:55:15.340190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:15.342054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] Returning 404 to user: Instance 32981020-3877-4017-bd68-824faf06136c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:15.342054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bc00bc1d-0252-4e9e-b8fb-6423e2ac66f7 tempest-ServersAdmin275Test-607587400 tempest-ServersAdmin275Test-607587400-project] 10.222.0.88 "GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c" status: 404 len: 111 microversion: 2.75 time: 0.125667 Jul 18 12:55:15.358408 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 509/1016] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:15 2022] GET /compute/v2.1/servers/32981020-3877-4017-bd68-824faf06136c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:55:15.382009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8447a291-ae0e-4484-a5e3-10ede7e54afa tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e46fee50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:15.473590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8447a291-ae0e-4484-a5e3-10ede7e54afa tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.112389 Jul 18 12:55:15.475767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 510/1017] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:55:15 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 58 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:15.483572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33d70fd3-84e6-4342-a5e3-fb0212db96a3 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:15.533879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33d70fd3-84e6-4342-a5e3-fb0212db96a3 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055309 Jul 18 12:55:15.536055 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 511/1018] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:15.545770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-723bc87f-04f9-4ed0-b20f-47291c5440bd tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'update_all', calling method: .version_select at 0x7f96e47411f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:15.675998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-723bc87f-04f9-4ed0-b20f-47291c5440bd tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:15.699038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-723bc87f-04f9-4ed0-b20f-47291c5440bd tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:16.423632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:16.424288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:16.425559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:16.426197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:16.427041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:16.431344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:16.445704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:16.446304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:16.448336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:16.449262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:16.463414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-723bc87f-04f9-4ed0-b20f-47291c5440bd tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.925377 Jul 18 12:55:16.465248 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 512/1019] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 12:55:15 2022] PUT /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 61 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:16.473965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65b26d98-fd58-4b71-8157-2736ee3df0c8 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1380304574", "id": 375216402, "os-flavor-access:is_public": "False"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:16.477530 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:16.477530 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:16.504033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Getting quotas for project 49607e75db52424788c6fd28b64a4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:16.510126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65b26d98-fd58-4b71-8157-2736ee3df0c8 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.042389 Jul 18 12:55:16.512298 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 513/1020] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:16 2022] POST /compute/v2.1/flavors => generated 436 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:16.519387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Getting quotas for user 77b8ecd2ffb045fc8cc2585be2852c48 and project 49607e75db52424788c6fd28b64a4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:16.532811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-434691710", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b247f390-7473-4edc-b6bf-63b08a11384c"}], "security_groups": [{"name": "tempest-securitygroup--1089674182"}], "key_name": "tempest-keypair-463633431", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:16.556485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:16.562623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:16.700354 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-924fb6b5-adfe-4b24-974f-a34b73d76ab7 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545388 Jul 18 12:55:16.702172 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 508/1021] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:16.877425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] validate_networks() for [('b247f390-7473-4edc-b6bf-63b08a11384c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:16.990555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e569f69e-8c7f-438b-808e-3e57b4c0982f req-733ff830-5d4b-4089-8ce2-45610e10bf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd149fd-6a6e-4fdb-9532-a0d005c941a1", "name": "network-vif-plugged", "status": "completed", "tag": "d39e1676-ab9f-4436-9bac-3d2487b343c0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:17.015859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e569f69e-8c7f-438b-808e-3e57b4c0982f req-733ff830-5d4b-4089-8ce2-45610e10bf40 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:17.017428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e569f69e-8c7f-438b-808e-3e57b4c0982f req-733ff830-5d4b-4089-8ce2-45610e10bf40 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:17.054528 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e569f69e-8c7f-438b-808e-3e57b4c0982f req-733ff830-5d4b-4089-8ce2-45610e10bf40 service nova] Creating event network-vif-plugged:d39e1676-ab9f-4436-9bac-3d2487b343c0 for instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 on n-h2-850003-3 Jul 18 12:55:17.064714 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e569f69e-8c7f-438b-808e-3e57b4c0982f req-733ff830-5d4b-4089-8ce2-45610e10bf40 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360029 Jul 18 12:55:17.075364 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 509/1022] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:17.088541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:17.089087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:17.104253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:17.105824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:17.109259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:17.111035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:17.739358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:17.759886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27954cbe-1423-4c17-9a9d-a6f5e64038b3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.681812 Jul 18 12:55:17.770640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 510/1023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:17 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:17.770640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-500905a8-ace1-4fba-9a5c-13d0a80ffaad tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Action: 'create', calling method: .version_select at 0x7f96e490b040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:17.878420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-500905a8-ace1-4fba-9a5c-13d0a80ffaad tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:17.903148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-500905a8-ace1-4fba-9a5c-13d0a80ffaad tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Getting quotas for user c5add64e05b44a74abbd10b0ac7957f1 and project 94219d16da8b4b409b8ac5bf9e5c5eb3. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:18.310656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:18.312345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:18.313244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:18.313914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:18.314544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:18.339800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:18.341195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:18.344275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:18.345659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:18.377130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=89,nova_api:DELETE=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:18.393928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:18.408159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for user f604cd53dad44c39944c7e7a57737941 and project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:18.448727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:18.452027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:18.543974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-195bd9a9-07c2-43d9-a1ae-9a3b77fbacc3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.029573 Jul 18 12:55:18.545607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 514/1024] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 12:55:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 12:55:18.551919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6ce6248-998a-4620-8dd5-aab836390044 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ae53a2153148417ab247a34d08ae550a"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:18.554292 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:18.554292 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:18.652878 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-500905a8-ace1-4fba-9a5c-13d0a80ffaad tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "POST /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.889812 Jul 18 12:55:18.654006 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 511/1025] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 18 12:55:17 2022] POST /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 85 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:18.666453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:18.671446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:18.690183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:18.691460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:18.694524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:18.696204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:18.885724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:18.908208 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eac5ea6c-6cf1-4b54-88c0-416a5a956be1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1268 microversion: 2.1 time: 0.251025 Jul 18 12:55:18.910104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 512/1026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:18 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1268 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:18.920988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:18.923839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:19.046217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:19.062135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:19.064980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:19.067421 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f85729b4-04bc-411d-ae7c-25c5ce1c9da1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1284 microversion: 2.25 time: 0.154423 Jul 18 12:55:19.068811 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 513/1027] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:18 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:19.078363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6aafd3ea-d44c-449a-aea9-d19a443dc3dc tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] Calling method '.version_select at 0x7f96e47bf0d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:19.173766 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6aafd3ea-d44c-449a-aea9-d19a443dc3dc tempest-ImagesMetadataTestJSON-435213124 tempest-ImagesMetadataTestJSON-435213124-project] 10.222.0.88 "GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.102745 Jul 18 12:55:19.174921 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 514/1028] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:55:19 2022] GET /compute/v2.1/images/1f001cb3-3108-4e8d-8da1-46916d62060d/metadata => generated 85 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:19.193271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:19.194484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:19.212800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:19.213607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:19.215135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:19.215944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:19.376283 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e6ce6248-998a-4620-8dd5-aab836390044 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] HTTP exception thrown: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6ce6248-998a-4620-8dd5-aab836390044 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Request method failure captured: Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/flavors/375216402/action HTTP/1.1 Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 70 Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VgfCWFFgHDnCmw9kiyQGNmPxSBaDvCxdF93BAwy-NMdmczeBiPvKBt5zoWWCykvGtnjrhPlBnWBpiNn2E_0AsgqVY02BXk_OKgqYkyAWdTedmlD90ET5emdmzwovLsmT4I7Gvy7Q6tv8ReB9mfKg_-3Zq3LwfOQDoK0JE4D6fWdZ3c Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 12:55:19.385454 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5cb0796813c4d5992b35b36069fb93a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5cb0796813c4d5992b35b36069fb93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a5cb0796813c4d5992b35b36069fb93a Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110 Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: eca61504d115488fb39810338ee5c045 Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: {"removeTenantAccess": {"tenant": "ae53a2153148417ab247a34d08ae550a"}} Jul 18 12:55:19.388379 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '375216402', 'body': {'removeTenantAccess': {'tenant': 'ae53a2153148417ab247a34d08ae550a'}}} Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 18 12:55:19.389989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:19.392658 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:55:19.395886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6ce6248-998a-4620-8dd5-aab836390044 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Returning 404 to user: Flavor access not found for 39 / ae53a2153148417ab247a34d08ae550a combination. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:19.406029 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6ce6248-998a-4620-8dd5-aab836390044 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/375216402/action" status: 404 len: 124 microversion: 2.1 time: 0.847511 Jul 18 12:55:19.406029 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 515/1029] 10.222.0.88 () {60 vars in 1196 bytes} [Mon Jul 18 12:55:18 2022] POST /compute/v2.1/flavors/375216402/action => generated 124 bytes in 854 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:55:19.447745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab535c1f-6fbf-457b-9910-37d83f458ebc tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:19.447745 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:19.447745 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:19.497545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ab535c1f-6fbf-457b-9910-37d83f458ebc tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/375216402" status: 202 len: 0 microversion: 2.1 time: 0.090067 Jul 18 12:55:19.504197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 516/1030] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:55:19 2022] DELETE /compute/v2.1/flavors/375216402 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:55:19.512983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfb0833a-7ad1-402b-b532-63c71ddab8a6 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:19.554984 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dfb0833a-7ad1-402b-b532-63c71ddab8a6 tempest-FlavorsAccessNegativeTestJSON-1781108110 tempest-FlavorsAccessNegativeTestJSON-1781108110-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048149 Jul 18 12:55:19.556726 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 517/1031] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:55:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:19.735086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:19.764428 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a507d6b-2085-4594-b7a2-664cdb8f294c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1316 microversion: 2.1 time: 0.584427 Jul 18 12:55:19.765737 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 515/1032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:19 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:19.946657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:19.948971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:19.965755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:19.971066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:19.974357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:19.974357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:20.104242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:20.106092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:20.121507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:20.123373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:20.127954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:20.130848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:20.209823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:20.246748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7ac40b6-80bb-4d53-8c49-be38e3b88a18 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1274 microversion: 2.1 time: 0.305665 Jul 18 12:55:20.270259 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 518/1033] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:19 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:20.318107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:20.337772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:20.341544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:20.344065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fc36ee2-e2ae-4fcc-bb92-ff1649d3d0ae tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1288 microversion: 2.25 time: 0.246053 Jul 18 12:55:20.347658 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 516/1034] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:20 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1288 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:55:20.791058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:20.792375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:20.806764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:20.808044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:20.809572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:20.810432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:21.280932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:21.283091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:21.347582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:21.348404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:21.350054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:21.350745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:21.856487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:21.888719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d417e91-9680-407a-acaf-d41f021a8513 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1466 microversion: 2.1 time: 1.095239 Jul 18 12:55:21.890807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 519/1035] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:20 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1466 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:21.909390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:21.911064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:21.931784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:21.933403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:21.939940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:21.941258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:22.049297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:22.080381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bc11904-56b6-4a78-a57f-bb7111a75d46 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.805698 Jul 18 12:55:22.094338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 517/1036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:21 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:22.110623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:22.111715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:22.151487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:22.152614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:22.160776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:22.161608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:22.267303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:22.284217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:22.289592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:22.293160 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b02f9fb5-5e17-40a4-9e62-84a155ceb70e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1342 microversion: 2.25 time: 0.398175 Jul 18 12:55:22.293803 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 520/1037] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:21 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1342 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:22.662377 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-823d114c-fe02-4c06-ad05-e08799cd8b87 tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1617 microversion: 2.1 time: 0.566016 Jul 18 12:55:22.666571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 518/1038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:22 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1617 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:23.024853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-285760995", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a2b23f64-8625-4abc-b8a7-29a85519282b"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:23.114960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:23.126643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:23.138688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:23.139469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:23.140282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:23.140904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:23.159220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:23.541519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:23.579212 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2bbf209-8281-48a5-ac16-2687c53d6b8d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.471245 Jul 18 12:55:23.581792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 519/1039] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:23 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:55:23.624577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:23.625726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:23.646530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:23.648062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:23.649987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:23.651035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:23.731725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:23.870060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:23.888326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:23.895647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:23.898657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2674566f-54cf-4ccf-b16e-b6078604a24c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1342 microversion: 2.25 time: 0.291390 Jul 18 12:55:23.900529 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 520/1040] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:23 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:24.590928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:24.591480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:24.592614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:24.593511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:24.594988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:24.613031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:24.617729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:24.644414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:24.648316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:24.649905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:24.651899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:24.653586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:24.655957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:24.657536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:24.663785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:24.710439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:24.721952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:24.760379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:24.765311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:24.971524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:24.976942 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-410cb0b8-62ed-455b-aba5-ad445472508d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959364 Jul 18 12:55:24.990732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38b396ff-a5a1-42b3-8c45-402d1d675345 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.384560 Jul 18 12:55:24.993681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 521/1041] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:24 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:24.999824 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 521/1042] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:25.021924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-179dbb51-1b9e-4d50-a284-608c456c23f7 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4726dc0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:25.031992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:25.036726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:25.095036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:25.095878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:25.097332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:25.103313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:25.209749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-179dbb51-1b9e-4d50-a284-608c456c23f7 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb" status: 200 len: 662 microversion: 2.1 time: 0.199185 Jul 18 12:55:25.226613 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 522/1043] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:24 2022] GET /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb => generated 662 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:25.248647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd7c3724-de39-43ed-8566-5bec200ce573 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:25.250001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd7c3724-de39-43ed-8566-5bec200ce573 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:25.451983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd7c3724-de39-43ed-8566-5bec200ce573 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:25.467469 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd7c3724-de39-43ed-8566-5bec200ce573 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1216 microversion: 2.1 time: 0.237441 Jul 18 12:55:25.470970 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 523/1044] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:25 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:25.932296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c3c865de-6b72-4549-a76b-ca75612cc5df"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:25.934065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:25.944285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:25.945563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:25.946766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:25.947893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.098335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:26.131070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:26.135500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:26.138535 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e66fa78-39f1-497e-a9d6-bcdf8a44d66e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 1.136310 Jul 18 12:55:26.142193 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 522/1045] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:25 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:26.153712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c555807-40c2-4ab7-b667-33b001082d57 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46fe0d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:26.265526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c555807-40c2-4ab7-b667-33b001082d57 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb" status: 200 len: 662 microversion: 2.1 time: 0.120634 Jul 18 12:55:26.268207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 523/1046] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:26 2022] GET /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:26.287838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:26.289513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:26.304118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.304827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.307930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.309382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.455226 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] HTTP exception thrown: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Request method failure captured: Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments/03594638-dcaf-4986-9b3f-0c38da64d2c8 HTTP/1.1 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 74 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VenaayYuhDvlNL0XLJY4qAveRlnTLZ4F8y4VYEtU-GI-eAQ8sPJfRZuY0aewz6oAB2P6Aw5Q3T4znUt32VHDc6grgh_Wv7Y2c6BwN88KwMO8uKlQA-naRR_j-AGLIU_xSLutTesECvMc8oPeV9A8XT4jcWd6VqdXwKgKF3ZWxZP79U Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21e0a2593c65472cadfbc9afd8d8da61 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:55:26.466725 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21e0a2593c65472cadfbc9afd8d8da61", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21e0a2593c65472cadfbc9afd8d8da61 Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesAdminNegativeTest-1033064203-project-admin Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 95790c4a9f01479587ba05a24653edbb Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesAdminNegativeTest-1033064203-project-admin Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: {"volumeAttachment": {"volumeId": "c3c865de-6b72-4549-a76b-ca75612cc5df"}} Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:55:26.469756 n-d-850003-3 devstack@n-api.service[131367]: exception: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': '7c36dc80-89d0-4801-88f2-2e74b3245ec2', 'id': '03594638-dcaf-4986-9b3f-0c38da64d2c8', 'body': {'volumeAttachment': {'volumeId': 'c3c865de-6b72-4549-a76b-ca75612cc5df'}}} Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 12:55:26.472165 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. (HTTP 404) (Request-ID: req-4143c34a-5e0f-4c4b-8ac8-c630c4e8d8a3) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 12:55:26.476326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:55:26.480918 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. Jul 18 12:55:26.487384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:55:26.491083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Returning 400 to user: Volume c3c865de-6b72-4549-a76b-ca75612cc5df could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:55:26.491083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5be9028a-69be-4465-95cb-e07ed9f78c71 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] 10.222.0.88 "PUT /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments/03594638-dcaf-4986-9b3f-0c38da64d2c8" status: 400 len: 107 microversion: 2.1 time: 1.009460 Jul 18 12:55:26.496122 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 524/1047] 10.222.0.88 () {60 vars in 1432 bytes} [Mon Jul 18 12:55:25 2022] PUT /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments/03594638-dcaf-4986-9b3f-0c38da64d2c8 => generated 107 bytes in 1024 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:55:26.500157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:26.528362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:26.534707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:26.549694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.551116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.553085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.554823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.724995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:26.755275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fa92447-e251-4b26-88c5-20a5664c82bd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1212 microversion: 2.1 time: 0.255396 Jul 18 12:55:26.756709 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 525/1048] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:26 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1212 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:26.764900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:26.765687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:26.780859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.782061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:26.785218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:26.786826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:27.090782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lazy-loading 'services' on Instance uuid 7c36dc80-89d0-4801-88f2-2e74b3245ec2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:55:27.355702 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce66bb13-045f-4dc0-80f8-0d12978652b1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments/03594638-dcaf-4986-9b3f-0c38da64d2c8" status: 202 len: 0 microversion: 2.1 time: 0.597066 Jul 18 12:55:27.362492 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 526/1049] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 12:55:26 2022] DELETE /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments/03594638-dcaf-4986-9b3f-0c38da64d2c8 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:27.483716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:27.517782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7075e9d3-47ed-4b22-b661-660297c50107 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 1.246119 Jul 18 12:55:27.523292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 524/1050] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:26 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:27.541912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:27.544101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:27.566959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:27.567555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:27.574634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:27.581112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:27.829488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3c6e9344-a57e-41b2-85f1-f6ce3a5a221b req-1c483ae4-fb4a-42cd-a2f0-a1fccd2b6696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc2e52d-320e-4cf4-9862-13a127a27792", "tag": "2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:27.887200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3c6e9344-a57e-41b2-85f1-f6ce3a5a221b req-1c483ae4-fb4a-42cd-a2f0-a1fccd2b6696 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:27.888707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3c6e9344-a57e-41b2-85f1-f6ce3a5a221b req-1c483ae4-fb4a-42cd-a2f0-a1fccd2b6696 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:27.945378 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3c6e9344-a57e-41b2-85f1-f6ce3a5a221b req-1c483ae4-fb4a-42cd-a2f0-a1fccd2b6696 service nova] Creating event network-changed:2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b for instance ffc2e52d-320e-4cf4-9862-13a127a27792 on n-h1-850003-3 Jul 18 12:55:27.958844 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3c6e9344-a57e-41b2-85f1-f6ce3a5a221b req-1c483ae4-fb4a-42cd-a2f0-a1fccd2b6696 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.593012 Jul 18 12:55:27.960628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 527/1051] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:27.977093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:27.979833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:28.024397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.025228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.033317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.037692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.229854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b0d91d52-9d28-4579-ac01-0eff2b12c5fa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.266434 Jul 18 12:55:28.232627 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 528/1052] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:27 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:28.264021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:28.268558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:28.290602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.292832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.294466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.295464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.649845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:28.677145 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6ee4631-654e-40ae-918a-04f12b049237 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1274 microversion: 2.1 time: 0.442917 Jul 18 12:55:28.694994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 529/1053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:28 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1274 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:28.727318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:28.728594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:28.750061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.756960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.757950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:28.758704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:28.984921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:29.010804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:29.027753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:29.041215 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f21c69fd-d549-4c0d-98cd-af7fba3dde09 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 1.504335 Jul 18 12:55:29.055154 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 525/1054] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:27 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:29.078568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f2b5eb5-557a-4b6d-a4a2-5ac5f317951e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4683040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:29.178096 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f2b5eb5-557a-4b6d-a4a2-5ac5f317951e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068" status: 200 len: 660 microversion: 2.1 time: 0.120566 Jul 18 12:55:29.178932 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 526/1055] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:29 2022] GET /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068 => generated 660 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:29.210339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6fd20266-cd8b-4e01-8e48-7e2ee8c7ee83 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4609040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:29.332592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6fd20266-cd8b-4e01-8e48-7e2ee8c7ee83 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068" status: 200 len: 660 microversion: 2.1 time: 0.140365 Jul 18 12:55:29.342721 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 527/1056] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:29 2022] GET /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068 => generated 660 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:29.367807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:29.371408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:29.387210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:29.390447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:29.393743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:29.395036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:29.521806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64d4fd8c-47ed-4ce8-a309-3ab1a310e997 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172377 Jul 18 12:55:29.524932 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 528/1057] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:29 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:29.714227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:29.715639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:29.727458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:29.728337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:29.730969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:29.733820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:29.742031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:29.767331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75153cba-c6c0-4471-980a-6b164ae96f55 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 1.070562 Jul 18 12:55:29.771137 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 530/1058] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:28 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:29.932477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:29.970561 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8547298e-5fa0-4411-8900-f4bb8ffca4d7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1274 microversion: 2.1 time: 0.263044 Jul 18 12:55:29.974693 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 529/1059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:29 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:30.027981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d0c1a199-8ccf-4645-998c-a97d0f822cca req-47bb8a66-c3ee-4c68-9dd0-cfdadf3b7a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:30.086862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:30.094507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d0c1a199-8ccf-4645-998c-a97d0f822cca req-47bb8a66-c3ee-4c68-9dd0-cfdadf3b7a95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.095998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:30.108748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d0c1a199-8ccf-4645-998c-a97d0f822cca req-47bb8a66-c3ee-4c68-9dd0-cfdadf3b7a95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.139552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.143854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d0c1a199-8ccf-4645-998c-a97d0f822cca req-47bb8a66-c3ee-4c68-9dd0-cfdadf3b7a95 service nova] Creating event network-changed:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:55:30.145168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.152533 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d0c1a199-8ccf-4645-998c-a97d0f822cca req-47bb8a66-c3ee-4c68-9dd0-cfdadf3b7a95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134180 Jul 18 12:55:30.154361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 531/1060] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:55:30.162895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.166756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.540417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:30.543960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:30.568964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.569928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.571884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.579090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.781481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20cc978a-c3ce-4e7c-b7e5-51f7eab2c2cf tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239276 Jul 18 12:55:30.782770 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 532/1061] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:30 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:55:30.811650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:30.812615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:30.838947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.845394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:30.849044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:30.849570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:31.041186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:31.082312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:31.084136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:31.099488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5795eb68-cc35-4ec1-b402-9ab6fcfc2ac0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 1.019274 Jul 18 12:55:31.103276 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 530/1062] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:30 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:55:31.118129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:31.119644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:31.129458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:31.130744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:31.132065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:31.132851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:32.221600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:32.281060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42a56c2f-e9f4-417e-8f44-cb059b1bd523 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 1.482895 Jul 18 12:55:32.293937 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 533/1063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:30 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:32.309520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:32.312819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:32.344739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:32.368402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:32.371714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:32.373513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:32.456053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62506cec-8ac8-46a9-8b90-34a9826f4868 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158548 Jul 18 12:55:32.459116 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 534/1064] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:32 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:32.469239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04c2b0e9-5dfc-4e6c-ac6d-67d68e9f88dd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4650280>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:32.575919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:32.583619 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04c2b0e9-5dfc-4e6c-ac6d-67d68e9f88dd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab" status: 200 len: 662 microversion: 2.1 time: 0.121610 Jul 18 12:55:32.584802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 535/1065] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:32 2022] GET /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:32.603942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:32.605484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4163ac40-57cd-48fb-b37f-efc3cb0fe239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1316 microversion: 2.1 time: 1.500358 Jul 18 12:55:32.606079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:32.607740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 531/1066] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:31 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1316 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:32.618050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf5f380f-989a-49c1-86d5-2e413690f42c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4700550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:32.622875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:32.624985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:32.627782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:32.630052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:32.702399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf5f380f-989a-49c1-86d5-2e413690f42c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab" status: 200 len: 662 microversion: 2.1 time: 0.092635 Jul 18 12:55:32.715652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 532/1067] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:55:32 2022] GET /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab => generated 662 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:33.212566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-802747907", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:33.216772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:33.241074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:33.249936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:33.251638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-629168df-3507-4ad7-a680-38f7eb213e9e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.664807 Jul 18 12:55:33.267148 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 536/1068] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:32 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:33.283294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1351710121", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:33.330540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:33.473708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:34.055574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:34.057300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:34.058827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:34.059818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:34.061620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:34.112444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=43 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:34.172585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:34.185474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:34.198407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:34.201503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:34.256651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Getting quotas for project 600ef3c5c0e9438c93e489e85e4da4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:34.271258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Getting quotas for user 0f40e0512e404183b3092e0ce7aea512 and project 600ef3c5c0e9438c93e489e85e4da4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:34.302606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:34.306494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:34.402841 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-66a891c6-f322-4859-8c36-fd61908f72fa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134040 Jul 18 12:55:34.403463 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 537/1069] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:34.411897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-12541d69-26a5-4d7c-aaab-7092ea0c3319 req-2556d851-d396-4142-a6e3-1b8351ef0525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdce4f2-f477-4b56-a478-6aaf470c23ce", "tag": "4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:34.430830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-12541d69-26a5-4d7c-aaab-7092ea0c3319 req-2556d851-d396-4142-a6e3-1b8351ef0525 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:34.431357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-12541d69-26a5-4d7c-aaab-7092ea0c3319 req-2556d851-d396-4142-a6e3-1b8351ef0525 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:34.524868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-12541d69-26a5-4d7c-aaab-7092ea0c3319 req-2556d851-d396-4142-a6e3-1b8351ef0525 service nova] Creating event network-changed:4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e for instance bfdce4f2-f477-4b56-a478-6aaf470c23ce on n-h2-850003-3 Jul 18 12:55:34.550262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-12541d69-26a5-4d7c-aaab-7092ea0c3319 req-2556d851-d396-4142-a6e3-1b8351ef0525 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144784 Jul 18 12:55:34.551942 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 538/1070] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:34.576943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:34.579164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:34.601219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:34.601772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:34.604166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:34.604625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:34.695716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:34.741718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:35.170898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:35.189955 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-516e7cc3-7ccb-47ba-ba7b-f91dfc7e14c5 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.635616 Jul 18 12:55:35.191435 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 539/1071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:34 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:35.213006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:35.215833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:35.259646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.263571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.266598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.267896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.397777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f31a2792-4ba5-42fa-aa55-1a544eb67584 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203154 Jul 18 12:55:35.409395 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 540/1072] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:35 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:35.432453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:35.433661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:35.461703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.467396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.469266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.470014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.628031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:35.630491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:35.631790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:35.632998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:35.638641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:35.716515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.718916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.721814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:35.740688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:35.850739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:35.888910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for user 3ddc9f824baa4ae99c78a313c3446568 and project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:35.961449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:35.973593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:36.114752 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1314350a-654a-42bb-b5fd-0258f1a39828 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.305718 Jul 18 12:55:36.117895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 533/1073] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 12:55:36.140206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:36.164317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:36.191236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:36.195027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:36.198306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:36.202079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:36.705161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:36.758645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4de91638-eab3-4b9d-a166-a461710e3f28 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1316 microversion: 2.1 time: 1.346468 Jul 18 12:55:36.761179 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 541/1074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:35 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1316 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:36.778292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2042089036", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:36.939013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:37.711600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:37.712647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:37.715830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:37.716771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:37.719062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:37.746542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:37.777933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:37.778929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:37.789457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:37.791252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:37.912188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Getting quotas for project 600ef3c5c0e9438c93e489e85e4da4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:37.919553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:37.940532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Getting quotas for user 0f40e0512e404183b3092e0ce7aea512 and project 600ef3c5c0e9438c93e489e85e4da4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:37.952934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:37.960694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:37.967561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:37.971184 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e49e1217-2d22-4e4d-81b9-f37e7b0fd977 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 1.842049 Jul 18 12:55:37.975695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:37.989970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 534/1075] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:36 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:38.007840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:38.009301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:38.034549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:38.038547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:38.040326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:38.049787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:38.057885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc175ad3-b2ef-4e0d-ab37-d71beb809857 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294053 Jul 18 12:55:38.059186 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 542/1076] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:38.084089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-124990640", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:38.263624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:39.138392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:39.139350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:39.140125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:39.140944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:39.146390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:39.213250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.213955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.215573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.216369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.264717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:39.322917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:39.350889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for user 3ddc9f824baa4ae99c78a313c3446568 and project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:39.403974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:39.409710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:39.447761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:39.467999 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ce938401-9ac4-42b6-b856-abe6e7d8e463 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 1.475845 Jul 18 12:55:39.469027 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 535/1077] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:37 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:39.489060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:39.492173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:39.501452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.502469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.504502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.506012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.614596 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6729ca42-9bfd-4dba-af93-f112be70feee tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128449 Jul 18 12:55:39.615678 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 536/1078] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:39 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:39.628204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:39.630073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:39.645836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.650128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.657292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1f219ee-05af-45c0-b174-a2bc985ab7ca tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595858 Jul 18 12:55:39.662759 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 543/1079] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:39.671019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.674368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.693676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:39.703772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:39.729975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.749349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:39.763890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:39.767335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:40.012409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:40.040191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5cc49c55-cbb1-4d2c-a2d5-d682a9b94058 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1222 microversion: 2.1 time: 0.369840 Jul 18 12:55:40.068588 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 544/1080] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:39 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:40.085544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-73e07f4b-f788-4e89-a3f0-13cc01114e40 req-8becff91-5738-4950-bf9a-524cf96c9080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc2e52d-320e-4cf4-9862-13a127a27792", "name": "network-vif-plugged", "status": "completed", "tag": "2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:40.127348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-73e07f4b-f788-4e89-a3f0-13cc01114e40 req-8becff91-5738-4950-bf9a-524cf96c9080 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:40.128343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-73e07f4b-f788-4e89-a3f0-13cc01114e40 req-8becff91-5738-4950-bf9a-524cf96c9080 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:40.176678 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-73e07f4b-f788-4e89-a3f0-13cc01114e40 req-8becff91-5738-4950-bf9a-524cf96c9080 service nova] Creating event network-vif-plugged:2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b for instance ffc2e52d-320e-4cf4-9862-13a127a27792 on n-h1-850003-3 Jul 18 12:55:40.193132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-73e07f4b-f788-4e89-a3f0-13cc01114e40 req-8becff91-5738-4950-bf9a-524cf96c9080 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121230 Jul 18 12:55:40.197497 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 545/1081] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:40.212213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:40.218644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:40.241974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:40.248167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:40.249285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:40.258533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:40.822691 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-096db838-5e8a-46cd-9c2c-a429480a01f6 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1813 microversion: 2.1 time: 0.621595 Jul 18 12:55:40.823762 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 546/1082] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:40 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1813 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:40.835686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:40.837122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:40.857264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:40.858509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:40.859922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:40.860580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.141160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.156835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.161323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.163371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d03a0c7a-5cbe-481b-8f80-b2b81b543d20 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.338286 Jul 18 12:55:41.179498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 547/1083] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:40 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:41.192225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:41.193543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:41.204484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.205504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.207620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.209408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.431058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.455305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e59cf138-1958-46e5-a5d9-80108a77358f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1209 microversion: 2.1 time: 0.274296 Jul 18 12:55:41.472827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.474570 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 548/1084] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:41 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1209 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:41.486353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:41.488447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:41.495254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b74eb28-dfc8-4f36-ba67-963b35916077 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1316 microversion: 2.1 time: 1.873191 Jul 18 12:55:41.500313 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 537/1085] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:39 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1316 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:41.516769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.517070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.518590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.519174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:41.519466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.522937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:41.535492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.536885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.539016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.540033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.551018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:41.602084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5bb6b58-c05b-4c0d-8b75-9c5f5e6b3d5d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099960 Jul 18 12:55:41.603268 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 538/1086] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:55:41 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:55:41.611185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:41.614210 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:55:41.614210 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 12:55:41.615973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.616478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.617370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.617818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.664440 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-78b585af-5a69-4c51-87ee-d2e1728c14d2 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059386 Jul 18 12:55:41.665410 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 539/1087] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:55:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:41.673199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:41.673836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:41.685952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.686759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.687980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:41.688750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:41.904970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:41.923220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07f10ceb-2de6-4bb4-8795-23cfa7510dfd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.446309 Jul 18 12:55:41.924846 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 549/1088] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:41 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:42.012143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-255950513", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "8763719c-9c6d-4355-baba-ad89c169db90"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:42.233848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] validate_networks() for [('8763719c-9c6d-4355-baba-ad89c169db90', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:42.345426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:42.374634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f3739e0-eff5-40fa-b96d-65cf1976f7b4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1276 microversion: 2.1 time: 0.707077 Jul 18 12:55:42.377068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 540/1089] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:41 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1276 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:42.401721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:42.405574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:42.417743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:42.419181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:42.420760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:42.421819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:43.171838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:43.186583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:43.189051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:43.196596 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82c768e9-080a-4502-b074-fe62c040be90 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.812218 Jul 18 12:55:43.210939 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 541/1090] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:42 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:43.216730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:43.217832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:43.231768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:43.232997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:43.234273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:43.235242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:43.413249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:43.433906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3a7dc255-d60a-4681-95a1-3b0ff59dd429 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1271 microversion: 2.1 time: 0.221103 Jul 18 12:55:43.446735 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 542/1091] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:43 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:43.458616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:43.465145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:43.490002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:43.492894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:43.496579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:43.500954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:44.257601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:44.299939 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a62fcfe6-35f3-4259-88d9-4275120c6cdc tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1316 microversion: 2.1 time: 0.850534 Jul 18 12:55:44.321651 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 543/1092] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:43 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1316 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:44.373555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e67de530-d3a3-43b8-89e0-c25fdf12e506 req-eee7fc22-a51f-42c0-a276-d13b9eef796f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdce4f2-f477-4b56-a478-6aaf470c23ce", "name": "network-vif-plugged", "status": "completed", "tag": "4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:44.394641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:44.402866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e67de530-d3a3-43b8-89e0-c25fdf12e506 req-eee7fc22-a51f-42c0-a276-d13b9eef796f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:44.411742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e67de530-d3a3-43b8-89e0-c25fdf12e506 req-eee7fc22-a51f-42c0-a276-d13b9eef796f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:44.457364 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e67de530-d3a3-43b8-89e0-c25fdf12e506 req-eee7fc22-a51f-42c0-a276-d13b9eef796f service nova] Creating event network-vif-plugged:4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e for instance bfdce4f2-f477-4b56-a478-6aaf470c23ce on n-h2-850003-3 Jul 18 12:55:44.470051 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e67de530-d3a3-43b8-89e0-c25fdf12e506 req-eee7fc22-a51f-42c0-a276-d13b9eef796f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144966 Jul 18 12:55:44.472120 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 544/1093] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:44.485168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:44.486471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:44.505598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:44.505960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:44.510392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:44.512661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.035433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:45.058585 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10594e8d-95d8-4127-a4cd-45f7c6ca664d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1316 microversion: 2.1 time: 0.583800 Jul 18 12:55:45.059668 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 545/1094] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:44 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:45.080111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:45.082900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:45.097283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.099162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.101224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.102432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.343664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:45.356396 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37a27e18-ac35-4082-91a1-1de0a209e02a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1276 microversion: 2.1 time: 0.283851 Jul 18 12:55:45.357038 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 546/1095] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:45 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:45.372247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:45.372247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:45.391660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.391660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.394843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.396144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.710024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:45.712553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:45.714566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:45.715842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:45.716695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:45.765495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.773742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.775936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:45.777263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:45.838425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:45.864467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Getting quotas for user 62315c008374414f8616584494d03573 and project cc9f9ea85e4547f284a50bff35926dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:45.908423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:45.919064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:45.931873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:46.076596 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3677d47-80f4-47a8-9caa-42cf24500b0f tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.072654 Jul 18 12:55:46.088908 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 550/1096] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:46.106534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:46.107912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:46.120668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:46.121930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:46.125594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:46.127171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:46.215653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:46.244776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:46.251861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:46.256095 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-358f92c6-0ca8-405a-bb10-7a27b23d98a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.897969 Jul 18 12:55:46.259985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 547/1097] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:45 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:46.278021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937fd224-6324-4f0b-a3f0-4496945f7e62", "device": "/dev/xvdb"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:46.286827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:46.320332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:46.321073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:46.322693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:46.323436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:47.108602 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29fda843-6656-4eaf-9f14-0753bd38bc85 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845808 Jul 18 12:55:47.137423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 548/1098] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 12:55:46 2022] POST /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 194 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:47.159249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:47.165704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:47.181159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:47.182042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:47.183126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:47.183920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:47.472900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:47.536192 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1fe2576a-8c63-4439-a68e-4ef5867640d3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1271 microversion: 2.1 time: 1.441287 Jul 18 12:55:47.563119 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 551/1099] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:46 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1271 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:47.606735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:47.611834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:47.630916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:47.632627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:47.635361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:47.636786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:47.975661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:48.006398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b27b96c3-9fe1-4e46-b9b9-0e1ca083df56 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1316 microversion: 2.1 time: 0.865767 Jul 18 12:55:48.007786 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 549/1100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:47 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:48.021261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:48.026601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:48.053856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.057141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:48.071313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.075264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:48.373309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:48.399134 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9c8ec5b-ec75-462b-a3e8-ff32f629e433 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1213 microversion: 2.1 time: 0.388286 Jul 18 12:55:48.402389 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 550/1101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:48 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1213 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:48.414093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:48.415689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:48.436332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.437306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:48.438938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.439779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:48.893068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:48.922410 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f498507a-486d-4090-af53-01e726a1370c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.517846 Jul 18 12:55:48.931478 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 551/1102] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:48 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:48.941502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:48.958169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:48.982385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.983505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:48.985268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:48.989292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:49.748930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:49.770422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c838fec5-934e-4247-84dc-df977dd4eac2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1504 microversion: 2.1 time: 2.201991 Jul 18 12:55:49.771166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:49.804867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:49.808052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:49.810227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-feb79ffd-e1ea-46bf-a054-dec22b1585af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.876424 Jul 18 12:55:49.834347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 552/1103] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:48 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:49.834887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 552/1104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:47 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1504 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:49.838577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:49.839750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:49.845149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:49.845787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:49.861090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:49.862065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:49.863675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:49.870319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:49.884214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:49.884792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:49.885680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:49.886131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:50.627063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:50.652243 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd3d4e70-8346-4371-8a0b-9b3dc204a3af tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1466 microversion: 2.1 time: 0.826206 Jul 18 12:55:50.663869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 553/1105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:49 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1466 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:50.680535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:50.682019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:50.716279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:50.717622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:50.722306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:50.723620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:50.739428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:50.783269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f76f0969-f2cf-4a3f-a92d-5e8050202e8e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.958967 Jul 18 12:55:50.794199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 553/1106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:49 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:50.834630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-946314193"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:50.835371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:50.877248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:50.886481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:50.898511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:50.899154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:51.075757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:51.090709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-207b0f34-ce6c-4b35-ac67-61e099975126 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1275 microversion: 2.1 time: 0.423655 Jul 18 12:55:51.107743 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 554/1107] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:50 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1275 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:51.118022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:51.119850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:51.151946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:51.152572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:51.153504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:51.154045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:51.633263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:51.713410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:51.740205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c4250c5-366c-46c3-88ce-b0630f56026f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.630155 Jul 18 12:55:51.745619 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 555/1108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:51 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:51.755202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:51.763601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:51.778482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:51.779458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:51.781814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:51.782490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:51.925539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.network.security_group_api [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Adding security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 to port 2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b Jul 18 12:55:52.469791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6200280e-c3c7-440d-a907-faafcff2ea5e tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1617 microversion: 2.1 time: 0.721718 Jul 18 12:55:52.470935 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 556/1109] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:51 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1617 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:52.512813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:52.513444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:52.536369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:52.537172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:52.538342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:52.538645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:53.193396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:53.210509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:53.214011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:53.217148 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-607fe124-49c2-4963-bc79-827a45b7fa93 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1410 microversion: 2.25 time: 0.729407 Jul 18 12:55:53.218966 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 557/1110] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:52 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1410 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:55:53.229731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-895874e3-929c-4c06-9911-7deac32dd9b8 req-72f54f60-88a0-4b45-947b-533139c6b17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "name": "network-vif-plugged", "status": "completed", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:53.246798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-895874e3-929c-4c06-9911-7deac32dd9b8 req-72f54f60-88a0-4b45-947b-533139c6b17a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:53.248019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-895874e3-929c-4c06-9911-7deac32dd9b8 req-72f54f60-88a0-4b45-947b-533139c6b17a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:53.298645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-895874e3-929c-4c06-9911-7deac32dd9b8 req-72f54f60-88a0-4b45-947b-533139c6b17a service nova] Creating event network-vif-plugged:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:55:53.312341 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-895874e3-929c-4c06-9911-7deac32dd9b8 req-72f54f60-88a0-4b45-947b-533139c6b17a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090980 Jul 18 12:55:53.319965 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 558/1111] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:55:53.345912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:53.348407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:53.368862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:53.371828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:53.384365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:53.386933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:54.447366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:54.465834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54a6d624-551f-4d43-a7f3-8ae86cc58ade tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 1.132544 Jul 18 12:55:54.466996 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 559/1112] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:53 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:54.491018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:54.491650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:54.516090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:54.516467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:54.517509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:54.518131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:54.916008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:54.954402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bdaec5f9-02a3-4206-a2e3-82f9c54b4d90 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.483098 Jul 18 12:55:54.969793 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 560/1113] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:54 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:54.986262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:55.005972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:55.023362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:55.026468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:55.027966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:55.028781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:55.342341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0700c7a3-f92d-4f1b-a9e3-97acd69a24bd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action" status: 202 len: 0 microversion: 2.1 time: 4.539357 Jul 18 12:55:55.347130 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 554/1114] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:55:50 2022] POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action => generated 0 bytes in 4552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:55:55.419145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1517986129", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a2b23f64-8625-4abc-b8a7-29a85519282b"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:55.754833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:55.818446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:55.888315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=23 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:56.257626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:55:56.267244 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d5a9b7d-e4b2-45a1-89b7-1330233280a1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 1.291374 Jul 18 12:55:56.278729 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 561/1115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:55:54 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:55:56.575941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1779454713", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "86e3abd6-5f45-4131-86ad-fd94f18b600e"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:55:56.775239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] validate_networks() for [('86e3abd6-5f45-4131-86ad-fd94f18b600e', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:55:58.975395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:58.976193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:58.976650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:58.977737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:58.978792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:59.023623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.028936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.032423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.043241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.098867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:55:59.153745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:59.192818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Getting quotas for user aa0e495ea3444c9492a9c8127639ff02 and project ec5ae8b0e4194582a61a4de63f742bbd. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:59.256624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:59.261135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:55:59.429678 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c647b0db-f64f-4ca2-80fb-f08e90bb3c54 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.077542 Jul 18 12:55:59.431871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 555/1116] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:55:59.455186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:55:59.456611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:55:59.509725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.518054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.520093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.520940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.749259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:55:59.750137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:55:59.750496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:55:59.751279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:55:59.751870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:55:59.781205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.782012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.783569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:55:59.784888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:55:59.876341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:55:59.906791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for user 719f068839494e66b2eb68285ef22214 and project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:55:59.975134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:55:59.982417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:56:00.164527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b1d5bd7b-401e-43fb-9db9-db99cf35e53b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.883052 Jul 18 12:56:00.181818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 562/1117] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:56:00.211130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e8dd44a3-678e-47f6-91f9-73b8dd5bb0d9 req-8901d78f-8add-4920-b8ea-4e52067e2b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:00.253948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e8dd44a3-678e-47f6-91f9-73b8dd5bb0d9 req-8901d78f-8add-4920-b8ea-4e52067e2b77 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:00.258451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e8dd44a3-678e-47f6-91f9-73b8dd5bb0d9 req-8901d78f-8add-4920-b8ea-4e52067e2b77 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:00.276033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:00.358824 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e8dd44a3-678e-47f6-91f9-73b8dd5bb0d9 req-8901d78f-8add-4920-b8ea-4e52067e2b77 service nova] Creating event network-changed:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:56:00.414394 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e8dd44a3-678e-47f6-91f9-73b8dd5bb0d9 req-8901d78f-8add-4920-b8ea-4e52067e2b77 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228304 Jul 18 12:56:00.421779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 563/1118] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:00.460064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e45d64c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:01.648555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:01.702675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:01.710923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:01.720455 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f73fa58-8f7d-4583-9322-958fea84e783 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1605 microversion: 2.25 time: 2.285080 Jul 18 12:56:01.743319 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 556/1119] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:55:59 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1605 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:56:01.763105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7c76519d-cf63-4e92-a6ab-5022e2a98b4c req-8e6c4235-00ff-49e6-a095-1d0c1b30d164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159b8bb3-5ab9-4e89-9a03-082494cb3b03", "tag": "d8a6952f-435a-4523-bab0-66e849fbd529"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:01.783306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7c76519d-cf63-4e92-a6ab-5022e2a98b4c req-8e6c4235-00ff-49e6-a095-1d0c1b30d164 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:01.784672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7c76519d-cf63-4e92-a6ab-5022e2a98b4c req-8e6c4235-00ff-49e6-a095-1d0c1b30d164 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:01.804706 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7c76519d-cf63-4e92-a6ab-5022e2a98b4c req-8e6c4235-00ff-49e6-a095-1d0c1b30d164 service nova] Creating event network-changed:d8a6952f-435a-4523-bab0-66e849fbd529 for instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 on n-h2-850003-3 Jul 18 12:56:01.811898 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7c76519d-cf63-4e92-a6ab-5022e2a98b4c req-8e6c4235-00ff-49e6-a095-1d0c1b30d164 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064994 Jul 18 12:56:01.813813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 557/1120] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:01.825911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:01.827994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:01.842527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:01.843994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:01.866967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:01.867998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.252099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:02.275076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6774f210-49ed-4e14-8adc-26368940b79f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.458678 Jul 18 12:56:02.277547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 558/1121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:01 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:02.297808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:02.299259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:02.309783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.310346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.311398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.311847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.459519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use.", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:56:02.460885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.460885 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5 HTTP/1.1 Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:56:02.466328 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: exception: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.469057 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '31482db7-9e0d-4538-9950-e78c70b9c5a5'} Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:02.470304 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.473294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:02.477406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] Jul 18 12:56:02.481863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:02.486015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 400 to user: Security Group 31482db7-9e0d-4538-9950-e78c70b9c5a5 in use. Jul 18 12:56:02.486015 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-f7222c9e-84dc-43fb-9a6f-0f6375366fe2'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:02.486015 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db100add-b221-4740-8bbf-4ad0348e3230 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5" status: 400 len: 185 microversion: 2.1 time: 2.054015 Jul 18 12:56:02.486818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 564/1122] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:56:00 2022] DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5 => generated 185 bytes in 2064 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:56:02.496853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:02.499548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:02.511559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.512318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.513888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.514471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.559473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:02.575993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-722adb9b-13a9-4105-ae5f-02f545e584b7 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.295058 Jul 18 12:56:02.577052 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 559/1123] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:02 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:02.585890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:02.587901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:02.598301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.599359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.600517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.601318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.729805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:02.750114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae34358c-6734-4c75-90a1-11ed1c0b3742 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1269 microversion: 2.1 time: 0.170461 Jul 18 12:56:02.751401 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 560/1124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:02 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:02.761105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:02.762747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:02.780719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.782130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.784155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.784155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.947708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:02.959950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-44b39644-fcd5-4cdf-a4ea-50256b439f14 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1260 microversion: 2.1 time: 0.207040 Jul 18 12:56:02.960559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 561/1125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:02 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:02.969611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:02.970529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:02.971590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:02.982179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.983003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.984378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:02.985072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:02.985697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-516b2943-7382-4220-9ec8-6bcaa16a33d8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.496647 Jul 18 12:56:02.986757 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 565/1126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:02 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:02.995752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:02.997537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.002578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:03.009095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.009786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.011615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.011753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.120995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a4549f3-c76e-44b2-afce-9d2e5cae0e5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.158543 Jul 18 12:56:03.122416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 562/1127] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 12:56:02 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:56:03.130801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc2e52d-320e-4cf4-9862-13a127a27792", "tag": "2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b"}, {"name": "network-changed", "server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}, {"name": "network-changed", "server_uuid": "7805837f-6fe5-4d53-ab51-97da89093a2b", "tag": "2b2b6b25-d54a-4b97-897c-ad2e17314ad2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:03.135138 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a2d90f4-4a1f-4d6d-a705-36f09baadba6 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action" status: 202 len: 0 microversion: 2.1 time: 0.145339 Jul 18 12:56:03.136520 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 566/1128] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:02 2022] POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:03.149567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:03.150776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.151187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.152274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.160213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.160841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.162980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.163582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.182028 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Creating event network-changed:2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b for instance ffc2e52d-320e-4cf4-9862-13a127a27792 on n-h1-850003-3 Jul 18 12:56:03.183077 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Creating event network-changed:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:56:03.183972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] Creating event network-changed:2b2b6b25-d54a-4b97-897c-ad2e17314ad2 for instance 7805837f-6fe5-4d53-ab51-97da89093a2b on n-h1-850003-3 Jul 18 12:56:03.195989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-aa0ca692-5ba5-490f-bfda-0dea20051bbc req-db80272e-0c63-40c5-bf43-d5bda7130286 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.070817 Jul 18 12:56:03.197454 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 563/1129] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:03.305816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:03.305816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.317677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.319104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.320946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.322535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.471374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:03.483538 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f940ac7d-870f-4940-8e1a-c883704485ab tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.339617 Jul 18 12:56:03.484912 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 567/1130] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:03 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:03.597479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:03.598101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.606075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.606636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.607892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.608685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.729654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:03.738911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e9a5aff-19b9-49d8-bb46-969e853afdb3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.441769 Jul 18 12:56:03.740453 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 564/1131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:03 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:03.786760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:03.787951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.801198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.802137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.804069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.805740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.829228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:03.844027 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffd7f964-a623-4b1a-81c2-3fbdf4c2e0e6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.250384 Jul 18 12:56:03.852700 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 568/1132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:03 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:03.942983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:03.954218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0350d446-5f33-4538-848b-105d3957150f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1269 microversion: 2.1 time: 0.177326 Jul 18 12:56:03.957921 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 565/1133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:03 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:03.981535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:03.982139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:03.991130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.991581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:03.992792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:03.995057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.009774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:04.011346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:04.019517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.019831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.020563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.021030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.108444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:04.119865 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8945b9b1-a168-4bec-95b5-2406da0fe818 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1268 microversion: 2.1 time: 0.143424 Jul 18 12:56:04.121008 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 569/1134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:03 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:04.126935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-14576b72-41f9-433f-b50c-c3456fee13e8 req-ead81d74-5b57-47fd-bab0-c65dd9f68249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f286e531-2428-42a1-8950-b0316d43558a", "tag": "d8d922a6-7c2a-4a97-a885-bebbea00d6f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:04.137278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14576b72-41f9-433f-b50c-c3456fee13e8 req-ead81d74-5b57-47fd-bab0-c65dd9f68249 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.137722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14576b72-41f9-433f-b50c-c3456fee13e8 req-ead81d74-5b57-47fd-bab0-c65dd9f68249 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.160075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-14576b72-41f9-433f-b50c-c3456fee13e8 req-ead81d74-5b57-47fd-bab0-c65dd9f68249 service nova] Creating event network-changed:d8d922a6-7c2a-4a97-a885-bebbea00d6f7 for instance f286e531-2428-42a1-8950-b0316d43558a on n-h2-850003-3 Jul 18 12:56:04.167928 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-14576b72-41f9-433f-b50c-c3456fee13e8 req-ead81d74-5b57-47fd-bab0-c65dd9f68249 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045172 Jul 18 12:56:04.169425 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 570/1135] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:04.357654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:04.370617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c588dbad-fa43-45d6-b64f-a3c5d876d44d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.364654 Jul 18 12:56:04.372265 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 566/1136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:04 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:04.506352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:04.507481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:04.523648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.524926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.526313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.530963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.772468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:04.774305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:04.796520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.797555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:04.802376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:04.805579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.388409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:05.412258 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c34a65aa-3ee9-46a0-aae3-0d5beabe1fc1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.912899 Jul 18 12:56:05.427907 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 571/1137] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:04 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:05.441295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:05.442858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:05.463205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.464544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.466674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.467961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.689705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:05.712123 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb0dfbfb-f08a-44c9-94ec-f4db45bff138 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.948743 Jul 18 12:56:05.714545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 567/1138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:04 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:05.726191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:05.727613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:05.736202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.736757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.738346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.739057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.890938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:05.909855 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-225894b4-d138-452a-97b2-1d16e222c713 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1269 microversion: 2.1 time: 0.192019 Jul 18 12:56:05.913294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 568/1139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:05 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:05.923744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:05.924925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:05.937279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.938573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:05.940441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:05.941658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.101896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:06.123730 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c4ede9e0-1707-44a5-9e83-aa04b716b624 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.692532 Jul 18 12:56:06.135404 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 572/1140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:05 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:06.141331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:06.141992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:06.164234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.165034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.166031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:06.166524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.167330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.194330 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-796823db-92cb-4e3e-b289-af0c0fbcde87 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1266 microversion: 2.1 time: 0.278290 Jul 18 12:56:06.206400 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 569/1141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:05 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:06.213465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8004abc6-49ac-49c5-b03c-07eef1263f79 req-915bd922-a034-4eae-8137-35ff0310936e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b8bb3-5ab9-4e89-9a03-082494cb3b03", "name": "network-vif-plugged", "status": "completed", "tag": "d8a6952f-435a-4523-bab0-66e849fbd529"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:06.230692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8004abc6-49ac-49c5-b03c-07eef1263f79 req-915bd922-a034-4eae-8137-35ff0310936e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.231702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8004abc6-49ac-49c5-b03c-07eef1263f79 req-915bd922-a034-4eae-8137-35ff0310936e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.257567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8004abc6-49ac-49c5-b03c-07eef1263f79 req-915bd922-a034-4eae-8137-35ff0310936e service nova] Creating event network-vif-plugged:d8a6952f-435a-4523-bab0-66e849fbd529 for instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 on n-h2-850003-3 Jul 18 12:56:06.269514 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8004abc6-49ac-49c5-b03c-07eef1263f79 req-915bd922-a034-4eae-8137-35ff0310936e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060276 Jul 18 12:56:06.271281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 570/1142] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:06.288318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c5e3fff1-cf49-44a4-a03b-6395cabc9969 req-edabed65-679d-4661-a61f-3b834dbd2dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:06.305468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c5e3fff1-cf49-44a4-a03b-6395cabc9969 req-edabed65-679d-4661-a61f-3b834dbd2dd1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.306203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c5e3fff1-cf49-44a4-a03b-6395cabc9969 req-edabed65-679d-4661-a61f-3b834dbd2dd1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.326991 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c5e3fff1-cf49-44a4-a03b-6395cabc9969 req-edabed65-679d-4661-a61f-3b834dbd2dd1 service nova] Creating event network-changed:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:56:06.333849 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c5e3fff1-cf49-44a4-a03b-6395cabc9969 req-edabed65-679d-4661-a61f-3b834dbd2dd1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053730 Jul 18 12:56:06.336334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 571/1143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:06.453590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:06.455551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:06.471061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.473351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.475121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.475981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.670820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:06.693432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4dcaabc4-5dc1-43a6-94c0-757e6ae46054 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.556361 Jul 18 12:56:06.713126 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 573/1144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:06 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:06.748865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:06.751732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:06.765439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.766766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.769058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.770119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.844295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:06.858486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c64221dd-722e-4d38-9d46-e9c7eee9565a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.413278 Jul 18 12:56:06.859409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 572/1145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:06 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:06.929041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:06.930719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:06.937799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.938332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:06.939132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:06.939567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.064822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:07.088259 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98696085-2070-4d5c-9ca5-75eb070cdcf2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1269 microversion: 2.1 time: 0.162407 Jul 18 12:56:07.088909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 573/1146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:06 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:07.155540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:07.155540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:07.159718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:07.175915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.176947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.178766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.179959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.190637 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8e3b51b-b602-4cf8-ad29-ffc58ab913e3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.460242 Jul 18 12:56:07.192717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 574/1147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:06 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:07.231024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:07.234259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:07.260476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.263405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.264961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.268747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.493312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:07.509545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-872d186a-7cd4-4e41-8964-055c464237a0 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.368084 Jul 18 12:56:07.523431 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 574/1148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:07 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:07.659109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:07.680103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1f98bffd-6023-4f9a-bdec-37e8908861dd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.467215 Jul 18 12:56:07.682070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 575/1149] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:07 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:07.727974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:07.729705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:07.746834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.748000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.749825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.750967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.803300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:07.882368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:07.882874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:07.901978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.903935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:07.908115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:07.911739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:08.389973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:08.417553 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-31ef2413-d92d-4a8e-892a-301c850d3d96 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.543617 Jul 18 12:56:08.429431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 576/1150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:07 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:08.438773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:08.450557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:08.474406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:08.480473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:08.482375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:08.483542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:08.694050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:08.713339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a1aec16-ab7a-4278-96e5-2cdd31630b02 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1318 microversion: 2.1 time: 0.993274 Jul 18 12:56:08.721208 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 575/1151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:07 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:08.747837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:08.748820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:08.766553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:08.768102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:08.770493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:08.771606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:08.911627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:08.930951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c878064e-daf4-44ed-93d0-ea6c0407f9ca tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1269 microversion: 2.1 time: 0.499483 Jul 18 12:56:08.937458 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 577/1152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:08 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1269 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:08.957147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:08.965974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:08.995770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:09.001658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:09.007591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:09.011614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:09.099404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:09.216156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:09.602624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:09.623045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6de8435b-40f5-4979-b9b9-387e4a3ae020 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.899549 Jul 18 12:56:09.641002 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 576/1153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:08 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:09.655622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:09.659633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:09.677020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:09.677751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:09.681622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:09.682094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:09.843167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:09.949386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:10.032419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:10.041565 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-681842c5-f31a-48bb-b373-d8be5e05d143 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.398898 Jul 18 12:56:10.042656 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 577/1154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:09 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:10.090449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:10.091512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:10.095510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:10.111991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3104af32-d35c-4e10-a19a-1d940cd20d13 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 1.170288 Jul 18 12:56:10.119043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.119816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.121294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.122097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.126492 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 578/1155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:08 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:10.145763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-21659260-b629-4d8f-af08-4a89ae29dc1a req-4dc28622-6979-40df-ab6c-eda3ea59a12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-plugged", "status": "completed", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:10.174558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21659260-b629-4d8f-af08-4a89ae29dc1a req-4dc28622-6979-40df-ab6c-eda3ea59a12f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.177034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21659260-b629-4d8f-af08-4a89ae29dc1a req-4dc28622-6979-40df-ab6c-eda3ea59a12f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.204906 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-21659260-b629-4d8f-af08-4a89ae29dc1a req-4dc28622-6979-40df-ab6c-eda3ea59a12f service nova] Creating event network-vif-plugged:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:56:10.216883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-21659260-b629-4d8f-af08-4a89ae29dc1a req-4dc28622-6979-40df-ab6c-eda3ea59a12f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082269 Jul 18 12:56:10.219245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 579/1156] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:10.233090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:10.235629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:10.251669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.253720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.255602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.257210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.631291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:10.646201 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-492a1cfa-fcff-44ba-93bb-434a22a15bea tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.560145 Jul 18 12:56:10.647511 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 578/1157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:10 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:10.658422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:10.658422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:10.668873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.669586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.671046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.671894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.785245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:10.796028 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-735551b7-9caf-4449-81af-b1b20ff4ac7f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1275 microversion: 2.1 time: 0.147306 Jul 18 12:56:10.796694 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 579/1158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:10 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:10.802677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:10.803703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:10.814030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.814788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:10.816245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:10.816774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.083504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.104611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02f5907d-614a-46c6-b270-4c483b207410 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.306642 Jul 18 12:56:11.119396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 580/1159] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:10 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:11.126867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:11.132932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:11.134218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.150220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.151823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.152751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.153501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.173593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a893e07-280d-40f7-a1a9-f1fbd233a1c6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1468 microversion: 2.1 time: 0.951433 Jul 18 12:56:11.175349 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 580/1160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:10 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1468 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:11.185678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:11.187345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:11.202871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.203745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.205533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.206843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.490922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.509295 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad2f0814-4fd9-4922-8582-2c50596faa78 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.387651 Jul 18 12:56:11.511094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 581/1161] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:11 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:11.530777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:11.533209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:11.547099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.547978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.550427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.550427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.802123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.810290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:11.819970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.830202 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37a81245-6760-4cc2-9289-3aad30dff803 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.652803 Jul 18 12:56:11.831009 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64ec83ba-caaf-4dcc-b2d7-10a69ba6407a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1318 microversion: 2.1 time: 0.317931 Jul 18 12:56:11.832176 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 581/1163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:11 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:11.841503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:11.842983 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 582/1163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:11 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:11.843138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:11.849490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:11.850494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:11.856815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.858046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.858531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.859071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.860116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.861075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:11.861379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.862619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:11.965190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:11.978514 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a896f660-f318-40e5-bae9-5056924c742f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1275 microversion: 2.1 time: 0.133515 Jul 18 12:56:11.979140 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 583/1164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:11 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:12.128237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:12.129182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:12.140128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.141055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.142615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.144078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.387388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:12.405255 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60c4464a-e20e-4f2f-aa1b-bd4e1c59236f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.282237 Jul 18 12:56:12.407145 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 584/1165] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:12 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:12.416795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-909809da-1cae-4381-98b6-34437d73814a req-dd8f4fbb-3265-4472-b363-2cea01281729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f286e531-2428-42a1-8950-b0316d43558a", "name": "network-vif-plugged", "status": "completed", "tag": "d8d922a6-7c2a-4a97-a885-bebbea00d6f7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:12.443331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-909809da-1cae-4381-98b6-34437d73814a req-dd8f4fbb-3265-4472-b363-2cea01281729 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.444002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-909809da-1cae-4381-98b6-34437d73814a req-dd8f4fbb-3265-4472-b363-2cea01281729 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.468201 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-909809da-1cae-4381-98b6-34437d73814a req-dd8f4fbb-3265-4472-b363-2cea01281729 service nova] Creating event network-vif-plugged:d8d922a6-7c2a-4a97-a885-bebbea00d6f7 for instance f286e531-2428-42a1-8950-b0316d43558a on n-h2-850003-3 Jul 18 12:56:12.478079 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-909809da-1cae-4381-98b6-34437d73814a req-dd8f4fbb-3265-4472-b363-2cea01281729 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068712 Jul 18 12:56:12.480329 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 585/1166] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:12.492753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3a47127a-8ab3-4e32-94d3-fbf143745913 req-04cdfe5a-2e03-4387-857f-dc39dc87f754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec16fe0-4afc-4b20-a744-862055abbf0d", "tag": "91362955-13dd-4ed5-a4d4-1ecf684232c1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:12.493089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:12.517459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a47127a-8ab3-4e32-94d3-fbf143745913 req-04cdfe5a-2e03-4387-857f-dc39dc87f754 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.519579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a47127a-8ab3-4e32-94d3-fbf143745913 req-04cdfe5a-2e03-4387-857f-dc39dc87f754 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.532140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5676654-88dc-4bdf-9b3e-69ed3075e044 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.688772 Jul 18 12:56:12.543260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3a47127a-8ab3-4e32-94d3-fbf143745913 req-04cdfe5a-2e03-4387-857f-dc39dc87f754 service nova] Creating event network-changed:91362955-13dd-4ed5-a4d4-1ecf684232c1 for instance 4ec16fe0-4afc-4b20-a744-862055abbf0d on n-h2-850003-3 Jul 18 12:56:12.553433 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 582/1167] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:11 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:12.554104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3a47127a-8ab3-4e32-94d3-fbf143745913 req-04cdfe5a-2e03-4387-857f-dc39dc87f754 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070539 Jul 18 12:56:12.561564 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 586/1168] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:12.569196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:12.570709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:12.583571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.584824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.586633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.589672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.855991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:12.857392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:12.866383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:12.874188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.874188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:12.876074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:12.876074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.295352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:13.317373 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae5f78de-d511-4225-bab8-6663801ef582 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.468157 Jul 18 12:56:13.320134 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 587/1169] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:12 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:13.330387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:13.332394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:13.349191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.350223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.353380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.354360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.404829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:13.423658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-508895c8-11b8-4ff3-aa20-c173598fed4e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.867254 Jul 18 12:56:13.434266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 583/1170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:12 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:13.444781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:13.444781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:13.454491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.455904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.457865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.457865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.633529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:13.648178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6dcc7db-5454-4f96-95af-0de1c2c2e4df tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1318 microversion: 2.1 time: 0.325217 Jul 18 12:56:13.650122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 588/1171] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:13 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:13.677406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:13.679265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:13.691132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.692047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.693721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.694656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.719856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:13.737870 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-549fba25-970b-4ce1-92c8-f7386202a072 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.308991 Jul 18 12:56:13.738573 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 584/1172] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:13 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:13.746139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:13.748044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:13.760538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.761436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:13.762918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:13.767184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.279420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:14.294731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de7585f6-adc7-4398-a62a-dd4ab8281583 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.643920 Jul 18 12:56:14.295853 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 589/1173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:13 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:14.349763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:14.352878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:14.365335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.365335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.365335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.365335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.426367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:14.438989 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8526af48-395b-4e48-9949-9d5ac595351c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.698759 Jul 18 12:56:14.440020 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 585/1174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:13 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:14.460971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:14.462242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:14.472148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.472685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.474173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.475209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.645417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:14.674561 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b65b1597-fa09-4338-ae42-0380cb778ad2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.327201 Jul 18 12:56:14.677872 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 590/1175] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:14 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:14.723182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-01105256-2473-4966-a77f-67877d8ed796 req-f428d08b-838f-4b5c-94d3-cab8bd477658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "name": "network-vif-plugged", "status": "completed", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:14.753722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-01105256-2473-4966-a77f-67877d8ed796 req-f428d08b-838f-4b5c-94d3-cab8bd477658 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.754529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-01105256-2473-4966-a77f-67877d8ed796 req-f428d08b-838f-4b5c-94d3-cab8bd477658 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.790218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-01105256-2473-4966-a77f-67877d8ed796 req-f428d08b-838f-4b5c-94d3-cab8bd477658 service nova] Creating event network-vif-plugged:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:56:14.801913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-01105256-2473-4966-a77f-67877d8ed796 req-f428d08b-838f-4b5c-94d3-cab8bd477658 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099109 Jul 18 12:56:14.803390 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 591/1176] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:14.825558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:14.828061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:14.842949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.844497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:14.848305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:14.849620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.127355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:15.145819 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b2c4784-d18e-4ff1-a12d-6fc76a695cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.694352 Jul 18 12:56:15.155713 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 586/1177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:14 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:15.176342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:15.177994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:15.192717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.193673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.195333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.197582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.551562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:15.579616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ddef9c5f-1f7d-4c57-801e-dddf689fc8e9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1318 microversion: 2.1 time: 0.772260 Jul 18 12:56:15.601783 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 592/1178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:14 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:15.614021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:15.615178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:15.630498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.631903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.634197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.635322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.676041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:15.694802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d74c8ef9-bc3c-440f-a606-3fb79c71e9a9 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.531008 Jul 18 12:56:15.698987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 587/1179] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:15 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:15.728987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:15.729628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:15.739150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.739902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:15.740717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:15.741271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.055774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:16.076381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ceb4a32-0bf8-4f62-9b37-3cbc69c90fc0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1313 microversion: 2.1 time: 0.470276 Jul 18 12:56:16.076381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 593/1180] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:15 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:16.086497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:16.088949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:16.100402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.101486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.103028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.103797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.110013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:16.336489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05bfa069-e76b-4e33-9784-8a7f2ce95970 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1859 microversion: 2.1 time: 0.258906 Jul 18 12:56:16.337285 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 594/1181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:16 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1859 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:16.343639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:16.344427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:16.352928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.353554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.355266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.355506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.409453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:16.431785 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7b387b2-467a-4b05-a55a-b1480a29b0ce tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.719839 Jul 18 12:56:16.433486 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 588/1182] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:15 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:16.452250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:16.453554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:16.465239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.466176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.467809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.468703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.640688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:16.658247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8bb6c28d-155a-4426-afee-f516d625acd1 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.319092 Jul 18 12:56:16.659423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 595/1183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:16 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:16.668731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:16.671381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:16.683425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.684239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.685388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.686006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.734235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lazy-loading 'flavor' on Instance uuid b90439a2-8727-45d4-98f7-1aef41b30c9c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:56:16.756758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131366) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:56:16.787956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:16.804972 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32bf8bd6-1fd9-4ef1-9315-6ec80cba9d20 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.369869 Jul 18 12:56:16.806196 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 589/1184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:16 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:16.816534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:16.818091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:16.831298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.832975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:16.834378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:16.835263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.113569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:17.137397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-303fefec-7199-4271-8272-4772c93391a9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1318 microversion: 2.1 time: 0.328969 Jul 18 12:56:17.138961 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 590/1185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:16 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:17.148991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3e278eef-b484-4ef1-9716-1a058d51912d req-ad1e3f9b-bc70-4898-8571-30c6647ca89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21f3f70-5851-4367-a476-f5898c61bbef", "tag": "f896abf5-db39-468c-a88d-c079dc41392c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:17.166352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3e278eef-b484-4ef1-9716-1a058d51912d req-ad1e3f9b-bc70-4898-8571-30c6647ca89f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.167528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3e278eef-b484-4ef1-9716-1a058d51912d req-ad1e3f9b-bc70-4898-8571-30c6647ca89f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.189506 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3e278eef-b484-4ef1-9716-1a058d51912d req-ad1e3f9b-bc70-4898-8571-30c6647ca89f service nova] Creating event network-changed:f896abf5-db39-468c-a88d-c079dc41392c for instance e21f3f70-5851-4367-a476-f5898c61bbef on n-h1-850003-3 Jul 18 12:56:17.197028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3e278eef-b484-4ef1-9716-1a058d51912d req-ad1e3f9b-bc70-4898-8571-30c6647ca89f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055360 Jul 18 12:56:17.198361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 591/1186] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:17.210923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:17.212380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:17.225062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.226058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.227648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.228428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.540045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:17.566801 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76a9cca8-5538-4d14-a87c-484e0876e4a0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.365824 Jul 18 12:56:17.576744 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 592/1187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:17 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:17.578202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:17.579841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:17.590046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.590914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.592100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.592742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.863419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:17.887504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-440e9a50-7a4b-4015-9516-2fed4c8e3100 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1462 microversion: 2.1 time: 0.315854 Jul 18 12:56:17.888592 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 593/1188] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:17 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1462 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:17.898545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:17.899671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:17.914107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.915015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:17.916809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:17.917600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:18.769778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:18.808361 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc48e214-bbde-4156-84d1-6447b4962f57 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.917410 Jul 18 12:56:18.826436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 594/1189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:17 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:18.858467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:18.860307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:18.885783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:18.887336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:18.889956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:18.894185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:19.847153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:19.868319 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db3cc91f-784d-4f01-a230-73805e629e4d tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 1.038979 Jul 18 12:56:19.870568 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 595/1190] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:18 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:19.880861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:19.882479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:19.894192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:19.894946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:19.896262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:19.896893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:20.869321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:20.884983 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e77988b-e909-4e29-a2ba-68369279609f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 1.011836 Jul 18 12:56:20.886137 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 596/1191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:19 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:20.898262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:20.899428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:20.911411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:20.912237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:20.913713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:20.914576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:21.663824 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-221aa6a8-1a60-4b5c-9939-c2704fe8554c tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/action" status: 202 len: 0 microversion: 2.1 time: 5.000526 Jul 18 12:56:21.666389 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 596/1192] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:16 2022] POST /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/action => generated 0 bytes in 5006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:21.680690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:21.683860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:21.708364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:21.711022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:21.713066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:21.714313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.043348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:22.058337 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76d5ff0a-6026-4188-a0b9-58fca65ffb10 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1468 microversion: 2.1 time: 0.389519 Jul 18 12:56:22.059197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 597/1193] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:21 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:22.073654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:22.075329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:22.085712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.086302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.087321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.087865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.327108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:22.342044 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd6df2a6-2130-4ee8-9af6-4212d7a3fe31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.279421 Jul 18 12:56:22.343143 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 598/1194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:22 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:22.351598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:22.352753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:22.362176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.362746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.364462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.365030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.505332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:22.527092 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fceb6fd2-5f21-4fc9-ab79-63d52e925fe6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1462 microversion: 2.1 time: 1.636563 Jul 18 12:56:22.543608 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 597/1195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:20 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1462 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:22.595720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-55445ea2-ae5a-4837-9725-59ff461bad36 req-dcb54a3d-c12a-493b-9ca8-68c07822812b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7805837f-6fe5-4d53-ab51-97da89093a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2b2b6b25-d54a-4b97-897c-ad2e17314ad2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:22.646965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-55445ea2-ae5a-4837-9725-59ff461bad36 req-dcb54a3d-c12a-493b-9ca8-68c07822812b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.655396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-55445ea2-ae5a-4837-9725-59ff461bad36 req-dcb54a3d-c12a-493b-9ca8-68c07822812b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.729665 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-55445ea2-ae5a-4837-9725-59ff461bad36 req-dcb54a3d-c12a-493b-9ca8-68c07822812b service nova] Creating event network-vif-plugged:2b2b6b25-d54a-4b97-897c-ad2e17314ad2 for instance 7805837f-6fe5-4d53-ab51-97da89093a2b on n-h1-850003-3 Jul 18 12:56:22.741353 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-55445ea2-ae5a-4837-9725-59ff461bad36 req-dcb54a3d-c12a-493b-9ca8-68c07822812b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195089 Jul 18 12:56:22.742475 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 598/1196] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:22.749622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:22.761837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:22.763204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:22.768924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f5785a0-a6b1-4de6-8f96-6e0df2f4e9be tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1574 microversion: 2.1 time: 0.423919 Jul 18 12:56:22.774938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.775738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.777187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.778174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.793906 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 599/1197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:22 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1574 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:22.804619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:22.806232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:22.821414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.822852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:22.824646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:22.825863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:23.139249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:23.157039 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b7f0d0f-27cd-445e-88f0-b689e1ad2c29 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.359946 Jul 18 12:56:23.166322 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 600/1198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:22 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:23.175406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:23.176364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:23.192949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:23.192949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:23.192949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:23.198480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:23.366942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:23.372182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:23.395556 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bed8e5b9-374a-4865-a242-6abb51ed311e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.640230 Jul 18 12:56:23.404382 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 599/1199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:22 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:23.426682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1512422763"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:23.429813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:23.444808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:23.448577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:23.450074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:23.450998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:23.503695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:23.528479 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87214536-78bc-419f-9bb1-3d1f7017b983 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.360038 Jul 18 12:56:23.530862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 601/1200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:23 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:23.544085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-536726967", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3f449d36-c7ef-420a-8b0e-33e6714f464c"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:23.659706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:56:24.073694 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9cbc2762-f946-4622-8fab-cd0821086320 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "POST /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998/action" status: 202 len: 0 microversion: 2.1 time: 0.664957 Jul 18 12:56:24.075708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 600/1201] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:23 2022] POST /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 12:56:24.086571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.088492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:24.101030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:56:24.101871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.102039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:56:24.103212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.103399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:56:24.103558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.103972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.104257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:56:24.105092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:56:24.125021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.125764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.128446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.129357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.166042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:56:24.177747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Getting quotas for user 3ddc9f824baa4ae99c78a313c3446568 and project 04af0ec2bbba40768fd3348e0d869485. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:56:24.203250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:56:24.207977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:56:24.292018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-749ef981-09eb-41fb-b20b-62ff22ed3820 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757182 Jul 18 12:56:24.302494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 602/1202] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:56:24.307510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.308188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:24.331679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.331679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.333092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.333933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.420768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:24.443563 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7fa300c3-037b-41de-8b3e-28b00d05ef31 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.363426 Jul 18 12:56:24.459444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 601/1203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:24.468598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e918fbda-0eba-4fe6-910f-f526551b04d4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4567550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.557646 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e918fbda-0eba-4fe6-910f-f526551b04d4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.096494 Jul 18 12:56:24.558981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 602/1204] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:24.568175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.576895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:24.578632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.579061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.582067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.583353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.671489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:24.697667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fab968a5-d69f-45f1-b109-83c94b074a3c tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1572 microversion: 2.1 time: 0.401127 Jul 18 12:56:24.698550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 603/1205] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1572 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:24.720645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-153dfca8-7be3-4311-88d2-dbb6dcf58dc6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.722331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-153dfca8-7be3-4311-88d2-dbb6dcf58dc6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:24.871819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-153dfca8-7be3-4311-88d2-dbb6dcf58dc6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:24.901600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-153dfca8-7be3-4311-88d2-dbb6dcf58dc6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1213 microversion: 2.1 time: 0.195466 Jul 18 12:56:24.903281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 604/1206] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:24.914955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:24.917521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:24.933089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.935013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.937816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:24.939523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:24.989718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:25.006683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa2ed9a5-4c26-4388-943f-224dc8405f59 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.446252 Jul 18 12:56:25.008282 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 603/1207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:25.017962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:25.019441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:25.033820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.035478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.037551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.038693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.325053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:25.342898 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3414d2d-61fc-443c-bb9f-9f21855282b6 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.436864 Jul 18 12:56:25.345291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 605/1208] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:24 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:25.354633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1994912106"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:25.355761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:25.370777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.371707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.374559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.375547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.426992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:25.444876 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-076af5df-6c9c-481a-bb6e-d9d66391b03f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.433182 Jul 18 12:56:25.447269 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 604/1209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:25 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:25.484540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:25.486248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:25.500262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.501435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.503299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.504864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:25.693923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.network.security_group_api [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Adding security group 0c84c611-2982-4422-8478-27d047599887 to port 2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b Jul 18 12:56:25.818309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:25.837626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bbfb5848-db52-4513-82e6-382ffd60ad7e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.364474 Jul 18 12:56:25.839518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 605/1210] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:25 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:25.858115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4cc0d9aa-9fd7-41ca-85c7-f9d8e4ebbff1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45669d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:25.954028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4cc0d9aa-9fd7-41ca-85c7-f9d8e4ebbff1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.112616 Jul 18 12:56:25.961728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 606/1211] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:25 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:25.971459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a633371c-a961-45f4-956e-82e882500674 req-56d8255b-5174-40b8-ab65-a147432daf9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec16fe0-4afc-4b20-a744-862055abbf0d", "name": "network-vif-plugged", "status": "completed", "tag": "91362955-13dd-4ed5-a4d4-1ecf684232c1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:25.992532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a633371c-a961-45f4-956e-82e882500674 req-56d8255b-5174-40b8-ab65-a147432daf9f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:25.993634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a633371c-a961-45f4-956e-82e882500674 req-56d8255b-5174-40b8-ab65-a147432daf9f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.029961 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a633371c-a961-45f4-956e-82e882500674 req-56d8255b-5174-40b8-ab65-a147432daf9f service nova] Creating event network-vif-plugged:91362955-13dd-4ed5-a4d4-1ecf684232c1 for instance 4ec16fe0-4afc-4b20-a744-862055abbf0d on n-h2-850003-3 Jul 18 12:56:26.041605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a633371c-a961-45f4-956e-82e882500674 req-56d8255b-5174-40b8-ab65-a147432daf9f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077222 Jul 18 12:56:26.042779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 607/1212] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:26.051363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:26.052526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:26.063905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.064757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.066320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.068314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.246437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:26.261929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26090bd5-d56a-4734-8ae3-d61e02437c58 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1217 microversion: 2.1 time: 0.217209 Jul 18 12:56:26.263573 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 608/1213] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:26 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:26.273395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:26.275026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:26.288983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.290215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.291492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.292334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.653307 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-129c56b6-0ba6-4c58-b43c-f97450a73467 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action" status: 202 len: 0 microversion: 2.1 time: 1.305853 Jul 18 12:56:26.655875 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 606/1214] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:25 2022] POST /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:26.665893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:26.673663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:26.679281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:26.698679 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-498fc571-bccb-430f-8e75-dec7dbfccecf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.429171 Jul 18 12:56:26.700502 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 609/1215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:26 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:26.722192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.722925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.724417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.725221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.731911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:26.742806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:26.758734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.765648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:26.775369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:26.777484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.059547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:27.082531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef21bb6e-a470-4810-8f54-a820af7c4f01 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.423975 Jul 18 12:56:27.084330 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 607/1216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:26 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:27.095965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e462c670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.224875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:27.241312 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4017ae2e-d87a-436a-bb80-16be91ef3eac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.539595 Jul 18 12:56:27.243408 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 610/1217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:26 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:27.254905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a5cf3ef0-44d9-48c9-ac46-3cf57a7b70a5 req-82b60d4d-c391-43e8-a688-90cf10622ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc2e52d-320e-4cf4-9862-13a127a27792", "tag": "2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:27.271034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a5cf3ef0-44d9-48c9-ac46-3cf57a7b70a5 req-82b60d4d-c391-43e8-a688-90cf10622ed8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.272228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a5cf3ef0-44d9-48c9-ac46-3cf57a7b70a5 req-82b60d4d-c391-43e8-a688-90cf10622ed8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.303683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a5cf3ef0-44d9-48c9-ac46-3cf57a7b70a5 req-82b60d4d-c391-43e8-a688-90cf10622ed8 service nova] Creating event network-changed:2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b for instance ffc2e52d-320e-4cf4-9862-13a127a27792 on n-h1-850003-3 Jul 18 12:56:27.313177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a5cf3ef0-44d9-48c9-ac46-3cf57a7b70a5 req-82b60d4d-c391-43e8-a688-90cf10622ed8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067216 Jul 18 12:56:27.315772 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 611/1218] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:27.328232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.331866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:27.347974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.348786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.349817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.351015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.355965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0c84c611-2982-4422-8478-27d047599887 in use.", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:56:27.357418 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.357418 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887 HTTP/1.1 Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:56:27.361589 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: exception: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.364174 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c84c611-2982-4422-8478-27d047599887'} Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:27.365527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.368204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:27.370783 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] Jul 18 12:56:27.373346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:27.376465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 400 to user: Security Group 0c84c611-2982-4422-8478-27d047599887 in use. Jul 18 12:56:27.376465 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-44e82cdc-802a-4947-8dfc-bd8b20508350'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:27.379300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-414bd677-c27e-40fb-af93-6911c5610daf tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887" status: 400 len: 185 microversion: 2.1 time: 0.292852 Jul 18 12:56:27.387743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 608/1219] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:56:27 2022] DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887 => generated 185 bytes in 302 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:56:27.401735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3cbf4f90-f8cb-49dc-b08c-a51398fce051 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e462ce50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.529770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3cbf4f90-f8cb-49dc-b08c-a51398fce051 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.139202 Jul 18 12:56:27.533238 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 609/1220] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:27 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:27.550034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.551622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:27.564267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.566359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.568102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.569162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.700844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:27.703092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:27.714904 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae1ce9ea-0609-466f-ae76-e1971e1044da tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1217 microversion: 2.1 time: 0.178944 Jul 18 12:56:27.716281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 610/1221] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:27 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:27.724038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-41f365ba-8bbb-4dea-bb4d-7cbdf74f8c16 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.405615 Jul 18 12:56:27.725542 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 612/1222] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:27 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:27.735458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.737877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:27.739935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:27.741276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:27.756732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.757502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.759335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.759788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.764754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.765544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.775873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:27.777410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:27.832866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:56:27.923686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:28.045114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-794cce1b-85cc-423c-85d7-4fc91f019705 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 204 len: 0 microversion: 2.1 time: 0.312956 Jul 18 12:56:28.046434 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 611/1223] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:56:27 2022] DELETE /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:56:28.067023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.069264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:28.083776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.084934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.087065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:28.088169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.089257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.100565 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-432613e2-4b60-4920-af51-843826f716d6 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.372543 Jul 18 12:56:28.114189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 613/1224] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:27 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:28.114189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.114189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:28.121819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.122805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.125206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.125206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.482679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:28.506623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5f8d60d-3a34-4300-ae2f-77e57da6a9a0 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1647 microversion: 2.1 time: 0.450258 Jul 18 12:56:28.508192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 612/1225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1647 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:28.517551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.518875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:28.531140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.532361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.535622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.536529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.621562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:28.636571 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0aff18a2-60da-4c56-a88f-8f6da9b13a59 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.532556 Jul 18 12:56:28.648516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 614/1226] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:28.676279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb2865f3-edcf-471c-8dc3-938ba7aacd6d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d68b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.760638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb2865f3-edcf-471c-8dc3-938ba7aacd6d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.111528 Jul 18 12:56:28.763270 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 615/1227] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:28.773357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.775757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:28.788701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.790108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.792043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.792950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.842733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:28.863927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f2a96ba-f838-48c6-a39f-43dc495fa090 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1308 microversion: 2.1 time: 0.353373 Jul 18 12:56:28.874618 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 613/1228] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:28.875251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:28.876555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:28.889486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.890268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.891833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:28.892658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:28.953536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:28.974808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-571ea244-b319-4671-9fc8-447b052443ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1209 microversion: 2.1 time: 0.209046 Jul 18 12:56:28.976232 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 616/1229] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:29.133802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:29.135501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:29.154989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.156663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.158553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.158553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.269034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:29.283489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4d3f743-d826-46ea-9cf0-ceeb27ca16f0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.415870 Jul 18 12:56:29.285295 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 614/1230] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:28 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:29.439505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:29.454692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b49d74d-e30d-47f2-b8ec-fca62ac31493 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.330753 Jul 18 12:56:29.456265 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 617/1231] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:29 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:29.529927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:29.531348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:29.545678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.546457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.547859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.548628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.685041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:29.685798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:29.700052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.700899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.702306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:29.703032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:29.864334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:29.881679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46c5d591-ebbd-494e-a02b-b895f391bd87 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1647 microversion: 2.1 time: 0.359092 Jul 18 12:56:29.883638 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 615/1232] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:29 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1647 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:29.894261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5d3008f-56df-4d8e-a04b-4d09366e846f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4650f70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:29.967134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:29.989480 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5d3008f-56df-4d8e-a04b-4d09366e846f tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.103523 Jul 18 12:56:29.990982 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 616/1233] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:29 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:29.996386 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4182f3f4-5129-4b5b-98cd-d87c190de341 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1317 microversion: 2.1 time: 0.315987 Jul 18 12:56:30.003206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:30.004559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.006828 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 618/1234] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:29 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:30.021334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.022091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.025242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:30.026384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.028102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.029328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.037343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:30.040121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.040942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.042722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.043521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.113117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:30.200074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:30.214508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c7b5699-43e9-4e1b-9848-e65b7eb8b678 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1209 microversion: 2.1 time: 0.203697 Jul 18 12:56:30.215826 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 619/1235] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:30 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:30.329174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:30.331648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.342001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:30.348277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.349079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.350680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.351979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.379257 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db36a747-5191-479f-a6ff-577405607fdd tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1488 microversion: 2.1 time: 0.385963 Jul 18 12:56:30.381302 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 617/1236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:29 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:30.409019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:30.410618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.422769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.424043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.425681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.426898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.596505 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa16bd78-e048-4c3c-877a-09f607d00cf1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d/action" status: 202 len: 0 microversion: 2.1 time: 0.192845 Jul 18 12:56:30.602388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 618/1237] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:30 2022] POST /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 12:56:30.607836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:30.609303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.623175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.624334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.626112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.627569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:30.904422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:30.941148 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa426e09-ad1d-472d-bffe-c23698f72acd tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.621536 Jul 18 12:56:30.942260 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 620/1238] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:30 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:30.960932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:30.963771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:30.977708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:30.992101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:30.998022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.000034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.003818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.021640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e69616e-f25f-4c53-9ee4-7e7f0535aebf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.421326 Jul 18 12:56:31.024757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 619/1239] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:30 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.051927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:31.055803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:31.092520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.097937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.099721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.101451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.300722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:31.313423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f25796c-b1ce-4d13-b653-0ca3d707683b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1493 microversion: 2.1 time: 0.369240 Jul 18 12:56:31.314959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 621/1240] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:30 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1493 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.322894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aaaa60bf-fef2-4113-a1f8-9a9512bd5c27 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d64c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:31.438777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aaaa60bf-fef2-4113-a1f8-9a9512bd5c27 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.117960 Jul 18 12:56:31.451825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 622/1241] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:31 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.473709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:31.474820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:31.497410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.501486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.505525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.506633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.542283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:31.561051 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec609d54-0f52-4f31-aec2-359f01f6f5c2 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1647 microversion: 2.1 time: 0.535541 Jul 18 12:56:31.562114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 620/1242] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:31 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1647 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.579659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:31.579659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:31.586679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.587503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.589004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:31.590494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:31.730915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:31.748436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5cca42be-3f0c-4a49-99d5-a8ef691eecb4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1265 microversion: 2.1 time: 0.184105 Jul 18 12:56:31.764417 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 621/1243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:31 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.934204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:31.954130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8103ecd4-7061-4fff-9605-7d0b2d185c7e tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1506 microversion: 2.1 time: 0.500317 Jul 18 12:56:31.956055 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 623/1244] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:31 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:31.985589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:31.987586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:32.004983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.006811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.008392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.020808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.058003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d1e41495-ae43-4605-b085-192f61160cda req-2ae43125-52ff-4250-8c88-42c4fd053a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21f3f70-5851-4367-a476-f5898c61bbef", "name": "network-vif-plugged", "status": "completed", "tag": "f896abf5-db39-468c-a88d-c079dc41392c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:32.108291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d1e41495-ae43-4605-b085-192f61160cda req-2ae43125-52ff-4250-8c88-42c4fd053a11 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.108803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d1e41495-ae43-4605-b085-192f61160cda req-2ae43125-52ff-4250-8c88-42c4fd053a11 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.135503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d1e41495-ae43-4605-b085-192f61160cda req-2ae43125-52ff-4250-8c88-42c4fd053a11 service nova] Creating event network-vif-plugged:f896abf5-db39-468c-a88d-c079dc41392c for instance e21f3f70-5851-4367-a476-f5898c61bbef on n-h1-850003-3 Jul 18 12:56:32.151843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d1e41495-ae43-4605-b085-192f61160cda req-2ae43125-52ff-4250-8c88-42c4fd053a11 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104228 Jul 18 12:56:32.155645 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 624/1245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:56:32.180224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:32.181512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:32.194889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.195627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.197156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.197953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.754717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:32.781907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-11ed3d23-c771-4377-ac1f-9a3604dedec4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.805608 Jul 18 12:56:32.798974 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 622/1246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:31 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:32.811121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:32.811902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:32.822982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.823754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:32.825183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:32.825988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:33.272853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:33.305906 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92e81b2a-8e7c-40cb-9df3-3002b6361dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 1.147775 Jul 18 12:56:33.311453 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 625/1247] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:32 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:33.338047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-060e5bbe-c72d-4657-9b79-7c28fac7e4b3 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4618ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:33.489486 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-060e5bbe-c72d-4657-9b79-7c28fac7e4b3 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.165416 Jul 18 12:56:33.491238 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 626/1248] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:33 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:33.514934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:33.520673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:33.562871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:33.565090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:33.566749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:33.573059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:33.574896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:33.603981 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9e23a7d-6fb5-4329-98ec-9eb8929c8dc3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 200 len: 1473 microversion: 2.1 time: 0.803333 Jul 18 12:56:33.640132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 623/1249] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:32 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 1473 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:33.661035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:33.662484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:33.702210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:33.711208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:33.713185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:33.713993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:34.145380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:34.193183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:34.217492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68d844f1-de01-4c6c-9844-9b393f27bf9d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1468 microversion: 2.1 time: 0.724283 Jul 18 12:56:34.220588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:34.221668 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 627/1250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:33 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:34.243357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1434995088"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:34.249137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:34.250018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70e1100e-c1cd-4277-82d0-adc59d01fcd0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1271 microversion: 2.1 time: 0.607563 Jul 18 12:56:34.266048 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 624/1251] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:33 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1271 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:34.271666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:34.272255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:34.273528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:34.274467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:34.280617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:34.282110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:34.294521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:34.296100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:34.297868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:34.299116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:34.872097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:34.886669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:34.902890 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3219eca7-fa82-4c83-8d57-0fc88d7aff45 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1317 microversion: 2.1 time: 0.623463 Jul 18 12:56:34.906848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 625/1252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:34 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:34.928953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3793697e-e606-4157-8ebd-1d6921733e20 req-3c8de80d-5701-415a-aca3-8cd625f4c47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc2e52d-320e-4cf4-9862-13a127a27792", "name": "network-vif-deleted", "tag": "2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:34.949063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3793697e-e606-4157-8ebd-1d6921733e20 req-3c8de80d-5701-415a-aca3-8cd625f4c47e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:34.949770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3793697e-e606-4157-8ebd-1d6921733e20 req-3c8de80d-5701-415a-aca3-8cd625f4c47e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.012030 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3793697e-e606-4157-8ebd-1d6921733e20 req-3c8de80d-5701-415a-aca3-8cd625f4c47e service nova] Creating event network-vif-deleted:2cd6a40a-7ee5-44c1-8a0e-ed37a01ddf6b for instance ffc2e52d-320e-4cf4-9862-13a127a27792 on n-h1-850003-3 Jul 18 12:56:35.036369 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3793697e-e606-4157-8ebd-1d6921733e20 req-3c8de80d-5701-415a-aca3-8cd625f4c47e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122217 Jul 18 12:56:35.037966 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 626/1253] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:35.067958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:35.081610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:35.098251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.106960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.109268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.110731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.304370 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d14522ad-cf0a-43bb-b661-a005c103f19b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d/action" status: 202 len: 0 microversion: 2.1 time: 1.077309 Jul 18 12:56:35.307477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 628/1254] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:56:34 2022] POST /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d/action => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 12:56:35.321246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2900f014-b9c0-43ab-b489-87a916934e77 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d63a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:35.440575 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2900f014-b9c0-43ab-b489-87a916934e77 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.130117 Jul 18 12:56:35.452097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 629/1255] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:35 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:35.462919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:35.464530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:35.478887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.480207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.482400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.483641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.563100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.564471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.565636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lazy-loading 'fault' on Instance uuid ffc2e52d-320e-4cf4-9862-13a127a27792 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:56:35.668857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:35.704849 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e59686db-554e-4e11-bc36-b1b05160c3cd tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 200 len: 1306 microversion: 2.1 time: 0.250196 Jul 18 12:56:35.711540 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 630/1256] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:35 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:35.727556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "abdcb43a-4153-4254-bcea-7759e710eab2"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:35.732661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:35.762417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.763633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.765338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:35.766312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:35.987751 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] HTTP exception thrown: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Request method failure captured: Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b/os-volume_attachments/14733ae9-6a3f-4937-8798-5cd20f9ae09b HTTP/1.1 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 74 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VenaayYuhDvlNL0XLJY4qAveRlnTLZ4F8y4VYEtU-GI-eAQ8sPJfRZuY0aewz6oAB2P6Aw5Q3T4znUt32VHDc6grgh_Wv7Y2c6BwN88KwMO8uKlQA-naRR_j-AGLIU_xSLutTesECvMc8oPeV9A8XT4jcWd6VqdXwKgKF3ZWxZP79U Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 21e0a2593c65472cadfbc9afd8d8da61 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:56:35.991257 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_21e0a2593c65472cadfbc9afd8d8da61", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/21e0a2593c65472cadfbc9afd8d8da61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 21e0a2593c65472cadfbc9afd8d8da61 Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1033064203 Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesAdminNegativeTest-1033064203-project-admin Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 95790c4a9f01479587ba05a24653edbb Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesAdminNegativeTest-1033064203-project-admin Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: {"volumeAttachment": {"volumeId": "abdcb43a-4153-4254-bcea-7759e710eab2"}} Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:56:35.994229 n-d-850003-3 devstack@n-api.service[131367]: exception: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': '7805837f-6fe5-4d53-ab51-97da89093a2b', 'id': '14733ae9-6a3f-4937-8798-5cd20f9ae09b', 'body': {'volumeAttachment': {'volumeId': 'abdcb43a-4153-4254-bcea-7759e710eab2'}}} Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 12:56:35.999534 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. (HTTP 404) (Request-ID: req-ff01e7be-6108-4733-978a-cf616bf1760c) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 12:56:36.001389 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:36.004485 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. Jul 18 12:56:36.006330 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.012039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] Returning 404 to user: Volume 14733ae9-6a3f-4937-8798-5cd20f9ae09b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:36.012039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af4c9310-ba12-4d63-b0f4-27a1cdfb4119 tempest-VolumesAdminNegativeTest-1033064203 tempest-VolumesAdminNegativeTest-1033064203-project-admin] 10.222.0.88 "PUT /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b/os-volume_attachments/14733ae9-6a3f-4937-8798-5cd20f9ae09b" status: 404 len: 109 microversion: 2.1 time: 0.283149 Jul 18 12:56:36.012039 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 631/1257] 10.222.0.88 () {60 vars in 1432 bytes} [Mon Jul 18 12:56:35 2022] PUT /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b/os-volume_attachments/14733ae9-6a3f-4937-8798-5cd20f9ae09b => generated 109 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:56:36.027995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:36.029239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:36.041939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.043026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.043281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:36.045099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.046083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.086694 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b3cc781-dc7d-4c97-8931-7bd7d38dc6ed tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 1.046462 Jul 18 12:56:36.088461 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 627/1258] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:35 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:36.115185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23330d4a-2b6d-40fa-bfdb-3b86594a8ab0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e45bcc10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:36.302650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23330d4a-2b6d-40fa-bfdb-3b86594a8ab0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1414 microversion: 2.1 time: 0.203116 Jul 18 12:56:36.306805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 628/1259] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:36 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1414 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:36.341174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:36.343281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:36.361806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:36.376473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.377834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.390710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.396324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.542578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:36.702104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:36.726099 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f78a149d-643f-4847-a6ab-ad1580783b57 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.706146 Jul 18 12:56:36.728214 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 632/1260] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:35 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:36.738544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ceb9f60-6f69-462f-9aec-7a5e347ea816 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4618ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:36.871420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ceb9f60-6f69-462f-9aec-7a5e347ea816 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.140732 Jul 18 12:56:36.873297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 633/1261] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:36 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:36.885505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:36.887029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:36.900824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.902045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.903748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:36.904710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:36.941767 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 HTTP/1.1 Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:56:36.945370 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:36.948738 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ffc2e52d-320e-4cf4-9862-13a127a27792'} Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:36.950535 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:36.953274 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:36.958368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:36.960412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e340410-dd15-48e6-add9-01e5caa4a055 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 404 len: 111 microversion: 2.1 time: 0.083150 Jul 18 12:56:36.961726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 634/1262] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:36 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:56:36.977396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6432e7b9-a161-470c-9d4e-744984dae27a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4618f70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:37.252732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:37.270067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8f9a3c1-8abf-48d2-aeaa-f4b0aad86c40 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1467 microversion: 2.1 time: 0.961795 Jul 18 12:56:37.302747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 629/1263] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:36 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1467 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:37.318630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:37.323361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:37.349880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:37.353499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:37.353499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:37.353499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:37.555415 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6432e7b9-a161-470c-9d4e-744984dae27a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5" status: 202 len: 0 microversion: 2.1 time: 0.585890 Jul 18 12:56:37.556898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 635/1264] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:56:36 2022] DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:37.578846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:37.580905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:37.604805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:37.606267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:37.608017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:37.609762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:37.944029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:37.974319 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b074fbc-94f2-4afa-9b83-d47997ecc1b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.669302 Jul 18 12:56:37.986740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 630/1265] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:37 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:38.009576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6bbc30a-6d2b-4f3f-b720-d8c166e7350a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e45efa60>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:38.028817 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be1ce264-174d-4d62-a5fe-590c9f9f61de tempest-ServersOnMultiNodesTest-1840578234 tempest-ServersOnMultiNodesTest-1840578234-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1618 microversion: 2.1 time: 0.465971 Jul 18 12:56:38.040371 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 636/1266] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:37 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1618 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:38.060395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94cbae10-80b6-425c-8109-442f662acc36 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e46f0670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:38.143891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6bbc30a-6d2b-4f3f-b720-d8c166e7350a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1414 microversion: 2.1 time: 0.164526 Jul 18 12:56:38.145007 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 631/1267] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:37 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1414 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:38.163914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:38.165210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:38.179855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:38.181166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:38.183047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:38.184275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:38.600857 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94cbae10-80b6-425c-8109-442f662acc36 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887" status: 202 len: 0 microversion: 2.1 time: 0.567787 Jul 18 12:56:38.602336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 637/1268] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:56:38 2022] DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:38.615981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de1e964c-25bf-40ff-ac99-ea98d7cc9dda tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4618af0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:38.730064 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de1e964c-25bf-40ff-ac99-ea98d7cc9dda tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.122803 Jul 18 12:56:38.731895 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 638/1269] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:38 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:38.742630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:38.751475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:38.763222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:38.765645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:38.767200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:38.769321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:38.771528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:38.808362 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f557067-0ff9-4b0b-9abc-0cd844ba3085 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.661218 Jul 18 12:56:38.824168 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 632/1270] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:38 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:38.849177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:56:38.849553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8bedad33-925f-44eb-aab1-7ac47165ed52 req-4c49bae3-255b-4fb8-961c-217a3d0ea322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3cf552-4e7f-4f53-9274-28e950ed3a3f", "tag": "1e10de9f-b965-4a9f-9cb6-1a62cd907e17"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:38.893153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8bedad33-925f-44eb-aab1-7ac47165ed52 req-4c49bae3-255b-4fb8-961c-217a3d0ea322 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:38.893153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8bedad33-925f-44eb-aab1-7ac47165ed52 req-4c49bae3-255b-4fb8-961c-217a3d0ea322 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:38.962779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8bedad33-925f-44eb-aab1-7ac47165ed52 req-4c49bae3-255b-4fb8-961c-217a3d0ea322 service nova] Creating event network-changed:1e10de9f-b965-4a9f-9cb6-1a62cd907e17 for instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f on n-h1-850003-3 Jul 18 12:56:38.996717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8bedad33-925f-44eb-aab1-7ac47165ed52 req-4c49bae3-255b-4fb8-961c-217a3d0ea322 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169633 Jul 18 12:56:38.999432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 633/1271] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:39.011367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2846124e-4dc1-451e-970f-99bade674294 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'create', calling method: .version_select at 0x7f96e45ef040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1469026681", "description": "tempest-description-2033060522"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:39.128014 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4abe34f2-e77d-45b7-ba30-0e2214e68b37 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 204 len: 0 microversion: 2.1 time: 0.392430 Jul 18 12:56:39.130432 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 639/1272] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:56:38 2022] DELETE /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:56:39.146462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:39.159773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:39.174952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:39.174952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:39.176684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:39.177160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:39.501823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2846124e-4dc1-451e-970f-99bade674294 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.499534 Jul 18 12:56:39.503876 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 634/1273] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 12:56:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:39.515096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:39.516953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:39.519036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:39.534835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:39.536142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:39.538123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:39.539485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:39.551355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e32714c-cf32-4daa-ba61-878175d62327 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.418910 Jul 18 12:56:39.561959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 640/1274] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:39 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:39.577141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b017627-ad7d-4462-a934-59dcf157ee66 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4618ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:39.681441 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b017627-ad7d-4462-a934-59dcf157ee66 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1414 microversion: 2.1 time: 0.117487 Jul 18 12:56:39.683097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 641/1275] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:39 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:39.694604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9120ad78-a032-42fe-a5fb-31815b0bbc15 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Action: 'update', calling method: .version_select at 0x7f96e4558280>, body: {"security_group": {"name": "tempest-sg-hth-1366347435", "description": "tempest-description-hth-295676224"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:39.906859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:39.930550 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f3a1f9e-21e1-40b2-9760-5aa53ac47aaf tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1473 microversion: 2.1 time: 0.423722 Jul 18 12:56:39.934180 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 635/1276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:39 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:39.949084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3725a769-c565-4f3a-ad23-9e7b851cb75d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4700550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:40.058178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3725a769-c565-4f3a-ad23-9e7b851cb75d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1455 microversion: 2.1 time: 0.124352 Jul 18 12:56:40.060372 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 636/1277] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:39 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:40.078308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:40.080236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:40.101639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:40.103483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:40.105281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:40.106095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9120ad78-a032-42fe-a5fb-31815b0bbc15 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "PUT /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03" status: 200 len: 217 microversion: 2.1 time: 0.419200 Jul 18 12:56:40.107973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 642/1278] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Jul 18 12:56:39 2022] PUT /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03 => generated 217 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:40.108313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:40.132719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9853c33-c623-4210-b75f-c6277cc82b4d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e452b8b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:40.331579 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9853c33-c623-4210-b75f-c6277cc82b4d tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03" status: 200 len: 217 microversion: 2.1 time: 0.208312 Jul 18 12:56:40.348802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 643/1279] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 12:56:40 2022] GET /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03 => generated 217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 12:56:40.357426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-132b1a57-dcd3-455d-83b5-618611548a98 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4540e50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:40.533697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:40.564614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9574d7b1-ca49-4a47-b149-75cade7153e8 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.492918 Jul 18 12:56:40.566258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 637/1280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:40 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:40.608046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:40.611756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:40.639684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:40.644189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:40.646231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:40.651856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:40.948069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-132b1a57-dcd3-455d-83b5-618611548a98 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03" status: 202 len: 0 microversion: 2.1 time: 0.597427 Jul 18 12:56:40.949000 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 644/1281] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:56:40 2022] DELETE /compute/v2.1/os-security-groups/19517ef1-88e9-46c0-913a-9682ce591c03 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:56:40.968446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5031f4a-d1b7-43e7-80e5-03f729c0b17a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4540820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:41.233854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5031f4a-d1b7-43e7-80e5-03f729c0b17a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1414 microversion: 2.1 time: 0.278996 Jul 18 12:56:41.240036 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 645/1282] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:40 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1414 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:41.266490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:41.268024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:41.300344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:41.302619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:41.306439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:41.308839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:41.400908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:41.536823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:41.572955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2be2f235-d16f-4e90-97a4-44b7ee883c60 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.989219 Jul 18 12:56:41.598574 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 638/1283] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:40 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:56:41.610972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:41.610972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:41.644423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:41.645648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:41.647153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:41.648125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:41.748960 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 HTTP/1.1 Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:56:41.771515 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:41.774382 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ffc2e52d-320e-4cf4-9862-13a127a27792'} Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:41.776040 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:41.778768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:56:41.786923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:41.788916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bbf0d5a5-df6c-48c6-8c3f-b521caef6815 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 404 len: 111 microversion: 2.1 time: 0.188425 Jul 18 12:56:41.790271 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 639/1284] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:56:41 2022] DELETE /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:56:41.806929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14dbe6b0-1bc9-45ab-91b8-cf7cdcea01f5 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d94c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:42.307768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:42.350608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64c3e2d3-1a4b-406a-ae84-0996069e2e6e tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 200 len: 1473 microversion: 2.1 time: 1.106081 Jul 18 12:56:42.355161 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 646/1285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:41 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 1473 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:42.388728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d56288b2-a0b8-45a2-a703-c487ed62b192 req-84531b92-cc7f-40e0-8ebc-0f5ade9c85d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-plugged", "status": "completed", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:56:42.437376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d56288b2-a0b8-45a2-a703-c487ed62b192 req-84531b92-cc7f-40e0-8ebc-0f5ade9c85d3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:42.438291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d56288b2-a0b8-45a2-a703-c487ed62b192 req-84531b92-cc7f-40e0-8ebc-0f5ade9c85d3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:42.520027 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d56288b2-a0b8-45a2-a703-c487ed62b192 req-84531b92-cc7f-40e0-8ebc-0f5ade9c85d3 service nova] Creating event network-vif-plugged:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:56:42.634985 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d56288b2-a0b8-45a2-a703-c487ed62b192 req-84531b92-cc7f-40e0-8ebc-0f5ade9c85d3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267830 Jul 18 12:56:42.636976 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 647/1286] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:56:42.649500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:42.651529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:42.679546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:42.691534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:42.693639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:42.694868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:43.854869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:56:43.913786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6399037f-24af-42c6-98a5-275a0057fe73 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 1.274046 Jul 18 12:56:43.938711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 648/1287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:42 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:56:43.943765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:43.945179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: ffc2e52d-320e-4cf4-9862-13a127a27792] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:56:43.988792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:43.989488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:43.991044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:56:43.991854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:56:44.114490 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 HTTP/1.1 Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:56:44.121588 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:44.124538 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ffc2e52d-320e-4cf4-9862-13a127a27792'} Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:56:44.128857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. Jul 18 12:56:44.131450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:56:44.133733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Instance ffc2e52d-320e-4cf4-9862-13a127a27792 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:56:44.133733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b18485e-2a2a-4328-86d8-fb42872fbdf1 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792" status: 404 len: 111 microversion: 2.1 time: 0.205949 Jul 18 12:56:44.140103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 649/1288] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:56:43 2022] GET /compute/v2.1/servers/ffc2e52d-320e-4cf4-9862-13a127a27792 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:56:44.163838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d61a123-8e40-435a-a60a-3d592dd6b661 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4547550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:56:51.643591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:51.685786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:53.980723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:56:54.014142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=13 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:02.316256 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14dbe6b0-1bc9-45ab-91b8-cf7cdcea01f5 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1464 microversion: 2.1 time: 20.523564 Jul 18 12:57:02.323597 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 640/1289] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:41 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1464 bytes in 20532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:02.344773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:02.345978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:02.360953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.361706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.363302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.364172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.385806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d61a123-8e40-435a-a60a-3d592dd6b661 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1423 microversion: 2.1 time: 18.247713 Jul 18 12:57:02.386946 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 650/1290] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:56:44 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1423 bytes in 18251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:02.412054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:02.413268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:02.421215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:02.426918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.427779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.429283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.430131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.627229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e8edd4b-f45c-4055-b767-4d906161a2aa tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 204 len: 0 microversion: 2.1 time: 0.298732 Jul 18 12:57:02.628890 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 641/1291] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:02 2022] DELETE /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:02.637652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:02.638939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: e21f3f70-5851-4367-a476-f5898c61bbef] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:02.650052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.650866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.652260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.653111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.680541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef HTTP/1.1 Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:02.682596 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. Jul 18 12:57:02.685479 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e21f3f70-5851-4367-a476-f5898c61bbef'} Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:02.687619 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. Jul 18 12:57:02.693157 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.695427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance e21f3f70-5851-4367-a476-f5898c61bbef could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:02.695427 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e2e89627-8d5e-469f-9d47-0f8ad6487155 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef" status: 404 len: 111 microversion: 2.1 time: 0.053933 Jul 18 12:57:02.695427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 642/1292] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:02 2022] GET /compute/v2.1/servers/e21f3f70-5851-4367-a476-f5898c61bbef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:02.695427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d6d767b8-f405-4f34-9813-010e3741fa37 req-3052ef7d-b51f-4e1f-8112-d8ae5b166c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21f3f70-5851-4367-a476-f5898c61bbef", "name": "network-vif-deleted", "tag": "f896abf5-db39-468c-a88d-c079dc41392c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:02.707550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d6d767b8-f405-4f34-9813-010e3741fa37 req-3052ef7d-b51f-4e1f-8112-d8ae5b166c4c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.708276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d6d767b8-f405-4f34-9813-010e3741fa37 req-3052ef7d-b51f-4e1f-8112-d8ae5b166c4c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.712695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:02.728952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f093866-4635-41bf-a490-376b24982de4 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.340066 Jul 18 12:57:02.729298 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d6d767b8-f405-4f34-9813-010e3741fa37 req-3052ef7d-b51f-4e1f-8112-d8ae5b166c4c service nova] Creating event network-vif-deleted:f896abf5-db39-468c-a88d-c079dc41392c for instance e21f3f70-5851-4367-a476-f5898c61bbef on n-h1-850003-3 Jul 18 12:57:02.730586 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 651/1293] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:02 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:02.738592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d6d767b8-f405-4f34-9813-010e3741fa37 req-3052ef7d-b51f-4e1f-8112-d8ae5b166c4c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050774 Jul 18 12:57:02.739844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 643/1294] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:02.742121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4540f70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:02.752107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:02.754475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:02.768299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.769101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.770493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.771234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.781918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0c84c611-2982-4422-8478-27d047599887 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:02.782653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 0c84c611-2982-4422-8478-27d047599887 not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:02.783420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.783420 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887 HTTP/1.1 Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:02.787322 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.789924 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0c84c611-2982-4422-8478-27d047599887'} Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:02.791581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:02.793851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.799495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 0c84c611-2982-4422-8478-27d047599887 does not exist Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5193a525-ada2-49dd-a13e-b41b7d85856a'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b60ca3e1-8f07-4021-a88b-9ad163db9367 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887" status: 404 len: 194 microversion: 2.1 time: 0.066192 Jul 18 12:57:02.801747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 652/1295] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:02 2022] DELETE /compute/v2.1/os-security-groups/0c84c611-2982-4422-8478-27d047599887 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:02.809837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c2ee7ae7-5571-4e0b-9a63-92dd6aa15700 req-2744f6f3-2f1a-431e-8ea4-ebe7a67f264c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec16fe0-4afc-4b20-a744-862055abbf0d", "name": "network-vif-plugged", "status": "completed", "tag": "91362955-13dd-4ed5-a4d4-1ecf684232c1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:02.830469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c2ee7ae7-5571-4e0b-9a63-92dd6aa15700 req-2744f6f3-2f1a-431e-8ea4-ebe7a67f264c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:02.831765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c2ee7ae7-5571-4e0b-9a63-92dd6aa15700 req-2744f6f3-2f1a-431e-8ea4-ebe7a67f264c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:02.848132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c2ee7ae7-5571-4e0b-9a63-92dd6aa15700 req-2744f6f3-2f1a-431e-8ea4-ebe7a67f264c service nova] Creating event network-vif-plugged:91362955-13dd-4ed5-a4d4-1ecf684232c1 for instance 4ec16fe0-4afc-4b20-a744-862055abbf0d on n-h2-850003-3 Jul 18 12:57:02.857131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c2ee7ae7-5571-4e0b-9a63-92dd6aa15700 req-2744f6f3-2f1a-431e-8ea4-ebe7a67f264c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054261 Jul 18 12:57:02.858970 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 653/1296] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:02.873473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb977fb1-4a89-4026-b554-4a73681c748d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e517d700>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.057041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb977fb1-4a89-4026-b554-4a73681c748d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 200 len: 1464 microversion: 2.1 time: 0.190451 Jul 18 12:57:03.063030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:03.070822 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 654/1297] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:02 2022] GET /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:03.082006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-abebaa42-01d5-4fc5-8c46-a238be41895b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e45400d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.085775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08e3d608-a1f9-49b1-97fc-cc91b6d1bcfb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.341170 Jul 18 12:57:03.087552 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 644/1298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:02 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:03.102840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.108084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:03.122636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.124075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.126792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.128452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.199536 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-abebaa42-01d5-4fc5-8c46-a238be41895b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 200 len: 1423 microversion: 2.1 time: 0.124441 Jul 18 12:57:03.200586 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 655/1299] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:03 2022] GET /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:03.210199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.211693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:03.223580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.224905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.226704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.228251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.299057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:03.440777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:03.452446 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8aee027-4167-47e2-aaf8-1898ec6938d2 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1512 microversion: 2.1 time: 0.362309 Jul 18 12:57:03.453529 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 645/1300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:03 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:03.478976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-505305a5-5672-472f-b55e-0fae0e40450a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 204 len: 0 microversion: 2.1 time: 0.276317 Jul 18 12:57:03.480420 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 656/1301] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:03 2022] DELETE /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:03.482422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e459b820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.490975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.492295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:03.505568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.506284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.507962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.508969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.529436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:03.531024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:03.532185 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.532185 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5 HTTP/1.1 Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:03.536544 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: exception: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.544865 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '31482db7-9e0d-4538-9950-e78c70b9c5a5'} Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:03.547725 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:03.551051 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.553392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 31482db7-9e0d-4538-9950-e78c70b9c5a5 does not exist Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-b522d240-670e-42eb-b6a0-98f3b2d2d77d'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90717ae7-b36f-409a-9aff-de3151cfea68 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5" status: 404 len: 194 microversion: 2.1 time: 0.083329 Jul 18 12:57:03.558499 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 646/1302] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:03 2022] DELETE /compute/v2.1/os-security-groups/31482db7-9e0d-4538-9950-e78c70b9c5a5 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:03.559997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e930c07f-e68c-4363-a8dc-e4145023b1d6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4576040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.806142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:03.819285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a419c6d-1163-43d6-82d2-689707fd52af tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1481 microversion: 2.1 time: 0.336509 Jul 18 12:57:03.820473 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 657/1303] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:03 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1481 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:03.837507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:03.838763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:03.853058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.853058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:03.853058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:03.853058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.101891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:04.123110 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54ea15f5-9e91-4de9-85b7-d2e1adfde398 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1472 microversion: 2.1 time: 0.292983 Jul 18 12:57:04.124157 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 658/1304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:03 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:04.133216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4711430>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.170666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:04.171281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 39d82597-3392-4914-adfe-9408de7b20dd not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:04.171806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.171806 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd HTTP/1.1 Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:04.175407 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.178825 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '39d82597-3392-4914-adfe-9408de7b20dd'} Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.182070 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:04.183701 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.187783 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 39d82597-3392-4914-adfe-9408de7b20dd does not exist Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-59a1d717-a187-4f69-8353-774d3a69887f'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4777d4a-ef45-46ff-a511-d4428c73dada tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd" status: 404 len: 194 microversion: 2.1 time: 0.051227 Jul 18 12:57:04.191640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 659/1305] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:04 2022] DELETE /compute/v2.1/os-security-groups/39d82597-3392-4914-adfe-9408de7b20dd => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:04.193355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.193355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:04.203383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.203383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.203383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.203383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.378939 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e930c07f-e68c-4363-a8dc-e4145023b1d6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 204 len: 0 microversion: 2.1 time: 0.836303 Jul 18 12:57:04.379573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 647/1306] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:03 2022] DELETE /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:04.389034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.390231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:04.407754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.408619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.411271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.412187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.496145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:04.513383 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fe6d675-14f0-448d-ad7e-094a72170ed9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.333449 Jul 18 12:57:04.514511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 660/1307] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:04 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:04.524712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e45a7dc0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.567511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:04.569027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 5228e68d-c671-4622-b0fc-87619bb2a4ce not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:04.570337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.570337 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce HTTP/1.1 Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:04.574844 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.577835 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5228e68d-c671-4622-b0fc-87619bb2a4ce'} Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.579537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:04.581398 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.583269 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 5228e68d-c671-4622-b0fc-87619bb2a4ce does not exist Jul 18 12:57:04.588360 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-3505385c-1908-4e90-9724-eace0e283cd4'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:04.591619 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-946f0e02-93d4-40d3-841c-59c636d13998 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce" status: 404 len: 194 microversion: 2.1 time: 0.074413 Jul 18 12:57:04.593314 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 661/1308] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:04 2022] DELETE /compute/v2.1/os-security-groups/5228e68d-c671-4622-b0fc-87619bb2a4ce => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:04.603391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.603909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:04.619495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.620205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.621584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.622960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.685517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:04.697668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:04.713359 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4f3c5aa-0c97-4410-820a-529385c08fd3 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.331716 Jul 18 12:57:04.714190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 648/1309] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:04 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:04.721129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.722084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:04.742728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.743464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.744766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.745621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:04.847177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf056e30-baba-4efa-8da9-2c7742f1fcc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 204 len: 0 microversion: 2.1 time: 0.251176 Jul 18 12:57:04.848121 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 662/1310] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:04 2022] DELETE /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:04.861011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e511d4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:04.903411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:04.905864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group 5a11b405-5947-45bf-a8f5-270964c73dfc not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:04.907463 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.907463 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc HTTP/1.1 Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:04.913178 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.922452 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5a11b405-5947-45bf-a8f5-270964c73dfc'} Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.924584 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:04.926944 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.929216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group 5a11b405-5947-45bf-a8f5-270964c73dfc does not exist Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-60b441ff-c4ab-47c8-8714-76e2d8945ffd'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f684fc99-e908-4935-8c0a-1f60f1240a63 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc" status: 404 len: 194 microversion: 2.1 time: 0.067045 Jul 18 12:57:04.931833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 663/1311] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:04 2022] DELETE /compute/v2.1/os-security-groups/5a11b405-5947-45bf-a8f5-270964c73dfc => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:04.933104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "name": "network-vif-unplugged", "status": "completed", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}, {"name": "network-changed", "server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:04.952465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:04.953298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:05.004992 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] Creating event network-vif-unplugged:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:57:05.006389 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] Creating event network-changed:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:57:05.019735 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-051a4e6f-9b55-4c24-ac3a-aa8ebc0cada3 req-eecbfc65-5491-48ce-abe6-1cc3e4b3e010 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.098674 Jul 18 12:57:05.033414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:05.035432 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 664/1312] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:05.048629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:05.049891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:05.052822 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a01899c-5c28-4730-87c5-6661d8b507de tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1512 microversion: 2.1 time: 0.336880 Jul 18 12:57:05.062109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:05.064056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:05.066398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:05.067272 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 649/1313] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:04 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:05.067922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:05.085229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-90f7fc3b-8323-4aec-adc2-31a1123e99ba req-2f3c4854-c5ab-4b61-bb39-f31076f4d708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cf552-4e7f-4f53-9274-28e950ed3a3f", "name": "network-vif-plugged", "status": "completed", "tag": "1e10de9f-b965-4a9f-9cb6-1a62cd907e17"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:05.105636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-90f7fc3b-8323-4aec-adc2-31a1123e99ba req-2f3c4854-c5ab-4b61-bb39-f31076f4d708 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:05.106562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-90f7fc3b-8323-4aec-adc2-31a1123e99ba req-2f3c4854-c5ab-4b61-bb39-f31076f4d708 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:05.156878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-90f7fc3b-8323-4aec-adc2-31a1123e99ba req-2f3c4854-c5ab-4b61-bb39-f31076f4d708 service nova] Creating event network-vif-plugged:1e10de9f-b965-4a9f-9cb6-1a62cd907e17 for instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f on n-h1-850003-3 Jul 18 12:57:05.172072 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-90f7fc3b-8323-4aec-adc2-31a1123e99ba req-2f3c4854-c5ab-4b61-bb39-f31076f4d708 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101242 Jul 18 12:57:05.175569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 650/1314] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:05.199592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e45bc940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:05.262050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:57:05.262865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Neutron security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 12:57:05.264411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.264411 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e HTTP/1.1 Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:05.268269 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: exception: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.271098 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c6a73004-2f6f-47e4-87d9-4516d7a84b6e'} Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:05.290089 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 12:57:05.294104 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.299090 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Security group c6a73004-2f6f-47e4-87d9-4516d7a84b6e does not exist Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-444fe855-bb0a-497b-817f-0a2f63f65b58'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9795f990-61f6-4f40-8acc-bcda06c1983e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e" status: 404 len: 194 microversion: 2.1 time: 0.091736 Jul 18 12:57:05.303746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 651/1315] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:05 2022] DELETE /compute/v2.1/os-security-groups/c6a73004-2f6f-47e4-87d9-4516d7a84b6e => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:05.306478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1772450929", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "86e3abd6-5f45-4131-86ad-fd94f18b600e"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:05.402107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] validate_networks() for [('86e3abd6-5f45-4131-86ad-fd94f18b600e', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:57:05.746491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:05.764405 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52cfa441-0fba-4676-aeae-184d7eb83a50 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1481 microversion: 2.1 time: 0.726245 Jul 18 12:57:05.765493 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 665/1316] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:05 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1481 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:05.792763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:05.794747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:05.809237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:05.810314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:05.812941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:05.812941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.307779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:06.322643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f2b2250-8e22-431b-8111-ab04489eae26 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1472 microversion: 2.1 time: 0.553873 Jul 18 12:57:06.338266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 666/1317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:05 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:06.352445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:06.354475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:06.372605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.373105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.375345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.378456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.433128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:06.621974 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23342653-2a8d-4c67-b200-0641831ef714 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 204 len: 0 microversion: 2.1 time: 0.287812 Jul 18 12:57:06.623423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 667/1318] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:06 2022] DELETE /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:06.639414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:06.641959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:06.654820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.656916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.660238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.660238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.929297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:06.933218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:57:06.934049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:57:06.934990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:57:06.935731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:57:06.938269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:57:06.945810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58f7b92f-a819-4705-a00c-094b53a66b0c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.315743 Jul 18 12:57:06.946601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 668/1319] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:06 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:06.955400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:06.956426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:06.966823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.967767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.968127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.968409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.969238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.970581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:06.970889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:06.971319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.022113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:57:07.051520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for user 719f068839494e66b2eb68285ef22214 and project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:57:07.101325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:57:07.105047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:57:07.192818 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b5b11f7-481c-4d40-853e-84a8dc98a234 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919319 Jul 18 12:57:07.197740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 652/1320] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:57:07.208296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:07.209593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.223539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.224560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.225905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.234314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.279856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:07.292208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:07.296370 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-827941a7-4a63-46b9-9b95-b5cf5bdaa9c6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1313 microversion: 2.1 time: 0.348363 Jul 18 12:57:07.297168 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 669/1321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:06 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:07.306295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:07.307379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.318133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.318740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.320383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.321333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.374544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:07.393016 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e604f5ac-3cbc-4a9f-8056-acc493a17e74 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1302 microversion: 2.1 time: 0.191764 Jul 18 12:57:07.394442 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 653/1322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:07 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:07.404172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:07.407022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.419177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.420473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.423527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.424200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.732053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:07.735048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:07.746402 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dfff6f51-c9f1-4552-b262-3b5ecbc67e19 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1468 microversion: 2.1 time: 0.349975 Jul 18 12:57:07.747937 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 654/1323] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:07 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:07.757172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-54b32196-8043-42bb-8141-47ca2e523f80 req-588180d9-a8e8-483e-80f7-835b4f2553cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7805837f-6fe5-4d53-ab51-97da89093a2b", "name": "network-vif-deleted", "tag": "2b2b6b25-d54a-4b97-897c-ad2e17314ad2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:07.757491 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80eee40e-4554-4cba-b404-0460a9df0811 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1647 microversion: 2.1 time: 0.458640 Jul 18 12:57:07.759306 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 670/1324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:07 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1647 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:07.782311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd1ac80f-dbd3-406e-9f81-a5ea79d4828a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:07.782812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd1ac80f-dbd3-406e-9f81-a5ea79d4828a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.791723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54b32196-8043-42bb-8141-47ca2e523f80 req-588180d9-a8e8-483e-80f7-835b4f2553cd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.793248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54b32196-8043-42bb-8141-47ca2e523f80 req-588180d9-a8e8-483e-80f7-835b4f2553cd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.818318 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-54b32196-8043-42bb-8141-47ca2e523f80 req-588180d9-a8e8-483e-80f7-835b4f2553cd service nova] Creating event network-vif-deleted:2b2b6b25-d54a-4b97-897c-ad2e17314ad2 for instance 7805837f-6fe5-4d53-ab51-97da89093a2b on n-h1-850003-3 Jul 18 12:57:07.829709 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-54b32196-8043-42bb-8141-47ca2e523f80 req-588180d9-a8e8-483e-80f7-835b4f2553cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078323 Jul 18 12:57:07.832205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 655/1325] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:07.842772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9045f6a3-a697-4c6a-aa69-55bc43b86aa5 req-328687ee-ecea-47c9-bf0e-2da9f5ebd485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec16fe0-4afc-4b20-a744-862055abbf0d", "name": "network-vif-unplugged", "status": "completed", "tag": "91362955-13dd-4ed5-a4d4-1ecf684232c1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:07.865983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9045f6a3-a697-4c6a-aa69-55bc43b86aa5 req-328687ee-ecea-47c9-bf0e-2da9f5ebd485 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.867012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9045f6a3-a697-4c6a-aa69-55bc43b86aa5 req-328687ee-ecea-47c9-bf0e-2da9f5ebd485 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.894234 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9045f6a3-a697-4c6a-aa69-55bc43b86aa5 req-328687ee-ecea-47c9-bf0e-2da9f5ebd485 service nova] Creating event network-vif-unplugged:91362955-13dd-4ed5-a4d4-1ecf684232c1 for instance 4ec16fe0-4afc-4b20-a744-862055abbf0d on n-h2-850003-3 Jul 18 12:57:07.902047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd1ac80f-dbd3-406e-9f81-a5ea79d4828a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:07.911421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9045f6a3-a697-4c6a-aa69-55bc43b86aa5 req-328687ee-ecea-47c9-bf0e-2da9f5ebd485 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077113 Jul 18 12:57:07.913420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 656/1326] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:07.917628 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd1ac80f-dbd3-406e-9f81-a5ea79d4828a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1208 microversion: 2.1 time: 0.157141 Jul 18 12:57:07.924228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:07.926009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.931664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 671/1327] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:07 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1208 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:07.953447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1421022575"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:07.956227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:07.956522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.957397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.959373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.961252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.974206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.975574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:07.977213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:07.978338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.281438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:08.299978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d37e56d-db19-4e4b-a33d-dcbc48139de6 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1472 microversion: 2.1 time: 0.383945 Jul 18 12:57:08.300734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 657/1328] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:07 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:08.309586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:08.310828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:08.323056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.323725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.324806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.325439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.581651 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4caf6fc9-c924-4dd9-b718-d93e0544ca76 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "POST /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03/action" status: 202 len: 0 microversion: 2.1 time: 0.647735 Jul 18 12:57:08.583180 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 672/1329] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:07 2022] POST /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 12:57:08.598388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:08.599596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:08.611152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.611762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.612764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.613316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.732182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:08.745865 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2494f778-ba30-4ab5-8297-a7fbd73e73f1 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.443584 Jul 18 12:57:08.746952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 658/1330] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:08 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:08.756006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:08.757460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:08.768357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.769211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.770925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.771768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.838940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.839789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.840788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lazy-loading 'fault' on Instance uuid 7805837f-6fe5-4d53-ab51-97da89093a2b {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:08.893034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:08.906639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7679d9f1-674d-4b20-8d24-4fb1394ba591 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1463 microversion: 2.1 time: 0.321123 Jul 18 12:57:08.908445 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 673/1331] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:08 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1463 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:08.917870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f618f3f8-e01a-46f9-9bd1-6763a1bca441 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45a7dc0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:08.935323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:08.953429 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98ff9f3f-60c1-48be-871d-8cb2e91cd581 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 200 len: 1307 microversion: 2.1 time: 0.204302 Jul 18 12:57:08.961793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 659/1332] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:08 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:08.971968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:08.974187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:08.994777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.995703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:08.997172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:08.997961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.015751 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f618f3f8-e01a-46f9-9bd1-6763a1bca441 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.105078 Jul 18 12:57:09.019348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 674/1333] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:08 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:09.140430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:09.153924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'deleted': False, 'project_id': '82a9195ab5b14a27a57ff0420c9f41c1'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:09.169131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.170422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.171891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.173591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.393649 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c9ce3022-4ca8-489b-9317-41cc0a08dbaf tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.369716 Jul 18 12:57:09.398824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 675/1334] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 12:57:09 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:09.404316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:09.407302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:09.420361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.420938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.423405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.423405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.559216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:09.606203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:09.606733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca1e24a0-2134-44c1-a60c-c7b87b8c9f5a tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1647 microversion: 2.1 time: 0.628106 Jul 18 12:57:09.606733 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 660/1335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:08 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1647 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:09.616944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:09.630447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:09.632726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae550269-fcc6-4da1-a0e7-9c64bc120907 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1212 microversion: 2.1 time: 0.236421 Jul 18 12:57:09.635687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 676/1336] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:09 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1212 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:09.653937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:09.669825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.671075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.679289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.681006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.689826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'deleted': False} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:09.728577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.735165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:09.739030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:09.740330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:10.372243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:10.374273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Listed batch of 23 results from cell out of 1000 limit. Returned 23 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:57:10.402734 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6181eaa-a660-4cda-ad56-e713e990ba27 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1472 microversion: 2.1 time: 0.800425 Jul 18 12:57:10.404221 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 661/1337] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:09 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1472 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:10.421179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:10.426315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:10.449345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:10.450686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:10.453548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:10.454775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:10.498411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:10.637968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:10.639987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:10.905707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:10.935353 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d109ddc-33e0-48d8-b67c-8863d6a31789 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.528602 Jul 18 12:57:10.941562 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 662/1338] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:10 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:10.967963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-62ddcda8-a37a-41a2-9fc7-76b062f88e6b req-b0274f0a-8d4a-496a-be41-05283b660164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-unplugged", "status": "completed", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:11.012895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-62ddcda8-a37a-41a2-9fc7-76b062f88e6b req-b0274f0a-8d4a-496a-be41-05283b660164 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:11.014047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-62ddcda8-a37a-41a2-9fc7-76b062f88e6b req-b0274f0a-8d4a-496a-be41-05283b660164 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:11.059720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-62ddcda8-a37a-41a2-9fc7-76b062f88e6b req-b0274f0a-8d4a-496a-be41-05283b660164 service nova] Creating event network-vif-unplugged:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:57:11.094615 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-62ddcda8-a37a-41a2-9fc7-76b062f88e6b req-b0274f0a-8d4a-496a-be41-05283b660164 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150699 Jul 18 12:57:11.100690 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 663/1339] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:11.112398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:11.113980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7805837f-6fe5-4d53-ab51-97da89093a2b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:11.145277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:11.146740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:11.159596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:11.161015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:11.228111 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] HTTP exception thrown: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Request method failure captured: Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b HTTP/1.1 Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeOnEPT-HrZYdLJi2hfW3YwvScruS2vPnIcrwVbLoEK07fAfw_oXwkTNEEYxhd8Gj0epefqXyOhonYuUM1qt8gc07lA1pP1nW2YofEoiMTeOC9fkimCy8d2CpAFZDLMJsVlqEtkL4aVieB1atwM8JTdU1aipvHzGEOg3YwAg7Z6EBM Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: cc9f9ea85e4547f284a50bff35926dfd Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:11.237301 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cc9f9ea85e4547f284a50bff35926dfd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: cc9f9ea85e4547f284a50bff35926dfd Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesAdminNegativeTest-504814044-project Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 62315c008374414f8616584494d03573 Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesAdminNegativeTest-504814044-project Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. Jul 18 12:57:11.240138 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '7805837f-6fe5-4d53-ab51-97da89093a2b'} Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:11.241602 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. Jul 18 12:57:11.243992 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:11.251800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Returning 404 to user: Instance 7805837f-6fe5-4d53-ab51-97da89093a2b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:11.251800 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f54c2ab-68cf-408b-8bd3-d5c919e32373 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b" status: 404 len: 111 microversion: 2.1 time: 0.142707 Jul 18 12:57:11.253715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 664/1340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:11 2022] GET /compute/v2.1/servers/7805837f-6fe5-4d53-ab51-97da89093a2b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:11.262999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c16765c-2314-45eb-b3d1-ad2e61757328 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46b0040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:11.418038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c16765c-2314-45eb-b3d1-ad2e61757328 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.161352 Jul 18 12:57:11.419461 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 665/1341] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:11 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:11.438886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:11.444222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:11.470691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:11.471538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:11.473748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:11.474975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:11.954407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8ecd2ffb045fc8cc2585be2852c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49607e75db52424788c6fd28b64a4e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:11.979133 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-78f292db-19cb-4426-97c4-db2470dfaa5e tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 200 len: 1469 microversion: 2.1 time: 0.556920 Jul 18 12:57:11.985807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 666/1342] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:11 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 1469 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:12.003197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:12.003942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:12.022015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.027692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:12.032419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.037323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:12.260614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:12.287535 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-611881de-1daa-4064-b918-bfc7a160e8fc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1266 microversion: 2.1 time: 0.299214 Jul 18 12:57:12.289041 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 667/1343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:11 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:12.304504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:12.311636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:12.336318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.339172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:12.345684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.346649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:12.683737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:12.723377 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71ca589a-6630-4eed-be96-da1eacc84239 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 200 len: 1430 microversion: 2.1 time: 0.423825 Jul 18 12:57:12.724532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 668/1344] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:12 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 1430 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:12.750746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:12.752351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:12.783517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.790697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:12.794279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:12.796277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:13.601425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:13.641148 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-85c320f7-d4a7-4c99-ba5d-33fe9b52a2ec tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 0.910092 Jul 18 12:57:13.642397 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 669/1345] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:12 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:13.654826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-80340a39-bee9-404e-a7da-79fc3d591eef req-1898aeea-85e9-429b-b583-70a08843e767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1288ac7c-9233-4c87-94a6-cd6bcab877eb", "name": "network-vif-deleted", "tag": "bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:13.689808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-80340a39-bee9-404e-a7da-79fc3d591eef req-1898aeea-85e9-429b-b583-70a08843e767 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:13.703564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-80340a39-bee9-404e-a7da-79fc3d591eef req-1898aeea-85e9-429b-b583-70a08843e767 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:13.739181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-80340a39-bee9-404e-a7da-79fc3d591eef req-1898aeea-85e9-429b-b583-70a08843e767 service nova] Creating event network-vif-deleted:bc2be8fd-a2f6-495c-bd1c-ff749c47bfb2 for instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb on n-h1-850003-3 Jul 18 12:57:13.751793 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-80340a39-bee9-404e-a7da-79fc3d591eef req-1898aeea-85e9-429b-b583-70a08843e767 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106568 Jul 18 12:57:13.753567 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 670/1346] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:13.766701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f571ee9-4250-4bc6-b1c1-0ae04f88721c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4582160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:13.918338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f571ee9-4250-4bc6-b1c1-0ae04f88721c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.162095 Jul 18 12:57:13.921848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 671/1347] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:13 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:13.934351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ddc3e30b-5926-4b47-8995-c2a2d2afed8b req-66228e13-0266-45d2-a0a7-c6919d5e6a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdce4f2-f477-4b56-a478-6aaf470c23ce", "name": "network-vif-deleted", "tag": "4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:13.972252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ddc3e30b-5926-4b47-8995-c2a2d2afed8b req-66228e13-0266-45d2-a0a7-c6919d5e6a15 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:13.975837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ddc3e30b-5926-4b47-8995-c2a2d2afed8b req-66228e13-0266-45d2-a0a7-c6919d5e6a15 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.075203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ddc3e30b-5926-4b47-8995-c2a2d2afed8b req-66228e13-0266-45d2-a0a7-c6919d5e6a15 service nova] Creating event network-vif-deleted:4ce7dfa8-643d-4c91-ad33-dc5e31ebf59e for instance bfdce4f2-f477-4b56-a478-6aaf470c23ce on n-h2-850003-3 Jul 18 12:57:14.122228 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ddc3e30b-5926-4b47-8995-c2a2d2afed8b req-66228e13-0266-45d2-a0a7-c6919d5e6a15 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187978 Jul 18 12:57:14.128316 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 672/1348] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:14.175769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:14.186961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] [instance: 1288ac7c-9233-4c87-94a6-cd6bcab877eb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:14.226929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.228195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.231715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.234333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.308141 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] HTTP exception thrown: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Request method failure captured: Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb HTTP/1.1 Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VfwJNT4JwJkq6j6B4fUhy4DLsSCCTQDX310uopcmfCaU9RxHCDw9JhBsG41P4iifOPzwIkAgP7VBZcAiDThugbbqR3bfEmaWm3sI17iTiPdVxqTCbFILdPZ6xPorhn_WoxE1HAEGbPrhKY245o6IiWNQCFaBW78DKwWvhWHR1N_eVM Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:14.311736 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_49607e75db52424788c6fd28b64a4e1b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/49607e75db52424788c6fd28b64a4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 49607e75db52424788c6fd28b64a4e1b Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081924326 Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 77b8ecd2ffb045fc8cc2585be2852c48 Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsTestJSON-2081924326-project Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. Jul 18 12:57:14.314748 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1288ac7c-9233-4c87-94a6-cd6bcab877eb'} Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:14.316703 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. Jul 18 12:57:14.327145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.329800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Returning 404 to user: Instance 1288ac7c-9233-4c87-94a6-cd6bcab877eb could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:14.329800 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2176367d-6bd0-4dd2-a438-9056096f1634 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb" status: 404 len: 111 microversion: 2.1 time: 0.186720 Jul 18 12:57:14.329800 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 673/1349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:14 2022] GET /compute/v2.1/servers/1288ac7c-9233-4c87-94a6-cd6bcab877eb => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:14.345233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:14.346676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:14.373918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.392556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.394332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.395257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.801298 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-343c443a-5037-4df9-bbdb-446d63d42d9a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 37553 microversion: 2.1 time: 5.162903 Jul 18 12:57:14.819414 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 677/1350] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 18 12:57:09 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 37553 bytes in 5183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:57:14.876938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:14.878042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: bfdce4f2-f477-4b56-a478-6aaf470c23ce] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:14.909701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.910858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.912635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:14.913563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:14.943809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce HTTP/1.1 Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:14.947116 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. Jul 18 12:57:14.949718 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bfdce4f2-f477-4b56-a478-6aaf470c23ce'} Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:14.951120 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. Jul 18 12:57:14.957318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:14.959827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance bfdce4f2-f477-4b56-a478-6aaf470c23ce could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:14.959964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:14.960670 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d17144c9-b877-487b-b54d-f8855a6fb025 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce" status: 404 len: 111 microversion: 2.1 time: 0.128391 Jul 18 12:57:14.960670 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 678/1351] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:14 2022] GET /compute/v2.1/servers/bfdce4f2-f477-4b56-a478-6aaf470c23ce => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:14.966042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-793340bc-f3c5-4bef-89f7-1e5080c464ac tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e44fb940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:14.967115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2483f6bd-40a4-4251-a2cf-cfd88a1ab287 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 0.643517 Jul 18 12:57:14.968981 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 674/1352] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:14 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:15.043444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:15.045028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:15.074916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:15.076067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:15.079347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:15.080235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.051980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:16.103143 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62a960f7-b38f-416f-856d-d1851d5b4b40 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1718 microversion: 2.1 time: 1.096867 Jul 18 12:57:16.123266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 675/1353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:14 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1718 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:16.151697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:16.177291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'deleted': False, 'project_id': '82a9195ab5b14a27a57ff0420c9f41c1'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:16.213360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.214945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.217200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.218749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.387402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-793340bc-f3c5-4bef-89f7-1e5080c464ac tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/c8f2f6c4-93aa-4a3a-9632-29d8f8bb244c" status: 202 len: 0 microversion: 2.1 time: 1.434289 Jul 18 12:57:16.394132 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 679/1354] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:14 2022] DELETE /compute/v2.1/os-security-groups/c8f2f6c4-93aa-4a3a-9632-29d8f8bb244c => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:16.432690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9733df94-c423-409c-ae47-21e09ffaeb7c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4558670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:16.552321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7a47c7a-afd8-4be3-8737-aab329b5cdfa tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?tenant_id=04af0ec2bbba40768fd3348e0d869485" status: 200 len: 15 microversion: 2.1 time: 0.426965 Jul 18 12:57:16.558514 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 676/1355] 10.222.0.88 () {58 vars in 1230 bytes} [Mon Jul 18 12:57:16 2022] GET /compute/v2.1/servers/detail?tenant_id=04af0ec2bbba40768fd3348e0d869485 => generated 15 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:16.576127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:16.576650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:16.607610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.608365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.609881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.610729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.616990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9733df94-c423-409c-ae47-21e09ffaeb7c tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.210789 Jul 18 12:57:16.618516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 680/1356] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:16 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:16.640349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:16.643360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:16.675175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.683548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.688384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:16.694972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:16.857389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:17.089526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:17.171397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-baaa802e-cf76-45b2-ba74-f005e34737e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 204 len: 0 microversion: 2.1 time: 0.606670 Jul 18 12:57:17.178031 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 677/1357] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:16 2022] DELETE /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:17.212349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-145822f3-aebf-4483-af3f-2f95062a886e req-6c95923d-77ac-431e-b402-b4844d426526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec16fe0-4afc-4b20-a744-862055abbf0d", "name": "network-vif-deleted", "tag": "91362955-13dd-4ed5-a4d4-1ecf684232c1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:17.269308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-145822f3-aebf-4483-af3f-2f95062a886e req-6c95923d-77ac-431e-b402-b4844d426526 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:17.273567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-145822f3-aebf-4483-af3f-2f95062a886e req-6c95923d-77ac-431e-b402-b4844d426526 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:17.325210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-145822f3-aebf-4483-af3f-2f95062a886e req-6c95923d-77ac-431e-b402-b4844d426526 service nova] Creating event network-vif-deleted:91362955-13dd-4ed5-a4d4-1ecf684232c1 for instance 4ec16fe0-4afc-4b20-a744-862055abbf0d on n-h2-850003-3 Jul 18 12:57:17.347492 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-145822f3-aebf-4483-af3f-2f95062a886e req-6c95923d-77ac-431e-b402-b4844d426526 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160308 Jul 18 12:57:17.352719 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 678/1358] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:17.385275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e2d85db-bddb-469e-acb8-e8844a835119 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] Calling method '.version_select at 0x7f96e4577b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:17.617855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:17.642909 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5591b221-bc14-40c2-b78f-e96f0c013062 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.021961 Jul 18 12:57:17.654224 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 681/1359] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:16 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:17.665363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:17.682627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'tenant_id': '04af0ec2bbba40768fd3348e0d869485', 'deleted': False} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:17.704772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:17.709955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:17.718393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:17.720564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:17.960057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:57:18.232747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:18.233910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:18.506963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e2d85db-bddb-469e-acb8-e8844a835119 tempest-SecurityGroupsTestJSON-2081924326 tempest-SecurityGroupsTestJSON-2081924326-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/0489f8a9-9beb-4b06-a8b3-affbdd9cf3c0" status: 202 len: 0 microversion: 2.1 time: 1.142856 Jul 18 12:57:18.509007 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 679/1360] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 12:57:17 2022] DELETE /compute/v2.1/os-security-groups/0489f8a9-9beb-4b06-a8b3-affbdd9cf3c0 => generated 0 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:18.520255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:18.544014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:18.569535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:18.570808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:18.599261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:18.602392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:18.717160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e161d953-87cf-4d3b-b581-3a2b83dec517 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=04af0ec2bbba40768fd3348e0d869485" status: 200 len: 4823 microversion: 2.1 time: 1.070860 Jul 18 12:57:18.718834 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 682/1361] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 12:57:17 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=04af0ec2bbba40768fd3348e0d869485 => generated 4823 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:18.734530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:18.735453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:18.751561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:18.753696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:18.756574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:18.758085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.229123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:19.285311 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11503a85-76b0-4f8f-b8d6-44f8aeb66cee tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1472 microversion: 2.1 time: 0.563476 Jul 18 12:57:19.297151 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 683/1362] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:18 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1472 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:19.319565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68f6e733-be81-4311-a44e-d86f1342f64a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45409d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.437461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68f6e733-be81-4311-a44e-d86f1342f64a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.136096 Jul 18 12:57:19.450239 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 684/1363] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:19.460849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-65c668f4-da2b-4aeb-a097-5e9240ac151f req-a8cd3da7-87d7-462a-84cb-a0889bd6942e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fcd071-1dd1-4d0e-bffe-c972f29f5849", "tag": "76b5f0f0-dabe-4392-9738-86f60ebafbe8"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:19.483256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-65c668f4-da2b-4aeb-a097-5e9240ac151f req-a8cd3da7-87d7-462a-84cb-a0889bd6942e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.484708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-65c668f4-da2b-4aeb-a097-5e9240ac151f req-a8cd3da7-87d7-462a-84cb-a0889bd6942e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.534509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:19.557701 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-65c668f4-da2b-4aeb-a097-5e9240ac151f req-a8cd3da7-87d7-462a-84cb-a0889bd6942e service nova] Creating event network-changed:76b5f0f0-dabe-4392-9738-86f60ebafbe8 for instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 on n-h2-850003-3 Jul 18 12:57:19.566062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ca75d51-d939-4495-97ac-2b88204e66de tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1708 microversion: 2.1 time: 1.054677 Jul 18 12:57:19.569496 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 680/1364] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:18 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1708 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:19.580368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.584297 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-65c668f4-da2b-4aeb-a097-5e9240ac151f req-a8cd3da7-87d7-462a-84cb-a0889bd6942e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131579 Jul 18 12:57:19.585957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 685/1365] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:19.590531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:19.601694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.613318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'tenant_id': '82a9195ab5b14a27a57ff0420c9f41c1', 'deleted': False} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:19.623666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.624542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.627043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.628049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.629811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:19.659926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.661130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.663322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.666489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.744957 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-35028223-7afd-46b6-ae1b-6c95287b3f4f tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=82a9195ab5b14a27a57ff0420c9f41c1" status: 200 len: 15 microversion: 2.1 time: 0.153869 Jul 18 12:57:19.754335 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 686/1366] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=82a9195ab5b14a27a57ff0420c9f41c1 => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:19.763828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3fc482a1-e0cd-4881-af60-8ded0d8c7410 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '.version_select at 0x7f96e46189d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.794361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fc482a1-e0cd-4881-af60-8ded0d8c7410 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.795722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fc482a1-e0cd-4881-af60-8ded0d8c7410 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.824597 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3fc482a1-e0cd-4881-af60-8ded0d8c7410 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1933 microversion: 2.1 time: 0.067458 Jul 18 12:57:19.833987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 687/1367] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/os-migrations => generated 1933 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:19.839196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-793610c1-09cb-4ef3-8d9c-a95a27b3e20a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.848086 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-793610c1-09cb-4ef3-8d9c-a95a27b3e20a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018804 Jul 18 12:57:19.849598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 688/1368] 10.222.0.88 () {58 vars in 1188 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:19.880375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:19.888113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:19.931817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.933334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:19.940600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:19.943942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:20.582422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a56a4ad-2300-4b5e-8304-f023115fc402 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1859 microversion: 2.1 time: 0.729796 Jul 18 12:57:20.595660 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 689/1369] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1859 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:20.610980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:20.635427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:20.660748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:20.687501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-634596d1-ec21-4f0c-8ffc-1663cc7d5b96 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.112963 Jul 18 12:57:20.688816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:20.689766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:20.699015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:20.700082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:20.701554 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 681/1370] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:19 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:20.716536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:20.718098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:20.744222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:20.752757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:20.754710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:20.755810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:21.046087 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b69f211-70e6-4d84-b8b3-3d71ddf0ef7a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 0 microversion: 2.1 time: 0.447930 Jul 18 12:57:21.057370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 690/1371] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:20 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:21.067105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcf11cc4-a6c6-4d16-b691-73e9904b1ad1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44fb8b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:21.196409 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dcf11cc4-a6c6-4d16-b691-73e9904b1ad1 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.134896 Jul 18 12:57:21.197324 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 691/1372] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:21 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:21.222119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:21.230073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:21.257365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:21.258105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:21.259471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:21.260199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:21.537907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:21.552980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lazy-loading 'services' on Instance uuid b90439a2-8727-45d4-98f7-1aef41b30c9c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:21.737690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2521423a-ad12-445e-aec1-479b70dd7288 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments/937fd224-6324-4f0b-a3f0-4496945f7e62" status: 202 len: 0 microversion: 2.1 time: 0.530156 Jul 18 12:57:21.744103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 692/1373] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 12:57:21 2022] DELETE /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments/937fd224-6324-4f0b-a3f0-4496945f7e62 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:21.754028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:21.761056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:21.764130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '04af0ec2bbba40768fd3348e0d869485'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:21.777860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:21.779031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:21.782450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:21.783811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.254744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:22.274954 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bf9b0dc9-506c-46b4-bc28-dc9f1e6593e3 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1472 microversion: 2.1 time: 1.571283 Jul 18 12:57:22.275238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:57:22.280839 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 682/1374] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:20 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1472 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:22.294455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c31d7e7e-e56c-433f-b681-105442f8e102 req-5ecb07a7-271a-423e-8056-1043a3f3535f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b8bb3-5ab9-4e89-9a03-082494cb3b03", "name": "network-vif-plugged", "status": "completed", "tag": "d8a6952f-435a-4523-bab0-66e849fbd529"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:22.324190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c31d7e7e-e56c-433f-b681-105442f8e102 req-5ecb07a7-271a-423e-8056-1043a3f3535f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:22.335080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c31d7e7e-e56c-433f-b681-105442f8e102 req-5ecb07a7-271a-423e-8056-1043a3f3535f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.354509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c31d7e7e-e56c-433f-b681-105442f8e102 req-5ecb07a7-271a-423e-8056-1043a3f3535f service nova] Creating event network-vif-plugged:d8a6952f-435a-4523-bab0-66e849fbd529 for instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 on n-h2-850003-3 Jul 18 12:57:22.382914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c31d7e7e-e56c-433f-b681-105442f8e102 req-5ecb07a7-271a-423e-8056-1043a3f3535f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096156 Jul 18 12:57:22.385217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 683/1375] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:22.409154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:22.410740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:22.425668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:22.426608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.428304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:22.429509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.578780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-95ff0d9a-5f1b-4007-be2d-48a66cc97179 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.834655 Jul 18 12:57:22.581067 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 693/1376] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 18 12:57:21 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:22.591739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:22.596097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:22.606522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:22.607933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.609829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:22.610992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:22.727726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ed751b6-5f1a-4529-a0b6-0623a06fd908 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138491 Jul 18 12:57:22.729035 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 694/1377] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:22 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:22.746006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb4c6954-3ff7-428d-b4f2-9fce3e3e3a53 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4540790>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:22.917681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb4c6954-3ff7-428d-b4f2-9fce3e3e3a53 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.185477 Jul 18 12:57:22.919655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 695/1378] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:22 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:22.938948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:22.941650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:22.998333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:23.009801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:23.011930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:23.015097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:23.321085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-44ee63fb-9502-48e8-9c48-921d322bda0d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 0 microversion: 2.1 time: 0.398442 Jul 18 12:57:23.322971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 696/1379] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:22 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:23.342075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:23.343539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:23.373194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:23.378378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:23.384346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:23.385286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.014007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:24.076340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc0916af-db23-4a60-af66-526c03c07c96 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1430 microversion: 2.1 time: 0.750862 Jul 18 12:57:24.092962 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 697/1380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:23 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1430 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:24.137701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:24.139357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:24.184482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:24.193021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:24.193545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.194557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:24.195523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.260156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:24.307897 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfa140ac-5832-4095-9694-788adf02bc4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.917881 Jul 18 12:57:24.338423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 684/1381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:22 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:24.372634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-aa586e62-9ddb-43c2-9a91-2d92edc89dde req-c40d10e1-4ff3-429d-b722-29004a929db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd149fd-6a6e-4fdb-9532-a0d005c941a1", "name": "network-vif-deleted", "tag": "d39e1676-ab9f-4436-9bac-3d2487b343c0"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:24.439490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa586e62-9ddb-43c2-9a91-2d92edc89dde req-c40d10e1-4ff3-429d-b722-29004a929db9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:24.446612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa586e62-9ddb-43c2-9a91-2d92edc89dde req-c40d10e1-4ff3-429d-b722-29004a929db9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.526649 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aa586e62-9ddb-43c2-9a91-2d92edc89dde req-c40d10e1-4ff3-429d-b722-29004a929db9 service nova] Creating event network-vif-deleted:d39e1676-ab9f-4436-9bac-3d2487b343c0 for instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 on n-h2-850003-3 Jul 18 12:57:24.549398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-aa586e62-9ddb-43c2-9a91-2d92edc89dde req-c40d10e1-4ff3-429d-b722-29004a929db9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207948 Jul 18 12:57:24.553442 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 685/1382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:24.576112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:24.582506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:24.631636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:24.632700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.640115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:24.646083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:24.749778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:24.868779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82450aff-ed8e-4f25-99db-5da7fb091163 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.312298 Jul 18 12:57:24.886756 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 686/1383] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:24 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:24.911259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6797844-c677-487c-bbc1-9639b3267111 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4577790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:25.184978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6797844-c677-487c-bbc1-9639b3267111 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.285420 Jul 18 12:57:25.186488 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 687/1384] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:24 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:25.197114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:25.209697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-29525948-99c9-407e-bf35-6b77b54ed593 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1613 microversion: 2.1 time: 1.111686 Jul 18 12:57:25.222200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:25.222677 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 698/1385] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:24 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1613 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:25.263138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.266837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.268095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.273136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:25.281051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.284420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:25.300772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.317485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.322354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.322633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.488152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:25.571837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.579220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.580231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lazy-loading 'fault' on Instance uuid 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:25.756773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:25.819170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-55bce38d-8062-4c23-b4ce-0b7569a27c95 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 200 len: 1306 microversion: 2.1 time: 0.597640 Jul 18 12:57:25.829347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 699/1386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:25 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 1306 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:25.889643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:25.891546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:25.915431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd973641-c8f4-455b-a230-a7252c2c9416 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 204 len: 0 microversion: 2.1 time: 0.726515 Jul 18 12:57:25.919624 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 688/1387] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:25 2022] DELETE /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:25.935649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:25.936694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:25.956869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.957866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.962361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.963575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.966659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.967746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:25.978519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:25.979514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:26.356598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:27.028293 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c4562d9-b623-4950-9cef-aba57e7f61e2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1613 microversion: 2.1 time: 1.188376 Jul 18 12:57:27.034594 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 700/1388] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:25 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1613 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:27.053993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:27.060833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:27.082224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:27.083910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:27.085068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:27.099308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:27.196443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a219c69b-5b73-4966-a303-b399ba5543e7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159488 Jul 18 12:57:27.209672 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 701/1389] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:27 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:27.223043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:27.232124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:27.255774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:27.259608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:27.261332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:27.262982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.125315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:28.159203 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-498a64fe-cd0c-4083-a29b-986cf3ff6995 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1681 microversion: 2.1 time: 0.945896 Jul 18 12:57:28.166814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 702/1390] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:27 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1681 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:28.189097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-41b62f5f-d2d5-4492-86f0-21977bfb73c8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e431eee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:28.227956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:28.311785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:28.333912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-41b62f5f-d2d5-4492-86f0-21977bfb73c8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.141829 Jul 18 12:57:28.336621 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 703/1391] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:28 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:28.342907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7d5aacb4-8b04-46f3-8866-017820744bc6 req-8de6204f-6f15-4d08-b5a6-cc1b10fbc0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "name": "network-vif-plugged", "status": "completed", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:28.351127 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd506602-66dd-4be0-a787-6afbb25d33d1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 2.431357 Jul 18 12:57:28.360262 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 689/1392] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:25 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:28.383045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "name": "network-vif-unplugged", "status": "completed", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}, {"name": "network-changed", "server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:28.393146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d5aacb4-8b04-46f3-8866-017820744bc6 req-8de6204f-6f15-4d08-b5a6-cc1b10fbc0aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.396038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d5aacb4-8b04-46f3-8866-017820744bc6 req-8de6204f-6f15-4d08-b5a6-cc1b10fbc0aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.429089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.429927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.464130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7d5aacb4-8b04-46f3-8866-017820744bc6 req-8de6204f-6f15-4d08-b5a6-cc1b10fbc0aa service nova] Creating event network-vif-plugged:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:57:28.479382 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7d5aacb4-8b04-46f3-8866-017820744bc6 req-8de6204f-6f15-4d08-b5a6-cc1b10fbc0aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140327 Jul 18 12:57:28.491711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] Creating event network-vif-unplugged:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:57:28.492593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] Creating event network-changed:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 12:57:28.495418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 704/1393] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:28.518240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:28.519663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 3dd149fd-6a6e-4fdb-9532-a0d005c941a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:28.529905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-903a442e-5292-4c3a-b5b1-fe9a2187d9d2 req-41af5893-3a81-43f3-a5e8-b8da5adb0e5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.167024 Jul 18 12:57:28.538721 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 690/1394] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:28.550425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:28.561540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.562695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.564448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.565250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.580967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'host': 'n-h1-850003-3', 'deleted': False} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:28.622194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.623534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.624550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.625901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.655198 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 HTTP/1.1 Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:28.674774 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. Jul 18 12:57:28.677652 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '3dd149fd-6a6e-4fdb-9532-a0d005c941a1'} Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:28.679303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. Jul 18 12:57:28.681884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:28.684581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance 3dd149fd-6a6e-4fdb-9532-a0d005c941a1 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:28.684581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a4ff078-a1ca-4479-a9fe-fba096e83ec8 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1" status: 404 len: 111 microversion: 2.1 time: 0.179954 Jul 18 12:57:28.688810 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 705/1395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:28 2022] GET /compute/v2.1/servers/3dd149fd-6a6e-4fdb-9532-a0d005c941a1 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:28.704173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:28.705802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:28.757864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.763046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.764674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:28.765558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:28.944573 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2327073c-7349-4bee-aec0-c54fe7b152ef tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248634 Jul 18 12:57:28.950259 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 706/1396] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:28 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:28.977879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:28.979781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:29.012953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.013863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.018530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.028306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.176248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:29.242369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 12:57:29.522821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56fcc0c6-6d8f-49f4-b85c-682e2b4c1dc3 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers?host=n-h1-850003-3&all_tenants=1" status: 200 len: 2974 microversion: 2.1 time: 0.981414 Jul 18 12:57:29.525767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 691/1397] 10.222.0.88 () {58 vars in 1189 bytes} [Mon Jul 18 12:57:28 2022] GET /compute/v2.1/servers?host=n-h1-850003-3&all_tenants=1 => generated 2974 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:29.536628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:29.538847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:29.552257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.553449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.555286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.556350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.578824 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50142277-d1ef-4e87-83cd-f6689751fc1a tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 204 len: 0 microversion: 2.1 time: 0.624483 Jul 18 12:57:29.587021 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 707/1398] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:28 2022] DELETE /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:29.621708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64f793ac-e14c-410d-8c5d-ebc5101fabfa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4c248b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:29.832761 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64f793ac-e14c-410d-8c5d-ebc5101fabfa tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.243928 Jul 18 12:57:29.839868 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 708/1399] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:29 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:29.849764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:29.872132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:29.899060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.907581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.909188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:29.910073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:29.931400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:30.559745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:30.587196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea2e4af8-4ef6-4361-b16e-4a07da9207cb tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1681 microversion: 2.1 time: 1.058909 Jul 18 12:57:30.595813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 692/1400] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:29 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1681 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:30.627600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:30.649378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 12:57:30.667424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:30.680290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.681268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.682981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.691286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.694521 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3027b122-89d3-457d-b6ca-5668ab56572b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 0.845664 Jul 18 12:57:30.714686 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 709/1401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:29 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:30.740240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:30.741574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:30.769197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.772470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.777245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.783512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.811309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac63e1e4-6ec6-432e-8dd2-367bef9a2cf2 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.213113 Jul 18 12:57:30.826768 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 693/1402] 10.222.0.88 () {58 vars in 1195 bytes} [Mon Jul 18 12:57:30 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:30.845165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:30.860452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:30.884777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.884777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.886374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:30.899222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:30.937341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:31.232645 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6f42e20-8818-44d0-aa30-18fabe1e974b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.403705 Jul 18 12:57:31.233406 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 694/1403] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:30 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:31.291557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:31.293285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:31.331801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.332579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:31.344598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.345498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:31.420399 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e60f8495-2261-4d53-a605-f56bd0d96442 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 204 len: 0 microversion: 2.1 time: 0.701013 Jul 18 12:57:31.440074 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 710/1404] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:30 2022] DELETE /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:31.473725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-865136c5-34d6-4133-8a37-594dd7297900 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44f99d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:31.720336 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-865136c5-34d6-4133-8a37-594dd7297900 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.277926 Jul 18 12:57:31.723962 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 711/1405] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:31 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:31.761311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:31.763759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:31.801164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.803410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:31.807514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.811406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:31.843282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91ddbd5c-adbc-4856-8c97-d28ba5b4155c tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 0 microversion: 2.1 time: 0.607294 Jul 18 12:57:31.849997 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 695/1406] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:31 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:31.872563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:31.886760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:31.900468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:31.927439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.928189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:31.929540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:31.936492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:32.377112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:32.407653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6aa00e42-a486-405e-9de8-8f28cffb76af tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1613 microversion: 2.1 time: 0.555805 Jul 18 12:57:32.423651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:32.427655 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 696/1407] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:31 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1613 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:32.451550 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0a23b2b-3ec6-4e74-8b16-e760e713b5a2 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1474 microversion: 2.1 time: 0.709397 Jul 18 12:57:32.465596 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 712/1408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:31 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1474 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:32.477201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:32.479359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:32.490686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:32.508858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:32.515060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:32.522129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:32.525008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:32.526101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:32.527772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:32.529306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:32.542818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:32.544142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:32.848175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:57:32.856219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:57:32.857367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:57:32.866033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:57:32.866964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:57:33.152844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:33.179370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.180112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:33.185607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.193024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:33.315852 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7869a24-3f6b-4443-ac40-1cdff7b3bf26 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 1066 microversion: 2.1 time: 0.857194 Jul 18 12:57:33.323495 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 713/1409] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:32 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 1066 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 12:57:33.351971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:33.361748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:33.387282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.389662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:33.395513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.396569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:33.601716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b69152b3-da27-4240-89b6-550f13da3de9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.276225 Jul 18 12:57:33.630138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 714/1410] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:33 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:33.650746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ab55a8f5-b991-4719-80e8-d0f22c637316 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4532040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:33.832544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ab55a8f5-b991-4719-80e8-d0f22c637316 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.194978 Jul 18 12:57:33.844342 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 715/1411] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:33 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:33.863748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:33.864730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:33.893763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.894497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:33.895700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:33.917654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:34.396936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:34.422604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73329e00-9eb2-4d42-8c52-87d542ccd8e8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.991816 Jul 18 12:57:34.437104 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 697/1412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:32 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:34.442687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:34.452474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:34.481698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:34.497699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:34.499435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:34.500892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:34.698220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:34.699018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:34.699570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lazy-loading 'fault' on Instance uuid 7c36dc80-89d0-4801-88f2-2e74b3245ec2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:34.712351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:34.761229 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-18e1f32f-dfc3-4830-98cc-c6febf382815 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 0.914135 Jul 18 12:57:34.776150 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 716/1413] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:33 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:34.804838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:34.821161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:34.867862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:34.868669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:34.872518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:34.875353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.167537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:35.196016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62315c008374414f8616584494d03573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f9ea85e4547f284a50bff35926dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:35.224867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b7692b7-3725-46ab-abb4-e47bf47bf2b7 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 200 len: 1432 microversion: 2.1 time: 0.443131 Jul 18 12:57:35.226918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 717/1414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:34 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 1432 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:35.232101 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96ed84a2-a30e-4101-987e-58cdf6c5263a tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 200 len: 1331 microversion: 2.1 time: 0.793124 Jul 18 12:57:35.233064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 698/1415] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:34 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 1331 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:35.264212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c885dfbb-8b94-4785-ab54-f8cf8b11eeec req-98ed9961-6b9e-443c-8ea7-785034f94ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c36dc80-89d0-4801-88f2-2e74b3245ec2", "name": "network-vif-deleted", "tag": "053f4e21-28a4-4e59-b5f6-9ca5c33f510a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:35.289036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:35.296203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:35.324506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c885dfbb-8b94-4785-ab54-f8cf8b11eeec req-98ed9961-6b9e-443c-8ea7-785034f94ac1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.332292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c885dfbb-8b94-4785-ab54-f8cf8b11eeec req-98ed9961-6b9e-443c-8ea7-785034f94ac1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.344496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.348417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.351821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.362317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.411322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c885dfbb-8b94-4785-ab54-f8cf8b11eeec req-98ed9961-6b9e-443c-8ea7-785034f94ac1 service nova] Creating event network-vif-deleted:053f4e21-28a4-4e59-b5f6-9ca5c33f510a for instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 on n-h1-850003-3 Jul 18 12:57:35.433163 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c885dfbb-8b94-4785-ab54-f8cf8b11eeec req-98ed9961-6b9e-443c-8ea7-785034f94ac1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197802 Jul 18 12:57:35.440295 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 718/1416] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:35.455880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:35.457654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:35.493821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.493821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.495762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.497017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.571616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3a5fbba1-cfce-4e63-adf6-e5e6c683f200 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.311065 Jul 18 12:57:35.587230 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 699/1417] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:35 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:35.603674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3a4e454e-7bca-4737-9041-8143bfec7e39 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4577ca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:35.826257 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3a4e454e-7bca-4737-9041-8143bfec7e39 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.236592 Jul 18 12:57:35.839142 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 700/1418] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:35 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:35.858972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:35.860480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:35.923395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.923936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:35.925449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:35.935122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:36.120222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:36.257765 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48dc6c8a-c412-467f-a477-69e716d945cd tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 2341 microversion: 2.25 time: 0.800834 Jul 18 12:57:36.262178 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 719/1419] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:57:35 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 2341 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:57:36.290231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:36.291302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:36.331248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:36.332101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:36.333614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:36.339083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:36.942981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:36.963241 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be3a1aea-0b8e-49fb-8a9a-72137916939a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 0.684234 Jul 18 12:57:36.965988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 720/1420] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:36 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:36.977480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:36.979218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 698ab691-827e-41f4-8c06-c2c64f15f51b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:36.993323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:36.995259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:36.997646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:36.999037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.041140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b HTTP/1.1 Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:37.047442 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. Jul 18 12:57:37.050912 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '698ab691-827e-41f4-8c06-c2c64f15f51b'} Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:37.052400 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. Jul 18 12:57:37.057884 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.063597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance 698ab691-827e-41f4-8c06-c2c64f15f51b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:37.063597 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75ee5986-7083-4caa-94c6-3949756fef48 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b" status: 404 len: 111 microversion: 2.1 time: 0.081777 Jul 18 12:57:37.063597 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 721/1421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:36 2022] GET /compute/v2.1/servers/698ab691-827e-41f4-8c06-c2c64f15f51b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:37.063597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.063597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [instance: 7c36dc80-89d0-4801-88f2-2e74b3245ec2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:37.081134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.082363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.084899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.087081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.135090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] HTTP exception thrown: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Request method failure captured: Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 HTTP/1.1 Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeOnEPT-HrZYdLJi2hfW3YwvScruS2vPnIcrwVbLoEK07fAfw_oXwkTNEEYxhd8Gj0epefqXyOhonYuUM1qt8gc07lA1pP1nW2YofEoiMTeOC9fkimCy8d2CpAFZDLMJsVlqEtkL4aVieB1atwM8JTdU1aipvHzGEOg3YwAg7Z6EBM Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: cc9f9ea85e4547f284a50bff35926dfd Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:57:37.149812 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cc9f9ea85e4547f284a50bff35926dfd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cc9f9ea85e4547f284a50bff35926dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: cc9f9ea85e4547f284a50bff35926dfd Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-504814044 Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesAdminNegativeTest-504814044-project Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 62315c008374414f8616584494d03573 Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesAdminNegativeTest-504814044-project Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. Jul 18 12:57:37.152325 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7c36dc80-89d0-4801-88f2-2e74b3245ec2'} Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:37.153594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. Jul 18 12:57:37.158375 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:57:37.163624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Returning 404 to user: Instance 7c36dc80-89d0-4801-88f2-2e74b3245ec2 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:37.163624 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b18c01ee-739c-4748-b4db-9c354c6dd0e5 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2" status: 404 len: 111 microversion: 2.1 time: 0.099480 Jul 18 12:57:37.167364 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 722/1422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:37 2022] GET /compute/v2.1/servers/7c36dc80-89d0-4801-88f2-2e74b3245ec2 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:37.194653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.197151 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:57:37.197151 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:57:37.198651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.199226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.200091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.200871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.327206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-622571eb-5dcf-40ed-8632-678a25379fac tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.153787 Jul 18 12:57:37.335527 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 723/1423] 10.222.0.88 () {60 vars in 1216 bytes} [Mon Jul 18 12:57:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:57:37.350870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.355089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:37.392947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.394087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.396146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.399178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.512634 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7b57169-57e9-4983-9613-9e765e9c0798 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174218 Jul 18 12:57:37.532563 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 724/1424] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:37 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:37.541810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-53b7e181-e2cb-4bd2-91fa-9ad5050192bf tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e42588b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.662775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:37.707590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9827fd76-91ea-4673-ad3e-0023f087d4e6 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.863674 Jul 18 12:57:37.712254 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 701/1425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:35 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:37.734550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.741505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:37.781391 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-53b7e181-e2cb-4bd2-91fa-9ad5050192bf tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.246109 Jul 18 12:57:37.782484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.783228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.784603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:37.785297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:37.799265 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 725/1426] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:37 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:37.814858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-43fb0361-797d-469d-ac35-db5468429565 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] Calling method '.version_select at 0x7f96e44f98b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:37.826028 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43fb0361-797d-469d-ac35-db5468429565 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 12:57:38.731954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:38.754647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:38.786611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f94ab55e-ed69-4749-bd63-ad052f4405e4 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1474 microversion: 2.1 time: 1.065210 Jul 18 12:57:38.792379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 702/1427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:37 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1474 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:38.819372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5fcfad4d-6a79-4c1d-8349-c91cb6891f3a req-c86c697c-cc8b-4bdc-99a4-a023d0ec47db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698ab691-827e-41f4-8c06-c2c64f15f51b", "name": "network-vif-deleted", "tag": "d4b6277e-6bbc-4a96-a867-4bed21ef4e50"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:38.840592 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-43fb0361-797d-469d-ac35-db5468429565 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 35382. Jul 18 12:57:38.906115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5fcfad4d-6a79-4c1d-8349-c91cb6891f3a req-c86c697c-cc8b-4bdc-99a4-a023d0ec47db service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:38.910556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5fcfad4d-6a79-4c1d-8349-c91cb6891f3a req-c86c697c-cc8b-4bdc-99a4-a023d0ec47db service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:38.929639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-43fb0361-797d-469d-ac35-db5468429565 tempest-VolumesAdminNegativeTest-504814044 tempest-VolumesAdminNegativeTest-504814044-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777650310" status: 202 len: 0 microversion: 2.1 time: 1.127593 Jul 18 12:57:38.930323 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 726/1428] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 12:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777650310 => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:38.962567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:38.963661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:38.977493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5fcfad4d-6a79-4c1d-8349-c91cb6891f3a req-c86c697c-cc8b-4bdc-99a4-a023d0ec47db service nova] Creating event network-vif-deleted:d4b6277e-6bbc-4a96-a867-4bed21ef4e50 for instance 698ab691-827e-41f4-8c06-c2c64f15f51b on n-h1-850003-3 Jul 18 12:57:39.021597 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5fcfad4d-6a79-4c1d-8349-c91cb6891f3a req-c86c697c-cc8b-4bdc-99a4-a023d0ec47db service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216799 Jul 18 12:57:39.022410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.025453 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 703/1429] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:39.029006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:39.038243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.044406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:39.065738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:39.072554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:39.134077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.135871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:39.145896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.152656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:39.290674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cea895d-0986-4026-b595-554a49ff421a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262891 Jul 18 12:57:39.301545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 704/1430] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:39 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:39.323554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:39.332800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:39.369858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.372392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:39.376671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:39.380825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.005766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:40.019605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-373c01af-19ea-4dc3-bb20-43114dfaa6e4 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 1.087916 Jul 18 12:57:40.034203 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 727/1431] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:38 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:40.103560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7924ccc2-d7ba-4dff-9923-a7f1cef19a83 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4540c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:40.282996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7924ccc2-d7ba-4dff-9923-a7f1cef19a83 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.246323 Jul 18 12:57:40.288125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 728/1432] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:40 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:40.324084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:40.333917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:40.365048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.383568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.393468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.394525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.471783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:40.546064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.548179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.558554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lazy-loading 'fault' on Instance uuid 888b28f5-3b97-4218-9811-a82ebdf63f27 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:57:40.683943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:40.706116 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8011a2da-409f-4f5e-874d-22b90c049126 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 200 len: 1308 microversion: 2.1 time: 0.414082 Jul 18 12:57:40.708262 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 729/1433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:40 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:40.717891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-47f40fee-958d-4157-8bb2-2adb82db0490 req-a3868add-50cd-4bf8-ad1d-a73f495fe991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888b28f5-3b97-4218-9811-a82ebdf63f27", "name": "network-vif-deleted", "tag": "87a0a8f3-d59b-430d-b1a3-f8daaf528f86"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:40.726725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:40.765254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-47f40fee-958d-4157-8bb2-2adb82db0490 req-a3868add-50cd-4bf8-ad1d-a73f495fe991 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.767065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-47f40fee-958d-4157-8bb2-2adb82db0490 req-a3868add-50cd-4bf8-ad1d-a73f495fe991 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.789062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:40.824022 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-47f40fee-958d-4157-8bb2-2adb82db0490 req-a3868add-50cd-4bf8-ad1d-a73f495fe991 service nova] Creating event network-vif-deleted:87a0a8f3-d59b-430d-b1a3-f8daaf528f86 for instance 888b28f5-3b97-4218-9811-a82ebdf63f27 on n-h2-850003-3 Jul 18 12:57:40.840201 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09b756fb-0ff9-4d39-9083-2ac3c4bb3bd1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.534768 Jul 18 12:57:40.846733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-47f40fee-958d-4157-8bb2-2adb82db0490 req-a3868add-50cd-4bf8-ad1d-a73f495fe991 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135198 Jul 18 12:57:40.848142 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 705/1434] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:39 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:40.869485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 730/1435] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:40.885758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:40.893095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:40.929685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.943436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:40.955153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:40.956048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.054789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:41.058188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:41.085189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:41.085669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.086595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:41.087071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.147512 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcae9bfa-3065-4e2a-8713-0969c77bffad tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291325 Jul 18 12:57:41.152573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 706/1436] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:40 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 197 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:41.321930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6c8df5f-b194-437e-b523-72294d637a20 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45bca60>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:41.552900 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6c8df5f-b194-437e-b523-72294d637a20 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.250395 Jul 18 12:57:41.558494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 707/1437] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:41 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:41.748253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:41.750739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: 888b28f5-3b97-4218-9811-a82ebdf63f27] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:41.775164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:41.776426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.779703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:41.781646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.833288 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 HTTP/1.1 Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:41.838873 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. Jul 18 12:57:41.841970 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '888b28f5-3b97-4218-9811-a82ebdf63f27'} Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:41.845250 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. Jul 18 12:57:41.848524 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:41.852998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance 888b28f5-3b97-4218-9811-a82ebdf63f27 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:41.855219 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d25f643b-3c75-4222-ad97-f793f1dfb815 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27" status: 404 len: 111 microversion: 2.1 time: 0.118147 Jul 18 12:57:41.857298 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 708/1438] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:41 2022] GET /compute/v2.1/servers/888b28f5-3b97-4218-9811-a82ebdf63f27 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:41.867175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8674629f-600e-4326-934e-e48afb4d2f00 req-f736bd6c-f4e7-4bb9-bde6-5680f0115808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fcd071-1dd1-4d0e-bffe-c972f29f5849", "name": "network-vif-plugged", "status": "completed", "tag": "76b5f0f0-dabe-4392-9738-86f60ebafbe8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:41.874567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:41.890010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8674629f-600e-4326-934e-e48afb4d2f00 req-f736bd6c-f4e7-4bb9-bde6-5680f0115808 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:41.892161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8674629f-600e-4326-934e-e48afb4d2f00 req-f736bd6c-f4e7-4bb9-bde6-5680f0115808 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:41.913716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59bb0929-dcd1-46d5-a363-97eb146c4609 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 0.865357 Jul 18 12:57:41.919441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 731/1439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:41 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:57:41.947560 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8674629f-600e-4326-934e-e48afb4d2f00 req-f736bd6c-f4e7-4bb9-bde6-5680f0115808 service nova] Creating event network-vif-plugged:76b5f0f0-dabe-4392-9738-86f60ebafbe8 for instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 on n-h2-850003-3 Jul 18 12:57:41.951727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-936def99-b424-49c2-bb00-32aadb9e8e5d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:41.975484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8674629f-600e-4326-934e-e48afb4d2f00 req-f736bd6c-f4e7-4bb9-bde6-5680f0115808 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115381 Jul 18 12:57:41.988614 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 709/1440] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:42.013524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:42.016093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:42.059907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.061239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.064770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.070645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.111904 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-936def99-b424-49c2-bb00-32aadb9e8e5d tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/061c90c0-2682-4356-9b3d-2be66a61f3af" status: 204 len: 0 microversion: 2.1 time: 0.189967 Jul 18 12:57:42.118517 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 732/1441] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 12:57:41 2022] DELETE /compute/v2.1/os-server-groups/061c90c0-2682-4356-9b3d-2be66a61f3af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:42.133266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:42.148806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:42.186570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.187935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.189518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.193657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.314179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:42.669956 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f2e6ac3-7a5a-49af-928c-6cea6fd0578b tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 204 len: 0 microversion: 2.1 time: 0.542445 Jul 18 12:57:42.674799 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 733/1442] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:42 2022] DELETE /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 12:57:42.696697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:42.700775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:42.719352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.720809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.724193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:42.725602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:42.846210 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd4956be-a4c0-40df-9318-5a7ba40b6dd9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163808 Jul 18 12:57:42.847474 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 734/1443] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 12:57:42 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:43.211943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:43.239780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b920cf6-ebd1-4f40-a765-0338070e7a86 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.248037 Jul 18 12:57:43.241883 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 710/1444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:41 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:43.262220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59078a06-26e8-4906-8eec-d3b581697b05 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4432ee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:43.405928 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59078a06-26e8-4906-8eec-d3b581697b05 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.161525 Jul 18 12:57:43.407931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 711/1445] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:43 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:43.417975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:43.419340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:43.437683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.438966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:43.440616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.441574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:43.497266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7106f9a4-30b5-4d5f-9f0f-eea36ea33d58", "device": "/dev/xvdb"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:43.501245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:43.519879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.521825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:43.525278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.527325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:43.552911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:43.802763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28f05de8-4312-459e-93d1-3c2d1a10ac1f tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 204 len: 0 microversion: 2.1 time: 0.391204 Jul 18 12:57:43.806689 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 712/1446] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:43 2022] DELETE /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:43.830135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:43.835896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:43.880875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.881681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:43.895760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:43.896787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:44.603109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:44.629854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5b7b8ba-c25a-4f66-a02a-963ad983365d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 0.820874 Jul 18 12:57:44.634553 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 713/1447] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:43 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:44.639419 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74e43a17-2f19-4921-be29-333040d29ad8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.787472 Jul 18 12:57:44.652862 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 735/1448] 10.222.0.88 () {62 vars in 1363 bytes} [Mon Jul 18 12:57:42 2022] POST /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 194 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:57:44.660515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:44.661657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:44.682955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:44.690533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:44.699437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:44.700165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:44.701360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:44.701909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:44.717513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:44.727995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:44.729749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:44.731694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:44.737155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:45.302563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:45.331672 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e6dc148-1051-431f-9f8f-67a5f79ec399 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 200 len: 1473 microversion: 2.1 time: 0.694839 Jul 18 12:57:45.337420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 714/1449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:44 2022] GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 1473 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:45.367731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0023c7e7-740b-459c-a8ae-9da201bc5056 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4577280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:45.548136 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0023c7e7-740b-459c-a8ae-9da201bc5056 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.208456 Jul 18 12:57:45.550126 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 715/1450] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:45 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:45.673148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:45.686485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:45.699513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:45.708022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:45.712348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:45.712348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:45.838787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:45.869452 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d8b26a2-cd06-4755-a2fb-eb2096531484 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 1.210904 Jul 18 12:57:45.882846 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 736/1451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:44 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:46.377099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:46.412011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dcaa9957-72ae-4355-a0a9-9037453169a2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1470 microversion: 2.1 time: 0.751311 Jul 18 12:57:46.429200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 716/1452] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:45 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1470 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:46.580482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0f2e9bb-68b6-41e0-904e-c88153558298 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4582040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:46.848528 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0f2e9bb-68b6-41e0-904e-c88153558298 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1455 microversion: 2.1 time: 0.270132 Jul 18 12:57:46.860817 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 717/1453] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:46 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1455 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:57:46.903960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:46.905454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:46.959438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:46.961451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:46.975380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:46.979786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:47.247744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:47.370368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:47.378589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:47.401875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:47.403046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:47.404448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:47.406305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:47.539359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:47.571298 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1259381-9c5a-40ca-947d-aa4efdebfa06 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1308 microversion: 2.1 time: 0.674430 Jul 18 12:57:47.580723 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 718/1454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:46 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:57:47.618732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:47.623186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:47.647110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:47.654220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:47.659846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:47.665370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:48.801113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:48.840069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0e9e627a-af1d-471a-8111-e1375cc7ce6c tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 200 len: 1473 microversion: 2.1 time: 2.476499 Jul 18 12:57:48.857185 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 737/1455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:46 2022] GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 1473 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:57:48.883233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ad5c79a-7209-4729-bb2b-9f9b71daae6d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44f9b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:49.193320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:49.216232 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99991988-2463-4e33-84cf-1b1dc3809ca0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1476 microversion: 2.1 time: 1.628505 Jul 18 12:57:49.218824 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 719/1456] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:47 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1476 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:49.228617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d06ccd5e-0502-4b2c-99c4-a964c6e0289b req-a75a35ce-611e-4c51-ba6b-4b162ffa9f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2edb7d-b8d6-479d-9120-62ceae4df679", "name": "network-vif-unplugged", "status": "completed", "tag": "16cf2a24-d295-40c6-b85e-57c3c5f6b20b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:49.247386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d06ccd5e-0502-4b2c-99c4-a964c6e0289b req-a75a35ce-611e-4c51-ba6b-4b162ffa9f8f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:49.248624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d06ccd5e-0502-4b2c-99c4-a964c6e0289b req-a75a35ce-611e-4c51-ba6b-4b162ffa9f8f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:49.927040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d06ccd5e-0502-4b2c-99c4-a964c6e0289b req-a75a35ce-611e-4c51-ba6b-4b162ffa9f8f service nova] Creating event network-vif-unplugged:16cf2a24-d295-40c6-b85e-57c3c5f6b20b for instance fa2edb7d-b8d6-479d-9120-62ceae4df679 on n-h2-850003-3 Jul 18 12:57:49.948730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d06ccd5e-0502-4b2c-99c4-a964c6e0289b req-a75a35ce-611e-4c51-ba6b-4b162ffa9f8f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.725532 Jul 18 12:57:49.955266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 720/1457] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:49.977393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:49.978705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:50.014904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:50.028464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:50.058604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:50.081429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:50.082705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:50.883323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:50.930260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5c5e1d2-518c-4ab4-98dc-d54fe8f98f1a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1488 microversion: 2.1 time: 0.972643 Jul 18 12:57:50.957257 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 721/1458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:49 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1488 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:51.774411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:51.778447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:51.789256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:51.799221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:51.800666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:51.979491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a7901d7-3028-446e-9734-3978b9f50aa8 tempest-AZV2TestJSON-433956768 tempest-AZV2TestJSON-433956768-project] 10.222.0.88 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.028679 Jul 18 12:57:51.990579 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 722/1459] 10.222.0.88 () {58 vars in 1163 bytes} [Mon Jul 18 12:57:50 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 12:57:52.031926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:52.038273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: fa2edb7d-b8d6-479d-9120-62ceae4df679] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:52.088267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:52.098907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:52.111025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:52.114578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:52.206733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 HTTP/1.1 Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:52.216329 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. Jul 18 12:57:52.219879 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'fa2edb7d-b8d6-479d-9120-62ceae4df679'} Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:52.221454 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. Jul 18 12:57:52.228417 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:52.235131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance fa2edb7d-b8d6-479d-9120-62ceae4df679 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:52.235131 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b66ef552-ca99-4bff-ab59-566fb1979378 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679" status: 404 len: 111 microversion: 2.1 time: 0.229546 Jul 18 12:57:52.236583 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 723/1460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:51 2022] GET /compute/v2.1/servers/fa2edb7d-b8d6-479d-9120-62ceae4df679 => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:52.260773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:52.279153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:52.316610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:52.317027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:52.323738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:52.327165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:53.009334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:53.101618 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26535165-46ed-45b2-8ac7-19a9f8df4453 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1476 microversion: 2.1 time: 0.854796 Jul 18 12:57:53.103000 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 724/1461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:52 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1476 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:53.143505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ab100e95-6550-4bc5-bfe5-ecd4a2baf506 req-b53faabd-8f9c-4b1f-a759-af9a498cfa3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2edb7d-b8d6-479d-9120-62ceae4df679", "name": "network-vif-deleted", "tag": "16cf2a24-d295-40c6-b85e-57c3c5f6b20b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:53.233675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ab100e95-6550-4bc5-bfe5-ecd4a2baf506 req-b53faabd-8f9c-4b1f-a759-af9a498cfa3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:53.234512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ab100e95-6550-4bc5-bfe5-ecd4a2baf506 req-b53faabd-8f9c-4b1f-a759-af9a498cfa3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:53.308989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ab100e95-6550-4bc5-bfe5-ecd4a2baf506 req-b53faabd-8f9c-4b1f-a759-af9a498cfa3c service nova] Creating event network-vif-deleted:16cf2a24-d295-40c6-b85e-57c3c5f6b20b for instance fa2edb7d-b8d6-479d-9120-62ceae4df679 on n-h2-850003-3 Jul 18 12:57:53.354271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ab100e95-6550-4bc5-bfe5-ecd4a2baf506 req-b53faabd-8f9c-4b1f-a759-af9a498cfa3c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239789 Jul 18 12:57:53.366310 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 725/1462] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:53.389436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4878f5d-30a7-4871-b821-df890572529d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:53.407973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4878f5d-30a7-4871-b821-df890572529d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:53.409517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4878f5d-30a7-4871-b821-df890572529d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:53.617370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:53.737676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4878f5d-30a7-4871-b821-df890572529d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 12:57:54.090314 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4878f5d-30a7-4871-b821-df890572529d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849/action" status: 202 len: 0 microversion: 2.1 time: 0.716711 Jul 18 12:57:54.109900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 726/1463] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:53 2022] POST /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:57:54.129842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-97b9ef15-0f81-48cb-9a6b-aa4c0bb17d90 req-028390dc-fc2a-46cf-9732-12714c9578f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0361ad1-b767-4167-a7ac-46b828a3f89b", "name": "network-vif-deleted", "tag": "7c9e36a3-77dd-4fe4-99bb-5a51c2238080"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:54.167493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-97b9ef15-0f81-48cb-9a6b-aa4c0bb17d90 req-028390dc-fc2a-46cf-9732-12714c9578f9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.176055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-97b9ef15-0f81-48cb-9a6b-aa4c0bb17d90 req-028390dc-fc2a-46cf-9732-12714c9578f9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:54.268201 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-97b9ef15-0f81-48cb-9a6b-aa4c0bb17d90 req-028390dc-fc2a-46cf-9732-12714c9578f9 service nova] Creating event network-vif-deleted:7c9e36a3-77dd-4fe4-99bb-5a51c2238080 for instance f0361ad1-b767-4167-a7ac-46b828a3f89b on n-h2-850003-3 Jul 18 12:57:54.300593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-97b9ef15-0f81-48cb-9a6b-aa4c0bb17d90 req-028390dc-fc2a-46cf-9732-12714c9578f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178336 Jul 18 12:57:54.305160 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 727/1464] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:54.336337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2362ba8e-09e7-4a31-a0eb-a5a41b0bcef0 req-e20a0183-5ede-4593-9da1-b3ae38b65ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "name": "network-vif-unplugged", "status": "completed", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:54.376158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2362ba8e-09e7-4a31-a0eb-a5a41b0bcef0 req-e20a0183-5ede-4593-9da1-b3ae38b65ee1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.378539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2362ba8e-09e7-4a31-a0eb-a5a41b0bcef0 req-e20a0183-5ede-4593-9da1-b3ae38b65ee1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:54.411350 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2362ba8e-09e7-4a31-a0eb-a5a41b0bcef0 req-e20a0183-5ede-4593-9da1-b3ae38b65ee1 service nova] Creating event network-vif-unplugged:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:57:54.435153 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2362ba8e-09e7-4a31-a0eb-a5a41b0bcef0 req-e20a0183-5ede-4593-9da1-b3ae38b65ee1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127460 Jul 18 12:57:54.439885 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 728/1465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:54.446846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:54.447592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: f0361ad1-b767-4167-a7ac-46b828a3f89b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:54.472293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.472794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:54.474040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.477315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:54.527158 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b HTTP/1.1 Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:57:54.543549 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. Jul 18 12:57:54.546287 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'f0361ad1-b767-4167-a7ac-46b828a3f89b'} Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:57:54.548615 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. Jul 18 12:57:54.553184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:57:54.565750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance f0361ad1-b767-4167-a7ac-46b828a3f89b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:57:54.566841 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3440c817-930f-4b13-bcfe-f248b656bcbe tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b" status: 404 len: 111 microversion: 2.1 time: 0.125263 Jul 18 12:57:54.567730 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 729/1466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:54 2022] GET /compute/v2.1/servers/f0361ad1-b767-4167-a7ac-46b828a3f89b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:57:54.583371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:54.584008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:54.604379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.607526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:54.608182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:54.608684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:55.353555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:55.375836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f8a186d-286b-428d-abb5-f7eaad864935 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.797489 Jul 18 12:57:55.376877 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 730/1467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:54 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:55.390612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:55.396183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:55.417512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:55.420160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:55.425165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:55.426069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:56.318109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:56.372580 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a646ebb-c15e-4806-896e-e39bd444b24d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1462 microversion: 2.1 time: 0.985555 Jul 18 12:57:56.379351 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 731/1468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:55 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1462 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:56.412180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96ef813f-7873-46ca-a5c0-ecb60300cdd5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:56.651351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96ef813f-7873-46ca-a5c0-ecb60300cdd5 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/8f8cee9b-f8dc-440e-b51c-cb72dad35532" status: 204 len: 0 microversion: 2.1 time: 0.268545 Jul 18 12:57:56.653772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 732/1469] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 12:57:56 2022] DELETE /compute/v2.1/os-server-groups/8f8cee9b-f8dc-440e-b51c-cb72dad35532 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:56.690857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:56.692026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:56.732070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:56.734475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:56.739740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:56.740670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:57.395835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:57.428606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:57.465444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a6a6547-7ebe-4a7c-ac60-893ded62fc3f tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1462 microversion: 2.1 time: 0.804807 Jul 18 12:57:57.467274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 733/1470] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:56 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1462 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:57.505117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:57.506369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:57.525173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:57.526366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:57.527518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:57.528144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:58.222192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:57:58.269530 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e53598c9-f35d-49f5-bc77-cc68e5de3bfb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.798950 Jul 18 12:57:58.270997 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 734/1471] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:57:57 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:57:58.287743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:57:58.288982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:58.301938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:58.304776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:58.308263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:58.309318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:58.426025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:57:58.790322 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-78b1f47e-1a97-4073-94ee-b65106aa4f77 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 204 len: 0 microversion: 2.1 time: 0.514072 Jul 18 12:57:58.797102 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 735/1472] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:57:58 2022] DELETE /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:57:58.816023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:57:58.820718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f19efd14-e0dc-4a9a-8dd3-65465487eb9f req-ce6ce9d4-5179-4879-ae0b-9a854d101767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "name": "network-vif-plugged", "status": "completed", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:58.849324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f19efd14-e0dc-4a9a-8dd3-65465487eb9f req-ce6ce9d4-5179-4879-ae0b-9a854d101767 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:58.850220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f19efd14-e0dc-4a9a-8dd3-65465487eb9f req-ce6ce9d4-5179-4879-ae0b-9a854d101767 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:58.930060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f19efd14-e0dc-4a9a-8dd3-65465487eb9f req-ce6ce9d4-5179-4879-ae0b-9a854d101767 service nova] Creating event network-vif-plugged:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:57:58.967237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f19efd14-e0dc-4a9a-8dd3-65465487eb9f req-ce6ce9d4-5179-4879-ae0b-9a854d101767 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164438 Jul 18 12:57:58.970195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 736/1473] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:57:59.035741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:57:59.058714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:57:59.118861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:59.123509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:57:59.125639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:57:59.131157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:01.852628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:03.448070 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ad5c79a-7209-4729-bb2b-9f9b71daae6d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1464 microversion: 2.1 time: 14.586698 Jul 18 12:58:03.465771 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 738/1474] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:57:48 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1464 bytes in 14608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:03.510942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:03.512345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:03.531084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:58:03.533076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:58:03.535018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:58:03.536640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:58:03.538240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:58:03.557121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.559435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:03.561772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.563521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:03.739965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:03.760105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.762301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:03.767403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.767403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:03.840932 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad7d2df9-888f-4a16-89e9-96ebfb32c681 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 1066 microversion: 2.1 time: 4.860219 Jul 18 12:58:03.842882 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 737/1475] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:57:58 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 1066 bytes in 4872 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 12:58:03.864592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:03.875966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:03.944108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.950545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:03.950851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e495ea3444c9492a9c8127639ff02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5ae8b0e4194582a61a4de63f742bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:03.956771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:03.961069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:04.021699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-afe3a6dd-cd36-42ad-afa6-6a41c2d331c0 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 200 len: 1431 microversion: 2.1 time: 0.549899 Jul 18 12:58:04.031781 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 739/1476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:03 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 1431 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:04.087130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-febd2a6e-252c-4937-9fb5-d9ae2a15d288 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4dc0e50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:04.612190 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-febd2a6e-252c-4937-9fb5-d9ae2a15d288 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 200 len: 1464 microversion: 2.1 time: 0.574205 Jul 18 12:58:04.616278 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 740/1477] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:04 2022] GET /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 1464 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:04.662608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:04.664059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:04.741825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:04.743502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:04.746981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:04.747813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:04.883652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:04.932290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e2de093-971f-44d4-bc5b-8a0a87c2d5de tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.084190 Jul 18 12:58:04.933976 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 738/1478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:03 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:04.957140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-40fa242e-b8af-4496-802b-ff11fe9f1fbf req-b4fa1437-52fb-4f45-a00e-0ab23b70df0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b23f64-8625-4abc-b8a7-29a85519282b", "name": "network-vif-deleted", "tag": "e7beb172-55f8-414a-9c23-dc67e6eea635"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:05.000324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40fa242e-b8af-4496-802b-ff11fe9f1fbf req-b4fa1437-52fb-4f45-a00e-0ab23b70df0b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:05.004677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40fa242e-b8af-4496-802b-ff11fe9f1fbf req-b4fa1437-52fb-4f45-a00e-0ab23b70df0b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:05.045412 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-40fa242e-b8af-4496-802b-ff11fe9f1fbf req-b4fa1437-52fb-4f45-a00e-0ab23b70df0b service nova] Creating event network-vif-deleted:e7beb172-55f8-414a-9c23-dc67e6eea635 for instance a2b23f64-8625-4abc-b8a7-29a85519282b on n-h1-850003-3 Jul 18 12:58:05.105557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-40fa242e-b8af-4496-802b-ff11fe9f1fbf req-b4fa1437-52fb-4f45-a00e-0ab23b70df0b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165157 Jul 18 12:58:05.118405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 739/1479] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:05.174401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:05.176289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:05.232132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:05.235647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:05.241235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:05.244871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:05.908824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:05.931661 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13578608-70b3-49ed-9270-1adb590d7bf6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 1.310661 Jul 18 12:58:05.958941 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 741/1480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:04 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:05.968242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:05.969335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] [instance: a2b23f64-8625-4abc-b8a7-29a85519282b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:05.999463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.000228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:06.001588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.015340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:06.065085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] HTTP exception thrown: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Request method failure captured: Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b HTTP/1.1 Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VeXXitAAdtETK-CzSOpDBnE_wzua0oBuTERagUMazlqj4TGujWDfjQGXXVFUAHQ-WLxJKVmMwK5iF1Xb2zX9NTCpEPXInAPf200VLPe7aiTDyP9Vj9ENKgDKcrywzM2i5rk3fA5webmEiZKIVXzvi5l7L3bZljRZxmGQ_5LPAS7jIY Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:58:06.081977 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec5ae8b0e4194582a61a4de63f742bbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec5ae8b0e4194582a61a4de63f742bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ec5ae8b0e4194582a61a4de63f742bbd Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1300237646 Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: aa0e495ea3444c9492a9c8127639ff02 Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersOnMultiNodesTest-1300237646-project Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. Jul 18 12:58:06.085114 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a2b23f64-8625-4abc-b8a7-29a85519282b'} Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:58:06.086863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. Jul 18 12:58:06.089762 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:06.095620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] Returning 404 to user: Instance a2b23f64-8625-4abc-b8a7-29a85519282b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:58:06.097306 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ee6b7df-e0b2-4966-9568-d03124889c35 tempest-ServersOnMultiNodesTest-1300237646 tempest-ServersOnMultiNodesTest-1300237646-project] 10.222.0.88 "GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b" status: 404 len: 111 microversion: 2.1 time: 0.136350 Jul 18 12:58:06.103492 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 742/1481] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:05 2022] GET /compute/v2.1/servers/a2b23f64-8625-4abc-b8a7-29a85519282b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:58:06.123454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:06.124865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:06.156052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.156740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:06.158222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.159031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:06.799694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:06.819401 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53502254-4fa3-416f-958e-92f41a74eff4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1468 microversion: 2.1 time: 1.692512 Jul 18 12:58:06.845707 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 740/1482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:05 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1468 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:06.869835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-139580462"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:06.872299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:06.891189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.894221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:06.897274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:06.900390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:07.087144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:07.127575 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69ac59bd-c5d6-40ed-b970-5a3b34179fc0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.022105 Jul 18 12:58:07.137026 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 743/1483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:06 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:07.156861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:07.161545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:07.191872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:07.192776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:07.197422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:07.198343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:07.808999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:07.920582 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-436a4d0c-91fc-4c90-b0f4-41dae5e0fa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "POST /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998/action" status: 202 len: 0 microversion: 2.1 time: 1.068501 Jul 18 12:58:07.921723 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 741/1484] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:58:06 2022] POST /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 12:58:07.968438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-502a0491-3d19-4ac7-ad85-d38a837063a2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44991f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:08.266820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-502a0491-3d19-4ac7-ad85-d38a837063a2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.320461 Jul 18 12:58:08.269287 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 742/1485] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:07 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:58:08.306117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:08.319943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:08.364770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:08.367061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:08.370278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:08.371354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:08.665458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:08.688638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-87fdd463-1d82-4d7a-97ad-45815ba7a258 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 1.549218 Jul 18 12:58:08.709333 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 744/1486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:07 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:08.735355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8bd33b6f-b301-42f3-bfd6-6edcccf8b2eb req-d55a70a8-e97f-4451-8b90-c9fed461e443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b8bb3-5ab9-4e89-9a03-082494cb3b03", "name": "network-vif-unplugged", "status": "completed", "tag": "d8a6952f-435a-4523-bab0-66e849fbd529"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:08.768212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8bd33b6f-b301-42f3-bfd6-6edcccf8b2eb req-d55a70a8-e97f-4451-8b90-c9fed461e443 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:08.768978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8bd33b6f-b301-42f3-bfd6-6edcccf8b2eb req-d55a70a8-e97f-4451-8b90-c9fed461e443 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:08.822768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8bd33b6f-b301-42f3-bfd6-6edcccf8b2eb req-d55a70a8-e97f-4451-8b90-c9fed461e443 service nova] Creating event network-vif-unplugged:d8a6952f-435a-4523-bab0-66e849fbd529 for instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 on n-h2-850003-3 Jul 18 12:58:08.851403 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8bd33b6f-b301-42f3-bfd6-6edcccf8b2eb req-d55a70a8-e97f-4451-8b90-c9fed461e443 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139313 Jul 18 12:58:08.865499 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 745/1487] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:09.238345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:09.291869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e8e4a37-5d92-4f94-bd5b-010a453263d6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44d08b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:09.298862 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39007369-51ce-401c-8caf-6bfd4eaf6428 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.021541 Jul 18 12:58:09.301232 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 743/1488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:08 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:09.378599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e8e4a37-5d92-4f94-bd5b-010a453263d6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.095537 Jul 18 12:58:09.379844 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 746/1489] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:09 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:09.714998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:09.715630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:09.735145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:09.738334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:09.745737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:09.748252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:10.327287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:10.328184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:10.344558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:10.354720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:10.355998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:10.356698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:10.626553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:10.638705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e63259af-b5d9-4793-b3e4-6310109cc488 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 0.927756 Jul 18 12:58:10.650625 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 744/1490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:09 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:10.656939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53a39016-12fd-4d6d-b67d-822c50a47e09 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d91f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:10.756570 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53a39016-12fd-4d6d-b67d-822c50a47e09 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.099740 Jul 18 12:58:10.763225 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 745/1491] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:10 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:11.437029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:11.461450 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-022605e8-43f5-4b04-8e15-cdaac543b053 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.140454 Jul 18 12:58:11.463634 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 747/1492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:10 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:11.664827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:11.665914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:11.715077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:11.722819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:11.724880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:11.725837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:11.783562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96f4a05c-1c94-4b49-b154-56894a851842 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45589d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:11.961981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96f4a05c-1c94-4b49-b154-56894a851842 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.184649 Jul 18 12:58:11.967045 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 748/1493] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:11 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:12.485112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:12.490256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:12.495571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:12.512334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-662ce4ae-c0ef-4df6-bdea-1bd3af2842bb tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 0.851341 Jul 18 12:58:12.520094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 746/1494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:11 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:12.543006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:12.543716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:12.546031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:12.549992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:12.989324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93cb3371-7548-43e7-921b-183567784092 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4400940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:13.205056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93cb3371-7548-43e7-921b-183567784092 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.225984 Jul 18 12:58:13.218661 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 747/1495] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:12 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:13.548587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:13.552943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:13.589887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:13.591403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:13.593871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:13.606797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:13.747664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:13.790599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cdb25ff-4dcc-4177-bf50-4a6f9ca255b5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.312245 Jul 18 12:58:13.797455 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 749/1496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:12 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:58:14.222692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:14.235480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e31e8e72-7449-4510-b424-c69067c74442 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e517d040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:14.257335 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b6676d7-bf90-4673-b416-17a3f92c73f6 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 0.717523 Jul 18 12:58:14.259941 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 748/1497] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:13 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:14.442504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e31e8e72-7449-4510-b424-c69067c74442 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.215180 Jul 18 12:58:14.459329 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 750/1498] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:14 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:14.836314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:14.841659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:14.899780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:14.901987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:14.907319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:14.909638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:15.179037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:15.182085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:15.208353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:15.208735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:15.216348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:15.222759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:15.660486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:58:15.754132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ddd6bd9e-c28b-495d-b661-ec3f13e279f5 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 2419 microversion: 2.25 time: 1.079170 Jul 18 12:58:15.757174 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 749/1499] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:14 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 2419 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:58:15.901023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:15.919180 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d828069-e817-4a10-b53a-31de8f7bf7b3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.101202 Jul 18 12:58:15.928877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f44b37a1-ba4b-4788-bee3-786a3540f313 tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T12%3A58%3A14.982001&end=2022-07-19T12%3A58%3A14.982001" status: 404 len: 112 microversion: - time: 0.155567 Jul 18 12:58:15.946327 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 751/1500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:14 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:15.948861 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 750/1501] 10.222.0.88 () {58 vars in 1315 bytes} [Mon Jul 18 12:58:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T12%3A58%3A14.982001&end=2022-07-19T12%3A58%3A14.982001 => generated 112 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 12:58:15.956333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b697f4e9-729b-4c5d-a2ba-9878acf55203 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46620d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:15.968753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:15.979074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:16.005404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:16.007416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:16.009725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:16.010563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:16.152147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b697f4e9-729b-4c5d-a2ba-9878acf55203 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.191686 Jul 18 12:58:16.152147 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 751/1502] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:15 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:16.186399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": "auto"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:16.187636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:16.210014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:16.212864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:16.215902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:16.215902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:16.292931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'flavor' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:58:16.317700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131366) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:58:17.010576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:17.049919 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc48fe4d-220c-41b4-a3da-ff9bd3fa12ae tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 1.105575 Jul 18 12:58:17.053073 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 752/1503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:15 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:17.072443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e2b1f74-2ca7-4133-9c82-4c7df80423cf tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] Calling method '.version_select at 0x7f96e4650ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:17.095431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-2e2b1f74-2ca7-4133-9c82-4c7df80423cf tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e2b1f74-2ca7-4133-9c82-4c7df80423cf tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] Request method failure captured: Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-simple-tenant-usage/3e4b8efe2a4c46388e5e51965c730f2f?start=2022-07-19T12%3A58%3A14.982001&end=2022-07-17T12%3A58%3A14.982001 HTTP/1.1 Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VjmbRgQsONRb4O2WXx-yCTBkZweswJGQ0gM3Z5cTXO0PZ6EQ2AbDVHsv9h0xDc-f4QB-GDmbYUcGRIkqTRl5ye8fvjPyY-_4UyXq2T3_35Is-cdndZe1ecpdXdFzV9LKkghde5MZt47t1tjNeo5xF-mmvpyLyxLJTbnEnI71J84avE Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5a893bb2d8e04bc7b1beea902f2ded3f Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1484349489 Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 12:58:17.116959 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5a893bb2d8e04bc7b1beea902f2ded3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5a893bb2d8e04bc7b1beea902f2ded3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5a893bb2d8e04bc7b1beea902f2ded3f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5a893bb2d8e04bc7b1beea902f2ded3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1484349489 Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5a893bb2d8e04bc7b1beea902f2ded3f Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1484349489 Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: d713f20eb3f147f7be7bec144936b687 Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid start time. The start time cannot occur after the end time. Jul 18 12:58:17.119859 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '3e4b8efe2a4c46388e5e51965c730f2f'} Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 12:58:17.121445 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e2b1f74-2ca7-4133-9c82-4c7df80423cf tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:58:17.124191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2e2b1f74-2ca7-4133-9c82-4c7df80423cf tempest-TenantUsagesNegativeTestJSON-1484349489 tempest-TenantUsagesNegativeTestJSON-1484349489-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/3e4b8efe2a4c46388e5e51965c730f2f?start=2022-07-19T12%3A58%3A14.982001&end=2022-07-17T12%3A58%3A14.982001" status: 400 len: 111 microversion: 2.1 time: 0.066996 Jul 18 12:58:17.125640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 753/1504] 10.222.0.88 () {58 vars in 1411 bytes} [Mon Jul 18 12:58:17 2022] GET /compute/v2.1/os-simple-tenant-usage/3e4b8efe2a4c46388e5e51965c730f2f?start=2022-07-19T12%3A58%3A14.982001&end=2022-07-17T12%3A58%3A14.982001 => generated 111 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 12:58:17.140213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:17.146838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:17.180868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:17.185724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:17.188016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:17.189937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:18.316645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:18.343519 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aed7ba8a-0e5e-4ca3-bfd2-cf59f686dc3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.217355 Jul 18 12:58:18.347048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 754/1505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:17 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:19.182716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c185cc1-1163-4982-8482-4527fc858409 tempest-TenantUsagesNegativeTestJSON-1960579361 tempest-TenantUsagesNegativeTestJSON-1960579361-project] Calling method '.version_select at 0x7f96e4594310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:19.186584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c185cc1-1163-4982-8482-4527fc858409 tempest-TenantUsagesNegativeTestJSON-1960579361 tempest-TenantUsagesNegativeTestJSON-1960579361-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '00d74b6ae589475f958b9d0252f613a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4b8efe2a4c46388e5e51965c730f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c185cc1-1163-4982-8482-4527fc858409 tempest-TenantUsagesNegativeTestJSON-1960579361 tempest-TenantUsagesNegativeTestJSON-1960579361-project] Request method failure captured: Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T12%3A58%3A14.982001&end=2022-07-19T12%3A58%3A14.982001&detailed=1 HTTP/1.1 Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vjl0_i_m1fxoplSRwnoZUwGnYzxkn8hGcoy1dRVUc30KAhR5yiam1Y1wyeYXFHms7X0k53eBLz9btO9JdWKbEf9i5t8mSWO0nIXfH7_ClZJRw7wMRaawX-7FMJttxOIbr7UUF_XD1WZAP-esY1bMMbOK9ILLXYS45FVJ2v13d9A12U Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 3e4b8efe2a4c46388e5e51965c730f2f Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1960579361 Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:58:19.193579 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3e4b8efe2a4c46388e5e51965c730f2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3e4b8efe2a4c46388e5e51965c730f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3e4b8efe2a4c46388e5e51965c730f2f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3e4b8efe2a4c46388e5e51965c730f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1960579361 Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 3e4b8efe2a4c46388e5e51965c730f2f Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1960579361 Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TenantUsagesNegativeTestJSON-1960579361-project Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 00d74b6ae589475f958b9d0252f613a9 Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1960579361-project Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 12:58:19.197285 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 12:58:19.199849 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 12:58:19.203821 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 12:58:19.207170 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 12:58:19.207170 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:58:19.207170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c185cc1-1163-4982-8482-4527fc858409 tempest-TenantUsagesNegativeTestJSON-1960579361 tempest-TenantUsagesNegativeTestJSON-1960579361-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:58:19.211247 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c185cc1-1163-4982-8482-4527fc858409 tempest-TenantUsagesNegativeTestJSON-1960579361 tempest-TenantUsagesNegativeTestJSON-1960579361-project] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T12%3A58%3A14.982001&end=2022-07-19T12%3A58%3A14.982001&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.853333 Jul 18 12:58:19.230553 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 755/1506] 10.222.0.88 () {58 vars in 1334 bytes} [Mon Jul 18 12:58:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T12%3A58%3A14.982001&end=2022-07-19T12%3A58%3A14.982001&detailed=1 => generated 123 bytes in 878 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:58:19.292928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-179481bb-70fc-41cb-ad65-a966f9601848 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4532af0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:19.663071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-179481bb-70fc-41cb-ad65-a966f9601848 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.433473 Jul 18 12:58:19.681264 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 756/1507] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:19 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:19.702856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:19.706018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:19.756331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:19.757166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:19.763144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:19.775370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:20.292600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:20.305966 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dca0f349-f201-4e37-a74b-59c26bd388d9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 0.622610 Jul 18 12:58:20.313556 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 757/1508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:19 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:20.330442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-59af86cc-ff3f-4a0d-8d5c-415a1fc4a6a8 req-dcc694b7-e108-4d87-ac65-86002da79fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-plugged", "status": "completed", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:20.376208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-59af86cc-ff3f-4a0d-8d5c-415a1fc4a6a8 req-dcc694b7-e108-4d87-ac65-86002da79fdd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:20.377324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-59af86cc-ff3f-4a0d-8d5c-415a1fc4a6a8 req-dcc694b7-e108-4d87-ac65-86002da79fdd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:20.452759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-59af86cc-ff3f-4a0d-8d5c-415a1fc4a6a8 req-dcc694b7-e108-4d87-ac65-86002da79fdd service nova] Creating event network-vif-plugged:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:58:20.496348 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-59af86cc-ff3f-4a0d-8d5c-415a1fc4a6a8 req-dcc694b7-e108-4d87-ac65-86002da79fdd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178771 Jul 18 12:58:20.497421 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 758/1509] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:20.535121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:20.535610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:20.597875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:20.602034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:20.609712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:20.616134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:21.378870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:21.410968 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e19e9785-3dd8-43dd-b227-938197561b1c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.906484 Jul 18 12:58:21.411903 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 759/1510] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:20 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:21.436270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad6911c3-e285-4fad-9194-fcc9771d9fd8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e47505e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:21.585436 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad6911c3-e285-4fad-9194-fcc9771d9fd8 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.167027 Jul 18 12:58:21.593376 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 760/1511] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:21 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:21.605172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:21.614641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:21.655987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:21.657045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:21.658598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:21.659619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:22.319185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:22.352317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f77596f9-18d0-4769-ad66-b9124cdf1a2e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 0.756759 Jul 18 12:58:22.359255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 761/1512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:21 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:22.892474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67f45345-ca9a-4f7a-9b7d-cebff9c9cfb9 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Action: 'create', calling method: .version_select at 0x7f96e44f9790>, body: {"keypair": {"name": "tempest-keypair-335469606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7H+gbhFTscrYXrXfNBW52h5lDbthERaQI+j27z/pLmRCckvfiWiu4y60fLvNgmLjeSnXW8pzr7+eZtPWlfM/co2C2zZWccFWT3U1uwJhO/4plOS1lRco6Ap1TH4DIIkQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:22.986775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-67f45345-ca9a-4f7a-9b7d-cebff9c9cfb9 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for project d824a7309550407595c967988338266a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:58:23.021530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-67f45345-ca9a-4f7a-9b7d-cebff9c9cfb9 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for user 975d525aa79c4a86b433686240705484 and project d824a7309550407595c967988338266a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:58:23.166489 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-67f45345-ca9a-4f7a-9b7d-cebff9c9cfb9 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.805564 Jul 18 12:58:23.170743 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 762/1513] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 12:58:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:23.186658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:23.189511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:23.214743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:23.223820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:23.232969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:23.233440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:23.554457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03ab9c54-7c26-4d2f-b177-4c93a67cb971 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/action" status: 202 len: 0 microversion: 2.25 time: 7.390882 Jul 18 12:58:23.558815 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 752/1514] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 12:58:16 2022] POST /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/action => generated 0 bytes in 7407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:58:23.578080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b367b45-1de8-4e04-bd97-785ddb20f360 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4b84e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:23.749584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b367b45-1de8-4e04-bd97-785ddb20f360 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.188555 Jul 18 12:58:23.752432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 753/1515] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:23 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:23.781784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:23.788007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:23.864176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:23.876570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:23.926526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:23.941678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:23.943213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:24.041891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:24.108340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50081cf1-72a8-4776-b620-8400ca8ba840 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.935078 Jul 18 12:58:24.117467 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 763/1516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:23 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:24.164283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:24.165952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:24.228235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:24.228972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:24.229910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:24.230507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:24.850125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:24.896947 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2017f34e-67a3-4d93-8618-f6b61892f37d tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 1.140469 Jul 18 12:58:24.901651 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 754/1517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:23 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:24.921948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41df2bcf-c82f-4558-a65b-334e149932b2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f80d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:25.103401 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41df2bcf-c82f-4558-a65b-334e149932b2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.199537 Jul 18 12:58:25.120829 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 755/1518] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:24 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:25.164100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:25.173673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:25.228732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:25.241872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:25.243518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:25.250711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:25.595001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:25.641631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:25.656838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:25.671349 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-757b1e6f-527d-45fe-a48d-945eafc21924 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.542990 Jul 18 12:58:25.706067 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 764/1519] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:24 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:25.928889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:25.941626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:26.008263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:26.012629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:26.014976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:26.031409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:26.276047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:26.301177 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa8f41ca-e03f-4438-9dff-f1cea67c2df5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 1.158733 Jul 18 12:58:26.302093 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 756/1520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:25 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:26.334353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0a27b70-4847-4323-9f4d-a3c818c83cb9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f81f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:26.504354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0a27b70-4847-4323-9f4d-a3c818c83cb9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.200915 Jul 18 12:58:26.505305 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 757/1521] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:26 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:26.722799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:26.723798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:26.748693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:26.749413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:26.750704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:26.751462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:27.679796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:27.719519 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-55f5a142-b390-42ff-85f7-1ed4bd4504dc tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1471 microversion: 2.1 time: 1.798759 Jul 18 12:58:27.744804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 765/1522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:25 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1471 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:58:27.770689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:27.803085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:27.812301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:27.829187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f0c80f9-c4cc-4841-9e1b-1930b865a287 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.112500 Jul 18 12:58:27.830485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:27.831864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:27.846414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:27.847989 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 758/1523] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:26 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:27.848614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:27.851429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:27.853026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:27.854311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:27.879091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56bd95da-5791-4f4b-9332-d657dbfcfa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46620d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:27.955846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:28.058019 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56bd95da-5791-4f4b-9332-d657dbfcfa81 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.201619 Jul 18 12:58:28.064535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 759/1524] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:27 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:28.800706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:28.804752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:28.864113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:28.882242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:28.884350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:28.885139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:30.325518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:30.355248 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5352e982-3510-41bf-b140-e4951ef7250e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 2.593486 Jul 18 12:58:30.360359 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 766/1525] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:27 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:30.401288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:30.412389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:30.449215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:30.453263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:30.460449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:30.467061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:31.148207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:31.185660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:31.206017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:31.219558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0144b11a-61fe-4a4e-8970-bbb5d64b125d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.855807 Jul 18 12:58:31.221010 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 767/1526] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:30 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:31.230916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cc2281c-5d9c-4b64-befc-c1775673f95b tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4711e50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:31.420177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cc2281c-5d9c-4b64-befc-c1775673f95b tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.197062 Jul 18 12:58:31.433326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:31.439409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 768/1527] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:31 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:31.466263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:31.467541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:31.488877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:31.495051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:31.496364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:31.497178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:31.502499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-47e88d6b-9054-4125-a1d9-cbf95d65a562 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1477 microversion: 2.1 time: 2.731665 Jul 18 12:58:31.508118 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 760/1528] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:28 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1477 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:32.048976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:32.058471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f01a31e-4090-4826-95fa-35e69fcbc00b tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:32.060355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-babc79e1-4fc0-43c4-99d5-6beb7c8cb3bc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.618576 Jul 18 12:58:32.061415 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 769/1529] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:31 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:32.126660 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f01a31e-4090-4826-95fa-35e69fcbc00b tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.579118 Jul 18 12:58:32.135937 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 761/1530] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:58:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:32.252749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:32.253814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:32.267179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:32.269661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:32.271172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:32.272772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:32.460367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46e132d7-b6dd-4b4b-b110-e3466a90af4e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e43cc5e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:32.962493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:33.012751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:33.024929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:33.044109 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ccc31a1-b6ba-4768-8205-7bcd07cad3ec tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.797509 Jul 18 12:58:33.053417 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 770/1531] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:32 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 12:58:33.129090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:33.132887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:33.170639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:33.214255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:33.215008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:33.216598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:33.217421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:33.940645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:33.970723 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-abab5b24-8f7d-4189-b85d-a34db8b85c8a tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1462 microversion: 2.1 time: 0.914946 Jul 18 12:58:33.977057 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 771/1532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:33 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1462 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:34.032590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:34.035004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:34.059566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.082227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:34.089340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.090955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:34.541702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46e132d7-b6dd-4b4b-b110-e3466a90af4e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 2.100295 Jul 18 12:58:34.562667 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 762/1533] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:32 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:34.593029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:34.608546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:34.664764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.666270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:34.669695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.679532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:34.682843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:34.724739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-228f6a77-d5f3-425f-abf8-3ebb079b2563 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1498 microversion: 2.1 time: 0.744982 Jul 18 12:58:34.726230 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 772/1534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:33 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1498 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:34.744002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:34.751697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:34.782429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.791662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:34.793590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:34.802657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:35.119346 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36ecdfbc-ef42-4161-b13a-ec97eaed9fef tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 0 microversion: 2.1 time: 0.554339 Jul 18 12:58:35.148842 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 763/1535] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:58:34 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:58:35.191978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-340303473", "imageRef": "77a5343a-26a8-459f-bde1-6cd733babca6", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:35.410501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:35.437948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:58:35.454490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:35.457625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:35.472843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91a36ffb-fc87-4e06-9b3d-fe261aadf0a5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.742954 Jul 18 12:58:35.477496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 773/1536] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:34 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:35.509075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1690847668", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c69bf1e2-8db4-4322-b19e-bf956db5db74"}], "security_groups": [{"name": "tempest-securitygroup--1975032312"}], "key_name": "tempest-keypair-335469606", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:35.987708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] validate_networks() for [('c69bf1e2-8db4-4322-b19e-bf956db5db74', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:58:37.183509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] Request method failure captured: Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 142 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vj3snsEscr_ibvlF8P_s2ce-nXg6C7cc1EetgmIbcjirPnUyOiKwYSFaIPNo37N9sL0PHrDLpH9RFQltgBtV7aiOvhU3ibqv9Zx2q-Nnq7cJXWdFTbIpyarVQCqRIiQVxAvaa6Srk0ucJ26sJHgrytJsSjCL7PlXb2hmRzTfEAyNi0 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 559df0da124049188afcef10ea8c7c20 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FlavorsV2NegativeTest-766851176 Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:58:37.186370 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/559df0da124049188afcef10ea8c7c20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/559df0da124049188afcef10ea8c7c20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_559df0da124049188afcef10ea8c7c20", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/559df0da124049188afcef10ea8c7c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FlavorsV2NegativeTest-766851176 Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 559df0da124049188afcef10ea8c7c20 Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-766851176 Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FlavorsV2NegativeTest-766851176-project Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: b3f11cc1c69d4173baec87c013f81d41 Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FlavorsV2NegativeTest-766851176-project Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-340303473", "imageRef": "77a5343a-26a8-459f-bde1-6cd733babca6", "flavorRef": "452"}} Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:58:37.189918 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor's memory is too small for requested image. Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-340303473', 'imageRef': '77a5343a-26a8-459f-bde1-6cd733babca6', 'flavorRef': '452'}}} Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:37.192167 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:58:37.202423 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c33504cf-1272-44e5-a946-94216e841ec2 tempest-FlavorsV2NegativeTest-766851176 tempest-FlavorsV2NegativeTest-766851176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.041152 Jul 18 12:58:37.209070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 764/1537] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:58:35 2022] POST /compute/v2.1/servers => generated 93 bytes in 2059 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 12:58:37.229619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:37.230521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:37.264851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:37.265306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:37.273985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:37.278511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:37.377880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:37.378796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:37.379467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lazy-loading 'fault' on Instance uuid 3f449d36-c7ef-420a-8b0e-33e6714f464c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:58:37.720554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for project d824a7309550407595c967988338266a. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:58:37.743459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for user 975d525aa79c4a86b433686240705484 and project d824a7309550407595c967988338266a. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:58:37.793544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:58:37.814674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:58:37.815654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:58:37.818436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:58:37.819540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:58:37.847178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:37.850989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:37.852195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:37.852834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:37.918861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for project d824a7309550407595c967988338266a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:58:37.943883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Getting quotas for user 975d525aa79c4a86b433686240705484 and project d824a7309550407595c967988338266a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:58:37.987115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:58:37.995583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:58:38.120501 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5e69a1a-d0dc-4483-a7e4-15c0c9070a42 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.639844 Jul 18 12:58:38.124159 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 774/1538] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:58:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 2644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:58:38.135800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:38.145874 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7fdc059b-a92c-4335-ad77-79ea7de65a6a tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1596 microversion: 2.1 time: 0.935405 Jul 18 12:58:38.152174 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 765/1539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:37 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1596 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:38.157804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c87c3b09-4f73-44a4-93af-7ff693112db6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4a78dc0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:38.175137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:38.180611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:38.202310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:38.205268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:38.207460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:38.209144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:38.492239 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c87c3b09-4f73-44a4-93af-7ff693112db6 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.355005 Jul 18 12:58:38.501516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 775/1540] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:38 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:38.514546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:38.520264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:38.534181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:38.537217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:38.539384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:38.542009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:39.319639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:39.402761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:39.410404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:39.425764 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8eaacabb-ff36-4873-b287-b58540a7cf2d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.915590 Jul 18 12:58:39.429000 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 776/1541] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:38 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:39.451509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8bc0ed95-05b2-42b3-ae1a-f34a4ff0fd33 req-051651d4-37cb-4bd8-8ddd-9c90ce4e4185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "name": "network-vif-plugged", "status": "completed", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:39.521381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8bc0ed95-05b2-42b3-ae1a-f34a4ff0fd33 req-051651d4-37cb-4bd8-8ddd-9c90ce4e4185 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:39.522189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8bc0ed95-05b2-42b3-ae1a-f34a4ff0fd33 req-051651d4-37cb-4bd8-8ddd-9c90ce4e4185 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:39.604038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8bc0ed95-05b2-42b3-ae1a-f34a4ff0fd33 req-051651d4-37cb-4bd8-8ddd-9c90ce4e4185 service nova] Creating event network-vif-plugged:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:58:39.643037 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8bc0ed95-05b2-42b3-ae1a-f34a4ff0fd33 req-051651d4-37cb-4bd8-8ddd-9c90ce4e4185 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207722 Jul 18 12:58:39.648558 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 777/1542] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:58:39.704271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6612303-5086-4abb-a679-e40de79d862f tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:39.710632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6612303-5086-4abb-a679-e40de79d862f tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:39.979964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f6612303-5086-4abb-a679-e40de79d862f tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:39.991677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6612303-5086-4abb-a679-e40de79d862f tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1269 microversion: 2.1 time: 0.337349 Jul 18 12:58:39.992298 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 778/1543] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:39 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1269 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:40.023963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:40.051568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:40.121613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.131353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:40.139313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.142724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:40.656646 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fddad87b-6712-4539-aa8f-5b0b26c978f1 tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action" status: 202 len: 0 microversion: 2.1 time: 0.643066 Jul 18 12:58:40.657616 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 779/1544] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:58:39 2022] POST /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:58:40.680245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-603ebf86-aa1a-4f48-b03a-05affb55ef91 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45324c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:40.696075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:40.731099 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfe8fd0f-b42f-480f-98af-302f9d9f86a5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 200 len: 1475 microversion: 2.1 time: 2.573740 Jul 18 12:58:40.746720 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 766/1545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:38 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 1475 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:40.780226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:40.781898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:40.822131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.831296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:40.841679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.843045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:40.903109 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-603ebf86-aa1a-4f48-b03a-05affb55ef91 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.240546 Jul 18 12:58:40.910437 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 780/1546] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:40 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:40.932823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:40.943110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:40.976434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.977791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:40.979175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:40.982279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:41.664354 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc9330c8-4e56-4a35-91ca-7060a3d31f7d tempest-ServersAdminTestJSON-2002615824 tempest-ServersAdminTestJSON-2002615824-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1613 microversion: 2.1 time: 0.748461 Jul 18 12:58:41.686185 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 781/1547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:40 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1613 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:41.703128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1812081023"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:41.712862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:41.783761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:41.784850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:41.788387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:41.798326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:42.371992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:42.432556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:42.443273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:42.446566 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c95fd5d-b449-4472-8d1c-35be03f8a69b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.695846 Jul 18 12:58:42.448651 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 767/1548] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:40 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:42.485173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:42.489042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:42.516578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:42.522516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:42.524725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:42.529990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:43.267038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:43.293947 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49f23965-3fb5-4610-9906-536225a6c99c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1339 microversion: 2.1 time: 0.843103 Jul 18 12:58:43.304241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 768/1549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:42 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1339 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:43.330619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:43.332252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:43.362368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:43.364640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:43.371195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:43.376005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:43.473592 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce3bf4a9-bbf8-4534-a461-8ecf70bd86cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849/action" status: 202 len: 0 microversion: 2.1 time: 1.791826 Jul 18 12:58:43.486914 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 782/1550] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:58:41 2022] POST /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849/action => generated 0 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 12:58:43.535443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d5c58c0-8338-45bd-8a27-8bd38bc546eb tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45669d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:43.645885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:58:43.959752 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d5c58c0-8338-45bd-8a27-8bd38bc546eb tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.464216 Jul 18 12:58:43.974510 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 783/1551] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:43 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:44.006271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:44.014357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:44.081436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:44.088010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:44.094671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:44.095882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:44.375662 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c83017e-ff46-40de-acc2-db0330f5d446 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 204 len: 0 microversion: 2.1 time: 1.071834 Jul 18 12:58:44.377108 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 769/1552] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:58:43 2022] DELETE /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:58:44.395217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9a1c531-91d2-4af2-9417-f5162fc11cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e43ee4c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:44.512112 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9a1c531-91d2-4af2-9417-f5162fc11cdb tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.132725 Jul 18 12:58:44.519065 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 770/1553] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:44 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:44.530988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:44.534924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:44.543968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:44.544512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:44.545560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:44.546543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:45.101933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:45.163849 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3ea1cff-1352-496b-acf1-7b52a51c3064 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.643320 Jul 18 12:58:45.164964 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 771/1554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:44 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:45.191089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:45.195706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:45.224377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:45.225721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:45.227820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:45.228847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:45.799577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:45.827428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:45.834205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:45.841132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5e06a183-09b9-4d8a-ac09-26626a0e5e87 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.864178 Jul 18 12:58:45.860092 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 784/1555] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:43 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:45.875737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b857de38-9125-4ba6-a0ff-f3337d5ccfa5 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4bf29d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:46.076588 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b857de38-9125-4ba6-a0ff-f3337d5ccfa5 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1454 microversion: 2.1 time: 0.211232 Jul 18 12:58:46.082282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:46.084253 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 785/1556] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:45 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1454 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:46.097541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-197746676", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "de298d9c-e7c4-4212-8e1a-869417573018"}], "block_device_mapping_v2": [{"uuid": "4b8efbac-4128-4890-979b-ece57e7d5fc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:58:46.107433 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d9b506f-17ad-4dd4-80df-91d6605677c2 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1469 microversion: 2.1 time: 0.939848 Jul 18 12:58:46.108491 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 772/1557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:45 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1469 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:46.132207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4abf9552-bc30-48ba-8383-8d848da7ba2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4b841f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:46.334115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4abf9552-bc30-48ba-8383-8d848da7ba2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.224007 Jul 18 12:58:46.339624 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 773/1558] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:46 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:46.349010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:46.354025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:46.371846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:46.373181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:46.375027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:46.375796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:46.507355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] validate_networks() for [('de298d9c-e7c4-4212-8e1a-869417573018', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:58:46.834179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:46.889513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b67fa1cc-0bf7-4e4b-9e09-4a98219e1dd4 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.547844 Jul 18 12:58:46.898862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 774/1559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:46 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:46.938204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:46.939230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:46.953758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:46.957929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:46.961469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:46.961944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:47.876105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:48.255001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:48.266701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:48.286203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:48.292366 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac120d86-a5c4-413d-86e6-7821e4b8dc95 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.392285 Jul 18 12:58:48.301972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 775/1560] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:58:46 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:58:48.307237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25f3caab-e0ce-46bf-bed0-d984d5f37c4d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4687280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:49.984440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:50.984841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:58:50.985821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:58:50.986026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:58:50.986762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:58:50.987380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:58:51.059655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:51.061204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:51.076838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:51.084162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:51.223401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:58:51.265247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Getting quotas for user 64cdfc77cf92451c84c873df41bc422f and project 0eacb137f6294164bc2bbb101ecc94f8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:58:51.449387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:58:51.452218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b8efbac-4128-4890-979b-ece57e7d5fc5',volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:58:51.901304 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c03a0a68-60d4-42c5-9236-d82fdf315e6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.805364 Jul 18 12:58:51.908553 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 786/1561] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 5822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:58:51.947797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:51.955916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:58:52.002571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:52.006711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:52.009196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:52.012780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:52.251520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:58:52.266746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:58:52.272626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lazy-loading 'fault' on Instance uuid ca3cf552-4e7f-4f53-9274-28e950ed3a3f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:58:52.590064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:58:52.641331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7e5a788-1237-4feb-9635-85df16906c78 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 200 len: 1303 microversion: 2.1 time: 0.728928 Jul 18 12:58:52.646456 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 787/1562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:58:51 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 1303 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:58:52.656945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-95671f5b-5123-4dac-b50d-e444b40799c9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4258ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:58:56.945289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:58:58.264390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:01.150751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:01.304891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:02.204958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:02.637254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:02.941361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25f3caab-e0ce-46bf-bed0-d984d5f37c4d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1463 microversion: 2.1 time: 14.636225 Jul 18 12:59:02.946413 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 776/1563] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:48 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1463 bytes in 14643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:02.951168 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-95671f5b-5123-4dac-b50d-e444b40799c9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 10.301920 Jul 18 12:59:02.955601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 788/1564] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:58:52 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 10308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:02.965194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:02.969922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:02.986278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:02.990032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:02.994742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:03.001084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.003121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.003905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.022294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.029241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.031190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.032114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.346694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:03.367893 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e43bf36-b025-4ed8-8e6c-c9ba2324ffdf tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.416240 Jul 18 12:59:03.370426 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 777/1565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:02 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:03.383914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8a4a85a0-90c0-4bc1-89dc-b014fd95c141 req-db06f8da-2a1b-4273-96e2-92a32d35b9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cf552-4e7f-4f53-9274-28e950ed3a3f", "name": "network-vif-unplugged", "status": "completed", "tag": "1e10de9f-b965-4a9f-9cb6-1a62cd907e17"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:03.411608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8a4a85a0-90c0-4bc1-89dc-b014fd95c141 req-db06f8da-2a1b-4273-96e2-92a32d35b9c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.412372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8a4a85a0-90c0-4bc1-89dc-b014fd95c141 req-db06f8da-2a1b-4273-96e2-92a32d35b9c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.457877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8a4a85a0-90c0-4bc1-89dc-b014fd95c141 req-db06f8da-2a1b-4273-96e2-92a32d35b9c0 service nova] Creating event network-vif-unplugged:1e10de9f-b965-4a9f-9cb6-1a62cd907e17 for instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f on n-h1-850003-3 Jul 18 12:59:03.468339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8a4a85a0-90c0-4bc1-89dc-b014fd95c141 req-db06f8da-2a1b-4273-96e2-92a32d35b9c0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096272 Jul 18 12:59:03.473995 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 778/1566] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:03.480773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-363a9b24-cb59-40c9-9d56-148289ecbad7 req-4609609f-46e7-4fb9-8f38-42144e440cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cf552-4e7f-4f53-9274-28e950ed3a3f", "name": "network-vif-deleted", "tag": "1e10de9f-b965-4a9f-9cb6-1a62cd907e17"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:03.508234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-363a9b24-cb59-40c9-9d56-148289ecbad7 req-4609609f-46e7-4fb9-8f38-42144e440cab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.508962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-363a9b24-cb59-40c9-9d56-148289ecbad7 req-4609609f-46e7-4fb9-8f38-42144e440cab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.534667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-363a9b24-cb59-40c9-9d56-148289ecbad7 req-4609609f-46e7-4fb9-8f38-42144e440cab service nova] Creating event network-vif-deleted:1e10de9f-b965-4a9f-9cb6-1a62cd907e17 for instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f on n-h1-850003-3 Jul 18 12:59:03.550112 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-363a9b24-cb59-40c9-9d56-148289ecbad7 req-4609609f-46e7-4fb9-8f38-42144e440cab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074199 Jul 18 12:59:03.555635 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 779/1567] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:03.562655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:03.579080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:03.596919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.597667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.598701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:03.599459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:03.980138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:03.998210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4883b80e-c251-4a91-a540-78c460ed6d80 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1210 microversion: 2.1 time: 0.437308 Jul 18 12:59:04.002334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 780/1568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:03 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1210 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:04.432231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:04.439699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-689850872", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "fa9c6398-417d-41a3-b824-8113bb7669f0"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:04.472140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:04.480451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:04.485440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10fa88f0-0db2-48b4-ad70-98324cd527a0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.518227 Jul 18 12:59:04.486049 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 789/1569] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:02 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:04.510009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:04.515398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: ca3cf552-4e7f-4f53-9274-28e950ed3a3f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:04.539867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:04.540531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:04.541681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:04.542342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:04.586917 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] HTTP exception thrown: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Request method failure captured: Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f HTTP/1.1 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VhCd4hRsBNdhU6CfYAfRfH2TgW6a2Q0P-h9TWCGz7XwKKpQkpGwxGdHKvR_LUWHw30jJAz7zgrXHc8jSRtOWi_L7PH8-RSgWSqHOGPoWO8l954u-SB1II9HBUMZqYL0UWLkxGy_dQylEqi3lxMhbiHb1hmOLZKNxDUfqenzkNyQ77A Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:04.588663 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_04af0ec2bbba40768fd3348e0d869485", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 3ddc9f824baa4ae99c78a313c3446568 Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. Jul 18 12:59:04.590174 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ca3cf552-4e7f-4f53-9274-28e950ed3a3f'} Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:04.591095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. Jul 18 12:59:04.592674 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:04.596306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Returning 404 to user: Instance ca3cf552-4e7f-4f53-9274-28e950ed3a3f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:04.596306 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-626918a5-34a5-458d-a640-1250bdea2e27 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f" status: 404 len: 111 microversion: 2.1 time: 0.103096 Jul 18 12:59:04.596306 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 790/1570] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:04 2022] GET /compute/v2.1/servers/ca3cf552-4e7f-4f53-9274-28e950ed3a3f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:04.616789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-99b9772e-9263-4c2d-a843-8b504beeeda9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4e0ce50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:04.655324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] validate_networks() for [('fa9c6398-417d-41a3-b824-8113bb7669f0', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:59:04.800028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-99b9772e-9263-4c2d-a843-8b504beeeda9 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 200 len: 1463 microversion: 2.1 time: 0.207783 Jul 18 12:59:04.811286 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 791/1571] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:04 2022] GET /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 1463 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:04.819272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4727a85-6d53-46ac-b998-645afa86e242 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4b049d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:04.980030 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4727a85-6d53-46ac-b998-645afa86e242 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.166852 Jul 18 12:59:04.985099 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 792/1572] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:04 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:05.010841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:05.014803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:05.040948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:05.045750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:05.050202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:05.051519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.386094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:59:06.387865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:59:06.388912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:59:06.389931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:59:06.391433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:59:06.431980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.433298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.438306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.439457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.543620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Getting quotas for project 283bae5ec5a8499d8ba353223330a7c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:59:06.574576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Getting quotas for user 1aa169cceea44c7dbeeb5178cfc90d5c and project 283bae5ec5a8499d8ba353223330a7c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:59:06.648424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:06.654208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:59:06.660573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:59:06.680608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36b80e38-4d40-4158-928c-adc0df9b2fe8 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 1.686469 Jul 18 12:59:06.686689 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 793/1573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:04 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:06.707231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:06.710078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:06.735223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.738688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.740795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.745354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.766496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e1b62ab-400d-4db6-b08d-e98f2934d554 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759572 Jul 18 12:59:06.771114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 781/1574] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:59:06.816635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:06.820315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:06.857256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.858961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.860675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:06.861268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:06.900495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:07.355947 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-225bc01d-74e8-42f0-a38f-4d147c52836e tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 204 len: 0 microversion: 2.1 time: 0.664547 Jul 18 12:59:07.362522 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 794/1575] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:06 2022] DELETE /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:07.393142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:07.397453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:07.435368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:07.435620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:07.447392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:07.448819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:07.456636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:07.471371 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d9d0122-2584-4643-87a9-7bf2ea74ec89 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1468 microversion: 2.1 time: 0.691909 Jul 18 12:59:07.475068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 782/1576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:06 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1468 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:07.495889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:07.497082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:07.526601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:07.527731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:07.535181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:07.536202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:07.929406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:07.961877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:07.973866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:07.977959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c88b14d-f92d-4c29-b47e-9a26f9f7c825 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.498122 Jul 18 12:59:07.982458 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 783/1577] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:07 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:07.999831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340329e2-ae2e-488c-8f3b-bbcfb0e55d11", "tag": "2a2cef8e-e2e4-4091-a7dc-8674c2839173"}, {"server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}, {"name": "network-changed", "server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:08.045584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:08.053100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:08.122186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Creating event network-changed:2a2cef8e-e2e4-4091-a7dc-8674c2839173 for instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 on n-h2-850003-3 Jul 18 12:59:08.137565 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Creating event network-vif-unplugged:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:59:08.141621 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] Creating event network-changed:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h1-850003-3 Jul 18 12:59:08.199671 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2e8cfc90-2daa-4c24-8b1f-0dc2d4925929 req-cb7a7564-4a30-46da-8eb7-dd142bb963b0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.214436 Jul 18 12:59:08.205190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 784/1578] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:08.225767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ce34f13b-0a3c-4c25-851e-547f1f14be62 req-6d373847-8445-4bd6-a45f-58ae986cf572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fcd071-1dd1-4d0e-bffe-c972f29f5849", "name": "network-vif-plugged", "status": "completed", "tag": "76b5f0f0-dabe-4392-9738-86f60ebafbe8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:08.272552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ce34f13b-0a3c-4c25-851e-547f1f14be62 req-6d373847-8445-4bd6-a45f-58ae986cf572 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:08.277235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ce34f13b-0a3c-4c25-851e-547f1f14be62 req-6d373847-8445-4bd6-a45f-58ae986cf572 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:08.335608 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ce34f13b-0a3c-4c25-851e-547f1f14be62 req-6d373847-8445-4bd6-a45f-58ae986cf572 service nova] Creating event network-vif-plugged:76b5f0f0-dabe-4392-9738-86f60ebafbe8 for instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 on n-h2-850003-3 Jul 18 12:59:08.409150 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ce34f13b-0a3c-4c25-851e-547f1f14be62 req-6d373847-8445-4bd6-a45f-58ae986cf572 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192302 Jul 18 12:59:08.415522 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 785/1579] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:08.455886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77d44f2b-0a83-4234-afa0-ed0690a63f56 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4687dc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:08.696337 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-77d44f2b-0a83-4234-afa0-ed0690a63f56 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.266222 Jul 18 12:59:08.718318 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 786/1580] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:08 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:08.728941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ea51de0-7b59-4136-b06a-761a3b049f61 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:08.735397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ea51de0-7b59-4136-b06a-761a3b049f61 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:08.929886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ea51de0-7b59-4136-b06a-761a3b049f61 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:08.966445 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ea51de0-7b59-4136-b06a-761a3b049f61 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1215 microversion: 2.1 time: 0.243789 Jul 18 12:59:08.985657 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 787/1581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:08 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:08.994540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:08.995615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:09.019573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:09.020166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:09.028047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:09.028613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:09.364754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:09.416536 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e739d0d0-0dcc-4ca7-a35c-22f591ffc30e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1210 microversion: 2.1 time: 2.051567 Jul 18 12:59:09.432128 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 795/1582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:07 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1210 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:09.463349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f878c9ff-0668-4eb7-9b8c-235bc2955254 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4540280>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:09.966866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:10.005888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-902eb67d-3bf5-48f4-8cba-a8134ee9cd40 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1468 microversion: 2.1 time: 1.032327 Jul 18 12:59:10.012358 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 788/1583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:08 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1468 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:10.045803 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f878c9ff-0668-4eb7-9b8c-235bc2955254 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?changes-since=2022-07-18T12%3A55%3A29Z" status: 200 len: 2374 microversion: 2.1 time: 0.614211 Jul 18 12:59:10.057915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:10.059409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:10.084835 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 796/1584] 10.222.0.88 () {58 vars in 1198 bytes} [Mon Jul 18 12:59:09 2022] GET /compute/v2.1/images?changes-since=2022-07-18T12%3A55%3A29Z => generated 2374 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:10.100898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:10.101750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:10.109724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:10.110579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:10.117863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:10.125882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:10.161016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:10.171440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:10.203109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:10.204301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:10.806561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:10.840982 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d7020d8-0228-4005-a977-59a378c7f5dc tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.805468 Jul 18 12:59:10.858357 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 789/1585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:10 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:10.869779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74a84ee3-ab16-408b-9f01-4ce017301fd3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e5259e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:10.979048 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74a84ee3-ab16-408b-9f01-4ce017301fd3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.118204 Jul 18 12:59:10.981252 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 790/1586] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:10 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:10.998795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:11.000071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:11.025281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:11.026106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:11.027723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:11.028481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:11.280060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:11.303492 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a24044e-65b3-4430-a9d1-736e74c4dc1d tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1267 microversion: 2.1 time: 0.319758 Jul 18 12:59:11.322560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 791/1587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:10 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:11.341392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94a0611b-3287-4b2e-ac1f-988c6766d062 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e50cb8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:11.574022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94a0611b-3287-4b2e-ac1f-988c6766d062 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1497710985" status: 200 len: 485 microversion: 2.1 time: 0.241913 Jul 18 12:59:11.575375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 792/1588] 10.222.0.88 () {58 vars in 1230 bytes} [Mon Jul 18 12:59:11 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1497710985 => generated 485 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:11.611659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:11.615701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:11.629066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:11.629757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:11.631078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:11.632038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:12.217932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:12.247400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:12.251407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:12.254366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e2566360-7323-44c0-bce6-5ac4c586aad5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 2.161155 Jul 18 12:59:12.279509 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 797/1589] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:10 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:12.290272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340329e2-ae2e-488c-8f3b-bbcfb0e55d11", "name": "network-vif-plugged", "status": "completed", "tag": "2a2cef8e-e2e4-4091-a7dc-8674c2839173"}, {"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-unplugged", "status": "completed", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:12.317374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:12.322065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:12.354231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] Creating event network-vif-plugged:2a2cef8e-e2e4-4091-a7dc-8674c2839173 for instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 on n-h2-850003-3 Jul 18 12:59:12.355813 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] Creating event network-vif-unplugged:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:59:12.377107 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2a20f0cf-e83e-4865-810a-271704689b19 req-5b342b6f-8151-4be1-901f-f18519cf9989 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.094937 Jul 18 12:59:12.381344 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 798/1590] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:12.401107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f90cbe5a-b1e7-4c30-98d1-b3d689f209d2 req-861c9e02-2b52-4e28-bf5f-5eba88c37219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:12.435203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f90cbe5a-b1e7-4c30-98d1-b3d689f209d2 req-861c9e02-2b52-4e28-bf5f-5eba88c37219 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:12.435964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f90cbe5a-b1e7-4c30-98d1-b3d689f209d2 req-861c9e02-2b52-4e28-bf5f-5eba88c37219 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:12.491220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f90cbe5a-b1e7-4c30-98d1-b3d689f209d2 req-861c9e02-2b52-4e28-bf5f-5eba88c37219 service nova] Creating event network-changed:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:59:12.506926 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f90cbe5a-b1e7-4c30-98d1-b3d689f209d2 req-861c9e02-2b52-4e28-bf5f-5eba88c37219 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122269 Jul 18 12:59:12.509436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 799/1591] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:12.556961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:12.558732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:12.585903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:12.591061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:12.592923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:12.604136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:12.662394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:12.685777 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-927370b3-0616-4c72-8b23-086de74a7ed3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1210 microversion: 2.1 time: 1.100551 Jul 18 12:59:12.686844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 793/1592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:11 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1210 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:12.721967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b4a95bb-d3ff-4313-a819-a5c28fe82dde tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4781940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:12.959632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b4a95bb-d3ff-4313-a819-a5c28fe82dde tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?server=0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 957 microversion: 2.1 time: 0.270705 Jul 18 12:59:12.963004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 794/1593] 10.222.0.88 () {58 vars in 1208 bytes} [Mon Jul 18 12:59:12 2022] GET /compute/v2.1/images?server=0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 957 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:12.983771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:12.986266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:12.998277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:12.999320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:13.000454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:13.001190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:13.385301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:13.397022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4dc9a9ae-09f5-4673-bb6d-7065190327f0 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.432204 Jul 18 12:59:13.409954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 795/1594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:12 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:13.416751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc5defeb-f144-453e-b752-a1d33666aaa7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e448d430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:13.516128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc5defeb-f144-453e-b752-a1d33666aaa7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.104442 Jul 18 12:59:13.522586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 796/1595] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:13 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:13.541112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:13.550171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:13.574930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:13.576158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:13.577401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:13.578254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:13.720380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:13.738183 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0ced160-82d5-462b-bf79-f99e65f4603e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1273 microversion: 2.1 time: 0.213078 Jul 18 12:59:13.754168 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 797/1596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:13 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:13.763028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70c4eb3b-5191-4639-a66f-5040f779d56e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e448d430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:13.858455 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70c4eb3b-5191-4639-a66f-5040f779d56e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 485 microversion: 2.1 time: 0.102092 Jul 18 12:59:13.869206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 798/1597] 10.222.0.88 () {58 vars in 1316 bytes} [Mon Jul 18 12:59:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:13.874367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:13.875426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:13.882510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:13.883285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:13.884422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:13.885204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:14.144530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:14.157994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:14.189439 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c02a3100-377d-483f-976a-3e1c45bdcd84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1468 microversion: 2.1 time: 1.668538 Jul 18 12:59:14.194830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 800/1598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:12 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1468 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:14.204356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:14.208271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:14.211780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:14.212772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5b70058-84ea-4d8f-9d1e-dea96b002e6b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.346546 Jul 18 12:59:14.213658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:14.214708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 799/1599] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:13 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:14.233905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:14.234751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53292c6a-1232-4388-94c7-a547dd728635 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e44991f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:14.240640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:14.244114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:14.252599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:14.389647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53292c6a-1232-4388-94c7-a547dd728635 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 485 microversion: 2.1 time: 0.169965 Jul 18 12:59:14.394610 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 800/1600] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 18 12:59:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 485 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:14.414315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c94073c-0b90-4d50-9a70-31024abbb400 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f8430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:14.744026 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c94073c-0b90-4d50-9a70-31024abbb400 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.335052 Jul 18 12:59:14.746714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 801/1601] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:59:14 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:14.752318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:14.753357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:14.762687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:14.763680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:14.764783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:14.765513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:15.238576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:15.261040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3eb7d12c-106d-4e96-9488-a712d30e641e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1395 microversion: 2.1 time: 0.512621 Jul 18 12:59:15.274212 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 802/1602] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:14 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1395 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:15.307859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9e1c426-49b9-43c3-a570-13d48330aef4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e45ef280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:15.427819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9e1c426-49b9-43c3-a570-13d48330aef4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.151468 Jul 18 12:59:15.429862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 803/1603] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:15 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:15.441430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:15.443955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:15.462092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:15.464416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:15.466958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:15.468975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:15.600764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:15.630276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e6ca4db-a908-4df8-89b4-0a4a6e648552 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1273 microversion: 2.1 time: 0.197631 Jul 18 12:59:15.632395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 804/1604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:15 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:15.647200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-84b7d0b7-8fac-4b73-a5ee-c6024417cf56 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4f758b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:15.836685 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-84b7d0b7-8fac-4b73-a5ee-c6024417cf56 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.200250 Jul 18 12:59:15.847581 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 805/1605] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:59:15 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:15.861570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:15.868738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:15.925151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:15.927985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:15.931232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:15.932374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.102806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.104216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.107299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lazy-loading 'fault' on Instance uuid f286e531-2428-42a1-8950-b0316d43558a {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:16.243394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:16.276363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e333b534-1289-473d-9ad7-0072f6a8035b tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 200 len: 1303 microversion: 2.1 time: 0.414439 Jul 18 12:59:16.294187 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 806/1606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:15 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 1303 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:16.299014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:16.312849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:16.323649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.339128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.341608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.345413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.437683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:16.470026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:16.502390 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b9d7414-d6a7-4214-9381-f679fbcdba12 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 2.286007 Jul 18 12:59:16.503990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 801/1607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:14 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:16.516027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:16.527757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f06332d7-92dc-479d-9639-3b6f2f5e6b5d req-cc71e79c-1d3b-4968-aa65-6753c48d7d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f286e531-2428-42a1-8950-b0316d43558a", "name": "network-vif-deleted", "tag": "d8d922a6-7c2a-4a97-a885-bebbea00d6f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:16.566473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f06332d7-92dc-479d-9639-3b6f2f5e6b5d req-cc71e79c-1d3b-4968-aa65-6753c48d7d2b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.571559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f06332d7-92dc-479d-9639-3b6f2f5e6b5d req-cc71e79c-1d3b-4968-aa65-6753c48d7d2b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.615898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f06332d7-92dc-479d-9639-3b6f2f5e6b5d req-cc71e79c-1d3b-4968-aa65-6753c48d7d2b service nova] Creating event network-vif-deleted:d8d922a6-7c2a-4a97-a885-bebbea00d6f7 for instance f286e531-2428-42a1-8950-b0316d43558a on n-h2-850003-3 Jul 18 12:59:16.629075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f06332d7-92dc-479d-9639-3b6f2f5e6b5d req-cc71e79c-1d3b-4968-aa65-6753c48d7d2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121743 Jul 18 12:59:16.631824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 802/1608] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:16.653321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d33e4b30-2618-4a7d-8511-3fce25e718a8 req-d949b97c-6d72-487d-a0ea-2d8bb161d198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:16.684079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d33e4b30-2618-4a7d-8511-3fce25e718a8 req-d949b97c-6d72-487d-a0ea-2d8bb161d198 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.685497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d33e4b30-2618-4a7d-8511-3fce25e718a8 req-d949b97c-6d72-487d-a0ea-2d8bb161d198 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.717770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:16.724784 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d33e4b30-2618-4a7d-8511-3fce25e718a8 req-d949b97c-6d72-487d-a0ea-2d8bb161d198 service nova] Creating event network-vif-unplugged:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h1-850003-3 Jul 18 12:59:16.733102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:16.737090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:16.738634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e843303c-b18d-4870-a4fd-7eedc440d0c6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.454989 Jul 18 12:59:16.739904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 807/1609] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:16 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:16.747514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1166d996-d93f-4f20-a9e1-b1e2f8fbef4d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4400040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:16.776719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d33e4b30-2618-4a7d-8511-3fce25e718a8 req-d949b97c-6d72-487d-a0ea-2d8bb161d198 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137728 Jul 18 12:59:16.792821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 803/1610] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:16.837911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:16.841331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:16.860971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.864383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.867903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:16.874394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:16.894000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1166d996-d93f-4f20-a9e1-b1e2f8fbef4d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.152855 Jul 18 12:59:16.896029 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 808/1611] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 12:59:16 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:16.906508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2bef9425-d4d8-4e3c-bf7c-05c54dbcdda8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e476fe50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:17.022993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2bef9425-d4d8-4e3c-bf7c-05c54dbcdda8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.125601 Jul 18 12:59:17.027189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 809/1612] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:16 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:17.057949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:17.059555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:17.077928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.078790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:17.079978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.081025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:17.316069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:17.334901 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f642b8bf-482e-48c3-8bb7-a2a4f3e3350c tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1273 microversion: 2.1 time: 0.293817 Jul 18 12:59:17.341270 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 810/1613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:17 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:17.357632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5e901da-0024-4d13-aee2-9558d7637fc7 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e5259e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:17.624218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5e901da-0024-4d13-aee2-9558d7637fc7 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?changes-since=2022-07-18T12%3A55%3A23Z" status: 200 len: 6333 microversion: 2.1 time: 0.281467 Jul 18 12:59:17.625542 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 811/1614] 10.222.0.88 () {58 vars in 1219 bytes} [Mon Jul 18 12:59:17 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-18T12%3A55%3A23Z => generated 6333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:17.635644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:17.640301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: f286e531-2428-42a1-8950-b0316d43558a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:17.657948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.669659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:17.671196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.671738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:17.733271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] HTTP exception thrown: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Request method failure captured: Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a HTTP/1.1 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhCd4hRsBNdhU6CfYAfRfH2TgW6a2Q0P-h9TWCGz7XwKKpQkpGwxGdHKvR_LUWHw30jJAz7zgrXHc8jSRtOWi_L7PH8-RSgWSqHOGPoWO8l954u-SB1II9HBUMZqYL0UWLkxGy_dQylEqi3lxMhbiHb1hmOLZKNxDUfqenzkNyQ77A Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:17.740399 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_04af0ec2bbba40768fd3348e0d869485", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 3ddc9f824baa4ae99c78a313c3446568 Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. Jul 18 12:59:17.742472 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'f286e531-2428-42a1-8950-b0316d43558a'} Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:17.744537 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. Jul 18 12:59:17.751654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:17.754029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Returning 404 to user: Instance f286e531-2428-42a1-8950-b0316d43558a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:17.754029 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3304ac2f-56cd-4254-8c94-52b675646631 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a" status: 404 len: 111 microversion: 2.1 time: 0.111812 Jul 18 12:59:17.754029 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 812/1615] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:17 2022] GET /compute/v2.1/servers/f286e531-2428-42a1-8950-b0316d43558a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:17.754495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:17.755610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:17.776843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.778226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:17.780183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:17.781482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.102787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:18.126818 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5f60bb4-fe54-477a-929c-7408387aec81 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 0.380186 Jul 18 12:59:18.128469 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 813/1616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:17 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:18.138378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d37df15a-d81a-4ad5-a5d8-ff7336c7799b tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46b0b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.239586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d37df15a-d81a-4ad5-a5d8-ff7336c7799b tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1497710985" status: 200 len: 665 microversion: 2.1 time: 0.108407 Jul 18 12:59:18.251159 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 814/1617] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 18 12:59:18 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1497710985 => generated 665 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:18.256561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.257071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:18.272643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.273098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.273915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.274396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.319146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:18.432994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:18.446651 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ccc0c0e-2f68-4b81-8efe-89e93d050698 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1575 microversion: 2.1 time: 1.650264 Jul 18 12:59:18.463363 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 804/1618] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:16 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1575 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:18.476475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.477377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:18.495719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.496121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.497581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.498499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.519705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-688e2476-f683-4d13-8b4f-0e9d3a2ebafa tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 204 len: 0 microversion: 2.1 time: 0.266848 Jul 18 12:59:18.522223 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 815/1619] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:18 2022] DELETE /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:18.531813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73f3f0f4-0a41-4e8a-84c6-718974125ebf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46874c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.665966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73f3f0f4-0a41-4e8a-84c6-718974125ebf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.140664 Jul 18 12:59:18.667663 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 816/1620] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:18 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:18.673934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7dadfb7b-cfe9-4e45-b08f-655ba26573a3 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e5259c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.754656 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7dadfb7b-cfe9-4e45-b08f-655ba26573a3 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1467 microversion: 2.1 time: 0.084765 Jul 18 12:59:18.768753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 817/1621] 10.222.0.88 () {58 vars in 1337 bytes} [Mon Jul 18 12:59:18 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1467 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:18.778744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:18.781058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:18.789046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.790672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.793605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:18.794508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:18.948128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:19.377752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:19.418376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c8a7a96-ecbe-4300-b1fa-c7853358f9cc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.637341 Jul 18 12:59:19.418376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 818/1622] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:18 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:19.431544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:19.431544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:19.441866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.444837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:19.447554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.455167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:19.456987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:19.489215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:19.492825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:19.502691 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc52c394-875e-47c7-b101-5bf83c01c1ef tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 1.036656 Jul 18 12:59:19.505632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 805/1623] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:18 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:19.528867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:19.530481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:19.549134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.549858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:19.550877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.551440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:19.649854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-387ee5dc-3df5-43c7-9d35-5fb6ece16892 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230779 Jul 18 12:59:19.651161 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 819/1624] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 12:59:19 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:19.658124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8dbf10d6-f18f-4d71-ac26-ccc089ced20a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f8820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:19.741763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8dbf10d6-f18f-4d71-ac26-ccc089ced20a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1467 microversion: 2.1 time: 0.088942 Jul 18 12:59:19.743004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 820/1625] 10.222.0.88 () {58 vars in 1323 bytes} [Mon Jul 18 12:59:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:19.750219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:19.751128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:19.761007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.762345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:19.764430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:19.765669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:20.133957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:20.145196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a4b305c1-addd-4ea9-82f6-f18ce54ec6e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 0.400315 Jul 18 12:59:20.155757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 821/1626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:19 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:20.161807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40d66ddf-753f-4188-b011-1f94146a8980 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e44991f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:20.265061 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40d66ddf-753f-4188-b011-1f94146a8980 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1414 microversion: 2.1 time: 0.107909 Jul 18 12:59:20.265680 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 822/1627] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:20 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:20.276929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2e36399-1438-4e10-abcf-805726d23e79 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f8550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:20.317447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:20.332796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1fc8506-e9db-4240-a7dd-151feffe9248 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1468 microversion: 2.1 time: 0.823598 Jul 18 12:59:20.335355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 806/1628] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:19 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1468 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:20.446524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:20.448152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:20.462675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2e36399-1438-4e10-abcf-805726d23e79 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.195269 Jul 18 12:59:20.464571 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 823/1629] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 12:59:20 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:20.473578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:20.480311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:20.482762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:20.492106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:20.506716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d55c20cd-dcf8-4171-b8ba-fed0c9df1e2e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46b0430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:20.710602 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d55c20cd-dcf8-4171-b8ba-fed0c9df1e2e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.218185 Jul 18 12:59:20.712087 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 824/1630] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 12:59:20 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:20.733430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:20.734657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:20.756142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:20.756940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:20.758762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:20.759547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:21.197150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:21.235147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:21.239951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:21.242569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6875e926-18cb-4525-9c9b-608c40e1d116 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.528610 Jul 18 12:59:21.259535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 825/1631] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:20 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:21.277552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cab7eb2-76cf-49f8-88eb-028fa42a665d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e45d9670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:21.349150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:21.373718 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0352e2c-a132-48ec-9cac-44efb9ce751b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.937433 Jul 18 12:59:21.388676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 807/1632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:20 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:59:21.401558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:21.404077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:21.415407 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9cab7eb2-76cf-49f8-88eb-028fa42a665d tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344" status: 200 len: 784 microversion: 2.1 time: 0.153727 Jul 18 12:59:21.418981 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 826/1633] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:21 2022] GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344 => generated 784 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:21.437681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:21.438225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a99290bf-2dd4-448f-89e8-f1e1de1cccbc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46f83a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:21.441577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:21.445020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:21.445662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:21.501539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a99290bf-2dd4-448f-89e8-f1e1de1cccbc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1423 microversion: 2.1 time: 0.077854 Jul 18 12:59:21.502561 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 827/1634] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:21 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:21.511136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:21.512613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:21.529058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:21.529557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:21.530383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:21.530837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:21.871984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:21.881458 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3dfab3e-e5d4-4376-9f04-fc0caf8b80b9 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1468 microversion: 2.1 time: 0.377004 Jul 18 12:59:21.893551 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 828/1635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:21 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:21.899136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95781c27-a9a9-4e5a-b84b-304f9228b722 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4c3cee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:21.995198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95781c27-a9a9-4e5a-b84b-304f9228b722 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.099107 Jul 18 12:59:21.999984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 829/1636] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 12:59:21 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:22.024438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8519a331-2b0e-4857-a763-6dff15062175 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46f88b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:22.160454 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8519a331-2b0e-4857-a763-6dff15062175 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 200 len: 1423 microversion: 2.1 time: 0.145735 Jul 18 12:59:22.163457 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 830/1637] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:22 2022] GET /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 1423 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:22.175562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e4af0f7-110f-4fac-ac91-d193b895869e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e46f8820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:22.403984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:22.422783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-705cbb52-873c-4f06-b392-124877c95066 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 1.032226 Jul 18 12:59:22.425787 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 808/1638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:21 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:22.442897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0979a991-204f-4be0-8d6a-862a5cb863a3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4918e50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:23.533258 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e4af0f7-110f-4fac-ac91-d193b895869e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d" status: 204 len: 0 microversion: 2.1 time: 1.367883 Jul 18 12:59:23.537011 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 831/1639] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:22 2022] DELETE /compute/v2.1/images/d128d530-3156-4e3d-ac87-37839c46538d => generated 0 bytes in 1370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:23.546477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:23.547896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:23.566535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:23.567130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:23.570469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:23.570956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:23.678463 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0979a991-204f-4be0-8d6a-862a5cb863a3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 204 len: 0 microversion: 2.1 time: 1.250661 Jul 18 12:59:23.679654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 809/1640] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:22 2022] DELETE /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:23.685082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:23.687295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:23.704547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:23.707095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:23.709651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:23.712868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:24.110497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:24.154866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:24.158015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:24.160141 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42e565f7-b182-4095-ae11-f6dfc5a0ff35 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.621700 Jul 18 12:59:24.163397 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 832/1641] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:23 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:24.377918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cbe4b6f-4dfa-4518-a82d-a2d7778e7e61 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Action: 'create', calling method: .version_select at 0x7f96e4687c10>, body: {"pool": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:24.393033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:24.433213 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7cae79f-c259-4d34-941e-f79355e13492 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.752286 Jul 18 12:59:24.456426 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 810/1642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:23 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:24.497284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:24.511009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:24.537901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:24.540912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:24.546132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:24.548952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:24.628368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:24.665826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:24.666487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:24.667040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lazy-loading 'fault' on Instance uuid 3f449d36-c7ef-420a-8b0e-33e6714f464c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:24.846723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddc9f824baa4ae99c78a313c3446568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af0ec2bbba40768fd3348e0d869485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:24.867199 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56b3adf1-05f5-4baf-b921-8221d05804e0 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 200 len: 1303 microversion: 2.1 time: 0.405231 Jul 18 12:59:24.868760 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 811/1643] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:24 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 1303 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:24.886453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:24.889695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:24.913867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:24.914615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:24.922070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:24.922859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:25.889110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:25.908358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3abdcc9-7b39-4caa-a873-40b6ffe87f5c tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1575 microversion: 2.1 time: 1.037160 Jul 18 12:59:25.910356 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 812/1644] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:24 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1575 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:25.925664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-89220e5a-8bff-4d33-a6fc-05f79c5258bc req-8e16cd90-7bea-47ae-9e43-511b16e894ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340329e2-ae2e-488c-8f3b-bbcfb0e55d11", "tag": "2a2cef8e-e2e4-4091-a7dc-8674c2839173"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:25.950327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-89220e5a-8bff-4d33-a6fc-05f79c5258bc req-8e16cd90-7bea-47ae-9e43-511b16e894ce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:25.952058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-89220e5a-8bff-4d33-a6fc-05f79c5258bc req-8e16cd90-7bea-47ae-9e43-511b16e894ce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:25.975657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-89220e5a-8bff-4d33-a6fc-05f79c5258bc req-8e16cd90-7bea-47ae-9e43-511b16e894ce service nova] Creating event network-changed:2a2cef8e-e2e4-4091-a7dc-8674c2839173 for instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 on n-h2-850003-3 Jul 18 12:59:25.986731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-89220e5a-8bff-4d33-a6fc-05f79c5258bc req-8e16cd90-7bea-47ae-9e43-511b16e894ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071283 Jul 18 12:59:25.988717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 813/1645] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:26.001578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:26.003044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:26.014879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:26.016125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:26.018088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:26.019242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:26.801330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:26.833693 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25bc457d-e8bb-42b3-bf2c-b979611d88cb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 0.841910 Jul 18 12:59:26.843061 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 814/1646] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:25 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:26.855170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f09f8e7-2583-44bd-a860-a7e8fe630902 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e469d8b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:27.114731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9cbe4b6f-4dfa-4518-a82d-a2d7778e7e61 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.914456 Jul 18 12:59:27.139933 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 833/1647] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:59:24 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:27.170911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:27.172187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:27.192082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:27.197028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.197969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.200914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.201819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.247123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:27.418516 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4b38873b-c903-40d3-a93e-31d744dc5f01 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 204 len: 0 microversion: 2.1 time: 0.276311 Jul 18 12:59:27.420068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 834/1648] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:27 2022] DELETE /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:27.429964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3a0d7f68-542e-4ebe-bf1f-edec1ecee3ed req-cc16ba38-fb6f-46cb-a0a9-382dc1842015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f449d36-c7ef-420a-8b0e-33e6714f464c", "name": "network-vif-deleted", "tag": "41120c51-ed50-4ace-ab5b-a4f3731ddfb7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:27.457718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a0d7f68-542e-4ebe-bf1f-edec1ecee3ed req-cc16ba38-fb6f-46cb-a0a9-382dc1842015 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.458577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a0d7f68-542e-4ebe-bf1f-edec1ecee3ed req-cc16ba38-fb6f-46cb-a0a9-382dc1842015 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.493650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3a0d7f68-542e-4ebe-bf1f-edec1ecee3ed req-cc16ba38-fb6f-46cb-a0a9-382dc1842015 service nova] Creating event network-vif-deleted:41120c51-ed50-4ace-ab5b-a4f3731ddfb7 for instance 3f449d36-c7ef-420a-8b0e-33e6714f464c on n-h1-850003-3 Jul 18 12:59:27.504494 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3a0d7f68-542e-4ebe-bf1f-edec1ecee3ed req-cc16ba38-fb6f-46cb-a0a9-382dc1842015 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081551 Jul 18 12:59:27.509280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 835/1649] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:27.522012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fb3a4629-b2a6-4e2a-8e34-5d9eb29ab796 req-5625a934-0a0a-44b0-9c92-1612595d8dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "name": "network-vif-plugged", "status": "completed", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:27.541813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fb3a4629-b2a6-4e2a-8e34-5d9eb29ab796 req-5625a934-0a0a-44b0-9c92-1612595d8dbc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.542580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fb3a4629-b2a6-4e2a-8e34-5d9eb29ab796 req-5625a934-0a0a-44b0-9c92-1612595d8dbc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.569508 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fb3a4629-b2a6-4e2a-8e34-5d9eb29ab796 req-5625a934-0a0a-44b0-9c92-1612595d8dbc service nova] Creating event network-vif-plugged:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h1-850003-3 Jul 18 12:59:27.578734 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fb3a4629-b2a6-4e2a-8e34-5d9eb29ab796 req-5625a934-0a0a-44b0-9c92-1612595d8dbc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066886 Jul 18 12:59:27.580158 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 836/1650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:27.591898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:27.593314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:27.604893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.606418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.607821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.608577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.882849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:27.894518 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f09f8e7-2583-44bd-a860-a7e8fe630902 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529" status: 204 len: 0 microversion: 2.1 time: 1.048639 Jul 18 12:59:27.895508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 815/1651] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:26 2022] DELETE /compute/v2.1/images/8ef783b8-ca89-43e0-8a97-d13d4886e529 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:27.896262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:27.898871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:27.901501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21bafa8c-0499-49ca-80c5-e4581d98f14d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.318922 Jul 18 12:59:27.903504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 837/1652] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:27 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:27.907008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:27.908777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:27.912674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:27.914689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] [instance: 3f449d36-c7ef-420a-8b0e-33e6714f464c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:27.929872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.930621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.931545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.932320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.940911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.941747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.943498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:27.944477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:27.983351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] HTTP exception thrown: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Request method failure captured: Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c HTTP/1.1 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhCd4hRsBNdhU6CfYAfRfH2TgW6a2Q0P-h9TWCGz7XwKKpQkpGwxGdHKvR_LUWHw30jJAz7zgrXHc8jSRtOWi_L7PH8-RSgWSqHOGPoWO8l954u-SB1II9HBUMZqYL0UWLkxGy_dQylEqi3lxMhbiHb1hmOLZKNxDUfqenzkNyQ77A Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:27.987086 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_04af0ec2bbba40768fd3348e0d869485", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/04af0ec2bbba40768fd3348e0d869485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 04af0ec2bbba40768fd3348e0d869485 Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminTestJSON-766159004 Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 3ddc9f824baa4ae99c78a313c3446568 Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminTestJSON-766159004-project Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. Jul 18 12:59:27.990121 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3f449d36-c7ef-420a-8b0e-33e6714f464c'} Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:27.991715 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. Jul 18 12:59:27.997732 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:28.001452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] Returning 404 to user: Instance 3f449d36-c7ef-420a-8b0e-33e6714f464c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:28.001452 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-77c8f978-b9f3-411b-a644-151a7af05b84 tempest-ServersAdminTestJSON-766159004 tempest-ServersAdminTestJSON-766159004-project] 10.222.0.88 "GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c" status: 404 len: 111 microversion: 2.1 time: 0.085729 Jul 18 12:59:28.001452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 838/1653] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:27 2022] GET /compute/v2.1/servers/3f449d36-c7ef-420a-8b0e-33e6714f464c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:28.007827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-daf3bc31-ff18-441a-a854-66a97e5e80be tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e4d26040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:28.214453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:28.234485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed926927-5285-4f24-8f0b-6fef026c1c94 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.336754 Jul 18 12:59:28.236171 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 816/1654] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:27 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:28.244099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1196803747", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "86e3abd6-5f45-4131-86ad-fd94f18b600e"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:28.330437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] validate_networks() for [('86e3abd6-5f45-4131-86ad-fd94f18b600e', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:59:28.348868 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-daf3bc31-ff18-441a-a854-66a97e5e80be tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/b8acb981-15e8-42e5-a49e-95673abf5838" status: 200 len: 140 microversion: 2.1 time: 0.347891 Jul 18 12:59:28.350136 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 839/1655] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:59:27 2022] GET /compute/v2.1/os-floating-ips/b8acb981-15e8-42e5-a49e-95673abf5838 => generated 140 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:28.361647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:28.363311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:28.378093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:28.379176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:28.380700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:28.381465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:28.961297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:28.976198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:28.982714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c594f2b3-a0bb-479b-bd8c-ac7d2b94735d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1198 microversion: 2.1 time: 0.630297 Jul 18 12:59:28.984416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 840/1656] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:28 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1198 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:28.993445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f673ac0c-bb1c-4e4a-b1d5-b5d36c762834 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4e24790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:29.740958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:59:29.741661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:59:29.742571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:59:29.743532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:59:29.744017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:59:29.764102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:29.765301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:29.766332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:29.767104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:29.799203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:59:29.806573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for user 719f068839494e66b2eb68285ef22214 and project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:59:29.837963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:59:29.845378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:59:29.967672 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0c247a81-7106-4321-b0d6-6263d6f427e7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729220 Jul 18 12:59:29.969201 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 817/1657] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:59:29.986529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e03e5a4-a37e-42e8-9f8d-6ec18184d683 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e45945e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:30.314343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f673ac0c-bb1c-4e4a-b1d5-b5d36c762834 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae" status: 204 len: 0 microversion: 2.1 time: 1.327793 Jul 18 12:59:30.315373 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 841/1658] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:28 2022] DELETE /compute/v2.1/images/08361262-8e04-4642-a251-4fe7fb9e68ae => generated 0 bytes in 1330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:30.330040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:30.332987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:30.358654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.360667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.363038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.365706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.460779 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e03e5a4-a37e-42e8-9f8d-6ec18184d683 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.488347 Jul 18 12:59:30.461791 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 818/1659] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 12:59:29 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:30.471577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:30.473696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:30.489136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.490695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.492218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.493497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.789716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:30.825972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:30.834534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:30.841599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:30.850217 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c19be03-d475-44ed-861d-8ac48b161fcd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1811 microversion: 2.25 time: 0.528091 Jul 18 12:59:30.864403 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0e905bf1-b42b-4fd2-ae9c-2a0de782defc tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.388739 Jul 18 12:59:30.864403 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 819/1660] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:30 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:30.864697 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 842/1661] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:30 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1811 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:30.878742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c8ab75d6-0dd4-4eb1-872b-b260a26d265e req-6a5ee722-f931-49bb-a741-56ad076ea399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fcd071-1dd1-4d0e-bffe-c972f29f5849", "name": "network-vif-unplugged", "status": "completed", "tag": "76b5f0f0-dabe-4392-9738-86f60ebafbe8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:30.884756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2cfc61ec-9da4-4004-9392-1d8006ed65d4 req-920d9253-f066-449b-8e89-a921746f1360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b411a0d1-1495-488f-8962-4b5f632d72b7", "tag": "883fd2ad-bafa-413f-954b-ad8bebe53dea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:30.909368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2cfc61ec-9da4-4004-9392-1d8006ed65d4 req-920d9253-f066-449b-8e89-a921746f1360 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.914889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2cfc61ec-9da4-4004-9392-1d8006ed65d4 req-920d9253-f066-449b-8e89-a921746f1360 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.929756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c8ab75d6-0dd4-4eb1-872b-b260a26d265e req-6a5ee722-f931-49bb-a741-56ad076ea399 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:30.935360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c8ab75d6-0dd4-4eb1-872b-b260a26d265e req-6a5ee722-f931-49bb-a741-56ad076ea399 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:30.946784 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2cfc61ec-9da4-4004-9392-1d8006ed65d4 req-920d9253-f066-449b-8e89-a921746f1360 service nova] Creating event network-changed:883fd2ad-bafa-413f-954b-ad8bebe53dea for instance b411a0d1-1495-488f-8962-4b5f632d72b7 on n-h2-850003-3 Jul 18 12:59:30.962443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c8ab75d6-0dd4-4eb1-872b-b260a26d265e req-6a5ee722-f931-49bb-a741-56ad076ea399 service nova] Creating event network-vif-unplugged:76b5f0f0-dabe-4392-9738-86f60ebafbe8 for instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 on n-h2-850003-3 Jul 18 12:59:30.978170 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c8ab75d6-0dd4-4eb1-872b-b260a26d265e req-6a5ee722-f931-49bb-a741-56ad076ea399 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116720 Jul 18 12:59:30.983708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 843/1662] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:30.984341 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2cfc61ec-9da4-4004-9392-1d8006ed65d4 req-920d9253-f066-449b-8e89-a921746f1360 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124897 Jul 18 12:59:30.989283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 820/1663] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:31.009426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:31.010571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:31.013305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f20b8389-f5bc-4ee0-aba7-c0d7fa290658 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:31.014642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f20b8389-f5bc-4ee0-aba7-c0d7fa290658 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:31.039963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.044317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:31.047070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.050689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:31.172130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f20b8389-f5bc-4ee0-aba7-c0d7fa290658 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:31.188758 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f20b8389-f5bc-4ee0-aba7-c0d7fa290658 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1208 microversion: 2.1 time: 0.200944 Jul 18 12:59:31.189819 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 844/1664] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:30 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:31.203047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:31.204458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:31.220340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.222388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:31.222664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.223565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:31.279559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:31.495769 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34f69861-5d7c-47b1-8093-dcc1f2ce3af4 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 204 len: 0 microversion: 2.1 time: 0.299562 Jul 18 12:59:31.504015 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 845/1665] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:31 2022] DELETE /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:31.530051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef42abc4-b80c-4b3d-8636-fccc84452fa8 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e50cb8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:31.800818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:31.817072 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64f305a2-474b-49cd-8596-3af851ecc6bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1381 microversion: 2.1 time: 0.823255 Jul 18 12:59:31.818801 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 821/1666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:30 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1381 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:31.836366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:31.839096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:31.853293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.855122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:31.857037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:31.858488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:32.314019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:32.337784 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b915592c-9f8f-4c43-9992-b0a31dbf6ca2 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1474 microversion: 2.1 time: 0.516490 Jul 18 12:59:32.340040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 822/1667] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:31 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:32.360564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:32.363230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:32.374395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:32.378512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:32.380072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:32.384782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:32.386026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:32.784004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50a5066f-26db-46ae-b558-9ffd5fde44a7 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1532 microversion: 2.1 time: 0.440619 Jul 18 12:59:32.786721 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 823/1668] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:32 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1532 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:32.795858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:32.796550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:32.809199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:32.810663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:32.812928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:32.813971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.328618 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef42abc4-b80c-4b3d-8636-fccc84452fa8 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/b8acb981-15e8-42e5-a49e-95673abf5838" status: 202 len: 0 microversion: 2.1 time: 1.821459 Jul 18 12:59:33.330557 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 846/1669] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:59:31 2022] DELETE /compute/v2.1/os-floating-ips/b8acb981-15e8-42e5-a49e-95673abf5838 => generated 0 bytes in 1826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:59:33.345903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:33.347032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:33.359495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.360280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.362266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.363954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.383420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:33.400772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:33.404558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:33.407098 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65ed59cd-dd79-4398-a58d-4840ca050d5a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1801 microversion: 2.25 time: 0.618761 Jul 18 12:59:33.425454 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 824/1670] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:32 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1801 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:33.434213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:33.436706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:33.450482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.451237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.452318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.454471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.577429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:33.589327 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9658abb-582f-493a-9342-eb2b06820f46 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1266 microversion: 2.1 time: 0.161286 Jul 18 12:59:33.592615 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 825/1671] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:33 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:33.604196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:33.604740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:33.614233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.615079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.616230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.617082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.625488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:33.643177 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69a9ef02-cfa1-4368-8a45-46664ff255e1 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1315 microversion: 2.1 time: 0.310186 Jul 18 12:59:33.644661 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 847/1672] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:33 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:33.655025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ef7d0a8c-1b29-4091-9b8d-7505227e10dc req-1629539e-dff2-4183-aba8-fe780e6bf7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b411a0d1-1495-488f-8962-4b5f632d72b7", "name": "network-vif-plugged", "status": "completed", "tag": "883fd2ad-bafa-413f-954b-ad8bebe53dea"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:33.679286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ef7d0a8c-1b29-4091-9b8d-7505227e10dc req-1629539e-dff2-4183-aba8-fe780e6bf7ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:33.680072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ef7d0a8c-1b29-4091-9b8d-7505227e10dc req-1629539e-dff2-4183-aba8-fe780e6bf7ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:33.703545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ef7d0a8c-1b29-4091-9b8d-7505227e10dc req-1629539e-dff2-4183-aba8-fe780e6bf7ea service nova] Creating event network-vif-plugged:883fd2ad-bafa-413f-954b-ad8bebe53dea for instance b411a0d1-1495-488f-8962-4b5f632d72b7 on n-h2-850003-3 Jul 18 12:59:33.713175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ef7d0a8c-1b29-4091-9b8d-7505227e10dc req-1629539e-dff2-4183-aba8-fe780e6bf7ea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066034 Jul 18 12:59:33.715342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 848/1673] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:33.724892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26b1c4be-73e1-4a2e-a76b-96e69d9180e1 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Action: 'create', calling method: .version_select at 0x7f96e4f36f70>, body: {"pool": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:34.504095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a67d0eb-ac34-4330-8156-82082ab6a0d5 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1532 microversion: 2.1 time: 0.903951 Jul 18 12:59:34.522210 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 826/1674] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:33 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1532 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:34.532320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:34.533717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:34.548801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:34.550940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:34.553309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:34.554057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:35.259068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:35.278887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81e0c009-f531-4ccc-ae37-6d35edc9b637 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 200 len: 1474 microversion: 2.1 time: 0.757301 Jul 18 12:59:35.280514 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 827/1675] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:34 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 1474 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:35.305777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f38f6107-1f08-463e-91a5-8acff1bb5bc1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '.version_select at 0x7f96e4918ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:35.312369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f38f6107-1f08-463e-91a5-8acff1bb5bc1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:35.313791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f38f6107-1f08-463e-91a5-8acff1bb5bc1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:35.337076 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f38f6107-1f08-463e-91a5-8acff1bb5bc1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 2777 microversion: 2.25 time: 0.053694 Jul 18 12:59:35.338444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 828/1676] 10.222.0.88 () {60 vars in 1183 bytes} [Mon Jul 18 12:59:35 2022] GET /compute/v2.1/os-migrations => generated 2777 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:35.647036 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b04a3cc2-c24e-47b9-bf36-6b98d0cd9474 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.305835 Jul 18 12:59:35.672950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 829/1677] 10.222.0.88 () {58 vars in 1127 bytes} [Mon Jul 18 12:59:35 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 12:59:35.689020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:35.692256 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 12:59:35.692256 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 12:59:35.695068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:35.700843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:35.702930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:35.704117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:35.776716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88a314ba-1ce6-4840-b27c-2eeb053d1101 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101672 Jul 18 12:59:35.786871 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 830/1678] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 12:59:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:35.799926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:35.804126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:35.828896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:35.829189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:35.831302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:35.832078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.018925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:37.034756 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23c94a9d-a6f4-4eda-8c90-3d7621cb3ea7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 1.245423 Jul 18 12:59:37.036472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 831/1679] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:35 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:37.048117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:37.049642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:37.061308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.062328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.064197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.065444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.311772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26b1c4be-73e1-4a2e-a76b-96e69d9180e1 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.595090 Jul 18 12:59:37.314047 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 849/1680] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 12:59:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:37.338459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:37.341006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:37.358102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.360074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.361566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.363901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.633149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:37.660642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6263a5e6-02a9-4b55-ba06-8cad44b31667 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 2419 microversion: 2.25 time: 0.334038 Jul 18 12:59:37.665160 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 850/1681] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:37 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 2419 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:37.675285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe4b18e-3c15-4cb9-a3e6-4c920ea976f4 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Calling method '.version_select at 0x7f96e4c57af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:37.717546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:37.737088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4bb54944-f6b8-4f6b-923c-27655fcc7c62 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1504 microversion: 2.1 time: 0.696579 Jul 18 12:59:37.738572 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 832/1682] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:37 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1504 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:37.760450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": false, "disk_over_commit": false}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:37.764114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-afe4b18e-3c15-4cb9-a3e6-4c920ea976f4 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] HTTP exception thrown: Image not found. Jul 18 12:59:37.765176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe4b18e-3c15-4cb9-a3e6-4c920ea976f4 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Request method failure captured: Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vk1kTE_I-cz0Zy2Icm7dNKhMec4wTAj5U5VdhQvtX3kd0UHq3N2T786oGr7TKCovmORxoL8QRf_cRLarl0MRQvnHDrnd3aj6e24-wD-VkP54SOShifD5ETdSPQdcFRxOeygbBNJYpKIrJ-Riopzh6cdggyYfpzGJqqqb9C1h-iNtWo Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:37.772651 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2bacc265e9564c8b91207d8066a16b5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4eba246dea904239bfd72bdce863f3dc Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '-1'} Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:37.775887 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.778224 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:37.787866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe4b18e-3c15-4cb9-a3e6-4c920ea976f4 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afe4b18e-3c15-4cb9-a3e6-4c920ea976f4 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.109085 Jul 18 12:59:37.790891 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 851/1683] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 12:59:37 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:59:37.797963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-afc9458c-284c-48a9-b64c-3b644eb879fc req-f8f69ce7-d28f-4eb5-9c3f-0ad8379edab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b8bb3-5ab9-4e89-9a03-082494cb3b03", "name": "network-vif-deleted", "tag": "d8a6952f-435a-4523-bab0-66e849fbd529"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:37.798187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.798187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.799409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.800361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.811895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-afc9458c-284c-48a9-b64c-3b644eb879fc req-f8f69ce7-d28f-4eb5-9c3f-0ad8379edab6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.812735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-afc9458c-284c-48a9-b64c-3b644eb879fc req-f8f69ce7-d28f-4eb5-9c3f-0ad8379edab6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.837018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-afc9458c-284c-48a9-b64c-3b644eb879fc req-f8f69ce7-d28f-4eb5-9c3f-0ad8379edab6 service nova] Creating event network-vif-deleted:d8a6952f-435a-4523-bab0-66e849fbd529 for instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 on n-h2-850003-3 Jul 18 12:59:37.849014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-afc9458c-284c-48a9-b64c-3b644eb879fc req-f8f69ce7-d28f-4eb5-9c3f-0ad8379edab6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066916 Jul 18 12:59:37.850281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 852/1684] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:37.862021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lazy-loading 'flavor' on Instance uuid 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:37.864567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:37.865994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 159b8bb3-5ab9-4e89-9a03-082494cb3b03] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:37.868952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:37.888255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.889349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.890872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.891678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:37.893553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 12:59:37.923839 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] HTTP exception thrown: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Request method failure captured: Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 HTTP/1.1 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vg5pJZErGuvHe87bPjgjx4cSt_lfPY8566rCol4NXHHVDONBtU3F9sKNBT47ajGuAzThdo_3Qa48ACLynmEGfGANqRadMIeJ_NZZWvyAQc4OPB0BWmpgWpj6fIwfV88XZ1P7zeOWX3Y_YmQt9UD4_0YU5OMSkEHhT1ZGFdoFSKClGo Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 600ef3c5c0e9438c93e489e85e4da4d0 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:37.930535 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_600ef3c5c0e9438c93e489e85e4da4d0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 600ef3c5c0e9438c93e489e85e4da4d0 Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ListImageFiltersTestJSON-1468555369-project Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f40e0512e404183b3092e0ce7aea512 Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ListImageFiltersTestJSON-1468555369-project Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. Jul 18 12:59:37.934307 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '159b8bb3-5ab9-4e89-9a03-082494cb3b03'} Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:37.936172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. Jul 18 12:59:37.939489 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:37.943395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Returning 404 to user: Instance 159b8bb3-5ab9-4e89-9a03-082494cb3b03 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:37.943395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5b64b64-5cd2-41e7-a07f-6123150ec3fd tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03" status: 404 len: 111 microversion: 2.1 time: 0.079603 Jul 18 12:59:37.943395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 853/1685] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:37 2022] GET /compute/v2.1/servers/159b8bb3-5ab9-4e89-9a03-082494cb3b03 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:37.951911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d0f1ebcf-01b3-4e54-ac43-3b93f919ec67 req-3a27f9df-22d2-403e-96d4-6b3a5302d805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fcd071-1dd1-4d0e-bffe-c972f29f5849", "name": "network-vif-deleted", "tag": "76b5f0f0-dabe-4392-9738-86f60ebafbe8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:37.972324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d0f1ebcf-01b3-4e54-ac43-3b93f919ec67 req-3a27f9df-22d2-403e-96d4-6b3a5302d805 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:37.973025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d0f1ebcf-01b3-4e54-ac43-3b93f919ec67 req-3a27f9df-22d2-403e-96d4-6b3a5302d805 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:38.020285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d0f1ebcf-01b3-4e54-ac43-3b93f919ec67 req-3a27f9df-22d2-403e-96d4-6b3a5302d805 service nova] Creating event network-vif-deleted:76b5f0f0-dabe-4392-9738-86f60ebafbe8 for instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 on n-h2-850003-3 Jul 18 12:59:38.037008 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d0f1ebcf-01b3-4e54-ac43-3b93f919ec67 req-3a27f9df-22d2-403e-96d4-6b3a5302d805 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094020 Jul 18 12:59:38.039727 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 854/1686] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:38.055581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6c80907-a881-4dbb-aba0-69335f6ced3d tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e46f8310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:39.818685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:39.860343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6c80907-a881-4dbb-aba0-69335f6ced3d tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a" status: 202 len: 0 microversion: 2.1 time: 1.818510 Jul 18 12:59:39.861120 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 855/1687] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:59:38 2022] DELETE /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a => generated 0 bytes in 1821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:59:39.867950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:39.868919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:39.878607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:39.879198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:39.880106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:39.880652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.043754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:40.063560 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ca36b74-769a-4319-92af-1161d32636d1 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 2419 microversion: 2.25 time: 0.200942 Jul 18 12:59:40.064448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 856/1688] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 12:59:39 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 2419 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 12:59:40.072804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.073595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:40.081918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.082419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.083233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.083678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.119521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:40.227330 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2a9571b-b694-47f9-aa73-20881b36f8ee tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 204 len: 0 microversion: 2.1 time: 0.160991 Jul 18 12:59:40.228745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 857/1689] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:40 2022] DELETE /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:40.249607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14711078-b89b-4225-a2cb-c2f8b7430c17 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Calling method '.version_select at 0x7f96e4617c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.288339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-14711078-b89b-4225-a2cb-c2f8b7430c17 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] HTTP exception thrown: Image not found. Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14711078-b89b-4225-a2cb-c2f8b7430c17 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Request method failure captured: Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/d65d9a88-6c8c-4fd4-ba30-fbd18810455j HTTP/1.1 Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vk1kTE_I-cz0Zy2Icm7dNKhMec4wTAj5U5VdhQvtX3kd0UHq3N2T786oGr7TKCovmORxoL8QRf_cRLarl0MRQvnHDrnd3aj6e24-wD-VkP54SOShifD5ETdSPQdcFRxOeygbBNJYpKIrJ-Riopzh6cdggyYfpzGJqqqb9C1h-iNtWo Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:40.292200 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2bacc265e9564c8b91207d8066a16b5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4eba246dea904239bfd72bdce863f3dc Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd65d9a88-6c8c-4fd4-ba30-fbd18810455j'} Jul 18 12:59:40.295408 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d65d9a88-6c8c-4fd4-ba30-fbd18810455j to delete Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.297088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d65d9a88-6c8c-4fd4-ba30-fbd18810455j could not be found. Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:40.300807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14711078-b89b-4225-a2cb-c2f8b7430c17 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:40.304426 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14711078-b89b-4225-a2cb-c2f8b7430c17 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/d65d9a88-6c8c-4fd4-ba30-fbd18810455j" status: 404 len: 62 microversion: 2.1 time: 0.055085 Jul 18 12:59:40.307064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 858/1690] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:40 2022] DELETE /compute/v2.1/images/d65d9a88-6c8c-4fd4-ba30-fbd18810455j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:59:40.307064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.309328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:40.319438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.319952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.320983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.321477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.359558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 12:59:40.502273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71e8d58a-6f9b-4b5b-a3e0-9ca72ed93c97 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 204 len: 0 microversion: 2.1 time: 0.203824 Jul 18 12:59:40.502922 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 859/1691] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:40 2022] DELETE /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:40.509589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.510842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:40.521376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.522272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.523319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.524033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.774999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:40.790132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9db947b9-e458-42d1-940c-06d72260971e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.285623 Jul 18 12:59:40.791208 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 860/1692] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:40 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:40.800730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e4c57160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.877888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a could not be found", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:59:40.879209 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] HTTP exception thrown: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Request method failure captured: Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a HTTP/1.1 Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VkqtvSq5Rt35mcr_A9c9LynwYO5vbdalM0N3-344GHmD8ldbDplGkrd4-VHJpmlWxAh5EnuQXsCrb5ZzmHm-GqEgFJ_wx7iJyVGStMGOL8VBU17VEJkRwWVOg-Dcnw2T7bnpsM7tKMoH_1u6GzoCOablwGfpMQ0QZxfKNZQpDC7aAM Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 833bacb5f9f74932a74207e94a1b8cff Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:40.883803 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_833bacb5f9f74932a74207e94a1b8cff", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 833bacb5f9f74932a74207e94a1b8cff Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsTestJSON-1244743930-project Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: af3e6c2d38d24a74911a9cac1c83e17e Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsTestJSON-1244743930-project Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: exception: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a'} Jul 18 12:59:40.886387 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:59:40.887610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a could not be found Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c68435db-a722-4f12-8fdc-55afbb8d985c'] Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a. Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.890302 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:40.892549 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:40.896085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:40.896085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:40.896085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Returning 404 to user: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:40.896085 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68db4c35-fe88-4eeb-afac-163e3d4e4332 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a" status: 404 len: 111 microversion: 2.1 time: 0.093603 Jul 18 12:59:40.896085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 861/1693] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 12:59:40 2022] GET /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:40.899602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dfd0a63e-6b28-4202-b321-fca45342768a req-c42250ac-e417-4a0c-bcc4-abdadfed6b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b66612e-bc27-4d8f-8206-787755b13cd6", "tag": "83693b58-f3b8-45f2-ada2-9a8b6de5ab7a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:40.915029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dfd0a63e-6b28-4202-b321-fca45342768a req-c42250ac-e417-4a0c-bcc4-abdadfed6b83 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.915559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dfd0a63e-6b28-4202-b321-fca45342768a req-c42250ac-e417-4a0c-bcc4-abdadfed6b83 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.930058 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dfd0a63e-6b28-4202-b321-fca45342768a req-c42250ac-e417-4a0c-bcc4-abdadfed6b83 service nova] Creating event network-changed:83693b58-f3b8-45f2-ada2-9a8b6de5ab7a for instance 3b66612e-bc27-4d8f-8206-787755b13cd6 on n-h1-850003-3 Jul 18 12:59:40.936925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dfd0a63e-6b28-4202-b321-fca45342768a req-c42250ac-e417-4a0c-bcc4-abdadfed6b83 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047206 Jul 18 12:59:40.937626 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 862/1694] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:40.947360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:40.948052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:40.961532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.962511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:40.963951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:40.964537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.179434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:41.183694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:41.189795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lazy-loading 'services' on Instance uuid 3c749356-da67-4bef-80b0-71624a06486e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:41.354917 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5b51512-1c6c-4da5-970e-a05bd94f848c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments/7106f9a4-30b5-4d5f-9f0f-eea36ea33d58" status: 202 len: 0 microversion: 2.25 time: 0.414788 Jul 18 12:59:41.356132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 863/1695] 10.222.0.88 () {60 vars in 1456 bytes} [Mon Jul 18 12:59:40 2022] DELETE /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments/7106f9a4-30b5-4d5f-9f0f-eea36ea33d58 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:41.365570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:41.366238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:41.377660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.378594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.380151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.381162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.603135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:41.613333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6981c699-0944-4e32-9bd9-06bfc35e3a7a tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1510 microversion: 2.1 time: 0.255265 Jul 18 12:59:41.613932 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 864/1696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:41 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:41.620177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52a6199d-f17e-46fd-bbf4-7b75d1179fb3 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Calling method '.version_select at 0x7f96e46f83a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:41.645167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-52a6199d-f17e-46fd-bbf4-7b75d1179fb3 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] HTTP exception thrown: Image not found. Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52a6199d-f17e-46fd-bbf4-7b75d1179fb3 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Request method failure captured: Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/cd09e985-fb47-4562-b3a4-cc75aeede99a1 HTTP/1.1 Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vk1kTE_I-cz0Zy2Icm7dNKhMec4wTAj5U5VdhQvtX3kd0UHq3N2T786oGr7TKCovmORxoL8QRf_cRLarl0MRQvnHDrnd3aj6e24-wD-VkP54SOShifD5ETdSPQdcFRxOeygbBNJYpKIrJ-Riopzh6cdggyYfpzGJqqqb9C1h-iNtWo Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:41.648229 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2bacc265e9564c8b91207d8066a16b5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4eba246dea904239bfd72bdce863f3dc Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'cd09e985-fb47-4562-b3a4-cc75aeede99a1'} Jul 18 12:59:41.650630 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd09e985-fb47-4562-b3a4-cc75aeede99a1 to delete Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.651574 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd09e985-fb47-4562-b3a4-cc75aeede99a1 could not be found. Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:41.653610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52a6199d-f17e-46fd-bbf4-7b75d1179fb3 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:41.655557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52a6199d-f17e-46fd-bbf4-7b75d1179fb3 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/cd09e985-fb47-4562-b3a4-cc75aeede99a1" status: 404 len: 62 microversion: 2.1 time: 0.035958 Jul 18 12:59:41.659246 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 865/1697] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:41 2022] DELETE /compute/v2.1/images/cd09e985-fb47-4562-b3a4-cc75aeede99a1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:59:41.660297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:41.660943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:41.672599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.673312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.674340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.674954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.868410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:41.877395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ef02591-c682-406b-ab81-8c7460e69755 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1474 microversion: 2.1 time: 0.222535 Jul 18 12:59:41.878195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 866/1698] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:41 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:41.884404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Calling method '.version_select at 0x7f96e448d430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:41.962740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a could not be found", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 12:59:41.963443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] HTTP exception thrown: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Request method failure captured: Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a HTTP/1.1 Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VkqtvSq5Rt35mcr_A9c9LynwYO5vbdalM0N3-344GHmD8ldbDplGkrd4-VHJpmlWxAh5EnuQXsCrb5ZzmHm-GqEgFJ_wx7iJyVGStMGOL8VBU17VEJkRwWVOg-Dcnw2T7bnpsM7tKMoH_1u6GzoCOablwGfpMQ0QZxfKNZQpDC7aAM Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 833bacb5f9f74932a74207e94a1b8cff Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:41.965830 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_833bacb5f9f74932a74207e94a1b8cff", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/833bacb5f9f74932a74207e94a1b8cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 833bacb5f9f74932a74207e94a1b8cff Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1244743930 Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsTestJSON-1244743930-project Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: af3e6c2d38d24a74911a9cac1c83e17e Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsTestJSON-1244743930-project Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: exception: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a'} Jul 18 12:59:41.968778 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 12:59:41.971133 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a could not be found Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d9b74cd-ccf4-41c6-977d-7d12e055230f'] Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a. Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.974366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:41.978258 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] Returning 404 to user: Floating IP not found for ID 25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97db55ec-66fd-4435-9b6a-5fee581a11e2 tempest-FloatingIPsTestJSON-1244743930 tempest-FloatingIPsTestJSON-1244743930-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a" status: 404 len: 111 microversion: 2.1 time: 0.088095 Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 867/1699] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 12:59:41 2022] DELETE /compute/v2.1/os-floating-ips/25ef3ad2-1ce9-4e3f-b836-f9bf98c52e3a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:41.981310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:41.982277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:41.985019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.985528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:41.986472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:41.987239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:42.040661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3d4170d-9929-45c0-af36-7eef404417bc tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071066 Jul 18 12:59:42.041816 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 868/1700] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:41 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:42.050600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78eebcd8-5e90-484b-a243-62cbf6c45541 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Calling method '.version_select at 0x7f96e5136790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:42.087679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-78eebcd8-5e90-484b-a243-62cbf6c45541 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] HTTP exception thrown: Image not found. Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78eebcd8-5e90-484b-a243-62cbf6c45541 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Request method failure captured: Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/tempest-invalid-104359486 HTTP/1.1 Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vk1kTE_I-cz0Zy2Icm7dNKhMec4wTAj5U5VdhQvtX3kd0UHq3N2T786oGr7TKCovmORxoL8QRf_cRLarl0MRQvnHDrnd3aj6e24-wD-VkP54SOShifD5ETdSPQdcFRxOeygbBNJYpKIrJ-Riopzh6cdggyYfpzGJqqqb9C1h-iNtWo Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:42.091212 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2bacc265e9564c8b91207d8066a16b5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4eba246dea904239bfd72bdce863f3dc Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'tempest-invalid-104359486'} Jul 18 12:59:42.094104 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-104359486 to delete Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.096198 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-104359486 could not be found. Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:42.099292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-78eebcd8-5e90-484b-a243-62cbf6c45541 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:42.105647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-78eebcd8-5e90-484b-a243-62cbf6c45541 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/tempest-invalid-104359486" status: 404 len: 62 microversion: 2.1 time: 0.050144 Jul 18 12:59:42.108061 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 869/1701] 10.222.0.88 () {58 vars in 1202 bytes} [Mon Jul 18 12:59:42 2022] DELETE /compute/v2.1/images/tempest-invalid-104359486 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:59:42.114277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:42.114848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:42.128840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:42.129470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:42.130854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:42.131290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:42.605862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:42.621876 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cd12400-1b40-416b-8b92-4f687a3b94a9 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.517775 Jul 18 12:59:42.623340 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 870/1702] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:42 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:42.632504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9566707f-ac26-458b-916d-f0058df981a0 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Calling method '.version_select at 0x7f96e4c571f0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:42.670992 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9566707f-ac26-458b-916d-f0058df981a0 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] HTTP exception thrown: Image not found. Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9566707f-ac26-458b-916d-f0058df981a0 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Request method failure captured: Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/7bf124ca-4588-4131-8f16-3f2c9c573de7 HTTP/1.1 Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vk1kTE_I-cz0Zy2Icm7dNKhMec4wTAj5U5VdhQvtX3kd0UHq3N2T786oGr7TKCovmORxoL8QRf_cRLarl0MRQvnHDrnd3aj6e24-wD-VkP54SOShifD5ETdSPQdcFRxOeygbBNJYpKIrJ-Riopzh6cdggyYfpzGJqqqb9C1h-iNtWo Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:42.672883 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2bacc265e9564c8b91207d8066a16b5f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2bacc265e9564c8b91207d8066a16b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2bacc265e9564c8b91207d8066a16b5f Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269 Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4eba246dea904239bfd72bdce863f3dc Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106412269-project Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '7bf124ca-4588-4131-8f16-3f2c9c573de7'} Jul 18 12:59:42.674756 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7bf124ca-4588-4131-8f16-3f2c9c573de7 to delete Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.676199 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bf124ca-4588-4131-8f16-3f2c9c573de7 could not be found. Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:42.680847 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9566707f-ac26-458b-916d-f0058df981a0 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:42.686832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9566707f-ac26-458b-916d-f0058df981a0 tempest-ImagesDeleteNegativeTestJSON-1106412269 tempest-ImagesDeleteNegativeTestJSON-1106412269-project] 10.222.0.88 "DELETE /compute/v2.1/images/7bf124ca-4588-4131-8f16-3f2c9c573de7" status: 404 len: 62 microversion: 2.1 time: 0.050100 Jul 18 12:59:42.690840 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 871/1703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:42 2022] DELETE /compute/v2.1/images/7bf124ca-4588-4131-8f16-3f2c9c573de7 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 12:59:42.690840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:42.690840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:42.701069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:42.701069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:42.701565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:42.701565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:43.404788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:43.437202 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5214ae2-9111-49c4-a804-87c9d529124e tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1510 microversion: 2.1 time: 0.759816 Jul 18 12:59:43.458266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 872/1704] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:42 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1510 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:43.470854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:43.472364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:43.487794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:43.488959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:43.492446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:43.493501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:44.125359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:44.151622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ebab449-5c1e-459a-9192-2840afce97ad tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1474 microversion: 2.1 time: 0.690619 Jul 18 12:59:44.167198 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 873/1705] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:43 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1474 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:44.187994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:44.190653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:44.216102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:44.216852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:44.218288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:44.219211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:44.417368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b6c17c8-3bfc-4585-b7fd-2b0f1bc90f66 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.246764 Jul 18 12:59:44.424094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 874/1706] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:44 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:44.432379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:44.433111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:44.486428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:44.488776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:44.490701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:44.491228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.197112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:45.234071 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9a36aba-1a3e-42b2-84e1-5d18592373fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.808177 Jul 18 12:59:45.283958 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 875/1707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:44 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:45.283958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:45.283958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:45.291165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.291996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.293320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.293789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.383209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.383839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.384934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lazy-loading 'fault' on Instance uuid b411a0d1-1495-488f-8962-4b5f632d72b7 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:45.536903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa169cceea44c7dbeeb5178cfc90d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283bae5ec5a8499d8ba353223330a7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:45.551200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c17a4efb-aa96-41ca-ad79-8bfdc7781d1b tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 200 len: 1305 microversion: 2.1 time: 0.276330 Jul 18 12:59:45.553053 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 876/1708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:45 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:45.560562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2aaffc01-a66d-40c3-ad0f-83838b56bc3e req-b9444b97-b65e-4e59-bc29-417c02aee4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b411a0d1-1495-488f-8962-4b5f632d72b7", "name": "network-vif-deleted", "tag": "883fd2ad-bafa-413f-954b-ad8bebe53dea"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:45.581476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2aaffc01-a66d-40c3-ad0f-83838b56bc3e req-b9444b97-b65e-4e59-bc29-417c02aee4a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.582623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2aaffc01-a66d-40c3-ad0f-83838b56bc3e req-b9444b97-b65e-4e59-bc29-417c02aee4a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.613088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2aaffc01-a66d-40c3-ad0f-83838b56bc3e req-b9444b97-b65e-4e59-bc29-417c02aee4a7 service nova] Creating event network-vif-deleted:883fd2ad-bafa-413f-954b-ad8bebe53dea for instance b411a0d1-1495-488f-8962-4b5f632d72b7 on n-h2-850003-3 Jul 18 12:59:45.623358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2aaffc01-a66d-40c3-ad0f-83838b56bc3e req-b9444b97-b65e-4e59-bc29-417c02aee4a7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067783 Jul 18 12:59:45.625964 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 877/1709] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:45.637307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:45.638440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:45.648417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.649182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.650576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:45.651240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:45.719455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:46.205435 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cbf2e80-b6d0-4223-931e-2680b434bb3d tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0/action" status: 202 len: 0 microversion: 2.1 time: 8.463204 Jul 18 12:59:46.206676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 833/1710] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:59:37 2022] POST /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0/action => generated 0 bytes in 8467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:59:46.238903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:46.245395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:46.280315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.281832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:46.297059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.301184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:46.412780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:46.455569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d26faf7-b03a-4a49-82e9-114bc398003e tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1474 microversion: 2.1 time: 0.824207 Jul 18 12:59:46.458659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 878/1711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:45 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1474 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:46.481513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:46.499828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:46.521539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.540044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:46.544639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.545572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:46.572271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4753e5d7-4635-49dd-9a97-a7654f4a02cd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.356137 Jul 18 12:59:46.587177 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 834/1712] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:46 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:46.619732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:46.624427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:46.665548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.667918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:46.674115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:46.676670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.231975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:47.249431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3801f6bd-de61-427c-9334-67efdd81b135 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.659831 Jul 18 12:59:47.255032 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 835/1713] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:46 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:47.301135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:47.308268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:47.325797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.326784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.328535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.331514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.356021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:47.377653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d43e87e8-e377-4932-bc34-a472f6c1fa20 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.917425 Jul 18 12:59:47.382921 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 879/1714] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:46 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:47.391782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-267625ed-58cb-4563-8baa-efa177764354 req-521bdeec-21e0-4abd-bb3c-d48bdfa539eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b66612e-bc27-4d8f-8206-787755b13cd6", "name": "network-vif-plugged", "status": "completed", "tag": "83693b58-f3b8-45f2-ada2-9a8b6de5ab7a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:47.398871 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 HTTP/1.1 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:47.401585 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.403904 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b411a0d1-1495-488f-8962-4b5f632d72b7'} Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:47.405208 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.407350 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.408703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:47.408703 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa0fdb0c-1080-41c2-8a78-06370338c474 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 404 len: 111 microversion: 2.1 time: 0.138091 Jul 18 12:59:47.408703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 836/1715] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:47 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:47.411692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-267625ed-58cb-4563-8baa-efa177764354 req-521bdeec-21e0-4abd-bb3c-d48bdfa539eb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.412440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-267625ed-58cb-4563-8baa-efa177764354 req-521bdeec-21e0-4abd-bb3c-d48bdfa539eb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.429502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-71840695", "metadata": {"image_type": "test"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:47.436257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:47.441359 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-267625ed-58cb-4563-8baa-efa177764354 req-521bdeec-21e0-4abd-bb3c-d48bdfa539eb service nova] Creating event network-vif-plugged:83693b58-f3b8-45f2-ada2-9a8b6de5ab7a for instance 3b66612e-bc27-4d8f-8206-787755b13cd6 on n-h1-850003-3 Jul 18 12:59:47.453387 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-267625ed-58cb-4563-8baa-efa177764354 req-521bdeec-21e0-4abd-bb3c-d48bdfa539eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068809 Jul 18 12:59:47.456063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 880/1716] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:47.456580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.457125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.462584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.463449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.512814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.514749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7/action HTTP/1.1 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 110 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:47.515202 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-71840695", "metadata": {"image_type": "test"}}} Jul 18 12:59:47.517965 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b411a0d1-1495-488f-8962-4b5f632d72b7', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-71840695', 'metadata': {'image_type': 'test'}}}} Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.520088 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.524724 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea995484-a36c-467d-997e-33e5a4bb62ea tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "POST /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7/action" status: 404 len: 111 microversion: 2.1 time: 0.101631 Jul 18 12:59:47.531078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 837/1717] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 12:59:47.536163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:47.550833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1130495102", "metadata": {"image_type": "test"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:47.552517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Failed to fetch instance by id tempest-invalid-238830506 {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 12:59:47.552868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance tempest-invalid-238830506 could not be found. Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/tempest-invalid-238830506/action HTTP/1.1 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 112 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:47.557906 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1130495102", "metadata": {"image_type": "test"}}} Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:47.559522 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance tempest-invalid-238830506 could not be found. Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'tempest-invalid-238830506', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1130495102', 'metadata': {'image_type': 'test'}}}} Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-238830506 could not be found. Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.560403 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-238830506 could not be found. Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-238830506 could not be found. Jul 18 12:59:47.561759 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.566049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance tempest-invalid-238830506 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:47.570599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32bac1f9-cb96-49f3-86f5-3df0d1e2afce tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "POST /compute/v2.1/servers/tempest-invalid-238830506/action" status: 404 len: 100 microversion: 2.1 time: 0.031450 Jul 18 12:59:47.571511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 838/1718] 10.222.0.88 () {60 vars in 1245 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/servers/tempest-invalid-238830506/action => generated 100 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:47.584087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.588151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1607111333"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:47.589682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.591870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.592740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.598662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 12:59:47.599033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 57 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:47.601232 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-test-snap-1607111333"}} Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:47.603976 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1607111333'}}} Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.607863 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.615802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.626995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:47.626995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b8cf3ba-69a0-4647-bc3d-c423b8a83ec9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.036008 Jul 18 12:59:47.627440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 839/1719] 10.222.0.88 () {60 vars in 1274 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:47.648789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:47.650268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:47.681346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.681927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.699952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.700522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.752213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:47.754721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:47.756938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:47.758520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lazy-loading 'fault' on Instance uuid 0a84cc14-b6b0-432f-a17b-8aee2fbea998 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:47.858497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd1b3f18-2aed-409b-836f-38ba129bd961 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.227566 Jul 18 12:59:47.861587 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 840/1720] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:47 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:47.879864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-268870206"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:47.881618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 12:59:47.884056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 56 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 12:59:47.890031 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-test-snap-268870206"}} Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 12:59:47.892889 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-268870206'}}} Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.896548 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 12:59:47.900664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 12:59:47.909936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:47.911141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e48f320b-f599-4155-ae61-3f73d9312ae6 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.046938 Jul 18 12:59:47.912584 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 841/1721] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:48.200244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f40e0512e404183b3092e0ce7aea512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ef3c5c0e9438c93e489e85e4da4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:48.234987 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13fa3966-eb92-4c78-93c5-b048763e0a8a tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 200 len: 1308 microversion: 2.1 time: 0.750993 Jul 18 12:59:48.236005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 881/1722] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:47 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 1308 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:48.241961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:48.261975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:48.279861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:48.286599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:48.295146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:48.296043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:48.367859 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 HTTP/1.1 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:48.370935 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:48.373272 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b411a0d1-1495-488f-8962-4b5f632d72b7'} Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:48.374233 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:48.375796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:48.385894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9da63c3b-868d-4822-8e19-7a230665c9a2 req-4aed531a-84e2-46bc-915a-0bd6e0ce592a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a84cc14-b6b0-432f-a17b-8aee2fbea998", "name": "network-vif-deleted", "tag": "775085f2-09ad-4ff4-bbb1-d85ebe3a11f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:48.387349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:48.395403 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d207b5cb-ca00-440f-8cda-1f8bf30f54a0 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 404 len: 111 microversion: 2.1 time: 0.157981 Jul 18 12:59:48.396638 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 882/1723] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 12:59:48 2022] DELETE /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:48.445566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9da63c3b-868d-4822-8e19-7a230665c9a2 req-4aed531a-84e2-46bc-915a-0bd6e0ce592a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:48.446079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9da63c3b-868d-4822-8e19-7a230665c9a2 req-4aed531a-84e2-46bc-915a-0bd6e0ce592a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:48.480640 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9da63c3b-868d-4822-8e19-7a230665c9a2 req-4aed531a-84e2-46bc-915a-0bd6e0ce592a service nova] Creating event network-vif-deleted:775085f2-09ad-4ff4-bbb1-d85ebe3a11f7 for instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 on n-h1-850003-3 Jul 18 12:59:48.503732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9da63c3b-868d-4822-8e19-7a230665c9a2 req-4aed531a-84e2-46bc-915a-0bd6e0ce592a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.586147 Jul 18 12:59:48.509471 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 842/1724] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:48.534558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:48.541970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:48.542419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-382445498", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:48.560276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:48.561291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:48.563554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:48.564958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:48.637182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 12:59:48.958454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:48.977122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b0b39b0-9671-44f6-b9b0-267de350d82a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.464191 Jul 18 12:59:48.977782 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 843/1725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:48 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:48.992506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:48.998408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:49.022058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.023731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.036502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.037632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.136365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 12:59:49.136927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 12:59:49.137726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 12:59:49.138322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 12:59:49.138852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 12:59:49.171146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.171748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.173971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.176277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.267998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Getting quotas for project 8282e6fd6e2a45a880e3d72dcb544540. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:59:49.280442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Getting quotas for user 4a84d146f9454e538b97cf7f6d247885 and project 8282e6fd6e2a45a880e3d72dcb544540. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:59:49.310423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 12:59:49.316470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 12:59:49.441340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:49.470588 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e7e9a69c-eaf2-43e1-9813-462eb41621b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069700 Jul 18 12:59:49.471345 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d7ed5d9-939f-45a6-8b04-b4801769177d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.490422 Jul 18 12:59:49.480882 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 883/1726] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 12:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 12:59:49.491629 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 844/1727] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:48 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:49.492403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:49.494235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] [instance: b411a0d1-1495-488f-8962-4b5f632d72b7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:49.503551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:49.505757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:49.509022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.509842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.512302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.512945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.524218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.525260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.531417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.533517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.562835 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] HTTP exception thrown: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Request method failure captured: Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 HTTP/1.1 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VkN-Qev6OyYPfplt7kduFMO26Ka3UAQs4UFgZKOgHX7QxFp-mGZc7M50mKSC6uvstReQ42V5BPoDXH4f2PI1rXOZWAqmRhQGDGorzbdM9XX3BYPBUfRg1sp7epGYV-VFRTlxobfwX6WWQVHMQtjjinmtjhS4aeRSTOEzNZ7W-ENrTY Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:49.564473 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_283bae5ec5a8499d8ba353223330a7c0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/283bae5ec5a8499d8ba353223330a7c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 283bae5ec5a8499d8ba353223330a7c0 Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2059298309 Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1aa169cceea44c7dbeeb5178cfc90d5c Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesNegativeTestJSON-2059298309-project Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:49.565965 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b411a0d1-1495-488f-8962-4b5f632d72b7'} Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:49.567550 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. Jul 18 12:59:49.569312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.571856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] Returning 404 to user: Instance b411a0d1-1495-488f-8962-4b5f632d72b7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:49.575874 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a862374-acce-46f5-aa96-b0efa50f43b9 tempest-ImagesNegativeTestJSON-2059298309 tempest-ImagesNegativeTestJSON-2059298309-project] 10.222.0.88 "GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7" status: 404 len: 111 microversion: 2.1 time: 0.092861 Jul 18 12:59:49.578900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 884/1728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:49 2022] GET /compute/v2.1/servers/b411a0d1-1495-488f-8962-4b5f632d72b7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:49.595111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:49.595111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] [instance: 0a84cc14-b6b0-432f-a17b-8aee2fbea998] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:49.604603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-89dd9123-e9ef-4c74-b2f5-0b52cad291c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110207 Jul 18 12:59:49.607718 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 845/1729] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:49 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:49.617694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38f7ada7-de67-4ded-a7f8-7166e616e5d9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:49.619804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38f7ada7-de67-4ded-a7f8-7166e616e5d9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:49.621053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.621518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.627546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:49.628246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:49.680971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] HTTP exception thrown: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Request method failure captured: Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 HTTP/1.1 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vg5pJZErGuvHe87bPjgjx4cSt_lfPY8566rCol4NXHHVDONBtU3F9sKNBT47ajGuAzThdo_3Qa48ACLynmEGfGANqRadMIeJ_NZZWvyAQc4OPB0BWmpgWpj6fIwfV88XZ1P7zeOWX3Y_YmQt9UD4_0YU5OMSkEHhT1ZGFdoFSKClGo Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 600ef3c5c0e9438c93e489e85e4da4d0 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 12:59:49.683421 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_600ef3c5c0e9438c93e489e85e4da4d0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/600ef3c5c0e9438c93e489e85e4da4d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 600ef3c5c0e9438c93e489e85e4da4d0 Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1468555369 Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ListImageFiltersTestJSON-1468555369-project Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f40e0512e404183b3092e0ce7aea512 Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ListImageFiltersTestJSON-1468555369-project Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. Jul 18 12:59:49.685176 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0a84cc14-b6b0-432f-a17b-8aee2fbea998'} Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 12:59:49.686189 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. Jul 18 12:59:49.688036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 12:59:49.691234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Returning 404 to user: Instance 0a84cc14-b6b0-432f-a17b-8aee2fbea998 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 12:59:49.692420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d844c881-bba5-434f-94a2-19b15c1081ba tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998" status: 404 len: 111 microversion: 2.1 time: 0.112387 Jul 18 12:59:49.707751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 885/1730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:49 2022] GET /compute/v2.1/servers/0a84cc14-b6b0-432f-a17b-8aee2fbea998 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 12:59:49.713470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f66f9062-d6b2-4e09-b66c-53f64a4646fb tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4700790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:49.935393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38f7ada7-de67-4ded-a7f8-7166e616e5d9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:49.948047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38f7ada7-de67-4ded-a7f8-7166e616e5d9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1216 microversion: 2.1 time: 0.338396 Jul 18 12:59:49.955870 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 846/1731] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:49 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1216 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:50.002031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:50.002705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:50.023259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:50.024304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:50.025627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:50.027019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:50.686800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:50.718930 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aacb75cd-c477-421c-aa5f-de5050b1a973 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1308 microversion: 2.1 time: 0.720461 Jul 18 12:59:50.731984 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 847/1732] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:49 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1308 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:59:50.745872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:50.753418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:50.776634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:50.782182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:50.784399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:50.786001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:51.307289 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f66f9062-d6b2-4e09-b66c-53f64a4646fb tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab" status: 204 len: 0 microversion: 2.1 time: 1.598138 Jul 18 12:59:51.308671 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 886/1733] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:49 2022] DELETE /compute/v2.1/images/f29bee2c-faac-4601-9600-008d722419ab => generated 0 bytes in 1600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:51.318660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:51.320352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:51.343036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:51.351501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:51.353593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:51.360485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:51.446654 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db649501-e7fd-4baa-b38f-a440e331f815 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136224 Jul 18 12:59:51.459253 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 887/1734] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:51 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:51.472223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:51.473805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:51.492773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:51.494054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:51.496717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:51.497935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:51.507581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:51.677141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:51.697145 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7bdef4e8-ff9e-4aa5-8f10-1234e93e1d9b tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1268 microversion: 2.1 time: 0.235944 Jul 18 12:59:51.698803 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 888/1735] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:51 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1268 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:51.706265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8a1f469-0b0b-42d4-b43f-78ab6c249598 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4db6940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:52.255962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:52.305557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c7396d38-9e40-47be-a8ab-174a57b4ef6d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.570945 Jul 18 12:59:52.311886 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 848/1736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:50 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:52.322602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:52.332645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:52.356504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.363318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:52.365544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.369620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:52.399552 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8a1f469-0b0b-42d4-b43f-78ab6c249598 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068" status: 204 len: 0 microversion: 2.1 time: 0.698664 Jul 18 12:59:52.400407 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 889/1737] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:51 2022] DELETE /compute/v2.1/images/c657e5fe-8ccb-4bbb-b3b4-c008fc9e5068 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 12:59:52.416177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-145156f3-b545-4c99-bfd7-d70882d45442 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] Calling method '.version_select at 0x7f96e4e64550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:52.887824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:52.898350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64c15309-b9d6-44e2-9f99-957f834ff8b2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1489 microversion: 2.1 time: 0.584108 Jul 18 12:59:52.898914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-145156f3-b545-4c99-bfd7-d70882d45442 tempest-ListImageFiltersTestJSON-1468555369 tempest-ListImageFiltersTestJSON-1468555369-project] 10.222.0.88 "DELETE /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb" status: 204 len: 0 microversion: 2.1 time: 0.489520 Jul 18 12:59:52.900670 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 849/1738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:52 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1489 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:52.911605 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 890/1739] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:52 2022] DELETE /compute/v2.1/images/fce23a40-56de-4c67-b0a7-101269dbdecb => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 12:59:52.916413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:52.919074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:52.935186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:52.936098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:52.943053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.944361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:52.949062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.949967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:52.950598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.951968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:52.954436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:52.954436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.044034 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e7fe74c-1c45-4b5b-b175-e64374ebc1c5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136685 Jul 18 12:59:53.045192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 891/1740] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:52 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:53.054715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:53.055515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:53.075546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.080258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.083349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.085560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.161912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lazy-loading 'flavor' on Instance uuid 3b66612e-bc27-4d8f-8206-787755b13cd6 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 12:59:53.368525 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b282f7b6-0406-4fa9-bf46-67c65913b8a8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6/action" status: 202 len: 0 microversion: 2.1 time: 0.319096 Jul 18 12:59:53.391675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 892/1741] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:59:53 2022] POST /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 12:59:53.395348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:53.425126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd59a8b0-0bff-46af-b0fb-86350097c4ca tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1274 microversion: 2.1 time: 0.498312 Jul 18 12:59:53.427839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:53.429478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:53.437652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.439266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 850/1742] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:52 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1274 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:53.447301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:53.451051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:53.454363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.459225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.461686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.475222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.479125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:53.480875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:53.485025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:54.054316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:54.109157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-daea5dee-8df4-4434-a97b-2b909573dbd5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.714455 Jul 18 12:59:54.111261 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 893/1743] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:53 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:54.123960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:54.136897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:54.140984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:54.155662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:54.156903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:54.158710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:54.160338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:54.179314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5c32db0-0e79-488b-a719-1d6300496cda tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1497 microversion: 2.1 time: 0.736960 Jul 18 12:59:54.191184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 851/1744] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:53 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1497 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:54.241860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef4fbabf-b088-41de-a2e5-da0d2398436b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127560 Jul 18 12:59:54.244396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 894/1745] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:54 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 12:59:54.476651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:54.477915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:54.523969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:54.526133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:54.531392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:54.532253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:54.880448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:54.893940 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a38d00be-a540-4411-8017-47a9cd7d887a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1274 microversion: 2.1 time: 0.437660 Jul 18 12:59:54.895233 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 852/1746] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:54 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1274 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:55.139328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:55.141015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:55.150180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.150939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.152649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.153331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.221272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:55.222444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:55.238037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.239052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.240279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.241015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.613247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:55.623812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ecb40097-c9ef-4755-801f-c8a12e528041 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.491105 Jul 18 12:59:55.629611 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 895/1747] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:55 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:55.647617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:55.648954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:55.663297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.666670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.668051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.668507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.782127 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ec360fc-70fb-43fd-b985-514212a13ae9 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.147409 Jul 18 12:59:55.793555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 896/1748] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 12:59:55 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:55.853635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:55.888386 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc38cac3-366c-40e7-9f81-84f35b7f68d4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 200 len: 1480 microversion: 2.1 time: 0.670766 Jul 18 12:59:55.894880 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 853/1749] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:55 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 1480 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 12:59:55.931051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1090825636"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:55.931626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:55.933110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:55.937027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:55.968358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.970784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.972057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.973907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.975064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.980720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:55.985906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:55.987048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:56.064541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:56.275702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:56.308508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-161cb9fb-0db5-40ee-8923-1b6b3df10086 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1274 microversion: 2.1 time: 0.385448 Jul 18 12:59:56.310738 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 854/1750] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:55 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1274 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:56.652113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:56.658476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:56.705554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:56.709333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:56.712856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:56.717485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:57.090755 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79fb4f71-729f-4af9-ba18-c8ffbd54426c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6/action" status: 202 len: 0 microversion: 2.1 time: 1.178099 Jul 18 12:59:57.096655 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 897/1751] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 12:59:55 2022] POST /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6/action => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 12:59:57.174605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1df34fbd-b8ed-4ec0-b38c-905da9ece20c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4d4aca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:57.349608 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1df34fbd-b8ed-4ec0-b38c-905da9ece20c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.236680 Jul 18 12:59:57.358831 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 898/1752] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:57 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:57.380719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:57.383286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:57.434499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:57.441126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:57.445508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:57.448958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:57.907938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:57.930844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-809a50e0-bb3f-4b8a-a926-edfbe03e2aaf tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 0.559462 Jul 18 12:59:57.932980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 899/1753] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:57 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:58.205232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 12:59:58.222282 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46f1d206-4e73-4469-9659-96fc2329d08e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.578451 Jul 18 12:59:58.223624 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 855/1754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:56 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:58.381033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ecfc49f7-acf8-42ef-b131-95e1101702d0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4d2dee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:58.563233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ecfc49f7-acf8-42ef-b131-95e1101702d0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.187013 Jul 18 12:59:58.564342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 900/1755] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 12:59:58 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 12:59:58.975021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:58.976241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:59.055356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:59.056074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:59.057650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:59.073102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:59.221294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:59.298118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 12:59:59.420520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16251073-ff7f-4328-b032-3e986c92f585 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e46feee0>, body: {"keypair": {"name": "tempest-keypair-215680209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnq0tPzikZBWV7+Uy0m0uk22aAgWiWpzP/HLQTdmao9L0cOSdmvy5ekZyMuz7fKTSPGSeO3DCe9kBl4XpHd5nTkGa/Ho4r9vQYHJZNyga0SNAYf5SZa6J4g65N4ZOT0zg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 12:59:59.498917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-16251073-ff7f-4328-b032-3e986c92f585 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 12:59:59.508925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-16251073-ff7f-4328-b032-3e986c92f585 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 12:59:59.594076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16251073-ff7f-4328-b032-3e986c92f585 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.617930 Jul 18 12:59:59.596195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 901/1756] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 12:59:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 12:59:59.613613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 12:59:59.618975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 12:59:59.632649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:59.638438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:59.640569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 12:59:59.641305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 12:59:59.945658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:00.042945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:00.057075 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3c6a0c6-d83b-4345-b9c7-14c1324c59b7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.458642 Jul 18 13:00:00.066573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 902/1757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:59 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:00.075821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b80c01b-9bba-4832-98ff-3784434deea3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46fe160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:00.193734 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b80c01b-9bba-4832-98ff-3784434deea3 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.125017 Jul 18 13:00:00.205535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 903/1758] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:00 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:00.218351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-888ce22b-5988-4097-84ad-4313d22ef95f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e4576820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:00.233773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-888ce22b-5988-4097-84ad-4313d22ef95f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-215680209" status: 200 len: 496 microversion: 2.1 time: 0.026562 Jul 18 13:00:00.235477 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 904/1759] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 13:00:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-215680209 => generated 496 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:00.328807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9454d20c-9357-4c9c-8053-48d887840434 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e4d26af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:00.415949 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9454d20c-9357-4c9c-8053-48d887840434 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215680209" status: 202 len: 0 microversion: 2.1 time: 0.164521 Jul 18 13:00:00.416566 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 905/1760] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215680209 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:00.446921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b616f030-11d4-4222-a1a9-e46f59e9f437 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e45bcc10>, body: {"keypair": {"name": "tempest-keypair-412545946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+wCKEQWk+3TsKQ/ezrKtr48Y+Wvi5eBdZHyQkVBKtVMdPBUeGvimFodRi7+0mSH/jTqQnTGy5v9fBNIVUzL+Qh4X9w6QqkpBpWat+KyXjLOH09PvLxvugRexx/htrNfQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:00.560280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b616f030-11d4-4222-a1a9-e46f59e9f437 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:00.603767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b616f030-11d4-4222-a1a9-e46f59e9f437 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:00.887782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b616f030-11d4-4222-a1a9-e46f59e9f437 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.450527 Jul 18 13:00:00.898682 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 906/1761] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:00:00.944884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cee3e7fb-704b-4a7f-b14d-640944c9a247 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e45764c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:00.971147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:01.065504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-609afd66-d29c-4c85-abf8-aa9efe9cbce5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 2.109408 Jul 18 13:00:01.087970 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 856/1762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 12:59:58 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:01.098261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:01.099734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:01.111969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:01.113074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:01.114857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:01.115910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:01.125813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cee3e7fb-704b-4a7f-b14d-640944c9a247 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412545946" status: 202 len: 0 microversion: 2.1 time: 0.216877 Jul 18 13:00:01.133596 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 907/1763] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412545946 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:01.163988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2980dae-e229-49f4-8836-6d5bcf3d7498 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e46fe1f0>, body: {"keypair": {"name": "tempest-keypair-453839306", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:01.299393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a2980dae-e229-49f4-8836-6d5bcf3d7498 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:01.347175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a2980dae-e229-49f4-8836-6d5bcf3d7498 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:01.473349 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2980dae-e229-49f4-8836-6d5bcf3d7498 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.331039 Jul 18 13:00:01.481465 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 908/1764] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:01 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:01.488361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-838aff87-c200-456d-9cf9-2b19fe02e492 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46fac10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:01.675300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-838aff87-c200-456d-9cf9-2b19fe02e492 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.194957 Jul 18 13:00:01.685807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 909/1765] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:01 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:01.700848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34541968-9243-49ca-bea9-097bc4083f3e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e46fee50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:01.826614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34541968-9243-49ca-bea9-097bc4083f3e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453839306" status: 202 len: 0 microversion: 2.1 time: 0.135482 Jul 18 13:00:01.841215 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 910/1766] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453839306 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:01.876208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b2c3808b-61fc-4f88-8901-2be66bf7057f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e45761f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1799849631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW1BuxAUTxkQTSdRKEL/wh/GnaNf6OKsLeE85eHe35QoKELhdjCke2C7/ev22w+FOLFZUGjj1CaAu9FyILTaZKn/X+xvJOyAE377P5EqH3oHTeLQo+W+ALlqUlkrbJdjA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:01.960065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b2c3808b-61fc-4f88-8901-2be66bf7057f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:01.969592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:01.995162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b2c3808b-61fc-4f88-8901-2be66bf7057f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:02.186488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b2c3808b-61fc-4f88-8901-2be66bf7057f tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.335025 Jul 18 13:00:02.188205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 911/1767] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:02.198703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:02.200763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:02.228405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:02.229925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:02.233994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:02.239658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:02.841183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:02.869385 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1892ebed-5806-4bf6-96ed-9d9f71e67d45 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.778081 Jul 18 13:00:02.882195 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 857/1768] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:01 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:02.908338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3af618e-9355-4002-ae48-82da620212a7 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e4540af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1064241830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaaBLPTD2CccT7WzkqCeda2Tyes4MMsR4CxtLCMFXuQx0dOsvj2v3ZRO38x2cMklCuZFeWP21waCymcgUoKmeyF+TIXp+QbhkBNzcnFiHA7QbD3cUzMPakldjIBTsdtWQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:02.950869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=66 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:03.006200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a3af618e-9355-4002-ae48-82da620212a7 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:03.036502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a3af618e-9355-4002-ae48-82da620212a7 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:03.148484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3af618e-9355-4002-ae48-82da620212a7 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.271208 Jul 18 13:00:03.150109 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 858/1769] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:03.157534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b359688f-2210-4b72-a25f-481633d3dd65 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e49185e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:03.318935 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b359688f-2210-4b72-a25f-481633d3dd65 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.166708 Jul 18 13:00:03.322791 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 859/1770] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:03 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:03.335055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20294067-8eed-4516-9f0f-b71b7e5ebf3c tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Action: 'create', calling method: .version_select at 0x7f96e4567f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2037952588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZFBx43jW5jMzP92s5/jSTkbRz6V01vzYHKrbA0uY30PFWhyxgYQcxDQQeMf2iiHQ2HROh1+fp5AVg65gg/sxsSglYuWBrDtweFzFa1c3I3bncDJRg+DQkCM2D/MhoGgQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:03.377680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-20294067-8eed-4516-9f0f-b71b7e5ebf3c tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:03.389762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-20294067-8eed-4516-9f0f-b71b7e5ebf3c tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Getting quotas for user fa47a775578742a08ce0147e0077ce1b and project 6dbb8389d467415bb112510beed612da. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:03.450298 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20294067-8eed-4516-9f0f-b71b7e5ebf3c tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123346 Jul 18 13:00:03.454022 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 860/1771] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:03.474428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8c5b680e-f9b5-4080-8603-5bb7b44ba5da req-ccef68f5-d5cd-4974-88e8-473c1972a67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b66612e-bc27-4d8f-8206-787755b13cd6", "name": "network-vif-plugged", "status": "completed", "tag": "83693b58-f3b8-45f2-ada2-9a8b6de5ab7a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:03.554381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c5b680e-f9b5-4080-8603-5bb7b44ba5da req-ccef68f5-d5cd-4974-88e8-473c1972a67a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:03.554845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c5b680e-f9b5-4080-8603-5bb7b44ba5da req-ccef68f5-d5cd-4974-88e8-473c1972a67a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:03.621875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8c5b680e-f9b5-4080-8603-5bb7b44ba5da req-ccef68f5-d5cd-4974-88e8-473c1972a67a service nova] Creating event network-vif-plugged:83693b58-f3b8-45f2-ada2-9a8b6de5ab7a for instance 3b66612e-bc27-4d8f-8206-787755b13cd6 on n-h1-850003-3 Jul 18 13:00:03.658483 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8c5b680e-f9b5-4080-8603-5bb7b44ba5da req-ccef68f5-d5cd-4974-88e8-473c1972a67a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192882 Jul 18 13:00:03.660836 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 861/1772] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:03.684840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2aa39c56-940c-443a-b74c-63393e2e26a9 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e44fb670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:03.714195 n-d-850003-3 devstack@n-api.service[131367]: WARNING oslo_db.sqlalchemy.utils [None req-2aa39c56-940c-443a-b74c-63393e2e26a9 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 13:00:03.752663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:03.757153 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2aa39c56-940c-443a-b74c-63393e2e26a9 tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.089584 Jul 18 13:00:03.763219 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 862/1773] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:00:03 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:03.792820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cf21658-f8eb-4d85-8f8b-5b0b9557f52e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e45670d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:03.793129 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-217814c8-4014-489f-bb25-931e4d8d91e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 1.599205 Jul 18 13:00:03.818705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 912/1774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:02 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:03.852319 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cf21658-f8eb-4d85-8f8b-5b0b9557f52e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2037952588" status: 202 len: 0 microversion: 2.1 time: 0.084391 Jul 18 13:00:03.853476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 863/1775] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 13:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2037952588 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:03.869336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bfecd52-7398-4518-b6f8-8521d8df5f1e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e46fab80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:03.893559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:03.895133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:03.915919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:03.917376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:03.918904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:03.920532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:03.970927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5bfecd52-7398-4518-b6f8-8521d8df5f1e tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1064241830" status: 202 len: 0 microversion: 2.1 time: 0.112357 Jul 18 13:00:03.973859 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 913/1776] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 13:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1064241830 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:00:04.003364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-901fe656-8a74-40b1-9bb4-3b89500aa09b tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] Calling method '.version_select at 0x7f96e46fe4c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:04.081312 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-901fe656-8a74-40b1-9bb4-3b89500aa09b tempest-KeyPairsV2TestJSON-1664371869 tempest-KeyPairsV2TestJSON-1664371869-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1799849631" status: 202 len: 0 microversion: 2.1 time: 0.100059 Jul 18 13:00:04.083192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 914/1777] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 13:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1799849631 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:04.351930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d90bc93-6b3b-4913-b51d-7ba042a3251c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4321670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:05.997963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:06.055180 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7817546-fcf6-4891-aa19-da60c42093e9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 2.168172 Jul 18 13:00:06.090613 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 864/1778] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:03 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:06.120544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:06.140955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:06.157797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:06.158319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:06.159331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:06.159990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:07.947206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:07.984541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3b2d9f49-1c07-4c37-a198-f770074f10d6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 1.891965 Jul 18 13:00:07.997889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 865/1779] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:06 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:08.020679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1894dd8a-66f8-4b45-9f03-e5858b15ee79 req-98e00d89-c93c-4a66-91b0-f6921abaaea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:08.046071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1894dd8a-66f8-4b45-9f03-e5858b15ee79 req-98e00d89-c93c-4a66-91b0-f6921abaaea1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:08.064233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1894dd8a-66f8-4b45-9f03-e5858b15ee79 req-98e00d89-c93c-4a66-91b0-f6921abaaea1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:08.108574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1894dd8a-66f8-4b45-9f03-e5858b15ee79 req-98e00d89-c93c-4a66-91b0-f6921abaaea1 service nova] Creating event network-changed:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:00:08.153284 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1894dd8a-66f8-4b45-9f03-e5858b15ee79 req-98e00d89-c93c-4a66-91b0-f6921abaaea1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149423 Jul 18 13:00:08.167319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 866/1780] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:08.214108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:08.231114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:08.294451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:08.303703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:08.310271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:08.315925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:09.792945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:09.830553 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3cec997c-0d06-45ff-a861-4cf56368dc5a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.660195 Jul 18 13:00:09.866672 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 867/1781] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:08 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:09.911479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:09.919358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:09.955308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:09.956178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:09.963022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:09.969213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:11.576137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:11.629323 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f3c4b59a-2b38-4a80-ab2f-7e1333f7725a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 1.728043 Jul 18 13:00:11.648491 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 868/1782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:09 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:11.672095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:11.675075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:11.691510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:11.694896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:11.697641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:11.698920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:12.051342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:13.407125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:13.435450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:13.461456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39ddfffc-a8fb-4f4a-8764-61eb9c94d26b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.807992 Jul 18 13:00:13.468441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 869/1783] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:11 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:13.561346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:13.566600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:13.613197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:13.614360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:13.615544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:13.618664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:13.764491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:14.052406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:15.052804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:15.064885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d695cd9-2987-4821-ac0e-6981bb070798 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 1.586282 Jul 18 13:00:15.069129 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 870/1784] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:13 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:15.086797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:15.091311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:15.095865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Searching by: {'deleted': False, 'project_id': 'd824a7309550407595c967988338266a'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:00:15.122699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:15.132513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:15.138241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:15.139370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:15.343563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:00:15.506292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c00eec5e-e114-45c5-9ca8-016efe87a1ba tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.432528 Jul 18 13:00:15.510904 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 871/1785] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:00:15 2022] GET /compute/v2.1/servers => generated 334 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:15.539237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:15.542733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:15.577629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:15.583001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:15.584422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:15.591414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:17.726035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:17.770046 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19b7b299-0563-4e5d-9a2e-6f3a5414a8f8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 2.249014 Jul 18 13:00:17.787794 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 872/1786] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:15 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:18.276987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-761fabbc-949e-4c14-be00-8a4b41559b1a req-9032e5a4-4c2b-4cd7-b127-e4c6e267197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-plugged", "status": "completed", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:18.295253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-761fabbc-949e-4c14-be00-8a4b41559b1a req-9032e5a4-4c2b-4cd7-b127-e4c6e267197e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:18.296448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-761fabbc-949e-4c14-be00-8a4b41559b1a req-9032e5a4-4c2b-4cd7-b127-e4c6e267197e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:18.319557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-761fabbc-949e-4c14-be00-8a4b41559b1a req-9032e5a4-4c2b-4cd7-b127-e4c6e267197e service nova] Creating event network-vif-plugged:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:00:18.334559 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-761fabbc-949e-4c14-be00-8a4b41559b1a req-9032e5a4-4c2b-4cd7-b127-e4c6e267197e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.544184 Jul 18 13:00:18.336496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 873/1787] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:18.346451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:18.353577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:18.356374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Searching by: {'deleted': False, 'project_id': 'd824a7309550407595c967988338266a'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:00:18.368229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:18.370255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:18.376543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:18.377743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:18.497982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:00:18.630503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:18.651914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:18.655182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:19.255300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a06519e8-004c-4a75-8dab-70512c876926 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.916112 Jul 18 13:00:19.258514 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 874/1788] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:00:18 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:19.296631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:19.306485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:19.344212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:19.347727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:19.351331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:19.363823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:20.556876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:20.591493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b6e032f-db88-45b2-b2bb-f1554b8d7209 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1316 microversion: 2.1 time: 1.326286 Jul 18 13:00:20.593909 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 875/1789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:19 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1316 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:20.622398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:20.633502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:20.668879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:20.672347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:20.675268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:20.679397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:21.487519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:21.513295 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d80d0ed0-8718-4227-badf-ab6869a75467 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.913274 Jul 18 13:00:21.521984 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 876/1790] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:20 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:21.581885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecb423a3-d4d1-4e29-81da-b7fb5bd40f0d tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:21.647988 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecb423a3-d4d1-4e29-81da-b7fb5bd40f0d tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.109989 Jul 18 13:00:21.649063 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 877/1791] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:00:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:21.684407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2ed80e99-0629-499c-a46b-579e7766f7f5 req-68b775cd-581e-49ed-84d9-c082a9bc1028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "name": "network-vif-unplugged", "status": "completed", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:21.800605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed80e99-0629-499c-a46b-579e7766f7f5 req-68b775cd-581e-49ed-84d9-c082a9bc1028 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:21.801438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed80e99-0629-499c-a46b-579e7766f7f5 req-68b775cd-581e-49ed-84d9-c082a9bc1028 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:21.921121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:21.944503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2ed80e99-0629-499c-a46b-579e7766f7f5 req-68b775cd-581e-49ed-84d9-c082a9bc1028 service nova] Creating event network-vif-unplugged:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h1-850003-3 Jul 18 13:00:22.004812 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2ed80e99-0629-499c-a46b-579e7766f7f5 req-68b775cd-581e-49ed-84d9-c082a9bc1028 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.346928 Jul 18 13:00:22.009201 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 878/1792] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:22.070196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:22.077791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:22.144985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:22.160511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:22.164235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:22.170317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:22.996673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:23.035373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cff7b904-bf52-40dc-9d09-341c553ded67 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1465 microversion: 2.1 time: 1.005152 Jul 18 13:00:23.041922 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 879/1793] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:22 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1465 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:23.081675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:23.083312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:23.112414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:23.114051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:23.115898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:23.116978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:23.263582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:00:23.633003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-55ee35e5-7fc8-45b8-8193-416892f65842 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "DELETE /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 204 len: 0 microversion: 2.1 time: 0.586468 Jul 18 13:00:23.634785 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 880/1794] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:00:23 2022] DELETE /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:00:23.656606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:23.664032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:23.701341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:23.701341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:23.704196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:23.706879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:24.228063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:24.265025 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9893adca-ec49-4504-b160-f0b7be0e7765 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 0.628052 Jul 18 13:00:24.286489 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 881/1795] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:23 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:24.309176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1446667301", "metadata": {"image_type": "test"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:24.314463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:24.355298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:24.358393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:24.367749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:24.368712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:24.504805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Getting quotas for project 8282e6fd6e2a45a880e3d72dcb544540. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:24.515635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Getting quotas for user 4a84d146f9454e538b97cf7f6d247885 and project 8282e6fd6e2a45a880e3d72dcb544540. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:28.432708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:28.610421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:30.416015 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d90bc93-6b3b-4913-b51d-7ba042a3251c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 26.078298 Jul 18 13:00:30.418446 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 915/1796] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:04 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 26083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:30.430015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:30.431120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:30.452353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:30.453819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:30.462311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:30.463652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:30.789312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:30.821043 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1337d32-9f75-435b-9c4d-32187f7eb113 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1632 microversion: 2.1 time: 0.401082 Jul 18 13:00:30.826896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 916/1797] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:30 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1632 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:30.858214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f88e6fc6-4ed6-47a3-a144-950e1e01d404 req-0835c2ae-bc46-4e39-b19e-dda2597939c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:30.895509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f88e6fc6-4ed6-47a3-a144-950e1e01d404 req-0835c2ae-bc46-4e39-b19e-dda2597939c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:30.898956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f88e6fc6-4ed6-47a3-a144-950e1e01d404 req-0835c2ae-bc46-4e39-b19e-dda2597939c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:30.948072 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f88e6fc6-4ed6-47a3-a144-950e1e01d404 req-0835c2ae-bc46-4e39-b19e-dda2597939c3 service nova] Creating event network-changed:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h1-850003-3 Jul 18 13:00:30.972557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f88e6fc6-4ed6-47a3-a144-950e1e01d404 req-0835c2ae-bc46-4e39-b19e-dda2597939c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143635 Jul 18 13:00:30.983216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 917/1798] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:31.030358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:31.033014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:31.061844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:31.066165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:31.071424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:31.073605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:31.401271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf6356b5-63a7-455d-9072-47a04a4759ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "POST /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f/action" status: 202 len: 0 microversion: 2.1 time: 7.107562 Jul 18 13:00:31.406085 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 882/1799] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:00:24 2022] POST /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f/action => generated 0 bytes in 7118 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:00:31.689379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-89b9cb0c-08d3-4df8-b49f-4a89176ebc3f tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Calling method '.version_select at 0x7f96e47113a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:32.085798 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-89b9cb0c-08d3-4df8-b49f-4a89176ebc3f tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.677889 Jul 18 13:00:32.086444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 883/1800] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 13:00:31 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:00:32.099063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8c4cfdc1-f685-4f51-8b3f-a8db94fcf4c9 req-0909e02e-8b98-4f9c-b45b-8ff974b30c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "name": "network-vif-unplugged", "status": "completed", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:32.130231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c4cfdc1-f685-4f51-8b3f-a8db94fcf4c9 req-0909e02e-8b98-4f9c-b45b-8ff974b30c0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:32.142968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c4cfdc1-f685-4f51-8b3f-a8db94fcf4c9 req-0909e02e-8b98-4f9c-b45b-8ff974b30c0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:32.160348 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8c4cfdc1-f685-4f51-8b3f-a8db94fcf4c9 req-0909e02e-8b98-4f9c-b45b-8ff974b30c0a service nova] Creating event network-vif-unplugged:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h1-850003-3 Jul 18 13:00:32.187804 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8c4cfdc1-f685-4f51-8b3f-a8db94fcf4c9 req-0909e02e-8b98-4f9c-b45b-8ff974b30c0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092138 Jul 18 13:00:32.191327 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 884/1801] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:32.206647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18331621-e982-4b3e-90ba-a63a66fdfe38 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e47113a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:32.375587 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-18331621-e982-4b3e-90ba-a63a66fdfe38 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.182189 Jul 18 13:00:32.376639 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 885/1802] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:32 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:32.385675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:32.398136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3992c553-0d3d-4356-adbb-40989cbda5db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e425a700>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:32.446369 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2610c111-4bb4-44cf-bcc8-37aaa1474976 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.444186 Jul 18 13:00:32.454787 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 918/1803] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:31 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:32.493263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:32.498520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:32.586772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:32.588285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:32.589244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:32.608360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:32.648957 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3992c553-0d3d-4356-adbb-40989cbda5db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.271598 Jul 18 13:00:32.649667 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 886/1804] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:32 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:32.668200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bab0d12-f9a1-4540-b2aa-e6b25c2e9393 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Action: 'create', calling method: .version_select at 0x7f96e425af70>, body: {"pool": "non_exist_pool"} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:32.771629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:32.775989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:32.806396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lazy-loading 'fault' on Instance uuid 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:00:33.180636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d525aa79c4a86b433686240705484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd824a7309550407595c967988338266a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:33.218667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7081d884-537b-4767-a2af-671973ff9957 tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 200 len: 1359 microversion: 2.1 time: 0.755404 Jul 18 13:00:33.221530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 919/1805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:32 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 1359 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:33.350438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1cc3099c-bde3-43ea-a428-00f530ee471e req-c2a3bc28-55b7-48ea-8b2a-53a722063b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340329e2-ae2e-488c-8f3b-bbcfb0e55d11", "name": "network-vif-deleted", "tag": "2a2cef8e-e2e4-4091-a7dc-8674c2839173"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:33.426034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1cc3099c-bde3-43ea-a428-00f530ee471e req-c2a3bc28-55b7-48ea-8b2a-53a722063b42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:33.428573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1cc3099c-bde3-43ea-a428-00f530ee471e req-c2a3bc28-55b7-48ea-8b2a-53a722063b42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:33.469083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1cc3099c-bde3-43ea-a428-00f530ee471e req-c2a3bc28-55b7-48ea-8b2a-53a722063b42 service nova] Creating event network-vif-deleted:2a2cef8e-e2e4-4091-a7dc-8674c2839173 for instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 on n-h2-850003-3 Jul 18 13:00:33.492491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1cc3099c-bde3-43ea-a428-00f530ee471e req-c2a3bc28-55b7-48ea-8b2a-53a722063b42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148489 Jul 18 13:00:33.495525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 920/1806] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:33.510876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4fc437c-b713-4335-8d12-0fd0075c0cb8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e46f80d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:33.742592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4fc437c-b713-4335-8d12-0fd0075c0cb8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.233033 Jul 18 13:00:33.744296 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 921/1807] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:33 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:33.793878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:33.808266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:33.859755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:33.860574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:33.864340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:33.866830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:34.457951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6bab0d12-f9a1-4540-b2aa-e6b25c2e9393 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] HTTP exception thrown: Floating IP pool not found. Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bab0d12-f9a1-4540-b2aa-e6b25c2e9393 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Request method failure captured: Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 26 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vlp-ad_P7gsjE3EGCjpO3GcnL5WjxxaE0ZqrvisrZ2FvqXpfZECPY0RDn4wgTjVUiDSRB3qypYTIX2UQTZ9rraDsCCVbEAr8w85L_apjtByQ2mTVEGTqhz9TUzMsmwqt1drv1HlJx0SV8bl26Casmxv-IqDtwm6sMsfq5t2XNlVYRc Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 084358f49cba4a44a0f8417e8167cab0 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:00:34.459987 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_084358f49cba4a44a0f8417e8167cab0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 084358f49cba4a44a0f8417e8167cab0 Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsNegativeTestJSON-883264364-project Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: d8823c6646b640d089288ee3cdf8ac54 Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-883264364-project Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: {"pool": "non_exist_pool"} Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: exception: Floating IP pool not found. Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 18 13:00:34.461622 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:00:34.463369 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 18 13:00:34.465233 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.470861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bab0d12-f9a1-4540-b2aa-e6b25c2e9393 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Returning 404 to user: Floating IP pool not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:00:34.472091 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bab0d12-f9a1-4540-b2aa-e6b25c2e9393 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 1.810455 Jul 18 13:00:34.473244 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 887/1808] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 13:00:32 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 1823 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:00:34.478857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d04661c-f0a7-467c-bec6-9350bc8e348c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e425a8b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:34.677140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d04661c-f0a7-467c-bec6-9350bc8e348c tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.202436 Jul 18 13:00:34.678043 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 888/1809] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:34 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:34.688186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:34.695959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] [instance: 340329e2-ae2e-488c-8f3b-bbcfb0e55d11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:34.719614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:34.734112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:34.736918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:34.738520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:34.746122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:34.819661 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] HTTP exception thrown: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Request method failure captured: Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 HTTP/1.1 Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vjt_S5jWf0g3bgMTpClOJjREASQTtd6jUXlJexBz4DqewaUAyHSMzQXp-9fW40JOAtvUgN6caiDQdjhr2VNiFu13ZOD0fBwHq7jCw3qyXQ84Rgq-ULgzh7wXUfcDwqK5SeuQ0aTzDzKG1LurSfYN_hrbFs1tbO2xVRQsaoc_JiSFIY Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: d824a7309550407595c967988338266a Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-43270051 Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:00:34.830935 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d824a7309550407595c967988338266a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d824a7309550407595c967988338266a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d824a7309550407595c967988338266a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d824a7309550407595c967988338266a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-43270051 Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: d824a7309550407595c967988338266a Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-43270051 Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-43270051-project Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 975d525aa79c4a86b433686240705484 Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-43270051-project Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '340329e2-ae2e-488c-8f3b-bbcfb0e55d11'} Jul 18 13:00:34.832556 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:00:34.833592 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. Jul 18 13:00:34.835619 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:34.837314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Returning 404 to user: Instance 340329e2-ae2e-488c-8f3b-bbcfb0e55d11 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:00:34.843449 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-18861af7-e44b-4a4d-8203-b9ed3b7d89fe tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11" status: 404 len: 111 microversion: 2.1 time: 0.158844 Jul 18 13:00:34.848693 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 889/1810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:34 2022] GET /compute/v2.1/servers/340329e2-ae2e-488c-8f3b-bbcfb0e55d11 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:00:34.871213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Calling method '.version_select at 0x7f96e425aa60>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:35.040570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:35.054782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-144f7f87-2d03-4052-aa8c-151fedbb3e3f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.308702 Jul 18 13:00:35.065488 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 922/1811] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:33 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:35.067181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aed57fae-8741-4f4c-849f-25f632078c73 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e46fe700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:35.171001 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aed57fae-8741-4f4c-849f-25f632078c73 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.104344 Jul 18 13:00:35.177059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 923/1812] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:35 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:35.195628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-644cba99-6f88-43df-94d9-7325cc42601e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] Calling method '.version_select at 0x7f96e46feee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:35.257083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-644cba99-6f88-43df-94d9-7325cc42601e tempest-ServersTestJSON-43270051 tempest-ServersTestJSON-43270051-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-335469606" status: 202 len: 0 microversion: 2.1 time: 0.078619 Jul 18 13:00:35.261895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 924/1813] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-335469606 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:00:35.471545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 could not be found", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:00:35.474622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] HTTP exception thrown: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Request method failure captured: Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-floating-ips/8ee4fe31-a26e-4feb-9c67-d9a44245ea85 HTTP/1.1 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vlp-ad_P7gsjE3EGCjpO3GcnL5WjxxaE0ZqrvisrZ2FvqXpfZECPY0RDn4wgTjVUiDSRB3qypYTIX2UQTZ9rraDsCCVbEAr8w85L_apjtByQ2mTVEGTqhz9TUzMsmwqt1drv1HlJx0SV8bl26Casmxv-IqDtwm6sMsfq5t2XNlVYRc Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 084358f49cba4a44a0f8417e8167cab0 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:00:35.479962 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_084358f49cba4a44a0f8417e8167cab0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/084358f49cba4a44a0f8417e8167cab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 084358f49cba4a44a0f8417e8167cab0 Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-883264364 Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsNegativeTestJSON-883264364-project Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: d8823c6646b640d089288ee3cdf8ac54 Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-883264364-project Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: exception: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '8ee4fe31-a26e-4feb-9c67-d9a44245ea85'} Jul 18 13:00:35.483016 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:00:35.484807 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 could not be found Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3d28ac5-0ccd-43e5-9992-8f9187b6e107'] Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85. Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:35.487632 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:00:35.490379 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:00:35.496756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 Jul 18 13:00:35.496756 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:00:35.496756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] Returning 404 to user: Floating IP not found for ID 8ee4fe31-a26e-4feb-9c67-d9a44245ea85 {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:00:35.507901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79fbc722-3765-49e5-b210-2ff920435222 tempest-FloatingIPsNegativeTestJSON-883264364 tempest-FloatingIPsNegativeTestJSON-883264364-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/8ee4fe31-a26e-4feb-9c67-d9a44245ea85" status: 404 len: 111 microversion: 2.1 time: 0.654481 Jul 18 13:00:35.513621 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 890/1814] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:00:34 2022] DELETE /compute/v2.1/os-floating-ips/8ee4fe31-a26e-4feb-9c67-d9a44245ea85 => generated 111 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:00:35.698881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-55e7f869-2c1c-4837-ac01-75172f1b85f7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4317d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:35.994490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-55e7f869-2c1c-4837-ac01-75172f1b85f7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.304413 Jul 18 13:00:35.995476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 925/1815] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:35 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:36.081767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:36.086467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:36.135131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:36.139265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:36.148702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:36.150476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:36.198778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2064e81-5550-42d4-bb78-a1b8deac1df4 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e46fee50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:36.396919 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2064e81-5550-42d4-bb78-a1b8deac1df4 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.202718 Jul 18 13:00:36.400734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 926/1816] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:36 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:37.020750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca51cbfb-0c49-4c59-8fd4-9d16f7781ec8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4d26160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:37.234589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca51cbfb-0c49-4c59-8fd4-9d16f7781ec8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.218545 Jul 18 13:00:37.240254 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 927/1817] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:37 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:37.421397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-854bf19b-36fb-4634-959d-78d537a9aaf9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e45bc670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:37.643125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-854bf19b-36fb-4634-959d-78d537a9aaf9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.230502 Jul 18 13:00:37.659404 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 928/1818] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:37 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:00:37.888056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:37.913013 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf28c287-e854-4984-beb0-600639f040e3 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 1.842202 Jul 18 13:00:37.920922 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 891/1819] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:36 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:38.264309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd909733-0e75-4da4-8b90-81fe92b76c77 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e46fe310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:38.502665 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd909733-0e75-4da4-8b90-81fe92b76c77 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1440 microversion: 2.1 time: 0.248182 Jul 18 13:00:38.514627 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 929/1820] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:38 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1440 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:38.682534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae8cbfbf-912e-40c3-9e0b-7ac04911ca18 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e425a5e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:38.897860 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae8cbfbf-912e-40c3-9e0b-7ac04911ca18 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.199134 Jul 18 13:00:38.906242 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 892/1821] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:38 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:38.956977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:38.962441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:39.016332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:39.030515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:39.037680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:39.043394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:39.539483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-245cc0a8-b5f3-4e9f-b2a3-927fe67c65fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e42bfe50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:41.584087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:41.612539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-720fcaea-cab1-432c-9a9b-2e04ccf284c7 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1391 microversion: 2.1 time: 2.666887 Jul 18 13:00:41.629464 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 930/1822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:38 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1391 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:41.652926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99b6b8f0-1c38-4050-be15-b9e6bfbde603 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e431b4c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:45.303898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-245cc0a8-b5f3-4e9f-b2a3-927fe67c65fe tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1449 microversion: 2.1 time: 5.775078 Jul 18 13:00:45.318632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 893/1823] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:39 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1449 bytes in 5792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:45.373827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99b6b8f0-1c38-4050-be15-b9e6bfbde603 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 3.742308 Jul 18 13:00:45.376853 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 931/1824] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:41 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 3746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:45.399001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:45.427021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:45.497878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:45.498664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:45.503543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:45.507375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:45.624074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-89fe0484-3af8-414a-8a57-56ffbb677a80 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Action: 'create', calling method: .version_select at 0x7f96e4216ee0>, body: {"keypair": {"name": "tempest-keypair-1496046883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO55AX2yo9dnDBa9+p4FNjG+phKbo0z9zL/1rzL2Nj+r6nm/cPXEvnVwIiPyu55LHqW+2oUIZYezaaHCQ6sohVGz5taeQ7Jtmxl5/rnlWsw+TkqgHixykllFMJKF3Zav/g=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:45.754990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-89fe0484-3af8-414a-8a57-56ffbb677a80 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Getting quotas for project d341ebfa385247cdb06dc238e1da521a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:45.776806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-89fe0484-3af8-414a-8a57-56ffbb677a80 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Getting quotas for user 9746694432704d258e2b9464f0e25c4a and project d341ebfa385247cdb06dc238e1da521a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:45.841427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-89fe0484-3af8-414a-8a57-56ffbb677a80 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.521479 Jul 18 13:00:45.842992 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 894/1825] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:00:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:45.852635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-635c2416-e2d0-4dde-a567-5a7c96d2627b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4566550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:46.094234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-635c2416-e2d0-4dde-a567-5a7c96d2627b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 200 len: 1449 microversion: 2.1 time: 0.248835 Jul 18 13:00:46.097190 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 895/1826] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:45 2022] GET /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 1449 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:46.145482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c9276e78-cea3-41e0-b9ce-7cc7a2afd6c2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e42615e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:46.541621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:46.560114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-941fb067-7093-4eca-aadf-66a5524bb37e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1381 microversion: 2.1 time: 1.174117 Jul 18 13:00:46.563856 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 932/1827] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:45 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1381 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:46.572135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c44b780-853c-402a-b753-658be40ef74e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e43cc310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:47.896082 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c9276e78-cea3-41e0-b9ce-7cc7a2afd6c2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 204 len: 0 microversion: 2.1 time: 1.782845 Jul 18 13:00:47.900876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 896/1828] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:46 2022] DELETE /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 0 bytes in 1789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:00:47.921937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4514cc3-98a3-4d62-9aab-40ed40eb0343 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '.version_select at 0x7f96e42199d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:47.957266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4514cc3-98a3-4d62-9aab-40ed40eb0343 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:47.967635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4514cc3-98a3-4d62-9aab-40ed40eb0343 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:47.970941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:48.068439 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c44b780-853c-402a-b753-658be40ef74e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 1.502391 Jul 18 13:00:48.069203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 933/1829] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:46 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:48.137453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4514cc3-98a3-4d62-9aab-40ed40eb0343 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 2701 microversion: 2.1 time: 0.232505 Jul 18 13:00:48.191929 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 897/1830] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 13:00:47 2022] GET /compute/v2.1/os-migrations => generated 2701 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:48.224234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-63527c6e-77a3-4cd3-ad05-029e25d9d3a1 req-b7e63961-d5e5-452e-8d7e-bc91531b9fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-plugged", "status": "completed", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:48.250885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-63527c6e-77a3-4cd3-ad05-029e25d9d3a1 req-b7e63961-d5e5-452e-8d7e-bc91531b9fa7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:48.251835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-63527c6e-77a3-4cd3-ad05-029e25d9d3a1 req-b7e63961-d5e5-452e-8d7e-bc91531b9fa7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:48.309342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1694717595", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "290d2741-2682-43c6-ac6f-47b8f2bbf745"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:48.347558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-63527c6e-77a3-4cd3-ad05-029e25d9d3a1 req-b7e63961-d5e5-452e-8d7e-bc91531b9fa7 service nova] Creating event network-vif-plugged:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:00:48.358307 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-63527c6e-77a3-4cd3-ad05-029e25d9d3a1 req-b7e63961-d5e5-452e-8d7e-bc91531b9fa7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169532 Jul 18 13:00:48.360453 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 898/1831] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:48.372959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:48.374860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:48.411868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:48.439457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:48.453219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:48.460834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:48.476228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] validate_networks() for [('290d2741-2682-43c6-ac6f-47b8f2bbf745', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:00:48.647495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:00:49.124881 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70cf312c-2d6f-44fa-9ea8-df9220d6c2a2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 204 len: 0 microversion: 2.1 time: 0.760621 Jul 18 13:00:49.129706 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 899/1832] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:00:48 2022] DELETE /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:00:49.190776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:49.198753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:49.236201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:49.239482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:49.242238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:49.243773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:50.113429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0efec94f-f58f-4a1f-adec-59f7b3905341 tempest-LiveMigrationTest-2111078729 tempest-LiveMigrationTest-2111078729-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1532 microversion: 2.1 time: 0.980217 Jul 18 13:00:50.128133 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 900/1833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:49 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1532 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:50.171748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a08f34c-c405-4cf5-95bb-88ba7f722d97 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4962ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:50.305644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a08f34c-c405-4cf5-95bb-88ba7f722d97 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.176085 Jul 18 13:00:50.306357 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 901/1834] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:50 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:50.376502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-350719108", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "86e3abd6-5f45-4131-86ad-fd94f18b600e"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:50.626698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] validate_networks() for [('86e3abd6-5f45-4131-86ad-fd94f18b600e', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:00:53.213206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:00:53.213951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:00:53.214865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:00:53.215617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:00:53.216376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:00:53.292278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:53.293135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:53.327949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:53.328767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:53.491839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:53.535797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for user 28072006ff234c14a8121c280adae603 and project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:53.611006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:00:53.651552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:00:53.893677 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93e0fc14-201f-4b02-af15-e8c5259b8692 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.822912 Jul 18 13:00:53.896506 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 934/1835] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:00:54.359194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:54.369015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:54.393765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:54.471926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:54.487561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:54.498075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:54.502468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:54.665334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=45 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:54.680356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:00:55.018545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-06d7d564-5fa6-4376-a0ca-2cc6021cf5a9 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 204 len: 0 microversion: 2.1 time: 1.119617 Jul 18 13:00:55.030052 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 935/1836] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:00:53 2022] DELETE /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:00:55.056208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-90316205-7e56-4de8-ac15-c05fcf050f64 req-2f225e43-1515-4813-a043-e220d10a554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b66612e-bc27-4d8f-8206-787755b13cd6", "name": "network-vif-unplugged", "status": "completed", "tag": "83693b58-f3b8-45f2-ada2-9a8b6de5ab7a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:55.144716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-90316205-7e56-4de8-ac15-c05fcf050f64 req-2f225e43-1515-4813-a043-e220d10a554b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:55.145502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-90316205-7e56-4de8-ac15-c05fcf050f64 req-2f225e43-1515-4813-a043-e220d10a554b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:55.225005 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-90316205-7e56-4de8-ac15-c05fcf050f64 req-2f225e43-1515-4813-a043-e220d10a554b service nova] Creating event network-vif-unplugged:83693b58-f3b8-45f2-ada2-9a8b6de5ab7a for instance 3b66612e-bc27-4d8f-8206-787755b13cd6 on n-h1-850003-3 Jul 18 13:00:55.240981 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-90316205-7e56-4de8-ac15-c05fcf050f64 req-2f225e43-1515-4813-a043-e220d10a554b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207816 Jul 18 13:00:55.242053 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 936/1837] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:55.281218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee2bc11e-b3c4-47b2-a413-7ecc0b750bfb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9ae5550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:55.509603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee2bc11e-b3c4-47b2-a413-7ecc0b750bfb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.251230 Jul 18 13:00:55.511881 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 937/1838] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:55 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:55.517968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e75978a4-6bc9-4725-8e69-3a583b0993d3 req-3415a6ef-6ecb-4286-8c70-0691015dc15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b66612e-bc27-4d8f-8206-787755b13cd6", "name": "network-vif-deleted", "tag": "83693b58-f3b8-45f2-ada2-9a8b6de5ab7a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:55.549978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e75978a4-6bc9-4725-8e69-3a583b0993d3 req-3415a6ef-6ecb-4286-8c70-0691015dc15f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:55.550792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e75978a4-6bc9-4725-8e69-3a583b0993d3 req-3415a6ef-6ecb-4286-8c70-0691015dc15f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:55.573608 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e75978a4-6bc9-4725-8e69-3a583b0993d3 req-3415a6ef-6ecb-4286-8c70-0691015dc15f service nova] Creating event network-vif-deleted:83693b58-f3b8-45f2-ada2-9a8b6de5ab7a for instance 3b66612e-bc27-4d8f-8206-787755b13cd6 on n-h1-850003-3 Jul 18 13:00:55.582062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e75978a4-6bc9-4725-8e69-3a583b0993d3 req-3415a6ef-6ecb-4286-8c70-0691015dc15f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068375 Jul 18 13:00:55.586667 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 938/1839] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:00:55.599375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4e6cf72-346d-4029-9dbd-567d95e9f9f6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:55.613240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4e6cf72-346d-4029-9dbd-567d95e9f9f6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:55.764734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4e6cf72-346d-4029-9dbd-567d95e9f9f6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:55.773081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4e6cf72-346d-4029-9dbd-567d95e9f9f6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1225 microversion: 2.1 time: 0.181709 Jul 18 13:00:55.776349 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 939/1840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:55 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:55.793583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:55.794562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:55.794930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:00:55.802876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:55.803817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:55.804860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:55.805560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:56.354570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:56.397666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61a82b93-ce8d-47e7-9224-05d7f6c8b091 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1387 microversion: 2.1 time: 0.609407 Jul 18 13:00:56.404774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 940/1841] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:55 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1387 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:56.540435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d16661eb-8600-4d2b-9362-a79352ed4620 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4584430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:56.708365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d16661eb-8600-4d2b-9362-a79352ed4620 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.175316 Jul 18 13:00:56.713222 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 941/1842] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:56 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:56.811764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:56.815906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:56.869395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:56.874530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:56.878910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:56.881398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:57.209849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:57.249125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d30bc5a-32f7-4a65-925c-b60d1194c398 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1285 microversion: 2.1 time: 0.459073 Jul 18 13:00:57.255029 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 942/1843] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:56 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1285 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:57.429633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:57.434842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:57.489416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:57.490538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:57.494025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:57.498385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:57.712890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:00:57.714947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:00:57.715925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:00:57.716864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:00:57.717779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:00:57.766705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:57.770936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:57.778075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:57.782573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:57.899683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:00:57.943075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Getting quotas for user 719f068839494e66b2eb68285ef22214 and project 53c243d4fb52461a8cee81ee9a998b34. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:00:58.010034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:58.050293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:00:58.059581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14bb8eef-26f5-4a2f-b2a3-21d84731bc4a tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1387 microversion: 2.1 time: 0.625589 Jul 18 13:00:58.060034 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 943/1844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:57 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1387 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:00:58.061069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:00:58.119635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88e9663a-b8ae-46f0-8e2e-7d55850eecf0 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e431b3a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:58.255997 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65583c9a-b6fc-4164-bd58-bfc6df579e9a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.941522 Jul 18 13:00:58.259305 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 902/1845] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 7952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:00:58.273593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "62d5f87b-b338-4f4d-8268-bfdb5995c969"}], "security_groups": [{"name": "tempest-securitygroup--441786881"}], "key_name": "tempest-keypair-1496046883", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:00:58.304801 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88e9663a-b8ae-46f0-8e2e-7d55850eecf0 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.218169 Jul 18 13:00:58.324910 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 944/1846] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:58 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:58.508901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc1da7e3-7b29-4bb0-96e2-61b4f01cdec0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:58.510040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc1da7e3-7b29-4bb0-96e2-61b4f01cdec0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:58.809337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cc1da7e3-7b29-4bb0-96e2-61b4f01cdec0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:58.838126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc1da7e3-7b29-4bb0-96e2-61b4f01cdec0 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1207 microversion: 2.1 time: 0.507472 Jul 18 13:00:58.860865 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 945/1847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:58 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1207 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:58.873479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:58.877043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:58.907352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:58.910869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:58.915894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:58.918086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:59.162771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:59.180318 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bb4a6d2-4698-444c-92fb-4c8afeab0e32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1283 microversion: 2.1 time: 0.318188 Jul 18 13:00:59.189427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 946/1848] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:58 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1283 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:59.202011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:59.205125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:59.228135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:59.230391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:59.235603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:59.238815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:59.538072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:00:59.554590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32472ad5-c78a-44d7-8bb2-b654ff5d1ff8 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1345 microversion: 2.1 time: 0.357917 Jul 18 13:00:59.565760 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 947/1849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:59 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1345 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:59.571834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff9108d4-5d10-4d2c-b240-656125982e44 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4577c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:59.728517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff9108d4-5d10-4d2c-b240-656125982e44 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.161026 Jul 18 13:00:59.729860 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 948/1850] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:00:59 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:00:59.885036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:00:59.902865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:00:59.937075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:59.937552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:00:59.944057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:00:59.944890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:00.046357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] validate_networks() for [('62d5f87b-b338-4f4d-8268-bfdb5995c969', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:01:00.316272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:00.334914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff4b13d1-b41c-42d0-acfd-2f3406392974 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1211 microversion: 2.1 time: 0.471633 Jul 18 13:01:00.336093 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 949/1851] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:00:59 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1211 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:01:00.384292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1b669e2a-6325-4ef9-9652-ad00b2573b66 req-c9ebf176-1c02-4c93-baf5-c6d0a764a877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f6ab0-7405-42fc-8932-e1f2a42df2a0", "name": "network-vif-deleted", "tag": "893c9395-1693-46f1-a7a2-2a2b6658b676"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:00.405168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1b669e2a-6325-4ef9-9652-ad00b2573b66 req-c9ebf176-1c02-4c93-baf5-c6d0a764a877 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:00.408415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1b669e2a-6325-4ef9-9652-ad00b2573b66 req-c9ebf176-1c02-4c93-baf5-c6d0a764a877 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:00.437124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1b669e2a-6325-4ef9-9652-ad00b2573b66 req-c9ebf176-1c02-4c93-baf5-c6d0a764a877 service nova] Creating event network-vif-deleted:893c9395-1693-46f1-a7a2-2a2b6658b676 for instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 on n-h2-850003-3 Jul 18 13:01:00.467383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1b669e2a-6325-4ef9-9652-ad00b2573b66 req-c9ebf176-1c02-4c93-baf5-c6d0a764a877 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125012 Jul 18 13:01:00.468931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 950/1852] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:00.502991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:00.510455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:00.537504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:00.543777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:00.549270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:00.556703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:00.800208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:00.828245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3ce8b31-3a7a-4fda-afe2-edb7645245d8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1283 microversion: 2.1 time: 0.352721 Jul 18 13:01:00.834569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 951/1853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:00 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1283 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:00.852605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1140075926", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b247f390-7473-4edc-b6bf-63b08a11384c"}], "block_device_mapping_v2": [{"uuid": "36cdc540-9a45-4c39-aed3-b5d04fc2ffa9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:00.997458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] validate_networks() for [('b247f390-7473-4edc-b6bf-63b08a11384c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:01:02.626684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:01:02.627551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:01:02.628228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:01:02.628970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:01:02.629697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:01:02.688616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:02.689959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:02.692064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:02.693356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:02.750431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:02.766469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Getting quotas for user f604cd53dad44c39944c7e7a57737941 and project 788a3068f3ed4ccb84c3899673be6934. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:02.929407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:01:02.944873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36cdc540-9a45-4c39-aed3-b5d04fc2ffa9',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:01:03.471091 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1dbb322-e944-4b78-813e-1bc3ef6a0b5b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.629317 Jul 18 13:01:03.481247 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 952/1854] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:01:03.503535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:03.515919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:03.560532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:03.568048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:03.573467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:03.578221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.025326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.079321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da72dd56-c6c2-4502-b23e-dc9ddbfb2c89 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 0.591562 Jul 18 13:01:04.085771 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 953/1855] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:03 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:04.121290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0f81c6b-5c20-4198-b44d-93480ac2ce81 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9ae5e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:04.279222 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0f81c6b-5c20-4198-b44d-93480ac2ce81 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.186735 Jul 18 13:01:04.286556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 954/1856] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:04 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:04.305965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:04.310417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:04.338137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.338960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.343214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.347275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.559785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.578014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6514683-ef16-41bf-b9b2-f8a8f51d980b tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1265 microversion: 2.1 time: 0.291197 Jul 18 13:01:04.595489 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 955/1857] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:04 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:04.609604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:04.611312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:04.628276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.629503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.631317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.632434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.787631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.804844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b707b0a5-a2dd-45e3-8491-11b110ef9181 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1283 microversion: 2.1 time: 0.206633 Jul 18 13:01:04.806846 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 956/1858] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:04 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1283 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:04.816756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:04.818106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:04.830208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.831809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.833594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:04.834696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:04.970592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.991798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.996537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:04.999475 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5718f9b-f2f5-4d91-a697-29b66b7d77e3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1185 microversion: 2.25 time: 0.190470 Jul 18 13:01:05.001681 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 957/1859] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:04 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:05.114381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:05.115420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:05.133676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:05.136548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:05.139000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:05.139474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:05.452940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:05.461938 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7dad0afc-9763-4fa1-a064-98407e259f0d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 0.358805 Jul 18 13:01:05.462571 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 958/1860] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:05 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:01:05.476844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8c3b287-a911-4547-b74b-567f699f7f64 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4317e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:05.599430 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8c3b287-a911-4547-b74b-567f699f7f64 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.135688 Jul 18 13:01:05.607700 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 959/1861] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:05 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:05.618657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:05.620678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:05.649399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:05.650361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:05.651574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:05.652269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:05.967852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:05.978140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:06.006933 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53b75382-781d-46ac-9c64-756a025a5369 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1265 microversion: 2.1 time: 0.394752 Jul 18 13:01:06.009574 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 960/1862] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:05 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:06.042531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:06.043414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:06.074652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.075034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:06.075846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.076338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:06.595912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:06.611294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6092286-707e-49c5-b6d4-80b5e3fc7c24 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1283 microversion: 2.1 time: 0.598196 Jul 18 13:01:06.621703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 961/1863] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:06 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1283 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:06.626848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:06.627470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:06.650091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.650784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:06.652074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.652718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:06.803955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:06.822738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:06.824813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:06.826595 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7c1cb53-2376-4027-8e58-f52eab64313e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1251 microversion: 2.25 time: 0.203451 Jul 18 13:01:06.838743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 962/1864] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:06 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1251 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:06.851265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:06.859788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:06.872832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.873566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:06.874633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:06.875248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:07.106919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:07.121235 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3986fdbd-9db3-47cb-a7df-d2dde7deba21 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 0.280956 Jul 18 13:01:07.138772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 963/1865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:06 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:07.145030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5ddf150-e260-423c-8340-7cddc5e64be8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e46175e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:07.231568 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5ddf150-e260-423c-8340-7cddc5e64be8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.090987 Jul 18 13:01:07.246565 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 964/1866] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:07 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:07.251871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:07.281193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:07.303839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:07.304604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:07.307725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:07.308537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:07.832356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:07.837448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:07.999550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:08.095711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:01:08.097918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:01:08.099210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:01:08.099841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:01:08.100499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:01:08.105776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:08.137418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.138698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.143214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.155222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.220684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:08.230731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-daef8a9e-ec80-4415-82d4-75e082dffc34 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1265 microversion: 2.1 time: 0.982891 Jul 18 13:01:08.236203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 965/1867] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:07 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1265 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:08.251817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:08.256396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:08.257367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Getting quotas for project d341ebfa385247cdb06dc238e1da521a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:08.271440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Getting quotas for user 9746694432704d258e2b9464f0e25c4a and project d341ebfa385247cdb06dc238e1da521a. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:08.282072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.282708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.284379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.284957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.347780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:01:08.350698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:01:08.593632 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45598032-4523-43d0-9b7f-4873fd4cf317 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 10.323593 Jul 18 13:01:08.597748 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 903/1868] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:00:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 10330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:01:08.620004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:08.626169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:08.673170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.683784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.684995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:08.689455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:08.918555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:08.951806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:08.956042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:08.965955 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd6a6650-3d45-4b01-946c-055a25dcd195 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1251 microversion: 2.25 time: 0.357429 Jul 18 13:01:08.967653 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 904/1869] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:08 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1251 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:08.988960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:08.995089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:09.013267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:09.014539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:09.016064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:09.017654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:09.309896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:09.326720 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98e5e8ec-3141-4681-b063-b0558657e135 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 0.356481 Jul 18 13:01:09.328689 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 905/1870] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:08 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:09.341620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2864c70b-51de-4fbc-b657-e438762124bb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4bf2b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:09.447541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2864c70b-51de-4fbc-b657-e438762124bb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.117398 Jul 18 13:01:09.453252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 906/1871] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:09 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:09.473926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b652caa-75b5-48f1-a525-5f190028671f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:09.478193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b652caa-75b5-48f1-a525-5f190028671f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:09.574931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:09.597675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ba561a3-85fe-4a61-b7d2-743b35d35212 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 1.359813 Jul 18 13:01:09.631659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 966/1872] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:08 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:09.649347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:09.654569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:09.678374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:09.692022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:09.706887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:09.708753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:10.012336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b652caa-75b5-48f1-a525-5f190028671f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:10.020681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b652caa-75b5-48f1-a525-5f190028671f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1226 microversion: 2.1 time: 0.565833 Jul 18 13:01:10.028246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 907/1873] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:09 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1226 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:10.043460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:10.048172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:10.076214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:10.079558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:10.087066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:10.090687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:11.005836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:11.068330 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1f1ef0c-20bf-474a-9d42-c7ef973a9753 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 1.433732 Jul 18 13:01:11.082141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 967/1874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:09 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:11.119502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:11.131201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:11.170257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:11.187899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:11.189405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:11.190282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.316801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:12.342565 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de56d867-b128-455c-a599-2a4629f7857c tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 1.258157 Jul 18 13:01:12.343206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 968/1875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:11 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:12.386425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e805f51-548f-4681-b8e3-8dd61331282c tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e431b700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:12.493926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e805f51-548f-4681-b8e3-8dd61331282c tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.132707 Jul 18 13:01:12.497387 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 969/1876] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:12 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:12.501009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:12.516229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:12.518058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:12.519825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:12.521164 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ef3be5f-b193-4529-a7e5-93d531599ea7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 2.483102 Jul 18 13:01:12.522070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:12.522807 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 908/1877] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:10 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:12.536754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:12.537708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:12.544644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.545252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.549657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.550287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.552772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.553444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.558770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.559513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.716673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:12.785574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:12.833599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:12.846402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bad90a5a-49ee-48a7-aab5-7afdf7483c71 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1284 microversion: 2.1 time: 0.321146 Jul 18 13:01:12.847211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 909/1878] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:12 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:12.860478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:12.861421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:12.876122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.880457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:12.881745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:12.882398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:13.559301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:13.609572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7e556e6-41f2-4a17-9bb1-db1728788432 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 1.100028 Jul 18 13:01:13.611437 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 970/1879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:12 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:13.618398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:13.620723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:13.667392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:13.667826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:13.676479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:13.677052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:13.943861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:13.972041 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b662030-6411-463a-9308-2dda3db7a673 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 200 len: 1183 microversion: 2.1 time: 0.355040 Jul 18 13:01:13.998000 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 971/1880] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:13 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 1183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:14.018555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a98e641-1b2d-4be4-9fde-11ffb25980ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4323d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:14.246976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a98e641-1b2d-4be4-9fde-11ffb25980ea tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.237380 Jul 18 13:01:14.262673 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 972/1881] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:13 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:14.313070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:14.317432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:14.360938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:14.364592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:14.371364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:14.381236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:15.423617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:15.454960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:15.469300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:15.476633 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56da3de4-8ac1-4119-b8f2-9f40c2ba39fb tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 1.210799 Jul 18 13:01:15.479612 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 973/1882] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:14 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:15.501724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:15.502996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:15.536437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:15.537271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:15.538757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:15.545105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:15.927718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:15.945946 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c147ba0-3f4d-451d-ae84-d03e0788e273 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1284 microversion: 2.1 time: 0.463624 Jul 18 13:01:15.952670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 974/1883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:15 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1284 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:15.969795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:15.971396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:15.997750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:15.998938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:16.003797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:16.008612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:16.022195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:16.035170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c384920-6017-4ed3-b346-3d9357f1208d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 3.183650 Jul 18 13:01:16.043196 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 910/1884] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:12 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 3192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:16.292360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5ac5cc80-ba06-4364-aeb6-7ce8d4107481 req-7435c321-7940-4c42-ac2d-cb386c75279e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:16.307739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5ac5cc80-ba06-4364-aeb6-7ce8d4107481 req-7435c321-7940-4c42-ac2d-cb386c75279e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:16.308467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5ac5cc80-ba06-4364-aeb6-7ce8d4107481 req-7435c321-7940-4c42-ac2d-cb386c75279e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:16.343643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5ac5cc80-ba06-4364-aeb6-7ce8d4107481 req-7435c321-7940-4c42-ac2d-cb386c75279e service nova] Creating event network-changed:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:01:16.361596 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5ac5cc80-ba06-4364-aeb6-7ce8d4107481 req-7435c321-7940-4c42-ac2d-cb386c75279e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313077 Jul 18 13:01:16.362973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 911/1885] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:16.385809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:16.388398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:16.398035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:16.398854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:16.399844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:16.400777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:16.452488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] HTTP exception thrown: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Request method failure captured: Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 HTTP/1.1 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcVCSgTKGZSdrA3DKXi-MZwcSWe3klEzpe3E4LWW_QrU19hMyPnr5TijzXuDsMMxrS0Fwpv8tBpZJowShYTBVGQpNw8rGSmKQGuR-erMtChjvk5MXa5dfXpGY5wOGPDViwB0S-xl95z8ZdRqCw7ivdMD3dC8hm7KpHUNb9tIN1b1vg Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:16.463452 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0eacb137f6294164bc2bbb101ecc94f8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 64cdfc77cf92451c84c873df41bc422f Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. Jul 18 13:01:16.465414 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '8a9f6ab0-7405-42fc-8932-e1f2a42df2a0'} Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:16.466450 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. Jul 18 13:01:16.468063 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:16.470974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Returning 404 to user: Instance 8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:16.472112 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79780c8c-8f45-4905-bcfb-156dbfc3336d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0" status: 404 len: 111 microversion: 2.1 time: 0.106504 Jul 18 13:01:16.475090 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 912/1886] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:16 2022] GET /compute/v2.1/servers/8a9f6ab0-7405-42fc-8932-e1f2a42df2a0 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:16.487234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73e4b308-f335-440b-b182-5be36b56e344 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e420d9d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:16.628388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73e4b308-f335-440b-b182-5be36b56e344 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1424 microversion: 2.1 time: 0.151715 Jul 18 13:01:16.636837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 913/1887] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:16 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:16.864837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:16.909871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-efb870df-c48e-44a0-b132-b07142f02a46 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.946047 Jul 18 13:01:16.911114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 975/1888] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:15 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:16.940764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:16.945954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:17.000803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.010534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.012315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.013411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.105231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3b409521-5f2e-41d2-a6d5-ec13f316e77e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e425af70>, body: {"keypair": {"name": "tempest-keypair-2123226230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRFIhl0gmx3dHZCfgNBpq0ts+17XLtKwTnSglmHyZEq+SD5hjbON7G+qMq/TTLVnooZy4ZCfgTzyrDtaBbUntioaiMYTllY1uSIqZs6JDEgqI60m3r3yrq/1qVUBSGvpQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:17.157107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3b409521-5f2e-41d2-a6d5-ec13f316e77e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:17.174632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3b409521-5f2e-41d2-a6d5-ec13f316e77e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:17.218419 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3b409521-5f2e-41d2-a6d5-ec13f316e77e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.579835 Jul 18 13:01:17.219829 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 914/1889] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 582 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:17.227794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:17.231039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:17.242898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.244352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.245543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.246725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.424057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:17.444509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:17.446923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:17.448400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b04c7002-2ce8-4fea-b014-164dd4254e4a tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.534480 Jul 18 13:01:17.459833 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 976/1890] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:16 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:17.466862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:17.467746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:17.474970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.475797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.476828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:17.477448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:17.567736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:17.579739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77f9845b-7ea1-4b6e-85b7-e2cf68bbd6fb tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1284 microversion: 2.1 time: 0.358271 Jul 18 13:01:17.586708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 915/1891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:17 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:17.592213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91cae66f-dd5b-4326-bc91-48d96b011f2e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e421bca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:17.613611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91cae66f-dd5b-4326-bc91-48d96b011f2e tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-2123226230" status: 200 len: 513 microversion: 2.2 time: 0.022687 Jul 18 13:01:17.614740 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 916/1892] 10.222.0.88 () {60 vars in 1257 bytes} [Mon Jul 18 13:01:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2123226230 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:17.782724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:17.799045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38989ce6-68bb-4ad8-9411-2e1f0cf40e1f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.335393 Jul 18 13:01:17.801427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 977/1893] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:17 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:17.820061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfa7345a-bb91-4a04-93d9-d47302375af6 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e9ae5e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:17.861655 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfa7345a-bb91-4a04-93d9-d47302375af6 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123226230" status: 204 len: 0 microversion: 2.2 time: 0.058614 Jul 18 13:01:17.862289 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 978/1894] 10.222.0.88 () {60 vars in 1260 bytes} [Mon Jul 18 13:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123226230 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:17.871937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9fe365cd-08d7-41e5-8894-94b4eae89a4f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9b14820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:17.984487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9fe365cd-08d7-41e5-8894-94b4eae89a4f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1433 microversion: 2.1 time: 0.120026 Jul 18 13:01:17.992008 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 979/1895] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:17 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1433 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:17.998088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3a07193f-2582-4e12-8809-63e968cce697 req-e6a80947-76ce-475b-a8e5-9e18fea6b87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43350aa-33a0-44ec-99e7-89b0fade9923", "tag": "8160da0f-c3ce-47f4-a153-3e58212e16a8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.008998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a07193f-2582-4e12-8809-63e968cce697 req-e6a80947-76ce-475b-a8e5-9e18fea6b87b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.009452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3a07193f-2582-4e12-8809-63e968cce697 req-e6a80947-76ce-475b-a8e5-9e18fea6b87b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.020809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f21c9f32-8d2d-4ba8-a3a7-09789d7fcff3 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-322898808", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.025453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f21c9f32-8d2d-4ba8-a3a7-09789d7fcff3 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] HTTP exception thrown: min_count must be <= max_count Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f21c9f32-8d2d-4ba8-a3a7-09789d7fcff3 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Request method failure captured: Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 183 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VmdVXSDMV1poFrZtK3K6qKcnX6fUS_42WrHUYFMLtJqa4w1-bPbOQaaMOlFJdZKdl2nVACwNYuYNXiuAPN67OglmIvZQ9Sr4l6FYdt3lopvEphV5pgUkSSW3Cr_QlQTzIs34ZNSxyfg8g5AQXOFzahh4-CMbURGU2bhjJdYnjTmTOY Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:18.028289 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5edb5009d5904fefa38fc3339d8e16a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e4c627be60174466b8281165924f737b Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:01:18.030128 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-322898808", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: exception: min_count must be <= max_count Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-322898808', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:01:18.031058 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.032422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f21c9f32-8d2d-4ba8-a3a7-09789d7fcff3 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Returning 400 to user: min_count must be <= max_count {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:18.033397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f21c9f32-8d2d-4ba8-a3a7-09789d7fcff3 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.417011 Jul 18 13:01:18.033659 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3a07193f-2582-4e12-8809-63e968cce697 req-e6a80947-76ce-475b-a8e5-9e18fea6b87b service nova] Creating event network-changed:8160da0f-c3ce-47f4-a153-3e58212e16a8 for instance d43350aa-33a0-44ec-99e7-89b0fade9923 on n-h2-850003-3 Jul 18 13:01:18.046347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 917/1896] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:01:17 2022] POST /compute/v2.1/servers => generated 74 bytes in 421 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:01:18.052927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3a07193f-2582-4e12-8809-63e968cce697 req-e6a80947-76ce-475b-a8e5-9e18fea6b87b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058848 Jul 18 13:01:18.057092 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 980/1897] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:18.077137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bdbd292-91c2-46fe-bdaf-4bb49e80005f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e42bf1f0>, body: {"keypair": {"name": "tempest-keypair-1828345553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDWLpYt7aiX75UVOSIB2klc0jfZWgfnlZz8XfsbDUy6KS4Zb7jCQv0xo/sGRLoPulwJz1/AwLPxwTlePWZyU1OikC3j3P0rCmSsCRMD1LcTv28VGMOdN6L6lYYFOYX1Cw=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.080277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.083971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:18.099370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.100038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.101018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.105866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.129237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8bdbd292-91c2-46fe-bdaf-4bb49e80005f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:18.144567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8bdbd292-91c2-46fe-bdaf-4bb49e80005f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:18.186021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:18.224049 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bdbd292-91c2-46fe-bdaf-4bb49e80005f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.185598 Jul 18 13:01:18.225577 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 918/1898] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:18.236223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79f61c42-bf43-489f-9178-b05a93d6c01d tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e44fb4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.319488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79f61c42-bf43-489f-9178-b05a93d6c01d tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 200 len: 1433 microversion: 2.1 time: 0.092731 Jul 18 13:01:18.328008 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 919/1899] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:18 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 1433 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:18.341049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f39f8b5-5fef-4457-a7d2-c5826c13bf56 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1894558472", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "max_count": 0}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f39f8b5-5fef-4457-a7d2-c5826c13bf56 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Request method failure captured: Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 168 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VmdVXSDMV1poFrZtK3K6qKcnX6fUS_42WrHUYFMLtJqa4w1-bPbOQaaMOlFJdZKdl2nVACwNYuYNXiuAPN67OglmIvZQ9Sr4l6FYdt3lopvEphV5pgUkSSW3Cr_QlQTzIs34ZNSxyfg8g5AQXOFzahh4-CMbURGU2bhjJdYnjTmTOY Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:18.344525 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5edb5009d5904fefa38fc3339d8e16a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e4c627be60174466b8281165924f737b Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1894558472", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "max_count": 0}} Jul 18 13:01:18.346395 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1894558472', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'max_count': 0}}} Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 0 Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.347238 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.348975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.350386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:18.350386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:18.350386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:18.350386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.358597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f39f8b5-5fef-4457-a7d2-c5826c13bf56 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:18.359790 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f39f8b5-5fef-4457-a7d2-c5826c13bf56 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030696 Jul 18 13:01:18.360664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 920/1900] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:01:18 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:18.389378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27a0d653-6b56-4e37-8b3f-7cba0750afee tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e42bfe50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.455509 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27a0d653-6b56-4e37-8b3f-7cba0750afee tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828345553" status: 204 len: 0 microversion: 2.2 time: 0.080309 Jul 18 13:01:18.456535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 921/1901] 10.222.0.88 () {60 vars in 1260 bytes} [Mon Jul 18 13:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828345553 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:18.473044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.475092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:18.493699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:18.496719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.497825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.499273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.500016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.510969 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1757cbd6-078a-471a-8b2d-edb49d4b4fe9 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.451451 Jul 18 13:01:18.512530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 981/1902] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:18 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:18.529394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.531680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:18.543295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:18.547261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.548399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.549975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.551382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.803541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:18.814228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:18.817136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:18.818367 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-67c1f55d-22d9-450b-b7ca-437df810bdbf tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.303120 Jul 18 13:01:18.819681 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 982/1903] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:18 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:18.828181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65b9488a-2706-4d30-b433-628569e49993 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e4bdbf70>, body: {"keypair": {"name": "tempest-keypair-914917670", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.846816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-65b9488a-2706-4d30-b433-628569e49993 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:18.854349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-65b9488a-2706-4d30-b433-628569e49993 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:18.890516 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65b9488a-2706-4d30-b433-628569e49993 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.068840 Jul 18 13:01:18.892525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 983/1904] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:18 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:18.907690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19e6175d-9889-43f8-bc22-f7d3521d9561 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1055831358", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "max_count": 2.5}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19e6175d-9889-43f8-bc22-f7d3521d9561 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Request method failure captured: Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 170 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VmdVXSDMV1poFrZtK3K6qKcnX6fUS_42WrHUYFMLtJqa4w1-bPbOQaaMOlFJdZKdl2nVACwNYuYNXiuAPN67OglmIvZQ9Sr4l6FYdt3lopvEphV5pgUkSSW3Cr_QlQTzIs34ZNSxyfg8g5AQXOFzahh4-CMbURGU2bhjJdYnjTmTOY Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:18.915245 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5edb5009d5904fefa38fc3339d8e16a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e4c627be60174466b8281165924f737b Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1055831358", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "max_count": 2.5}} Jul 18 13:01:18.918754 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1055831358', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'max_count': 2.5}}} Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.920869 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:18.924340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19e6175d-9889-43f8-bc22-f7d3521d9561 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19e6175d-9889-43f8-bc22-f7d3521d9561 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031446 Jul 18 13:01:18.933708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 984/1905] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:01:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:18.938015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:18.941472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:18.980066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.983292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.987592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:18.988392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:18.997067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:19.193532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:19.208720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-becb57cb-00fe-475c-be60-3688a7881c41 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.280905 Jul 18 13:01:19.209984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 985/1906] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:18 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:19.232760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:19.233515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:19.244472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.245192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.246213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.246909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.464246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:19.478555 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f7a29b2-3c08-4d50-ad4f-c5f7d89ff0dc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.266104 Jul 18 13:01:19.480323 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 986/1907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:19 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:19.496641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-55da84bb-c19b-4462-bdb6-faf568be8e6a tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e9b14a60>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:19.525979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-55da84bb-c19b-4462-bdb6-faf568be8e6a tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914917670" status: 204 len: 0 microversion: 2.2 time: 0.035700 Jul 18 13:01:19.527382 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 987/1908] 10.222.0.88 () {60 vars in 1257 bytes} [Mon Jul 18 13:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914917670 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:19.542255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aec7a742-d39d-4a67-83ca-3f8cd96b9737 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-266067792", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 0}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aec7a742-d39d-4a67-83ca-3f8cd96b9737 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Request method failure captured: Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 167 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VmdVXSDMV1poFrZtK3K6qKcnX6fUS_42WrHUYFMLtJqa4w1-bPbOQaaMOlFJdZKdl2nVACwNYuYNXiuAPN67OglmIvZQ9Sr4l6FYdt3lopvEphV5pgUkSSW3Cr_QlQTzIs34ZNSxyfg8g5AQXOFzahh4-CMbURGU2bhjJdYnjTmTOY Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:19.545333 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5edb5009d5904fefa38fc3339d8e16a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e4c627be60174466b8281165924f737b Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-266067792", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 0}} Jul 18 13:01:19.548596 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-266067792', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'min_count': 0}}} Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 0 Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.550495 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:19.553870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aec7a742-d39d-4a67-83ca-3f8cd96b9737 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aec7a742-d39d-4a67-83ca-3f8cd96b9737 tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013115 Jul 18 13:01:19.559710 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 988/1909] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:01:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:19.573967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:19.574864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:19.584980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.585649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.586890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.587729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.761780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:19.777131 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a215d61b-8009-409e-8afd-8520578754d1 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.223728 Jul 18 13:01:19.791019 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 989/1910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:19 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:19.799904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7db2a021-4db9-439b-a8c6-ffa55b0506f0 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e4577790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2125115684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESHSoqv4V+5L4Qoum/x3bjgoE440SqieN7+UPfiUikXP7Qr36sTjQ6lzIrgGfVKgeJKqQ5AJkabv/D5NayM6RfUO7dbil7DiPMjKkIWAEKVD7X9uRbBNTiQt0fs0qah0Q=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:19.823039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7db2a021-4db9-439b-a8c6-ffa55b0506f0 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:19.835095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7db2a021-4db9-439b-a8c6-ffa55b0506f0 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:19.881873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:19.892654 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61e6fdc6-5921-4d4c-b3c8-6eddc0c85ed3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1465 microversion: 2.1 time: 1.431110 Jul 18 13:01:19.897062 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 922/1911] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:18 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1465 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:19.915378 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7db2a021-4db9-439b-a8c6-ffa55b0506f0 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.122432 Jul 18 13:01:19.916524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 990/1912] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:19 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:19.918976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3fe7b015-53f7-4b44-8f3c-961e6a207f5d tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-967790485", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 2.5}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:19.926042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:19.927432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3fe7b015-53f7-4b44-8f3c-961e6a207f5d tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Request method failure captured: Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 169 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VmdVXSDMV1poFrZtK3K6qKcnX6fUS_42WrHUYFMLtJqa4w1-bPbOQaaMOlFJdZKdl2nVACwNYuYNXiuAPN67OglmIvZQ9Sr4l6FYdt3lopvEphV5pgUkSSW3Cr_QlQTzIs34ZNSxyfg8g5AQXOFzahh4-CMbURGU2bhjJdYnjTmTOY Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:19.927582 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5edb5009d5904fefa38fc3339d8e16a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5edb5009d5904fefa38fc3339d8e16a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5edb5009d5904fefa38fc3339d8e16a8 Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-83781741 Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e4c627be60174466b8281165924f737b Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-83781741-project Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-967790485", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 2.5}} Jul 18 13:01:19.929918 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-967790485', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'min_count': 2.5}}} Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.931050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:19.932854 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:19.934478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:19.934478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:19.934478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 13:01:19.934478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:19.936961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3fe7b015-53f7-4b44-8f3c-961e6a207f5d tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:19.941485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.942103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3fe7b015-53f7-4b44-8f3c-961e6a207f5d tempest-MultipleCreateNegativeTestJSON-83781741 tempest-MultipleCreateNegativeTestJSON-83781741-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029852 Jul 18 13:01:19.942407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.943588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:19.944056 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 923/1913] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:01:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:19.944427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:19.955247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b03b828c-08e0-47fa-a7e7-9c30dec07641 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4256820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:20.034548 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b03b828c-08e0-47fa-a7e7-9c30dec07641 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344" status: 200 len: 784 microversion: 2.1 time: 0.086758 Jul 18 13:01:20.035728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 924/1914] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:19 2022] GET /compute/v2.1/images/df1d514c-8a50-4216-9a84-c81f6f685344 => generated 784 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:20.046706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3c5881d-b1ae-4d65-9d0a-4a77a4ffa086 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e4281ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-503685709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQdmGoRloYkMPjrls20FHsusQVzRJLTAorUPSGQ3he9W1iRppYdkpXWwQb2JS79bhtuLmSb35D7xIRNRvYYmZfjQBqNfKKH2LArPzVDlKZIIP+2t+5xAgxZPRGzlOIOnA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:20.089706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d3c5881d-b1ae-4d65-9d0a-4a77a4ffa086 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:20.104044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d3c5881d-b1ae-4d65-9d0a-4a77a4ffa086 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:20.164749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3c5881d-b1ae-4d65-9d0a-4a77a4ffa086 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.126476 Jul 18 13:01:20.171263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 925/1915] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:20.177353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5dfdec2a-a82b-499e-bf84-daf9aed4bec5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:20.203981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5dfdec2a-a82b-499e-bf84-daf9aed4bec5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030699 Jul 18 13:01:20.205416 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 926/1916] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:01:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:20.217134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a07fd1f-909d-4afa-a2ba-26664ff92216 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e4c7a3a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1654902944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFjHSR9vaRnd9HN44q+BL/2eu5w9PViGvFa17I6V+BPwv4RAefIABDOw4KedqK+Oj1BrME81JqqxxWRyUAfs47ToIxfFG5uAIT6txUFz7wVDqQgYOrYey7e7fRe5aMGgA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:20.248748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1a07fd1f-909d-4afa-a2ba-26664ff92216 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:20.260952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1a07fd1f-909d-4afa-a2ba-26664ff92216 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:20.305993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:20.318442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a07fd1f-909d-4afa-a2ba-26664ff92216 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.109076 Jul 18 13:01:20.318906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:20.320820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:20.323324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d9daf5f-67e3-4bcf-bf16-86d8cf48f369 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.404631 Jul 18 13:01:20.324043 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 927/1917] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:20.324547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 991/1918] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:19 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:20.330816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b211f55-65d3-44c7-9fac-dd9d909dc88c tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4323c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:20.335868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-90bd2049-296b-4a19-b78a-ba586d210667 req-903eb885-9688-496b-949e-64a50838a754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc", "tag": "18f989ef-679f-402c-84aa-df7abc920e5e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:20.382123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-90bd2049-296b-4a19-b78a-ba586d210667 req-903eb885-9688-496b-949e-64a50838a754 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:20.383143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-90bd2049-296b-4a19-b78a-ba586d210667 req-903eb885-9688-496b-949e-64a50838a754 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:20.428717 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-90bd2049-296b-4a19-b78a-ba586d210667 req-903eb885-9688-496b-949e-64a50838a754 service nova] Creating event network-changed:18f989ef-679f-402c-84aa-df7abc920e5e for instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc on n-h1-850003-3 Jul 18 13:01:20.458318 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-90bd2049-296b-4a19-b78a-ba586d210667 req-903eb885-9688-496b-949e-64a50838a754 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127964 Jul 18 13:01:20.459525 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 928/1919] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:20.478783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:20.480145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:20.508214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:20.508720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:20.515608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:20.516924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.282592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b211f55-65d3-44c7-9fac-dd9d909dc88c tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "DELETE /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 204 len: 0 microversion: 2.1 time: 0.955528 Jul 18 13:01:21.283586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 992/1920] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:20 2022] DELETE /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:21.292578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1fc4348c-12e3-49e8-b19d-d01e54036607 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e46fa550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.299418 n-d-850003-3 devstack@n-api.service[131366]: WARNING oslo_db.sqlalchemy.utils [None req-1fc4348c-12e3-49e8-b19d-d01e54036607 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 13:01:21.310171 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1fc4348c-12e3-49e8-b19d-d01e54036607 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.023901 Jul 18 13:01:21.318428 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 993/1921] 10.222.0.88 () {60 vars in 1176 bytes} [Mon Jul 18 13:01:21 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:21.324688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.325807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:21.339997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.340942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.342099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.342850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.451727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:21.470477 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12a0157c-88e1-4c14-b9ab-f72f542f28f9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 1.008774 Jul 18 13:01:21.479774 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 929/1922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:20 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:21.495209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.496449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:21.516230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.520511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.521994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.525582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.670974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:21.686745 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-501d3ef0-00fb-4fa8-be1d-7c320aa402bf tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.366660 Jul 18 13:01:21.700047 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 994/1923] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:21 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:21.705748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ce151ed-bd77-4b34-96a0-9b492b172496 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e491fd30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.730584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0ce151ed-bd77-4b34-96a0-9b492b172496 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] HTTP exception thrown: Image not found. Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ce151ed-bd77-4b34-96a0-9b492b172496 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Request method failure captured: Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 HTTP/1.1 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VlDmJ_XqBxEHMvxJjN7uZDBX2u0lruzRp2aAzCQQzaaHuy7EnVrU2CEIlWMip6xInaxUbWAr-q5xlSJRxD5JNlqpLGjNKYrYzmuwrwkvmRgF5jUc3w_ZiN-PxJXfXHPVXetYD56lMeYKnG7mkKbEVEGe5FEg6a7mzC_2-BKFh9QwYw Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:21.732973 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8282e6fd6e2a45a880e3d72dcb544540", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4a84d146f9454e538b97cf7f6d247885 Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'dd67902d-a2be-47da-bb1b-a801d5caf7f4'} Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:21.735169 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dd67902d-a2be-47da-bb1b-a801d5caf7f4 Jul 18 13:01:21.736444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:21.737999 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd67902d-a2be-47da-bb1b-a801d5caf7f4 could not be found. Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:21.739995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:01:21.741772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:21.745990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ce151ed-bd77-4b34-96a0-9b492b172496 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:21.745990 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ce151ed-bd77-4b34-96a0-9b492b172496 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 404 len: 62 microversion: 2.1 time: 0.043936 Jul 18 13:01:21.746550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 995/1924] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:21 2022] GET /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:01:21.758581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d465b027-710f-40de-bf9f-12cd06bd2e5f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e9b06af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.794745 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d465b027-710f-40de-bf9f-12cd06bd2e5f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1654902944" status: 204 len: 0 microversion: 2.2 time: 0.046436 Jul 18 13:01:21.797277 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 996/1925] 10.222.0.88 () {60 vars in 1320 bytes} [Mon Jul 18 13:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1654902944 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:21.806176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:21.809546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:21.828973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.829439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:21.830410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:21.830867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:22.147349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:22.179595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:22.185402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:22.191684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:22.197487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1913d25-a949-4986-97a8-2829a162fd3d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.395819 Jul 18 13:01:22.203134 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 997/1926] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:21 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:22.232768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-daedfd1f-c4a2-44bb-b381-361b6cf52f2a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.750790 Jul 18 13:01:22.234567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-167013840"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:22.236422 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 930/1927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:21 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:22.254257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:22.287435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb32e78d-eab8-469d-97be-84f59f2b63f2 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e47260d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:22.299092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:22.300747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:22.302032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:22.302732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:22.353036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:22.375086 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb32e78d-eab8-469d-97be-84f59f2b63f2 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-503685709" status: 204 len: 0 microversion: 2.2 time: 0.114359 Jul 18 13:01:22.377275 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 931/1928] 10.222.0.88 () {60 vars in 1317 bytes} [Mon Jul 18 13:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-503685709 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:22.390001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3bc2cefe-d978-4ad0-9fe2-11d57028d83f req-84aa2e88-83bd-492a-a661-fbcf47e14965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-unplugged", "status": "completed", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:22.419453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3bc2cefe-d978-4ad0-9fe2-11d57028d83f req-84aa2e88-83bd-492a-a661-fbcf47e14965 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:22.420179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3bc2cefe-d978-4ad0-9fe2-11d57028d83f req-84aa2e88-83bd-492a-a661-fbcf47e14965 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:22.451625 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3bc2cefe-d978-4ad0-9fe2-11d57028d83f req-84aa2e88-83bd-492a-a661-fbcf47e14965 service nova] Creating event network-vif-unplugged:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:01:22.464091 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3bc2cefe-d978-4ad0-9fe2-11d57028d83f req-84aa2e88-83bd-492a-a661-fbcf47e14965 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082506 Jul 18 13:01:22.466411 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 932/1929] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:22.500530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc6caaed-1038-48b9-8ce7-355d0f9ba244 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e42811f0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:22.566260 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc6caaed-1038-48b9-8ce7-355d0f9ba244 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2125115684" status: 204 len: 0 microversion: 2.2 time: 0.097456 Jul 18 13:01:22.567151 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 933/1930] 10.222.0.88 () {60 vars in 1320 bytes} [Mon Jul 18 13:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2125115684 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:22.587980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:22.588997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:22.629186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:22.629888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:22.631218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:22.631859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.216858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97c60d55-d592-45b9-b9e9-b1fafcd40e55 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "POST /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f/action" status: 202 len: 0 microversion: 2.1 time: 1.010772 Jul 18 13:01:23.226130 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 998/1931] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:01:22 2022] POST /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:01:23.236828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7c2a6ac-0493-4547-9773-bfffd5ce4b78 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e431b940>, body: {"keypair": {"name": "tempest-keypair-1134655804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdYdj8Pf0+Im7IyypOBiRygvaxBXjgkVVldwXi3p8Xf8hhom8ckc+IFDqzrN5Q/ats5G8b0QTryY0h1wpvO5w7YLWbehFRNhbADHZpwAIv69NZsAP6wTjRMhD7OHFAuUg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:23.272897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f7c2a6ac-0493-4547-9773-bfffd5ce4b78 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:23.282561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f7c2a6ac-0493-4547-9773-bfffd5ce4b78 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:23.339503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7c2a6ac-0493-4547-9773-bfffd5ce4b78 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.108860 Jul 18 13:01:23.341124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 999/1932] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 18 13:01:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:01:23.344868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:23.356116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:23.360278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:23.370393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e25bbf6-749b-460d-8745-d54c5eae45e7 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.797240 Jul 18 13:01:23.371593 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 934/1933] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:22 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:23.375926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:23.376944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.377554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1d31f968-f641-46f3-80ae-54bc25c35161 req-2331e021-ff00-4a7f-ac18-e7e127f7c938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c0fa0a-e4c3-4182-a238-a2f997d2b947", "tag": "09d2970e-4c5a-452a-a6a1-0ccc23c6b73e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:23.379537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:23.380533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.393145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1d31f968-f641-46f3-80ae-54bc25c35161 req-2331e021-ff00-4a7f-ac18-e7e127f7c938 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:23.393982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1d31f968-f641-46f3-80ae-54bc25c35161 req-2331e021-ff00-4a7f-ac18-e7e127f7c938 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.410557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1d31f968-f641-46f3-80ae-54bc25c35161 req-2331e021-ff00-4a7f-ac18-e7e127f7c938 service nova] Creating event network-changed:09d2970e-4c5a-452a-a6a1-0ccc23c6b73e for instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 on n-h2-850003-3 Jul 18 13:01:23.421826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1d31f968-f641-46f3-80ae-54bc25c35161 req-2331e021-ff00-4a7f-ac18-e7e127f7c938 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047843 Jul 18 13:01:23.423783 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 935/1934] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:23.705628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2479f1a-478e-422a-88ec-eb24eaa9a0c0 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] Calling method '.version_select at 0x7f96e42815e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:23.810397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2479f1a-478e-422a-88ec-eb24eaa9a0c0 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.383830 Jul 18 13:01:23.816436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 936/1935] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:01:23 2022] GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc/defaults => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:23.826505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-40894d1b-0b38-4919-be05-e4fb4a30a277 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4256820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:23.906005 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-40894d1b-0b38-4919-be05-e4fb4a30a277 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.088171 Jul 18 13:01:23.906967 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 937/1936] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:23 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:23.926360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:23.927370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:23.932923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:23.936222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:23.939660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.940510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:23.941199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:23.965975 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8db39201-bd66-4d13-bb02-28bd71583e97 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.622715 Jul 18 13:01:23.975056 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1000/1937] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:23 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:24.007066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.009327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:24.033752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:24.034998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:24.036842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:24.037968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:24.362277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:24.383615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:24.389615 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1829bde3-5df9-4101-be38-553b9d0a91c5 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.405766 Jul 18 13:01:24.392835 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1001/1938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:23 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:24.396464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:24.401750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee80b5bc-485d-49ce-8893-c1a3fd0e83ef tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e9b14310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.404008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:24.405474 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76dbacd0-7e17-4aff-9854-390f0aa4d256 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.496279 Jul 18 13:01:24.421939 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 938/1939] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:23 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:24.427579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59b1c438-f24d-47b0-a8b1-adcc64716f6f tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] Calling method '.version_select at 0x7f96e4256ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.446984 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee80b5bc-485d-49ce-8893-c1a3fd0e83ef tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-1134655804" status: 200 len: 513 microversion: 2.2 time: 0.049030 Jul 18 13:01:24.447868 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1002/1940] 10.222.0.88 () {60 vars in 1257 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1134655804 => generated 513 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:24.455997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.461430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:24.496184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:24.496891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:24.497884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:24.498518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:24.617883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59b1c438-f24d-47b0-a8b1-adcc64716f6f tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc" status: 200 len: 371 microversion: 2.1 time: 0.193614 Jul 18 13:01:24.622311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 939/1941] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:24.640628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e1f2d9b5-9ea7-40ae-bd49-1e1a9c45e9bb tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e4281160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.648130 n-d-850003-3 devstack@n-api.service[131367]: WARNING oslo_db.sqlalchemy.utils [None req-e1f2d9b5-9ea7-40ae-bd49-1e1a9c45e9bb tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 13:01:24.663079 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e1f2d9b5-9ea7-40ae-bd49-1e1a9c45e9bb tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.029015 Jul 18 13:01:24.672040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 940/1942] 10.222.0.88 () {60 vars in 1176 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:24.672040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0dfd5d6a-9653-408d-890c-820635165afb tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] Calling method '.version_select at 0x7f96e425a040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.782192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:24.797703 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-242bf4a8-1bcf-4cce-8598-f63fef499f5e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.348067 Jul 18 13:01:24.798675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1003/1943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:24.803628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fcf1732-7de4-4a6a-bf21-cc71a07cd64b tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e4400280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.838062 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0dfd5d6a-9653-408d-890c-820635165afb tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.170156 Jul 18 13:01:24.848078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 941/1944] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc/defaults => generated 371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:24.858500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cfb64b75-e320-4c21-8fde-68f016e8e050 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] Calling method '.version_select at 0x7f96e441f160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:24.880216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fcf1732-7de4-4a6a-bf21-cc71a07cd64b tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134655804" status: 204 len: 0 microversion: 2.2 time: 0.078899 Jul 18 13:01:24.881081 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1004/1945] 10.222.0.88 () {60 vars in 1260 bytes} [Mon Jul 18 13:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134655804 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:24.901800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Action: 'create', calling method: .version_select at 0x7f96e4323af0>, body: {"keypair": {"name": "tempest-keypair-673840497", "type": "x509"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:24.971062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:24.976763 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cfb64b75-e320-4c21-8fde-68f016e8e050 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc" status: 200 len: 371 microversion: 2.1 time: 0.126917 Jul 18 13:01:24.983558 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 942/1946] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:24.989309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d0ae3d8-87de-40bd-a3dd-d1188a8b60b6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4ed5820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:25.007919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:25.035216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.processutils [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcxtlq8ti/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcxtlq8ti/temp.key -subj /CN=c2178406817b4fed83a55535a0b3e4ac -extensions v3_req_client {{(pid=131366) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 13:01:25.059068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d0ae3d8-87de-40bd-a3dd-d1188a8b60b6 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.073516 Jul 18 13:01:25.079539 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 943/1947] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:24 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:25.079539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba86451e-0a21-4ccd-907e-b1982aee9c80 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] Calling method '.version_select at 0x7f96e4219040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:25.230880 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba86451e-0a21-4ccd-907e-b1982aee9c80 tempest-QuotasTestJSON-2047876628 tempest-QuotasTestJSON-2047876628-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc?user_id=f1a36d56b7174a0d9006829299fc9eeb" status: 200 len: 371 microversion: 2.1 time: 0.156802 Jul 18 13:01:25.231494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 944/1948] 10.222.0.88 () {58 vars in 1322 bytes} [Mon Jul 18 13:01:25 2022] GET /compute/v2.1/os-quota-sets/8fdb18008d4c453c9756f1cf4057addc?user_id=f1a36d56b7174a0d9006829299fc9eeb => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:25.262890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:25.263437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:25.287569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:25.288013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:25.291990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:25.303048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:25.514193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.processutils [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcxtlq8ti/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcxtlq8ti/temp.key -subj /CN=c2178406817b4fed83a55535a0b3e4ac -extensions v3_req_client" returned: 0 in 0.478s {{(pid=131366) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 13:01:25.518206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.processutils [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcxtlq8ti/temp.key -password pass: {{(pid=131366) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 13:01:25.611131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.processutils [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcxtlq8ti/temp.key -password pass:" returned: 0 in 0.093s {{(pid=131366) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 13:01:25.732772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:01:25.761573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Getting quotas for user c2178406817b4fed83a55535a0b3e4ac and project 7343840d8cef4e4aad8fa3d1ba12490b. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:01:25.827051 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b19da931-c980-477c-9ae6-c453b2ad8c33 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.929107 Jul 18 13:01:25.843959 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1005/1949] 10.222.0.88 () {62 vars in 1197 bytes} [Mon Jul 18 13:01:24 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 955 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:25.881944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:25.884889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:25.921524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:25.925046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:25.927480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:25.928142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:25.931400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:25.969197 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca113b11-5b90-4964-aebc-16f98de1ca2e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.722317 Jul 18 13:01:25.975096 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 945/1950] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:25 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:25.980716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:25.999117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:26.013475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:26.014451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:26.017261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:26.023169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:26.381097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:26.393531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6ff373d-7f00-422c-8eff-ff5b50cd720d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.546987 Jul 18 13:01:26.410186 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1006/1951] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:25 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:26.410186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:26.410186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:26.412133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:26.412688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:26.413520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:26.416661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:26.537017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:26.549459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:26.557516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:26.559432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6825a05b-bbdc-4c3c-b6f1-8fe3c79e5f43 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.582915 Jul 18 13:01:26.567560 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 946/1952] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:25 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:26.574094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0003d453-99df-4491-9e2a-bed3b1ff8e3f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e42bfee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:26.595565 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0003d453-99df-4491-9e2a-bed3b1ff8e3f tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-673840497" status: 200 len: 1533 microversion: 2.2 time: 0.026314 Jul 18 13:01:26.596508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 947/1953] 10.222.0.88 () {60 vars in 1254 bytes} [Mon Jul 18 13:01:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-673840497 => generated 1533 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:26.615008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3db97573-e233-4674-8649-b9ad261d803e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4962790>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:26.765965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3db97573-e233-4674-8649-b9ad261d803e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.167696 Jul 18 13:01:26.774078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 948/1954] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:26 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:26.803611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eeaf3203-1097-412b-ae45-b4d857b22e41 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e4f36c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:26.809556 n-d-850003-3 devstack@n-api.service[131367]: WARNING oslo_db.sqlalchemy.utils [None req-eeaf3203-1097-412b-ae45-b4d857b22e41 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 13:01:26.843960 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eeaf3203-1097-412b-ae45-b4d857b22e41 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.061235 Jul 18 13:01:26.848107 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 949/1955] 10.222.0.88 () {60 vars in 1176 bytes} [Mon Jul 18 13:01:26 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:26.872151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f16430b-d029-4935-90f8-d31a38277e76 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] Calling method '.version_select at 0x7f96e4f36ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:26.954292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f16430b-d029-4935-90f8-d31a38277e76 tempest-KeyPairsV22TestJSON-798866518 tempest-KeyPairsV22TestJSON-798866518-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673840497" status: 204 len: 0 microversion: 2.2 time: 0.095613 Jul 18 13:01:26.957755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 950/1956] 10.222.0.88 () {60 vars in 1257 bytes} [Mon Jul 18 13:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673840497 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:27.014675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:27.016163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:27.080456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.096105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.107144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.109916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.557648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:27.560488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:27.576644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be94d258-9a4a-46af-9652-1b2f3c61c5af tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.574492 Jul 18 13:01:27.576914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b982cedf-9a9c-4023-b48f-4d069f6e614a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 1.180836 Jul 18 13:01:27.580006 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 951/1957] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:27 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:27.594253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:27.596485 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1007/1958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:26 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:27.597299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:27.618847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:27.623274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:27.623750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.624340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.630491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.633866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.636523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:27.654436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.655979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.664852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:27.666210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:27.728144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:28.194907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:28.228032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:28.250409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:28.253055 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dbe5afc7-e586-482e-8bbd-0cb2e2716c72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.654697 Jul 18 13:01:28.259423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1008/1959] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:27 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:28.285182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e55ece0b-95c2-43d0-ae91-338378484a48 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4577670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:28.470996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e55ece0b-95c2-43d0-ae91-338378484a48 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.206713 Jul 18 13:01:28.485554 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1009/1960] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:28 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:28.628817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:28.631199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:28.668679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:28.669420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:28.684070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:28.685105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:29.087417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:29.119136 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3943b51c-40f9-4cdc-91c9-315795013c5c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 1.532707 Jul 18 13:01:29.121796 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 952/1961] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:27 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:29.135843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:29.139639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:29.159859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:29.165300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:29.168832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:29.170870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:29.438646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:29.484426 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff482376-1a96-452f-913b-5ad8b41d06f4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.868992 Jul 18 13:01:29.487853 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1010/1962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:28 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:29.532325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:29.537912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:29.560530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:29.564331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:29.568495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:29.569959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:29.814237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:29.833851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3df14406-d9f3-4b22-96f6-cf647cc67f90 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.707355 Jul 18 13:01:29.845909 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 953/1963] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:29 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:29.865984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3caa13c9-c2a0-42ec-add6-0e243c8b7b49 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e425a790>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:30.056234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3caa13c9-c2a0-42ec-add6-0e243c8b7b49 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.207762 Jul 18 13:01:30.061687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 954/1964] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:29 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:30.154237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:30.167858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:30.230071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:30.239165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:30.240153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:30.240612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:30.311888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:30.322676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:30.340115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:30.341710 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-138eb481-1307-401c-8114-0b032255d321 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1293 microversion: 2.25 time: 0.828755 Jul 18 13:01:30.345241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1011/1965] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:29 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1293 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:30.636852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:30.669730 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b554782c-0920-4dbd-b4aa-3f7ca9fddf85 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.524613 Jul 18 13:01:30.689045 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 955/1966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:30 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:30.717420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:30.719864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:30.735194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:30.736332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:30.738492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:30.739804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:30.997694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:31.025456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf77c6d1-79aa-4a66-b839-047e2530df64 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.343308 Jul 18 13:01:31.026423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 956/1967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:30 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:31.036559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:31.037118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:31.068437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.069126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.071022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.071743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.080964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a19991e4-5175-417e-b2c4-1fdbeaa8a7af tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Action: 'create', calling method: .version_select at 0x7f96e4321310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1825364940"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:31.165695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:01:31.396259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38fdd7c6-fd11-48f9-ba18-15ba7de5c624 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 204 len: 0 microversion: 2.1 time: 0.367515 Jul 18 13:01:31.400640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 957/1968] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:31 2022] DELETE /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:31.416776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:31.421063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:31.437510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.438395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.439913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.441162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.760533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:31.780452 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39748f2d-a2f5-4031-8a5b-024ea2494e7e tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.378159 Jul 18 13:01:31.782193 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 958/1969] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:31 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:31.805975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-801d0f11-52e0-4b78-bb1b-7ea9b88ddb42 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4243c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:31.879374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a19991e4-5175-417e-b2c4-1fdbeaa8a7af tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.464150 Jul 18 13:01:31.895414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1012/1970] 10.222.0.88 () {60 vars in 1154 bytes} [Mon Jul 18 13:01:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1481 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 13:01:31.911614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:31.913267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:31.943934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.946698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.951211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:31.954889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:31.992837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-801d0f11-52e0-4b78-bb1b-7ea9b88ddb42 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.200440 Jul 18 13:01:31.994089 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 959/1971] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:31 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:31.998508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:32.020995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:32.023159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:32.048425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.052241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.053782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.057035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.369221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:32.395251 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec8c845d-f731-4aed-ad5a-7554f96ad7ee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1668 microversion: 2.1 time: 0.398153 Jul 18 13:01:32.397501 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 960/1972] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:31 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1668 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:32.408299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:32.416314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:32.425069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:32.426365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:32.429878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:32.432285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aadc8442-1025-4370-a82a-09b0c3aee9c7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 0.535632 Jul 18 13:01:32.436169 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1013/1973] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:31 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:32.449471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14891978-9a5d-40e1-8e12-84a7b9c7f5ee tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e431b280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:32.459145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.461522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.464696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.467386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.652743 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14891978-9a5d-40e1-8e12-84a7b9c7f5ee tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 200 len: 345 microversion: 2.1 time: 0.215233 Jul 18 13:01:32.653941 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1014/1974] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:32 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:32.662104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:32.665900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:32.681017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.684987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.686617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.687098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:32.903084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:32.926230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca59c7c3-f16f-4223-9532-0014e335ee9e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.525048 Jul 18 13:01:32.930246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 961/1975] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:32 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:32.952058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-041f575c-d461-4cb0-b302-0e730c343eb9 req-86279122-3cc6-4a44-9cbb-a5c759f71a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43350aa-33a0-44ec-99e7-89b0fade9923", "name": "network-vif-plugged", "status": "completed", "tag": "8160da0f-c3ce-47f4-a153-3e58212e16a8"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:32.995425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-041f575c-d461-4cb0-b302-0e730c343eb9 req-86279122-3cc6-4a44-9cbb-a5c759f71a26 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:32.996504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-041f575c-d461-4cb0-b302-0e730c343eb9 req-86279122-3cc6-4a44-9cbb-a5c759f71a26 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.049767 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-041f575c-d461-4cb0-b302-0e730c343eb9 req-86279122-3cc6-4a44-9cbb-a5c759f71a26 service nova] Creating event network-vif-plugged:8160da0f-c3ce-47f4-a153-3e58212e16a8 for instance d43350aa-33a0-44ec-99e7-89b0fade9923 on n-h2-850003-3 Jul 18 13:01:33.076317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-041f575c-d461-4cb0-b302-0e730c343eb9 req-86279122-3cc6-4a44-9cbb-a5c759f71a26 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143432 Jul 18 13:01:33.081986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 962/1976] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:33.102037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:33.105721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:33.131063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.135634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.138520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.142363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.203389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:33.215340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0cf627fd-1c79-4e43-aec7-b4116ddbd0db tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.557862 Jul 18 13:01:33.230111 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1015/1977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:32 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:33.236214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f84af80-78a8-46bf-b709-a3183545e476 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4f75af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:33.312956 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f84af80-78a8-46bf-b709-a3183545e476 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.081100 Jul 18 13:01:33.317305 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1016/1978] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:33 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:33.421156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:33.422101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:33.438789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.444005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.447265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.449587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.687691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:33.706716 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-427acddb-42ca-4e48-9319-4660b43141ec tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.620544 Jul 18 13:01:33.708885 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 963/1979] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:33 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:33.720294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:33.721680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:33.742762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.746571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.749051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:33.750897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:33.922996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:33.933764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0496e08d-6b0c-453e-8b06-6e291506c6f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1668 microversion: 2.1 time: 0.516522 Jul 18 13:01:33.935327 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1017/1980] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:33 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:33.942597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96b87a32-5a4c-4139-99d9-4172a9095dc8 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e4576430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:34.087867 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96b87a32-5a4c-4139-99d9-4172a9095dc8 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 200 len: 346 microversion: 2.1 time: 0.148793 Jul 18 13:01:34.089904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1018/1981] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:33 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:34.101447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:34.103540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:34.123521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.124526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:34.126526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.128876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:34.345563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:34.386913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:34.395593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:34.398027 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-138056c4-1410-4c54-ac69-b0f8543c09ca tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 0.686713 Jul 18 13:01:34.417538 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 964/1982] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:33 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:34.429658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8df1b1a8-2f1c-4e5a-bd10-3f6ed206d20c tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Action: 'create', calling method: .version_select at 0x7f96e425a310>, body: {"snapshot": {"volume_id": "2fd4a0bb-2a9d-4f07-9487-33d80f4f7886", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1325740133"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:34.543991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:34.557499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f86b8317-b09d-493a-b221-6e0e0c4949d2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.466170 Jul 18 13:01:34.559970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1019/1983] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:34 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:34.575600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:34.576612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:34.586598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.587936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:34.589117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.589851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:34.861994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:34.885790 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd6c60a3-7b5c-477d-9c94-59d26bb53f3f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1307 microversion: 2.1 time: 0.323726 Jul 18 13:01:34.926670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1020/1984] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:34 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:34.943486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74b08efa-0cf9-4cad-a0aa-758c96128153 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e43214c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:34.947718 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8df1b1a8-2f1c-4e5a-bd10-3f6ed206d20c tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.528323 Jul 18 13:01:34.961185 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 965/1985] 10.222.0.88 () {60 vars in 1161 bytes} [Mon Jul 18 13:01:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:34.969705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:34.973839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:34.989305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.990320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:34.992177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:34.994602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:35.092678 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74b08efa-0cf9-4cad-a0aa-758c96128153 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.162152 Jul 18 13:01:35.093664 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1021/1986] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:34 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:35.105542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9f0c0bd-45da-4779-ad1a-e2b6d302d5fa tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9adb280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:35.214489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=32 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:35.370785 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9f0c0bd-45da-4779-ad1a-e2b6d302d5fa tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 200 len: 287 microversion: 2.1 time: 0.274459 Jul 18 13:01:35.374258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1022/1987] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:35 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 287 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:35.395515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:35.397514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:35.470761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:35.472346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:35.474547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:35.478045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:35.789778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=20 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:35.819409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:35.861245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ceb72ad-fd68-4bf3-aac3-793a394e156a tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 0.897537 Jul 18 13:01:35.900485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 966/1988] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:34 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:35.921687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc", "name": "network-vif-plugged", "status": "completed", "tag": "18f989ef-679f-402c-84aa-df7abc920e5e"}, {"server_uuid": "b8c0fa0a-e4c3-4182-a238-a2f997d2b947", "name": "network-vif-plugged", "status": "completed", "tag": "09d2970e-4c5a-452a-a6a1-0ccc23c6b73e"}, {"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-plugged", "status": "completed", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:35.965314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:35.966404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:36.027040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Creating event network-vif-plugged:18f989ef-679f-402c-84aa-df7abc920e5e for instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc on n-h1-850003-3 Jul 18 13:01:36.027563 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Creating event network-vif-plugged:09d2970e-4c5a-452a-a6a1-0ccc23c6b73e for instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 on n-h2-850003-3 Jul 18 13:01:36.030597 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] Creating event network-vif-plugged:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:01:36.109688 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1ea83b50-2c2c-4eed-9965-1fe13e373e8a req-cf6da4fd-8ba6-4e2d-8cf5-3d87a2530866 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.207194 Jul 18 13:01:36.122668 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 967/1989] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:36.147564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-283bc91c-c4a9-4570-b315-660535676b1d tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e425af70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:36.312385 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-283bc91c-c4a9-4570-b315-660535676b1d tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.187290 Jul 18 13:01:36.324137 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 968/1990] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 13:01:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:36.337153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:36.340674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:36.368788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:36.372759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:36.374547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:36.377838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:36.446634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:36.501472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d04be1e-db2c-4f85-bb16-f6f767b6a0fb tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1668 microversion: 2.1 time: 1.124685 Jul 18 13:01:36.504515 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1023/1991] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:35 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1668 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:36.555824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:36.566903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:36.606135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:36.611843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:36.623632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:36.628552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:37.380859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:37.393011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:37.395206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:37.396787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:37.398037 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f99d2c5-6b72-4137-8216-7bcdd95d6e0e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 1.081857 Jul 18 13:01:37.411090 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 969/1992] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:36 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:37.414298 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ae45698-c577-4504-b7bb-a47793002871 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1325 microversion: 2.1 time: 0.903408 Jul 18 13:01:37.417493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:37.424766 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1024/1993] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:36 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1325 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:37.427125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:37.431340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-745a8685-3d88-4de6-b917-eb590789c6b3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e431b700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:37.438347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:37.438805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:37.445864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:37.446972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:37.577581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-745a8685-3d88-4de6-b917-eb590789c6b3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.151171 Jul 18 13:01:37.593777 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1025/1994] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:37 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:37.621312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-683a7b82-d5f0-455c-a1f6-3d148432ed5b tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e4321550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:37.761142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-683a7b82-d5f0-455c-a1f6-3d148432ed5b tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 200 len: 287 microversion: 2.1 time: 0.165365 Jul 18 13:01:37.762342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1026/1995] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:37 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:37.774610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:37.794055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:37.819830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:37.827532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:37.829284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:37.830380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:37.945072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:37.986048 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3818bf03-1af1-421f-b625-49538a5284d8 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1487 microversion: 2.1 time: 0.570180 Jul 18 13:01:37.990214 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 970/1996] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:37 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1487 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:38.014745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c18a4e80-7032-480f-8709-bacb4269a10d req-21e5d803-6f43-4717-9be3-13609df39569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90439a2-8727-45d4-98f7-1aef41b30c9c", "name": "network-vif-deleted", "tag": "a23e42e2-3f5a-48b8-a1d5-7f3e56236914"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:38.058331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c18a4e80-7032-480f-8709-bacb4269a10d req-21e5d803-6f43-4717-9be3-13609df39569 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:38.062689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c18a4e80-7032-480f-8709-bacb4269a10d req-21e5d803-6f43-4717-9be3-13609df39569 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:38.118205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c18a4e80-7032-480f-8709-bacb4269a10d req-21e5d803-6f43-4717-9be3-13609df39569 service nova] Creating event network-vif-deleted:a23e42e2-3f5a-48b8-a1d5-7f3e56236914 for instance b90439a2-8727-45d4-98f7-1aef41b30c9c on n-h1-850003-3 Jul 18 13:01:38.143730 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c18a4e80-7032-480f-8709-bacb4269a10d req-21e5d803-6f43-4717-9be3-13609df39569 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150181 Jul 18 13:01:38.144812 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 971/1997] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:38.154493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:38.155650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:38.185189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:38.186536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:38.188977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:38.191710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:38.436663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:38.476642 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63860200-3326-4e8d-9290-1ebc183075f5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 200 len: 1318 microversion: 2.1 time: 0.328683 Jul 18 13:01:38.478903 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 972/1998] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:38 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:38.499382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1021416803"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:38.502783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:38.516824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:38.518697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:38.521371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:38.523514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:38.677165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:38.949183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:38.979017 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ffde83e-c0b5-4803-9365-9e728f4ce4fc tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1351 microversion: 2.1 time: 1.214747 Jul 18 13:01:38.983450 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1027/1999] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:37 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1351 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:39.006658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:39.010134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:39.052291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:39.054262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:39.058936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:39.094667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.124036 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77329b31-a3f3-4ffe-b25e-fd51648567ac tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "POST /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923/action" status: 202 len: 0 microversion: 2.1 time: 1.634135 Jul 18 13:01:40.129329 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 973/2000] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:01:38 2022] POST /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923/action => generated 0 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:01:40.181376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:40.185312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:40.234841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:40.245778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.253258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.259725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.267394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.281321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:40.290729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:40.293490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f155f1ff-d734-4d95-9e68-4d1a9d69d4ff tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 1.303393 Jul 18 13:01:40.300435 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1028/2001] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:38 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:40.320807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc728251-295a-4d2c-940b-d420f73b4456 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9b14d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:40.521745 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc728251-295a-4d2c-940b-d420f73b4456 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.219184 Jul 18 13:01:40.549777 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1029/2002] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:40.559352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eae10991-2f10-402c-81c3-984f999a1a8f tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9a65040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:40.658277 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eae10991-2f10-402c-81c3-984f999a1a8f tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 200 len: 288 microversion: 2.1 time: 0.105920 Jul 18 13:01:40.660255 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1030/2003] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:40.675801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:40.680764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: b90439a2-8727-45d4-98f7-1aef41b30c9c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:40.706725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.708018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.709887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.711398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.792422 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] HTTP exception thrown: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Request method failure captured: Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c HTTP/1.1 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcVCSgTKGZSdrA3DKXi-MZwcSWe3klEzpe3E4LWW_QrU19hMyPnr5TijzXuDsMMxrS0Fwpv8tBpZJowShYTBVGQpNw8rGSmKQGuR-erMtChjvk5MXa5dfXpGY5wOGPDViwB0S-xl95z8ZdRqCw7ivdMD3dC8hm7KpHUNb9tIN1b1vg Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:40.796784 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0eacb137f6294164bc2bbb101ecc94f8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 64cdfc77cf92451c84c873df41bc422f Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. Jul 18 13:01:40.799939 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b90439a2-8727-45d4-98f7-1aef41b30c9c'} Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:40.801759 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. Jul 18 13:01:40.804874 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:40.808931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Returning 404 to user: Instance b90439a2-8727-45d4-98f7-1aef41b30c9c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:40.812895 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d37ba1d-faf9-4549-99b8-441950c5b9bf tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c" status: 404 len: 111 microversion: 2.1 time: 0.150341 Jul 18 13:01:40.818951 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1031/2004] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/servers/b90439a2-8727-45d4-98f7-1aef41b30c9c => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:40.832981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:40.835642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:40.851690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.852672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.854300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:40.855989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:40.962372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:40.982527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e02123f-e677-4604-ab16-d608265a6106 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.848036 Jul 18 13:01:40.984533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 974/2005] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:41.008213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-948fda0f-05ac-4e28-bda5-daedd26985e5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4c7a670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.151428 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-948fda0f-05ac-4e28-bda5-daedd26985e5 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6" status: 200 len: 1414 microversion: 2.1 time: 0.165026 Jul 18 13:01:41.166017 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 975/2006] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:41.176873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49cd5389-b212-453e-845a-053d8b4fae48 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e41f6790>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.355749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49cd5389-b212-453e-845a-053d8b4fae48 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 202 len: 0 microversion: 2.1 time: 0.185309 Jul 18 13:01:41.356450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 976/2007] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 13:01:41 2022] DELETE /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:01:41.377994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-774c96ef-86ea-4db1-9519-af783a74d2c5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '.version_select at 0x7f96e4219700>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.419045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:41.448787 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-774c96ef-86ea-4db1-9519-af783a74d2c5 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391544092" status: 202 len: 0 microversion: 2.1 time: 0.087392 Jul 18 13:01:41.451443 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 977/2008] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:01:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391544092 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:01:41.474635 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97baa03c-6335-4db0-b540-464b1a3893ed tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1541 microversion: 2.1 time: 0.653278 Jul 18 13:01:41.476965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.478306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:41.482223 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1032/2009] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:40 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1541 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:41.512931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:41.514225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d7c5ecc-35f8-40a2-8ccd-5a98d6439b4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e9acf670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.515699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:41.524497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:41.526001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:41.741821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d7c5ecc-35f8-40a2-8ccd-5a98d6439b4d tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6" status: 200 len: 1414 microversion: 2.1 time: 0.257030 Jul 18 13:01:41.755083 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1033/2010] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:41 2022] GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 => generated 1414 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:41.760842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:41.761863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:41.795613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:41.796455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:41.798024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:41.798832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:42.372248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:42.401994 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-478518a6-5084-422c-be23-340eee1fe510 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.947124 Jul 18 13:01:42.403193 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 978/2011] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:41 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:42.417599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc1060f0-7030-4173-b2cf-11d745d30bfd tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e41f60d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:42.608645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc1060f0-7030-4173-b2cf-11d745d30bfd tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 200 len: 287 microversion: 2.1 time: 0.202374 Jul 18 13:01:42.610660 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 979/2012] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:42 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:42.623323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:42.634685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:42.644340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:42.659616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:42.668532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:42.671077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:42.674271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-652d9ac8-1056-4640-ba87-9e653dbc044d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 0.926047 Jul 18 13:01:42.676210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:42.677887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:42.679314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:42.682772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1034/2013] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:41 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:42.696923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9451f289-ef87-4266-b85a-79b04b3d0174 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4584c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:42.905677 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9451f289-ef87-4266-b85a-79b04b3d0174 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.220721 Jul 18 13:01:42.919044 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1035/2014] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:42 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:42.954195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0607dd31-7043-482f-a2ce-2fe8eaad9888 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e431b8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:43.237359 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-efaac258-16d5-4351-92fc-83f8caca8dd6 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.624503 Jul 18 13:01:43.239993 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 980/2015] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:01:42 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947/os-interface => generated 285 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:43.260885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd6dce29-0a4f-4c49-86ca-b7998d294e19 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210053973", "metadata": {"": ""}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd6dce29-0a4f-4c49-86ca-b7998d294e19 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action HTTP/1.1 Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 106 Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:43.281264 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210053973", "metadata": {"": ""}}} Jul 18 13:01:43.285360 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-210053973', 'metadata': {'': ''}}}} Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'': ''} Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:43.287727 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.293280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:43.299051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.303831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd6dce29-0a4f-4c49-86ca-b7998d294e19 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:43.311611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd6dce29-0a4f-4c49-86ca-b7998d294e19 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action" status: 400 len: 170 microversion: 2.1 time: 0.066557 Jul 18 13:01:43.313481 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 981/2016] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 18 13:01:43 2022] POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action => generated 170 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:43.334613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:43.338814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:43.363987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:43.372959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:43.376105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:43.380666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:43.381559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:43.441291 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0607dd31-7043-482f-a2ce-2fe8eaad9888 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6" status: 204 len: 0 microversion: 2.1 time: 0.520005 Jul 18 13:01:43.442842 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1036/2017] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:42 2022] DELETE /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:43.457492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9102c309-ea0e-4847-ac97-d1ede52bec68 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e9b06040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:43.539260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9102c309-ea0e-4847-ac97-d1ede52bec68 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Image not found. Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9102c309-ea0e-4847-ac97-d1ede52bec68 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 HTTP/1.1 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:43.549648 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '14720092-a864-4f3d-96df-8d54c0d080f6'} Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:43.553047 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14720092-a864-4f3d-96df-8d54c0d080f6 Jul 18 13:01:43.556382 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:43.560338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14720092-a864-4f3d-96df-8d54c0d080f6 could not be found. Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:43.571103 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9102c309-ea0e-4847-ac97-d1ede52bec68 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:43.573912 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9102c309-ea0e-4847-ac97-d1ede52bec68 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6" status: 404 len: 62 microversion: 2.1 time: 0.113564 Jul 18 13:01:43.577912 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1037/2018] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:43 2022] GET /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 13:01:43.592447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:43.594045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:43.606282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:43.607543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:43.609358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:43.610637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:45.361302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:45.418381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-90850895-c496-4466-a1f3-7a8e08ccd519 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 2.097519 Jul 18 13:01:45.442586 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 982/2019] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:43 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:01:45.461454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbfb748d-fbf5-4d43-9d84-ad45d3d39479 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e42bfe50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:45.557337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:45.584664 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2efbcb4f-c8cd-4b34-b3ad-b9b6d5ec9843 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1505 microversion: 2.1 time: 2.001181 Jul 18 13:01:45.586229 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1038/2020] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:43 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1505 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:45.606374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:45.614947 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbfb748d-fbf5-4d43-9d84-ad45d3d39479 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 200 len: 287 microversion: 2.1 time: 0.181909 Jul 18 13:01:45.616888 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 983/2021] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:45 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:45.617685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:45.627721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08dffc7c-6d5f-4803-800d-17fae04dc504 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e418c550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:45.636762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:45.637457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:45.638750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:45.639457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:45.776243 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08dffc7c-6d5f-4803-800d-17fae04dc504 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.155890 Jul 18 13:01:45.778537 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 984/2022] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:45 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:45.801810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:45.804550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:45.837533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:45.842497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:45.846724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:45.848136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:46.557576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:46.582551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:46.588858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:46.591724 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3801425-6bf6-426e-b945-2d7d9b5f7c15 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 1.003806 Jul 18 13:01:46.593111 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1039/2023] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:45 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:46.604126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:46.605408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:46.623416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:46.624716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:46.626692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:46.628111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:46.660350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:46.692725 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51bae1da-4359-43ee-ad65-6eec95543a02 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.911166 Jul 18 13:01:46.696288 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 985/2024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:45 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:46.720643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:46.722683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:46.755292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:01:46.757050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:46.763431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:46.766558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:46.771106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:47.175522 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-421ab4c8-2fa7-48ec-9aff-4fa643f8ad35 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 204 len: 0 microversion: 2.1 time: 0.579753 Jul 18 13:01:47.180909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1040/2025] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:46 2022] DELETE /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:47.199819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c87e5a7-133d-4c95-a6ed-829f4e902604 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e4321b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:47.268947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:47.292068 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5c87e5a7-133d-4c95-a6ed-829f4e902604 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] HTTP exception thrown: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. Jul 18 13:01:47.293568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e9e3fbc-dea1-4887-85b2-c76f77f759c1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1487 microversion: 2.1 time: 0.592499 Jul 18 13:01:47.294596 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 986/2026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:46 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1487 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c87e5a7-133d-4c95-a6ed-829f4e902604 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Request method failure captured: Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede HTTP/1.1 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vmqa13ZNZVvB8tqubRND3oiJ6Dd-ANtz0pkLNjUFGh_krEpvfGqBRJDDF_NmZFOP45ms8Zj0ZDykw2m74J26Ft8WZOur4sz2bC2hahtnh97IJghvCsT-ZA9ZCwpupZv90g0rhXTr9S_Fyg-DnyY5s-hFUmTCVhBJazvO0xhnmkRWoc Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:47.322961 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6feedcb2215b456a86e015472e20c797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6feedcb2215b456a86e015472e20c797", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 214034b0c17a446b97ba555d081c4182 Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: exception: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '45435708-c771-4947-a9f5-824e5c539ede'} Jul 18 13:01:47.326049 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. (HTTP 404) (Request-ID: req-b2480d43-903e-4867-8837-1cb407751a7e) Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.329866 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:47.334346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 13:01:47.345036 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. Jul 18 13:01:47.350001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a5b0fba-c760-4026-b3cd-8b2f31338633 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1654749279", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a5b0fba-c760-4026-b3cd-8b2f31338633 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action HTTP/1.1 Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 619 Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:47.352910 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:47.357253 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:01:47.361458 n-d-850003-3 devstack@n-api.service[131367]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1654749279", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 18 13:01:47.361458 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:47.361458 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1654749279', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 13:01:47.363909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:47.367622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.371941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:01:47.376014 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:47.377582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a5b0fba-c760-4026-b3cd-8b2f31338633 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:47.377582 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a5b0fba-c760-4026-b3cd-8b2f31338633 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action" status: 400 len: 938 microversion: 2.1 time: 0.016650 Jul 18 13:01:47.377582 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 987/2027] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 18 13:01:47 2022] POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action => generated 938 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:47.378467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c87e5a7-133d-4c95-a6ed-829f4e902604 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Returning 404 to user: Snapshot 45435708-c771-4947-a9f5-824e5c539ede could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:47.378467 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c87e5a7-133d-4c95-a6ed-829f4e902604 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede" status: 404 len: 111 microversion: 2.1 time: 0.150146 Jul 18 13:01:47.378467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1041/2028] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 13:01:47 2022] GET /compute/v2.1/os-snapshots/45435708-c771-4947-a9f5-824e5c539ede => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:47.379395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f307b615-8098-4106-b969-c63363fcd905 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e425a9d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:47.394286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:47.395635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:47.441798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:47.449244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:47.451194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:47.452013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:47.480654 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f307b615-8098-4106-b969-c63363fcd905 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.141100 Jul 18 13:01:47.487281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 988/2029] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:47 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:47.518811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:47.520072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:47.547875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:47.549079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:47.550881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:47.557641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:47.686927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:01:47.988761 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-859b410a-4738-481d-a6b7-9b1e790740ae tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 204 len: 0 microversion: 2.1 time: 0.498989 Jul 18 13:01:47.999090 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 989/2030] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:47 2022] DELETE /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:48.015333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:48.020746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:48.052363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:48.061516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:48.063884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:48.065144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:48.198084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:48.225976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19af181e-12cc-4e31-820b-4052b0e570cd tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1484 microversion: 2.1 time: 0.852686 Jul 18 13:01:48.228631 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1042/2031] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:47 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1484 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:48.251801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c17362d6-063d-458a-9f35-9ffbdd449ee4 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9b14700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:48.679036 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c17362d6-063d-458a-9f35-9ffbdd449ee4 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 202 len: 0 microversion: 2.1 time: 0.448050 Jul 18 13:01:48.680723 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1043/2032] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:01:48 2022] DELETE /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:01:48.712533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:48.719637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:48.772104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:48.775146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:48.779702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:48.790244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:48.836619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:49.956600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:49.994014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:50.011186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:50.013993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dcef8c39-3fa8-4b9f-acd5-861a29e206e4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 1.331201 Jul 18 13:01:50.015895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1044/2033] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:48 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:50.029223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dd4a7ea2-3989-4c8c-8f77-debc3f3a99a5 req-1503dae4-9196-4137-9d31-1aeb601f354d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "name": "network-vif-plugged", "status": "completed", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:50.077346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dd4a7ea2-3989-4c8c-8f77-debc3f3a99a5 req-1503dae4-9196-4137-9d31-1aeb601f354d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:50.078730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dd4a7ea2-3989-4c8c-8f77-debc3f3a99a5 req-1503dae4-9196-4137-9d31-1aeb601f354d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:50.127479 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dd4a7ea2-3989-4c8c-8f77-debc3f3a99a5 req-1503dae4-9196-4137-9d31-1aeb601f354d service nova] Creating event network-vif-plugged:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:01:50.171400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dd4a7ea2-3989-4c8c-8f77-debc3f3a99a5 req-1503dae4-9196-4137-9d31-1aeb601f354d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146136 Jul 18 13:01:50.172699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1045/2034] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:50.209369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-821e0931-271f-4869-aa3a-94d6e955a22f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e9b06280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:50.340158 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-821e0931-271f-4869-aa3a-94d6e955a22f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Image not found. Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-821e0931-271f-4869-aa3a-94d6e955a22f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 HTTP/1.1 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:50.344111 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '14720092-a864-4f3d-96df-8d54c0d080f6'} Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:50.347306 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 14720092-a864-4f3d-96df-8d54c0d080f6 to delete Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.349329 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14720092-a864-4f3d-96df-8d54c0d080f6 could not be found. Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:50.352863 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-821e0931-271f-4869-aa3a-94d6e955a22f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-821e0931-271f-4869-aa3a-94d6e955a22f tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6" status: 404 len: 62 microversion: 2.1 time: 0.172093 Jul 18 13:01:50.357879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1046/2035] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:50 2022] DELETE /compute/v2.1/images/14720092-a864-4f3d-96df-8d54c0d080f6 => generated 62 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:01:50.380314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0aa6b5d6-4c48-4c0c-9942-8a77353314da tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9aca280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:50.572230 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0aa6b5d6-4c48-4c0c-9942-8a77353314da tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.216285 Jul 18 13:01:50.575942 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1047/2036] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:50 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:50.597736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12f8c008-0bf1-4cc5-8496-edcac2e5f84d tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9a7ec10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:50.853975 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12f8c008-0bf1-4cc5-8496-edcac2e5f84d tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 200 len: 345 microversion: 2.1 time: 0.274524 Jul 18 13:01:50.860304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1048/2037] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:50 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 345 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:50.881168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:50.884463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:50.934970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:50.936903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:50.939286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:50.941247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:51.047229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:51.051127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:51.052463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lazy-loading 'fault' on Instance uuid 80f0acbf-0cde-4244-9dac-a799ee8607bb {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:01:51.304540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:51.340271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a58c383-930e-45f9-ae12-337d78d0a188 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 200 len: 1300 microversion: 2.1 time: 0.477071 Jul 18 13:01:51.364567 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1049/2038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:50 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 1300 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:51.373325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:51.374004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:51.382462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:51.383400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:51.384578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:51.385212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:51.469230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:01:51.702494 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Instance is already in deleting state, ignoring this request Jul 18 13:01:51.704855 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f0546249-68ec-42ee-be98-7b3cd3d521c4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 204 len: 0 microversion: 2.1 time: 0.339776 Jul 18 13:01:51.715973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1050/2039] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:51 2022] DELETE /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:51.730825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:51.732142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:51.761918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:51.762778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:51.764255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:51.780337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:52.098684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:52.168700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9d3b780-5c85-420a-bb60-d276a923704a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 4.166743 Jul 18 13:01:52.171837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 990/2040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:47 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 4172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:52.215849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2959e59e-7bed-492b-8dff-d2355ae7c523 req-34a61bde-2a88-46f4-98d1-2b5411c294e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0acbf-0cde-4244-9dac-a799ee8607bb", "name": "network-vif-deleted", "tag": "f5cf22a1-810b-46ff-89fe-e3de8ce57f9e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:52.249639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2959e59e-7bed-492b-8dff-d2355ae7c523 req-34a61bde-2a88-46f4-98d1-2b5411c294e7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:52.251087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2959e59e-7bed-492b-8dff-d2355ae7c523 req-34a61bde-2a88-46f4-98d1-2b5411c294e7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:52.306076 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2959e59e-7bed-492b-8dff-d2355ae7c523 req-34a61bde-2a88-46f4-98d1-2b5411c294e7 service nova] Creating event network-vif-deleted:f5cf22a1-810b-46ff-89fe-e3de8ce57f9e for instance 80f0acbf-0cde-4244-9dac-a799ee8607bb on n-h2-850003-3 Jul 18 13:01:52.321792 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2959e59e-7bed-492b-8dff-d2355ae7c523 req-34a61bde-2a88-46f4-98d1-2b5411c294e7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143191 Jul 18 13:01:52.329892 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 991/2041] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:52.357785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-01f9ad98-e850-410c-96cc-62b10016c731 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4243670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:52.595906 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-01f9ad98-e850-410c-96cc-62b10016c731 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.261940 Jul 18 13:01:52.596854 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 992/2042] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:52 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:52.627806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:52.630442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:52.663842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:52.670848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:52.673276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:52.681882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:52.851919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:52.867057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:52.869918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:52.878427 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f150cd6-d5ae-4454-9c7f-4d616f435187 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1281 microversion: 2.25 time: 1.158243 Jul 18 13:01:52.879895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1051/2043] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:51 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1281 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:52.892519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8611bffe-ba89-4479-9634-682a025ddd89 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9a65c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:53.016968 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8611bffe-ba89-4479-9634-682a025ddd89 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 200 len: 345 microversion: 2.1 time: 0.135705 Jul 18 13:01:53.017556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1052/2044] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:52 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:53.023111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:53.023858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:53.071741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.074623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.079069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.079538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.340341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:53.355177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dfc14c4b-0d35-49b0-8894-c3cdd22d0b57 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1493 microversion: 2.1 time: 0.740965 Jul 18 13:01:53.356219 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 993/2045] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:52 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1493 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:53.371189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43350aa-33a0-44ec-99e7-89b0fade9923", "name": "network-vif-plugged", "status": "completed", "tag": "8160da0f-c3ce-47f4-a153-3e58212e16a8"}, {"server_uuid": "d43350aa-33a0-44ec-99e7-89b0fade9923", "name": "network-vif-unplugged", "status": "completed", "tag": "8160da0f-c3ce-47f4-a153-3e58212e16a8"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:53.395882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.396348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.424963 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] Creating event network-vif-plugged:8160da0f-c3ce-47f4-a153-3e58212e16a8 for instance d43350aa-33a0-44ec-99e7-89b0fade9923 on n-h2-850003-3 Jul 18 13:01:53.425496 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] Creating event network-vif-unplugged:8160da0f-c3ce-47f4-a153-3e58212e16a8 for instance d43350aa-33a0-44ec-99e7-89b0fade9923 on n-h2-850003-3 Jul 18 13:01:53.440856 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8138cc25-19af-434b-b984-63df2f2598c3 req-a6c30b9d-d9e7-4b3f-9fc3-b7229a2a7cc3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.076499 Jul 18 13:01:53.442052 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 994/2046] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:53.469999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:53.472990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 80f0acbf-0cde-4244-9dac-a799ee8607bb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:53.504534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.505848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.507142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.508472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.562998 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] HTTP exception thrown: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Request method failure captured: Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb HTTP/1.1 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VcVCSgTKGZSdrA3DKXi-MZwcSWe3klEzpe3E4LWW_QrU19hMyPnr5TijzXuDsMMxrS0Fwpv8tBpZJowShYTBVGQpNw8rGSmKQGuR-erMtChjvk5MXa5dfXpGY5wOGPDViwB0S-xl95z8ZdRqCw7ivdMD3dC8hm7KpHUNb9tIN1b1vg Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:53.565884 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0eacb137f6294164bc2bbb101ecc94f8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 64cdfc77cf92451c84c873df41bc422f Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveMigrationTest-1302780380-project Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. Jul 18 13:01:53.568682 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '80f0acbf-0cde-4244-9dac-a799ee8607bb'} Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:53.570831 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. Jul 18 13:01:53.573323 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:53.580681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Returning 404 to user: Instance 80f0acbf-0cde-4244-9dac-a799ee8607bb could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:53.580681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-383556b5-6813-45c3-bd9f-5b3cc6387054 tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb" status: 404 len: 111 microversion: 2.1 time: 0.127175 Jul 18 13:01:53.580681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 995/2047] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:53 2022] GET /compute/v2.1/servers/80f0acbf-0cde-4244-9dac-a799ee8607bb => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:53.582260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:53.601124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9bea2fb0-d344-4c3d-bd8b-b04858162b81 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.581641 Jul 18 13:01:53.602211 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1053/2048] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:53 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:53.622283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:53.623072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:53.633897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.634595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.636944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:53.637687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:53.747497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:01:54.008786 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3794c7a-0a49-4da7-be5c-3accec646aee tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "DELETE /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 204 len: 0 microversion: 2.1 time: 0.390785 Jul 18 13:01:54.014324 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1054/2049] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:53 2022] DELETE /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:01:54.020662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13b6dc7e-a110-40ff-97df-143196ab8c40 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9acfca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:54.161490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13b6dc7e-a110-40ff-97df-143196ab8c40 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.145285 Jul 18 13:01:54.164750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1055/2050] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:54 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:54.181187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eeae21e0-4afb-4484-b0e0-4bdad2ffa8eb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eeae21e0-4afb-4484-b0e0-4bdad2ffa8eb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action HTTP/1.1 Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 285 Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:54.194739 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:01:54.197639 n-d-850003-3 devstack@n-api.service[131366]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:01:54.199143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:01:54.200507 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:01:54.206262 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:01:54.210802 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:01:54.210802 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.214084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eeae21e0-4afb-4484-b0e0-4bdad2ffa8eb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:54.219742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eeae21e0-4afb-4484-b0e0-4bdad2ffa8eb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action" status: 400 len: 619 microversion: 2.1 time: 0.050559 Jul 18 13:01:54.221305 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1056/2051] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 18 13:01:54 2022] POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action => generated 619 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:54.241971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:54.245499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:54.255223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Calling method '.version_select at 0x7f96e42025e0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:54.266276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:54.268964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:54.272531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:54.273351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:54.346131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:01:54.347192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Neutron security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:01:54.348083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] HTTP exception thrown: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.348083 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Request method failure captured: Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 HTTP/1.1 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VnAuZmtacvO-pTEUkilOPEd56RfzWhqxMi8fb1YAsia8WVxPOADo-qOPB0Y1Nu-D-WYbPfdw5BJy9cgt9B1RzPtQlAb2sBc2QMz9ORch29iOWPB4jFXtfTo2z3EHPwYku5B0AoHKDFc9qjb6KxdUVKmB5ASbM7MVZryUwJEe_ZcciA Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:54.352022 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f72ee1a7e7fd454f81c41aa1e2f48d86", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 7f733bf860e84403a057417de313f3f2 Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.354317 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ed3fa6a8-c825-4e7b-89c5-3ff2ea526512'} Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:54.356048 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:01:54.360478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.364622 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Returning 404 to user: Security group ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 does not exist Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-dd8d0dd2-00e4-48b4-b8cf-90e3d0300996'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0cefdb29-0ca7-4fb1-99c6-91eb48f4640d tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/ed3fa6a8-c825-4e7b-89c5-3ff2ea526512" status: 404 len: 194 microversion: 2.1 time: 0.772835 Jul 18 13:01:54.374700 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 996/2052] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:01:53 2022] DELETE /compute/v2.1/os-security-groups/ed3fa6a8-c825-4e7b-89c5-3ff2ea526512 => generated 194 bytes in 790 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:54.377508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:54.377508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:54.415900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:54.417200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:54.418926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:54.420126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:54.794305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:54.819455 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77925c58-7db6-4b95-a167-26ad139e367f tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1499 microversion: 2.1 time: 0.448415 Jul 18 13:01:54.821575 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 997/2053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:54 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1499 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:54.843798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6858a7c-3feb-4d19-bb35-eb39bc68a034 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e42563a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:54.921831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:54.954577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:54.966777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:54.970745 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05c9ffe3-3461-419b-914a-a0e3d29ad260 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1476 microversion: 2.25 time: 0.741621 Jul 18 13:01:54.976551 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1057/2054] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:54 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1476 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:54.996764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:55.000164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:55.040938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.046614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.048659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.073460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.095682 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6858a7c-3feb-4d19-bb35-eb39bc68a034 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 200 len: 345 microversion: 2.1 time: 0.268593 Jul 18 13:01:55.097110 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 998/2055] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:54 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 345 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:55.134042 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9279dc70-c262-4708-93c2-fcc091681866 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.031850 Jul 18 13:01:55.155093 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 999/2056] 10.222.0.88 () {58 vars in 1163 bytes} [Mon Jul 18 13:01:55 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 13:01:55.187636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:55.188344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:55.238334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.238334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.239243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.239243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.386432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.389058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.389963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lazy-loading 'fault' on Instance uuid d43350aa-33a0-44ec-99e7-89b0fade9923 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:01:55.624913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f068839494e66b2eb68285ef22214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c243d4fb52461a8cee81ee9a998b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:55.636893 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04d64177-aa4e-476b-ba6f-0c240cb87969 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 200 len: 1297 microversion: 2.1 time: 0.480064 Jul 18 13:01:55.645325 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1000/2057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:55 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 1297 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:55.651748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c0fa0a-e4c3-4182-a238-a2f997d2b947", "tag": "09d2970e-4c5a-452a-a6a1-0ccc23c6b73e"}, {"server_uuid": "d43350aa-33a0-44ec-99e7-89b0fade9923", "name": "network-vif-deleted", "tag": "8160da0f-c3ce-47f4-a153-3e58212e16a8"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:55.701459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:55.707632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.708972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.729232 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e187170c-b834-4779-86ce-0038226793cf tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.742707 Jul 18 13:01:55.731204 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1058/2058] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:54 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:55.742031 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] Creating event network-changed:09d2970e-4c5a-452a-a6a1-0ccc23c6b73e for instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 on n-h2-850003-3 Jul 18 13:01:55.747560 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] Creating event network-vif-deleted:8160da0f-c3ce-47f4-a153-3e58212e16a8 for instance d43350aa-33a0-44ec-99e7-89b0fade9923 on n-h2-850003-3 Jul 18 13:01:55.757067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:55.761594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:55.763095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-63106afc-c018-4c96-90c6-5eac361647f2 req-df372b76-4247-4b5d-87e5-11af412494f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.115248 Jul 18 13:01:55.768840 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1001/2059] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:55.783995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bb6e6ab8-a4c3-4067-9f99-1ec4cd4ea03f tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Calling method '.version_select at 0x7f96e425af70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:55.819010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.827949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:55.829344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:55.830031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:56.220758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ebcc7198-f0ce-4873-9614-187cceacde6f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:01:56.238289 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bb6e6ab8-a4c3-4067-9f99-1ec4cd4ea03f tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.466694 Jul 18 13:01:56.239377 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1002/2060] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 13:01:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:56.255347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-395e2d40-9693-4375-91da-fbda4533bbda tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4a78b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:56.266491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-931a5843-987c-4d5e-af4f-31f2c3539fc6 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1969 microversion: 2.25 time: 0.533602 Jul 18 13:01:56.267760 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1059/2061] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:55 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1969 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:56.288666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:56.290525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:56.314425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:56.315095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:56.316518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:56.316980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:56.394973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-395e2d40-9693-4375-91da-fbda4533bbda tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.153914 Jul 18 13:01:56.411567 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1003/2062] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:56 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:56.427854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:56.434426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:56.451145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:56.453957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:56.460190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:56.460998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:56.789710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:56.800726 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4f2be67-0b6b-4336-8ced-469f19170c8b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.531480 Jul 18 13:01:56.804612 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1060/2063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:56 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:56.818372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1397dda7-9d43-4aed-9186-7e34b439fce1 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e9adbd30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:56.879592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1397dda7-9d43-4aed-9186-7e34b439fce1 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] HTTP exception thrown: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1397dda7-9d43-4aed-9186-7e34b439fce1 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Request method failure captured: Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 HTTP/1.1 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vmqa13ZNZVvB8tqubRND3oiJ6Dd-ANtz0pkLNjUFGh_krEpvfGqBRJDDF_NmZFOP45ms8Zj0ZDykw2m74J26Ft8WZOur4sz2bC2hahtnh97IJghvCsT-ZA9ZCwpupZv90g0rhXTr9S_Fyg-DnyY5s-hFUmTCVhBJazvO0xhnmkRWoc Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:56.886435 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6feedcb2215b456a86e015472e20c797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6feedcb2215b456a86e015472e20c797", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 214034b0c17a446b97ba555d081c4182 Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: exception: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '2fd4a0bb-2a9d-4f07-9487-33d80f4f7886'} Jul 18 13:01:56.889638 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. (HTTP 404) (Request-ID: req-b8e96864-c739-4342-87a7-92796729d772) Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:56.891650 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:56.895052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 13:01:56.897972 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1397dda7-9d43-4aed-9186-7e34b439fce1 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Returning 404 to user: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1397dda7-9d43-4aed-9186-7e34b439fce1 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 404 len: 109 microversion: 2.1 time: 0.085105 Jul 18 13:01:56.899605 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1061/2064] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:56 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:56.951006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Calling method '.version_select at 0x7f96e99e6b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:57.133187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:57.155157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:57.172599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d0ba3f32-ef65-4219-91ac-a7d0e9719d7b tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1499 microversion: 2.1 time: 0.753271 Jul 18 13:01:57.182460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1004/2065] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:56 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1499 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:57.200441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:57.205230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:57.231828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.232720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.236167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.239220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.581847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:01:57.583290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 18 13:01:57.583290 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Request method failure captured: Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-security-groups/a6bb0a5f-4655-4810-81b7-6776bbabf6b5 HTTP/1.1 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VnAuZmtacvO-pTEUkilOPEd56RfzWhqxMi8fb1YAsia8WVxPOADo-qOPB0Y1Nu-D-WYbPfdw5BJy9cgt9B1RzPtQlAb2sBc2QMz9ORch29iOWPB4jFXtfTo2z3EHPwYku5B0AoHKDFc9qjb6KxdUVKmB5ASbM7MVZryUwJEe_ZcciA Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:57.588255 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f72ee1a7e7fd454f81c41aa1e2f48d86", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 7f733bf860e84403a057417de313f3f2 Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: exception: Insufficient rights for removing default security group. Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.591696 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a6bb0a5f-4655-4810-81b7-6776bbabf6b5'} Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:57.593638 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 18 13:01:57.596720 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.599578 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-28f76dc0-aeb3-435d-a123-a7c05a8105db'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:57.607309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-767a9be6-af78-4d74-be97-c14da9cc62e3 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a6bb0a5f-4655-4810-81b7-6776bbabf6b5" status: 400 len: 182 microversion: 2.1 time: 0.693912 Jul 18 13:01:57.609931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1062/2066] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:01:56 2022] DELETE /compute/v2.1/os-security-groups/a6bb0a5f-4655-4810-81b7-6776bbabf6b5 => generated 182 bytes in 707 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:01:57.651606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:57.659008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d43350aa-33a0-44ec-99e7-89b0fade9923] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:57.682283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.683880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.691079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.691911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.768151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 HTTP/1.1 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:57.777773 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd43350aa-33a0-44ec-99e7-89b0fade9923'} Jul 18 13:01:57.780846 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:57.782587 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. Jul 18 13:01:57.785592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:57.790785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance d43350aa-33a0-44ec-99e7-89b0fade9923 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:57.790785 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fc8dc27-5d11-4d87-a8e7-0088da317a0a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923" status: 404 len: 111 microversion: 2.1 time: 0.156290 Jul 18 13:01:57.790785 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1063/2067] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:57 2022] GET /compute/v2.1/servers/d43350aa-33a0-44ec-99e7-89b0fade9923 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:57.814210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2101658916"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:57.816250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:57.839175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:57.845418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ebcc7198-f0ce-4873-9614-187cceacde6f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:01:57.846230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.849162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.850983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:57.851764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:57.923912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf5703b9-6d8a-41bf-bf1b-4e05b86e211b tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1969 microversion: 2.25 time: 0.738986 Jul 18 13:01:57.929348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1005/2068] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:01:57 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1969 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:01:57.963072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d425181-de68-42be-88bd-42fa2969b425 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e418aa60>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:58.100851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4d425181-de68-42be-88bd-42fa2969b425 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] HTTP exception thrown: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d425181-de68-42be-88bd-42fa2969b425 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Request method failure captured: Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 HTTP/1.1 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vmqa13ZNZVvB8tqubRND3oiJ6Dd-ANtz0pkLNjUFGh_krEpvfGqBRJDDF_NmZFOP45ms8Zj0ZDykw2m74J26Ft8WZOur4sz2bC2hahtnh97IJghvCsT-ZA9ZCwpupZv90g0rhXTr9S_Fyg-DnyY5s-hFUmTCVhBJazvO0xhnmkRWoc Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:58.105520 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6feedcb2215b456a86e015472e20c797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6feedcb2215b456a86e015472e20c797", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 214034b0c17a446b97ba555d081c4182 Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: exception: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2fd4a0bb-2a9d-4f07-9487-33d80f4f7886'} Jul 18 13:01:58.108573 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. (HTTP 404) (Request-ID: req-094e0ed1-d7d1-455e-844c-d03101779947) Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.110303 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:01:58.113885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 13:01:58.116767 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:58.119593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.135017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d425181-de68-42be-88bd-42fa2969b425 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Returning 404 to user: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:58.139275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4d425181-de68-42be-88bd-42fa2969b425 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 404 len: 109 microversion: 2.1 time: 0.205513 Jul 18 13:01:58.155316 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1006/2069] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:01:57 2022] DELETE /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:58.177572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffb3f30f-2747-4d06-afa9-52223c0e21b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41f6af0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:58.401453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffb3f30f-2747-4d06-afa9-52223c0e21b9 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.241822 Jul 18 13:01:58.419534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1007/2070] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:58 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:58.435862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Calling method '.version_select at 0x7f96e4eb0160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:58.653717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:01:58.655299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Neutron security group 86550523-b0b8-41fa-aa12-a46443d841b1 not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:01:58.656566 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] HTTP exception thrown: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.656566 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Request method failure captured: Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-security-groups/86550523-b0b8-41fa-aa12-a46443d841b1 HTTP/1.1 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VnAuZmtacvO-pTEUkilOPEd56RfzWhqxMi8fb1YAsia8WVxPOADo-qOPB0Y1Nu-D-WYbPfdw5BJy9cgt9B1RzPtQlAb2sBc2QMz9ORch29iOWPB4jFXtfTo2z3EHPwYku5B0AoHKDFc9qjb6KxdUVKmB5ASbM7MVZryUwJEe_ZcciA Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:58.660604 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f72ee1a7e7fd454f81c41aa1e2f48d86", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 7f733bf860e84403a057417de313f3f2 Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.664500 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '86550523-b0b8-41fa-aa12-a46443d841b1'} Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:58.667027 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:01:58.671931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.675360 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] Jul 18 13:01:58.680261 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.685030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Returning 404 to user: Security group 86550523-b0b8-41fa-aa12-a46443d841b1 does not exist Jul 18 13:01:58.685030 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-752dd884-b6a3-4f1f-91ee-b4266a828000'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:58.690297 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5be35312-1dc6-4c9e-afcb-97b479d69bad tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/86550523-b0b8-41fa-aa12-a46443d841b1" status: 404 len: 194 microversion: 2.1 time: 0.265532 Jul 18 13:01:58.701091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1008/2071] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:01:58 2022] GET /compute/v2.1/os-security-groups/86550523-b0b8-41fa-aa12-a46443d841b1 => generated 194 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:58.720350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77ba8c45-a063-4fdf-8421-84362f6ed18e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e41f6ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:58.830067 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-77ba8c45-a063-4fdf-8421-84362f6ed18e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Image not found. Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77ba8c45-a063-4fdf-8421-84362f6ed18e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b HTTP/1.1 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:58.835771 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '8348b243-d43b-4c66-b4a7-45fcf149c45b'} Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:58.839035 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8348b243-d43b-4c66-b4a7-45fcf149c45b to delete Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.840887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8348b243-d43b-4c66-b4a7-45fcf149c45b could not be found. Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:58.843478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:01:58.850850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:58.861541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77ba8c45-a063-4fdf-8421-84362f6ed18e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:58.866354 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77ba8c45-a063-4fdf-8421-84362f6ed18e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b" status: 404 len: 62 microversion: 2.1 time: 0.162568 Jul 18 13:01:58.873988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1009/2072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:58 2022] DELETE /compute/v2.1/images/8348b243-d43b-4c66-b4a7-45fcf149c45b => generated 62 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:01:58.889595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:58.892446 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:01:58.892446 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:01:58.902054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:58.909736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:58.915471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:58.916619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.058088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c271eea-4161-4432-94ce-e23cff425f57 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.180052 Jul 18 13:01:59.060427 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1010/2073] 10.222.0.88 () {60 vars in 1216 bytes} [Mon Jul 18 13:01:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:01:59.074320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c17da48-6f8f-43ba-99ae-fd2170289cb2 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Calling method '.version_select at 0x7f96e418ad30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:59.282864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8c17da48-6f8f-43ba-99ae-fd2170289cb2 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] HTTP exception thrown: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c17da48-6f8f-43ba-99ae-fd2170289cb2 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Request method failure captured: Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 HTTP/1.1 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vmqa13ZNZVvB8tqubRND3oiJ6Dd-ANtz0pkLNjUFGh_krEpvfGqBRJDDF_NmZFOP45ms8Zj0ZDykw2m74J26Ft8WZOur4sz2bC2hahtnh97IJghvCsT-ZA9ZCwpupZv90g0rhXTr9S_Fyg-DnyY5s-hFUmTCVhBJazvO0xhnmkRWoc Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:01:59.288378 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6feedcb2215b456a86e015472e20c797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6feedcb2215b456a86e015472e20c797", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6feedcb2215b456a86e015472e20c797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6feedcb2215b456a86e015472e20c797 Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-280170459 Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 214034b0c17a446b97ba555d081c4182 Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-280170459-project Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: exception: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2fd4a0bb-2a9d-4f07-9487-33d80f4f7886'} Jul 18 13:01:59.291772 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. (HTTP 404) (Request-ID: req-6ca0313f-4543-4851-b077-d9e02cd76732) Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.293765 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:01:59.297334 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 13:01:59.304130 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.306930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c17da48-6f8f-43ba-99ae-fd2170289cb2 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] Returning 404 to user: Volume 2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:59.313651 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c17da48-6f8f-43ba-99ae-fd2170289cb2 tempest-VolumesSnapshotsTestJSON-280170459 tempest-VolumesSnapshotsTestJSON-280170459-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886" status: 404 len: 109 microversion: 2.1 time: 0.250634 Jul 18 13:01:59.317877 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1011/2074] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:01:59 2022] GET /compute/v2.1/os-volumes/2fd4a0bb-2a9d-4f07-9487-33d80f4f7886 => generated 109 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:59.340085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:59.341563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:59.378600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.380955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.385608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.386806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.438551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9718e8d-ce3c-439e-83f9-3b6a01a53d28 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action" status: 202 len: 0 microversion: 2.1 time: 1.644233 Jul 18 13:01:59.445820 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1064/2075] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:01:57 2022] POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action => generated 0 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:01:59.505851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d7d0eb06-bf77-43b5-a73d-b5d551796ef3 req-62259b52-2bb5-4d28-98ba-6331fc307cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72844d7c-a36e-417d-ab3e-a2e92819dc0f", "name": "network-vif-deleted", "tag": "f43b6a1e-07db-47c7-8be6-9d8828bfa8b6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:59.560656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d7d0eb06-bf77-43b5-a73d-b5d551796ef3 req-62259b52-2bb5-4d28-98ba-6331fc307cbb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.562509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d7d0eb06-bf77-43b5-a73d-b5d551796ef3 req-62259b52-2bb5-4d28-98ba-6331fc307cbb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.569083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.574779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.576662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lazy-loading 'fault' on Instance uuid 72844d7c-a36e-417d-ab3e-a2e92819dc0f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:01:59.637602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:01:59.678933 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d7d0eb06-bf77-43b5-a73d-b5d551796ef3 req-62259b52-2bb5-4d28-98ba-6331fc307cbb service nova] Creating event network-vif-deleted:f43b6a1e-07db-47c7-8be6-9d8828bfa8b6 for instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f on n-h2-850003-3 Jul 18 13:01:59.697264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d7d0eb06-bf77-43b5-a73d-b5d551796ef3 req-62259b52-2bb5-4d28-98ba-6331fc307cbb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243488 Jul 18 13:01:59.701743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1065/2076] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:01:59.723502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Action: 'update', calling method: .version_select at 0x7f96e9a72b80>, body: {"security_group": {"name": "tempest-sg-1396616717", "description": "tempest-description-1926076489"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:59.809691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:01:59.811370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Neutron security group 7129fe7f-1391-4adf-a05b-918d3e5216bb not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:01:59.812645 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] HTTP exception thrown: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.812645 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Request method failure captured: Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/os-security-groups/7129fe7f-1391-4adf-a05b-918d3e5216bb HTTP/1.1 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 102 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VnAuZmtacvO-pTEUkilOPEd56RfzWhqxMi8fb1YAsia8WVxPOADo-qOPB0Y1Nu-D-WYbPfdw5BJy9cgt9B1RzPtQlAb2sBc2QMz9ORch29iOWPB4jFXtfTo2z3EHPwYku5B0AoHKDFc9qjb6KxdUVKmB5ASbM7MVZryUwJEe_ZcciA Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:59.817712 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f72ee1a7e7fd454f81c41aa1e2f48d86", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f72ee1a7e7fd454f81c41aa1e2f48d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f72ee1a7e7fd454f81c41aa1e2f48d86 Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161 Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 7f733bf860e84403a057417de313f3f2 Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1011733161-project Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: {"security_group": {"name": "tempest-sg-1396616717", "description": "tempest-description-1926076489"}} Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:01:59.821816 n-d-850003-3 devstack@n-api.service[131366]: exception: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '7129fe7f-1391-4adf-a05b-918d3e5216bb', 'body': {'security_group': {'name': 'tempest-sg-1396616717', 'description': 'tempest-description-1926076489'}}} Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:01:59.824019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 13:01:59.826798 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.829833 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] Jul 18 13:01:59.838359 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.840117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cdfc77cf92451c84c873df41bc422f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eacb137f6294164bc2bbb101ecc94f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:01:59.840324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] Returning 404 to user: Security group 7129fe7f-1391-4adf-a05b-918d3e5216bb does not exist Jul 18 13:01:59.840324 n-d-850003-3 devstack@n-api.service[131366]: Neutron server returns request_ids: ['req-5c2308fe-3d15-4703-8e40-2a2e7eb12c86'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:59.840324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aebfe4cf-e498-4451-8f98-28464d57a878 tempest-SecurityGroupsNegativeTestJSON-1011733161 tempest-SecurityGroupsNegativeTestJSON-1011733161-project] 10.222.0.88 "PUT /compute/v2.1/os-security-groups/7129fe7f-1391-4adf-a05b-918d3e5216bb" status: 404 len: 194 microversion: 2.1 time: 0.129115 Jul 18 13:01:59.855348 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1066/2077] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Jul 18 13:01:59 2022] PUT /compute/v2.1/os-security-groups/7129fe7f-1391-4adf-a05b-918d3e5216bb => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:59.868873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:01:59.870403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:59.887253 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd64c942-f8e3-4bac-ac9e-aa8a3df9309d tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 200 len: 1300 microversion: 2.1 time: 0.563738 Jul 18 13:01:59.892478 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1012/2078] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:01:59 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 1300 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:01:59.894587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.895649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.897293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:01:59.898289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:01:59.934761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850003-3", "block_migration": "auto"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:01:59.939364 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:01:59.941227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 HTTP/1.1 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:01:59.946765 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:01:59.949690 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3b66612e-bc27-4d8f-8206-787755b13cd6'} Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:01:59.951407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:01:59.954633 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:01:59.964270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:01:59.979363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59e5b128-0a9f-4b13-ac70-1b9415f5e5cc tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 404 len: 111 microversion: 2.1 time: 0.112053 Jul 18 13:01:59.982531 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1067/2079] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:01:59 2022] DELETE /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:01:59.993506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e755f1a-20f6-4aad-834a-c03cc249002e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4584c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:00.004931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.027890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.029638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.030594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.202351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e755f1a-20f6-4aad-834a-c03cc249002e tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.212425 Jul 18 13:02:00.210245 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1068/2080] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:01:59 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:00.227295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1302194268"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:00.228932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:00.278490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.279224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.291510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.292197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.393364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'flavor' on Instance uuid ebcc7198-f0ce-4873-9614-187cceacde6f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:02:00.439867 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Cannot 'createImage' instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc while it is in task_state image_snapshot Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action HTTP/1.1 Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 85 Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:00.448060 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1302194268"}} Jul 18 13:02:00.451019 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'createImage' instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc while it is in task_state image_snapshot Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1302194268'}}} Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:00.452631 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc while it is in task_state image_snapshot Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc while it is in task_state image_snapshot Jul 18 13:02:00.455201 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.459402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 409 to user: Cannot 'createImage' instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc while it is in task_state image_snapshot {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:00.461115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98b82d2c-846e-40c1-a84d-c6ce551951b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action" status: 409 len: 159 microversion: 2.1 time: 0.252692 Jul 18 13:02:00.462868 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1069/2081] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:02:00 2022] POST /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc/action => generated 159 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:02:00.470828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:00.472227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 3b66612e-bc27-4d8f-8206-787755b13cd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:00.483198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.484343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.485903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:00.486882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:00.537697 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:02:00.538529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Going to try to live migrate instance to n-h2-850003-3 {{(pid=131367) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 HTTP/1.1 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:00.540493 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3b66612e-bc27-4d8f-8206-787755b13cd6'} Jul 18 13:02:00.543518 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:00.546592 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. Jul 18 13:02:00.549414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:00.551833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance 3b66612e-bc27-4d8f-8206-787755b13cd6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:00.551833 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f944b9d-afa8-41d9-84e0-c09b1416910e tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6" status: 404 len: 111 microversion: 2.1 time: 0.078122 Jul 18 13:02:00.552706 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1070/2082] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:00 2022] GET /compute/v2.1/servers/3b66612e-bc27-4d8f-8206-787755b13cd6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:00.588956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-357e0a0f-bfa6-4e28-8bc2-ecdb9b9ab8f2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e9a650d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:01.057186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-357e0a0f-bfa6-4e28-8bc2-ecdb9b9ab8f2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/images/8fcb5e3e-2b9e-4408-9dfa-08885d1416e1" status: 204 len: 0 microversion: 2.1 time: 0.502281 Jul 18 13:02:01.058086 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1071/2083] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:00 2022] DELETE /compute/v2.1/images/8fcb5e3e-2b9e-4408-9dfa-08885d1416e1 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:01.081963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b25dc50b-8a82-440b-ac28-ed1a7836e7e1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e99e6ee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:01.235953 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b25dc50b-8a82-440b-ac28-ed1a7836e7e1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Image not found. Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b25dc50b-8a82-440b-ac28-ed1a7836e7e1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c HTTP/1.1 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:01.241073 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e54bab93-fde0-4463-b43f-908e1aed1d9c'} Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:01.244516 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e54bab93-fde0-4463-b43f-908e1aed1d9c to delete Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.246945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e54bab93-fde0-4463-b43f-908e1aed1d9c could not be found. Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:01.251532 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b25dc50b-8a82-440b-ac28-ed1a7836e7e1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b25dc50b-8a82-440b-ac28-ed1a7836e7e1 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c" status: 404 len: 62 microversion: 2.1 time: 0.184031 Jul 18 13:02:01.256968 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1072/2084] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:01 2022] DELETE /compute/v2.1/images/e54bab93-fde0-4463-b43f-908e1aed1d9c => generated 62 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:02:01.315006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:01.317241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] [instance: 72844d7c-a36e-417d-ab3e-a2e92819dc0f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:01.393196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:01.393933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:01.447777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:01.450916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:01.560933 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] HTTP exception thrown: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Request method failure captured: Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f HTTP/1.1 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VcVCSgTKGZSdrA3DKXi-MZwcSWe3klEzpe3E4LWW_QrU19hMyPnr5TijzXuDsMMxrS0Fwpv8tBpZJowShYTBVGQpNw8rGSmKQGuR-erMtChjvk5MXa5dfXpGY5wOGPDViwB0S-xl95z8ZdRqCw7ivdMD3dC8hm7KpHUNb9tIN1b1vg Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:01.576312 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0eacb137f6294164bc2bbb101ecc94f8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0eacb137f6294164bc2bbb101ecc94f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-LiveMigrationTest-1302780380 Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0eacb137f6294164bc2bbb101ecc94f8 Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-LiveMigrationTest-1302780380 Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-LiveMigrationTest-1302780380-project Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 64cdfc77cf92451c84c873df41bc422f Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-LiveMigrationTest-1302780380-project Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. Jul 18 13:02:01.579398 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '72844d7c-a36e-417d-ab3e-a2e92819dc0f'} Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:01.582278 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. Jul 18 13:02:01.585364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:01.588196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] Returning 404 to user: Instance 72844d7c-a36e-417d-ab3e-a2e92819dc0f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:01.588196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6bd46bb0-178e-4aba-8549-d691a3e4030e tempest-LiveMigrationTest-1302780380 tempest-LiveMigrationTest-1302780380-project] 10.222.0.88 "GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f" status: 404 len: 111 microversion: 2.1 time: 0.332152 Jul 18 13:02:01.588196 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1073/2085] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:01 2022] GET /compute/v2.1/servers/72844d7c-a36e-417d-ab3e-a2e92819dc0f => generated 111 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:01.620109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:01.622626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:01.651193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:01.654835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:01.656634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:01.660449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.374059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:03.388886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53c4c4ab-c0e7-4d22-84b0-eec9960b0036 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1534 microversion: 2.1 time: 1.799813 Jul 18 13:02:03.393857 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1074/2086] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:01 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1534 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:03.414216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb4c000f-476c-4c63-ae90-5deadbae7f87 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9a65ee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:03.562580 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb4c000f-476c-4c63-ae90-5deadbae7f87 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.152154 Jul 18 13:02:03.581362 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1075/2087] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:03 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:03.608948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:03.610746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:03.626972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.628272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.631759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.632788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.677307 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 HTTP/1.1 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:03.686422 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.691039 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd3fcd071-1dd1-4d0e-bffe-c972f29f5849'} Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:03.692928 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.696660 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.701471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:03.703772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61e0bc75-f32f-4444-8c65-606cde94bdd2 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 404 len: 111 microversion: 2.1 time: 0.119578 Jul 18 13:02:03.705427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1076/2088] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:02:03 2022] DELETE /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:03.721698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:03.724078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: d3fcd071-1dd1-4d0e-bffe-c972f29f5849] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:03.739847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.741368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.743243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.744697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.833196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 HTTP/1.1 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:03.837433 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd3fcd071-1dd1-4d0e-bffe-c972f29f5849'} Jul 18 13:02:03.839865 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:03.841227 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. Jul 18 13:02:03.842804 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.846436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance d3fcd071-1dd1-4d0e-bffe-c972f29f5849 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:03.847603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8374431d-63e5-45bf-9bb5-1ad3c2ede742 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849" status: 404 len: 111 microversion: 2.1 time: 0.134571 Jul 18 13:02:03.848670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1077/2089] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:03 2022] GET /compute/v2.1/servers/d3fcd071-1dd1-4d0e-bffe-c972f29f5849 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:03.859322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ef897cc-c230-47a3-a006-f1c06937f5b7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '.version_select at 0x7f96e4323940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:03.908935 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7ef897cc-c230-47a3-a006-f1c06937f5b7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Image not found. Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ef897cc-c230-47a3-a006-f1c06937f5b7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb HTTP/1.1 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:03.911770 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb'} Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:03.913490 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb to delete Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.914607 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb could not be found. Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:03.915985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:02:03.917498 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:03.934965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ef897cc-c230-47a3-a006-f1c06937f5b7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:03.937203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ef897cc-c230-47a3-a006-f1c06937f5b7 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb" status: 404 len: 62 microversion: 2.1 time: 0.082234 Jul 18 13:02:03.939465 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1078/2090] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:03 2022] DELETE /compute/v2.1/images/9d4b9704-6dca-49fb-a52b-4cab5b8d6bcb => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:02:03.968182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:03.971964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:03.994291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.995830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:03.997838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:03.999325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.031050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d HTTP/1.1 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:04.038537 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.041597 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4ec16fe0-4afc-4b20-a744-862055abbf0d'} Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:04.043361 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.045653 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.052539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:04.054473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eba812ba-5674-43b9-8c03-41af9412358a tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 404 len: 111 microversion: 2.1 time: 0.106559 Jul 18 13:02:04.055694 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1079/2091] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:02:03 2022] DELETE /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:04.070357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:04.072474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] [instance: 4ec16fe0-4afc-4b20-a744-862055abbf0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:04.082243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.083306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.084613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.085327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.104561 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] HTTP exception thrown: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Request method failure captured: Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d HTTP/1.1 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VhZVUyd-p4aKqROJcxBZIuXU961S2zEJow5tRhEfcH5V4vrqYNgkRSrKySsoLoT8pUjBXoLESFgpqTgrOcynbEvERFmls0oFbSOi2bE7cxkeLSEZnW2X5LO4dH_oPushj90KY_rclHeL6ObNOikkyE6mTrY8e9opInqh-GoZn5tzuA Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:04.106651 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_53c243d4fb52461a8cee81ee9a998b34", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/53c243d4fb52461a8cee81ee9a998b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 53c243d4fb52461a8cee81ee9a998b34 Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesTestJSON-1727392200 Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 719f068839494e66b2eb68285ef22214 Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesTestJSON-1727392200-project Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4ec16fe0-4afc-4b20-a744-862055abbf0d'} Jul 18 13:02:04.108417 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:04.109350 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. Jul 18 13:02:04.110946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:04.114839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] Returning 404 to user: Instance 4ec16fe0-4afc-4b20-a744-862055abbf0d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:04.116631 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4b92274-2baf-4903-9b5d-6cbe5a8793b4 tempest-ImagesTestJSON-1727392200 tempest-ImagesTestJSON-1727392200-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d" status: 404 len: 111 microversion: 2.1 time: 0.051601 Jul 18 13:02:04.117997 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1080/2092] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:04 2022] GET /compute/v2.1/servers/4ec16fe0-4afc-4b20-a744-862055abbf0d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:04.415398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:04.416712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:04.439634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.441982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.447312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.448233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.643353 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4528bfee-9098-401c-9161-1f0480906163 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f/action" status: 202 len: 0 microversion: 2.25 time: 4.749138 Jul 18 13:02:04.645086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1013/2093] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:01:59 2022] POST /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f/action => generated 0 bytes in 4752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:04.651285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a439201f-44e9-4a7e-bc5c-da1cc5de42a3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4566d30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:04.795896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a439201f-44e9-4a7e-bc5c-da1cc5de42a3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.149077 Jul 18 13:02:04.809775 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1014/2094] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:04 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:04.815897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:04.826229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:04.857173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.867129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:04.868274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:04.869039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:05.454557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:05.465461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:05.476309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:05.478393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f58e6f9-158d-4202-b71f-efc514213896 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.666991 Jul 18 13:02:05.479703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1015/2095] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:04 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:05.573830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:05.632728 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cf8b373-0b43-42fe-8b9c-b25de3014ca7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1540 microversion: 2.1 time: 1.205792 Jul 18 13:02:05.633993 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1081/2096] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:04 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1540 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:05.820073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e27e6a44-1df5-42bf-9051-874ac0e45d0a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41de4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:06.030969 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e27e6a44-1df5-42bf-9051-874ac0e45d0a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.220268 Jul 18 13:02:06.033548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1016/2097] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:05 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:06.518565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:06.519859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:06.541471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:06.547137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:06.550524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:06.557264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:06.675041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:06.676991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:06.722418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:06.723600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:06.725276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:06.726191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:07.721864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:07.762879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:07.765787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:07.776015 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7f17dae-6456-42b0-bf92-ae45205d2bc8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.263063 Jul 18 13:02:07.781443 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1082/2098] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:06 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:07.787394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94a8b40e-6c23-47e5-a197-1796bd4a7bbd tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9adb040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:07.831815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:07.844161 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f2c61b5-df57-4763-ab48-45a971ba18bd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1540 microversion: 2.1 time: 1.192606 Jul 18 13:02:07.864254 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1017/2099] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:06 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1540 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:07.880676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5472396a-401b-4393-8246-bf830a96e27a req-63989977-cc70-4ef0-bf49-34ad40155bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc", "name": "network-vif-plugged", "status": "completed", "tag": "18f989ef-679f-402c-84aa-df7abc920e5e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:07.901547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5472396a-401b-4393-8246-bf830a96e27a req-63989977-cc70-4ef0-bf49-34ad40155bb8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:07.904968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5472396a-401b-4393-8246-bf830a96e27a req-63989977-cc70-4ef0-bf49-34ad40155bb8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:07.960555 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5472396a-401b-4393-8246-bf830a96e27a req-63989977-cc70-4ef0-bf49-34ad40155bb8 service nova] Creating event network-vif-plugged:18f989ef-679f-402c-84aa-df7abc920e5e for instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc on n-h1-850003-3 Jul 18 13:02:07.995054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94a8b40e-6c23-47e5-a197-1796bd4a7bbd tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.203719 Jul 18 13:02:07.996060 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1083/2100] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:07 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:08.004141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5472396a-401b-4393-8246-bf830a96e27a req-63989977-cc70-4ef0-bf49-34ad40155bb8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135271 Jul 18 13:02:08.011391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1018/2101] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:08.802083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:08.802945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:08.826092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:08.826831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:08.828922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:08.830042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:08.876574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:08.882752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:08.917452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:08.925919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:08.930403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:08.931573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:09.012366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:09.389927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:09.407301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:09.411932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:09.415157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d29a7023-4201-4d82-867b-9fce05b5962f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.619173 Jul 18 13:02:09.417896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1084/2102] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:08 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:09.428362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f02ee0d-0d7a-46b2-802d-0f3508b4bab5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4f75af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:09.573262 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f02ee0d-0d7a-46b2-802d-0f3508b4bab5 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.151907 Jul 18 13:02:09.585919 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1085/2103] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:09 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:10.394890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:10.432096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f638329-3e22-4acd-85b9-16096dfc8e3e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1535 microversion: 2.1 time: 1.570272 Jul 18 13:02:10.446957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1019/2104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:08 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1535 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:10.471653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:10.477741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:10.548404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:10.549003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:10.550826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:10.562481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:10.594577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c59845bd-448d-4880-96cc-f7ff8495c17a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41944c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:10.697086 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c59845bd-448d-4880-96cc-f7ff8495c17a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.107299 Jul 18 13:02:10.697477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1020/2105] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:10 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:11.451248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:11.452440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:11.463297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:11.470092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:11.486080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:11.490872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:11.493965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:11.494617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:11.508410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:11.510729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ab08ca0-bc7b-4d50-a397-c4f1c8dbcc01 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.044198 Jul 18 13:02:11.524059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1086/2106] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:10 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:11.711968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-017757cd-d1f5-4e64-9af0-a40f44434eeb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e45ef8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:11.807907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-017757cd-d1f5-4e64-9af0-a40f44434eeb tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.100626 Jul 18 13:02:11.809014 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1087/2107] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:11 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:12.234201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:12.271697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-525b16df-d669-4c8d-bb78-0a5b9e63a5a8 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1522 microversion: 2.1 time: 0.824252 Jul 18 13:02:12.290283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1021/2108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:11 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:12.313040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:12.314325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:12.359859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:12.361313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:12.371989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:12.373148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:12.548978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:12.550978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:12.564003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:02:12.575449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:12.582418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:12.584065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:12.587710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:13.045942 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8914a94-c950-4b7a-a358-83821b49f22c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 204 len: 0 microversion: 2.1 time: 0.739851 Jul 18 13:02:13.059171 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1088/2109] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:02:12 2022] DELETE /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:13.071566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2da81bbd-3db6-416d-b117-af9b4dc0a179 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e9a0d700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:13.338668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2da81bbd-3db6-416d-b117-af9b4dc0a179 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1428 microversion: 2.1 time: 0.277699 Jul 18 13:02:13.342491 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1089/2110] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:13 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1428 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:13.378087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:13.391935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:13.430705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:13.432091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:13.435185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:13.441607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:14.145936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:14.160511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:14.162089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:14.196936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5beb448c-bad2-4e6a-8ead-8bb6d8c5bc39 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.646251 Jul 18 13:02:14.197584 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1022/2111] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:12 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:14.223009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9e54b829-9ff1-4de2-a968-86a44d89d0f2 req-b6fcb572-f572-4e98-96b7-f9d6099e9dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc", "name": "network-vif-unplugged", "status": "completed", "tag": "18f989ef-679f-402c-84aa-df7abc920e5e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:14.282109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:14.293156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9e54b829-9ff1-4de2-a968-86a44d89d0f2 req-b6fcb572-f572-4e98-96b7-f9d6099e9dc8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:14.294603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9e54b829-9ff1-4de2-a968-86a44d89d0f2 req-b6fcb572-f572-4e98-96b7-f9d6099e9dc8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:14.458876 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9e54b829-9ff1-4de2-a968-86a44d89d0f2 req-b6fcb572-f572-4e98-96b7-f9d6099e9dc8 service nova] Creating event network-vif-unplugged:18f989ef-679f-402c-84aa-df7abc920e5e for instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc on n-h1-850003-3 Jul 18 13:02:14.519337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9e54b829-9ff1-4de2-a968-86a44d89d0f2 req-b6fcb572-f572-4e98-96b7-f9d6099e9dc8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.309714 Jul 18 13:02:14.524302 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1023/2112] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:14.618670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd6cb613-2b8d-42b0-acbd-8ad0dfb5c100 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41b59d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:14.825608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd6cb613-2b8d-42b0-acbd-8ad0dfb5c100 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1437 microversion: 2.1 time: 0.281177 Jul 18 13:02:14.827260 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1024/2113] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:14 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1437 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:14.867929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2b12800-73b9-49e1-873b-8917c9dcb34a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41b4310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:15.176831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2b12800-73b9-49e1-873b-8917c9dcb34a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 200 len: 1437 microversion: 2.1 time: 0.328221 Jul 18 13:02:15.178875 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1025/2114] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:14 2022] GET /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 1437 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:15.203815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:15.214790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:15.259865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:15.263639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:15.265385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:15.270005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:15.886581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:15.919852 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d360be91-54b6-4013-af82-e6d45630eeb6 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1528 microversion: 2.1 time: 2.575389 Jul 18 13:02:15.931900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1090/2115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:13 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1528 bytes in 2578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:15.939823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:15.941209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:15.994612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:15.995648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:16.005129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:16.008452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:17.000044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:17.014350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b4ae2ff-eb69-44f8-9d6e-c50ea91c51ae tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1478 microversion: 2.1 time: 1.818994 Jul 18 13:02:17.028748 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1026/2116] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:15 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1478 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:17.038173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:17.039218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:17.050268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:17.051213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:17.053702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:17.054833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:17.676499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:17.719808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6a33b94-a4e6-4709-ba72-b61bf7da2324 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1528 microversion: 2.1 time: 0.689070 Jul 18 13:02:17.721408 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1027/2117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:17 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1528 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:17.975550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:18.012815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:18.020253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:18.024287 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eaf05229-71fb-425d-b7bd-73b13caf6a6d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 2.094107 Jul 18 13:02:18.042030 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1091/2118] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:15 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:18.051173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:18.055185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:18.099199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.102949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-70db838f-63dd-47cf-b11f-f4fd429b4309 req-edece4c2-00b1-41d4-9f0b-5144ca3adb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc", "name": "network-vif-deleted", "tag": "18f989ef-679f-402c-84aa-df7abc920e5e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:18.109270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.116730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.120068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-70db838f-63dd-47cf-b11f-f4fd429b4309 req-edece4c2-00b1-41d4-9f0b-5144ca3adb16 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.122117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-70db838f-63dd-47cf-b11f-f4fd429b4309 req-edece4c2-00b1-41d4-9f0b-5144ca3adb16 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.131328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.153581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-70db838f-63dd-47cf-b11f-f4fd429b4309 req-edece4c2-00b1-41d4-9f0b-5144ca3adb16 service nova] Creating event network-vif-deleted:18f989ef-679f-402c-84aa-df7abc920e5e for instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc on n-h1-850003-3 Jul 18 13:02:18.163107 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-70db838f-63dd-47cf-b11f-f4fd429b4309 req-edece4c2-00b1-41d4-9f0b-5144ca3adb16 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065348 Jul 18 13:02:18.165331 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1092/2119] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:02:18.750911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:18.752743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:18.805825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.806841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.808369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.812106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.853032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:18.879515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79db839f-3aba-4d39-a772-1e5f8659b0e3 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1465 microversion: 2.1 time: 0.842437 Jul 18 13:02:18.920357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:18.921105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:18.921968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lazy-loading 'fault' on Instance uuid 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:02:18.922625 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1028/2120] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:18 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1465 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:18.976413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7661d905-c6da-4860-8873-4f4142a12624 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e41b49d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:19.107071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:19.153466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bf75bd96-820a-44c9-9fba-d98ddba17c32 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 200 len: 1315 microversion: 2.1 time: 0.415857 Jul 18 13:02:19.166228 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1093/2121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:18 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:19.177881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:19.179743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:19.188958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:19.189779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:19.191181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:19.192436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.263699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:20.312583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:20.325911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:20.327054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8bcfaa4-5477-45bf-98bc-2d9e77f98017 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.158900 Jul 18 13:02:20.327632 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1094/2122] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:19 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:20.349741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6a7b1f47-93e9-4e9d-a001-4ce08a2efbd4 req-1e9696e2-d502-4020-a671-652d4ec573e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-unplugged", "status": "completed", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:20.394238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6a7b1f47-93e9-4e9d-a001-4ce08a2efbd4 req-1e9696e2-d502-4020-a671-652d4ec573e3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:20.395028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6a7b1f47-93e9-4e9d-a001-4ce08a2efbd4 req-1e9696e2-d502-4020-a671-652d4ec573e3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.479589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6a7b1f47-93e9-4e9d-a001-4ce08a2efbd4 req-1e9696e2-d502-4020-a671-652d4ec573e3 service nova] Creating event network-vif-unplugged:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:02:20.505823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6a7b1f47-93e9-4e9d-a001-4ce08a2efbd4 req-1e9696e2-d502-4020-a671-652d4ec573e3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171892 Jul 18 13:02:20.521931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1095/2123] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:20.529408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:20.556054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:20.585597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:20.591486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.594916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:20.603321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.631504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7661d905-c6da-4860-8873-4f4142a12624 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "DELETE /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51" status: 204 len: 0 microversion: 2.1 time: 1.688290 Jul 18 13:02:20.645109 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1029/2124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:18 2022] DELETE /compute/v2.1/images/3c384afb-0a26-482a-a696-63761d95dc51 => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:20.708357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-441224f0-2241-4591-89a7-b54393a8c13f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '.version_select at 0x7f96e4194310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:20.714010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc HTTP/1.1 Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:20.727087 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:02:20.729614 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc'} Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:20.731088 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:02:20.733527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.735578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:20.735578 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5d3b4cb-e248-4d5e-b8b0-de44aa5bc03f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 404 len: 111 microversion: 2.1 time: 0.213291 Jul 18 13:02:20.749805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1096/2125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:20 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:20.779855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a25e1bc1-26ed-45f4-9b87-699b6e03cc6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'create', calling method: .version_select at 0x7f96e9a65700>, body: {"keypair": {"name": "tempest-keypair-1213097824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz8dBBz7WlMOMPSXD/xT+1QbUxilbm2/CX4BWRGECjNKs9KQ6i1u4aNEsn0iM6o8uJ4q8xNv7mPLogXGEhKulFSdClkvPwp7RncBWiTv8UW5r+XEYKwbT4GzujiYvKNfg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:20.796159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-441224f0-2241-4591-89a7-b54393a8c13f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] HTTP exception thrown: Image not found. Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-441224f0-2241-4591-89a7-b54393a8c13f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Request method failure captured: Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 HTTP/1.1 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VlDmJ_XqBxEHMvxJjN7uZDBX2u0lruzRp2aAzCQQzaaHuy7EnVrU2CEIlWMip6xInaxUbWAr-q5xlSJRxD5JNlqpLGjNKYrYzmuwrwkvmRgF5jUc3w_ZiN-PxJXfXHPVXetYD56lMeYKnG7mkKbEVEGe5FEg6a7mzC_2-BKFh9QwYw Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:02:20.798858 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8282e6fd6e2a45a880e3d72dcb544540", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4a84d146f9454e538b97cf7f6d247885 Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'dd67902d-a2be-47da-bb1b-a801d5caf7f4'} Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:20.800175 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dd67902d-a2be-47da-bb1b-a801d5caf7f4 to delete Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.800958 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd67902d-a2be-47da-bb1b-a801d5caf7f4 could not be found. Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:20.802228 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-441224f0-2241-4591-89a7-b54393a8c13f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:20.803877 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-441224f0-2241-4591-89a7-b54393a8c13f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "DELETE /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4" status: 404 len: 62 microversion: 2.1 time: 0.151611 Jul 18 13:02:20.807208 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1030/2126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:20 2022] DELETE /compute/v2.1/images/dd67902d-a2be-47da-bb1b-a801d5caf7f4 => generated 62 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:02:20.835117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:20.835690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:20.866321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:20.866989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.872920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:20.878598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:20.886011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a25e1bc1-26ed-45f4-9b87-699b6e03cc6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for project dfdcb708fc204399bd4aacbced94348d. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:02:20.910375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a25e1bc1-26ed-45f4-9b87-699b6e03cc6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for user 28072006ff234c14a8121c280adae603 and project dfdcb708fc204399bd4aacbced94348d. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:02:21.031140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:02:21.032933 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a25e1bc1-26ed-45f4-9b87-699b6e03cc6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.280919 Jul 18 13:02:21.044723 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1097/2127] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:02:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:21.276070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:21.379211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:21.380588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:21.429570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:21.430596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:21.432172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:21.432975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:21.433215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-95e7983d-dea7-47dc-bd37-0d6eb382faf8 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "DELETE /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 204 len: 0 microversion: 2.1 time: 0.623278 Jul 18 13:02:21.436427 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1031/2128] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:02:20 2022] DELETE /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:21.450061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:21.451849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:21.466012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:21.467323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:21.468742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:21.469938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:21.484754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:22.116106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:22.144668 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-28f0595a-db4b-4bab-8137-05b2fec67be7 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1471 microversion: 2.1 time: 0.700070 Jul 18 13:02:22.147048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1032/2129] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:21 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1471 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:22.253411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:22.305413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:22.309191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:22.314491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4fef1575-aaee-4b6e-a76b-b40e47de9255 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.949786 Jul 18 13:02:22.315948 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1098/2130] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:21 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:23.177551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:23.178600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:23.199681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:23.200184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:23.201117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:23.201559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:23.348319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:23.348976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:23.364155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:23.367408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:23.370831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:23.372105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:23.972481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:24.008294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:24.022097 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-abd52edb-fe59-4f39-a078-46f721c1275a tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1471 microversion: 2.1 time: 0.847059 Jul 18 13:02:24.029336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1033/2131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:23 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1471 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:24.037919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:24.042225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:24.046825 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f7d0f1d-ba17-45a3-97ef-3e163c0cfa06 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.700861 Jul 18 13:02:24.048765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1099/2132] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:23 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:02:25.103337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:25.104703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:25.107263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:25.107840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:25.154634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:25.155248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:25.157700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:25.158200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:25.163821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:25.166846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:25.167989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:25.170291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:25.873676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:25.917050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e97f54e-b996-4198-b790-4c9bf070d26f tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1471 microversion: 2.1 time: 0.836446 Jul 18 13:02:25.922396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1100/2133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:25 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1471 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:26.308018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:26.333272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:26.346469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:26.349476 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-579cee61-aae5-4eba-b3e5-951201f0a613 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.270643 Jul 18 13:02:26.350667 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1034/2134] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:25 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:26.579879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5fe6f87b-44b7-4ffa-a835-982d9fb74df7 req-85c0100d-c427-4083-81a1-a0b24a60a3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918183c0-1c36-4fc3-8276-3d5b349dc98f", "name": "network-vif-deleted", "tag": "8653162d-f513-4452-b75b-f63d6e2dbcdb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:26.616501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5fe6f87b-44b7-4ffa-a835-982d9fb74df7 req-85c0100d-c427-4083-81a1-a0b24a60a3c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:26.626442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5fe6f87b-44b7-4ffa-a835-982d9fb74df7 req-85c0100d-c427-4083-81a1-a0b24a60a3c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:26.655347 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5fe6f87b-44b7-4ffa-a835-982d9fb74df7 req-85c0100d-c427-4083-81a1-a0b24a60a3c6 service nova] Creating event network-vif-deleted:8653162d-f513-4452-b75b-f63d6e2dbcdb for instance 918183c0-1c36-4fc3-8276-3d5b349dc98f on n-h1-850003-3 Jul 18 13:02:26.663413 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5fe6f87b-44b7-4ffa-a835-982d9fb74df7 req-85c0100d-c427-4083-81a1-a0b24a60a3c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099543 Jul 18 13:02:26.664623 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1101/2135] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:26.954095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:26.960182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:27.013220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:27.013803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:27.016969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:27.017494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:27.213707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:27.214542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:27.218758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lazy-loading 'fault' on Instance uuid 918183c0-1c36-4fc3-8276-3d5b349dc98f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:02:27.375693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84d146f9454e538b97cf7f6d247885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8282e6fd6e2a45a880e3d72dcb544540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:27.396207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:27.401918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:27.406885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f24f2c64-503f-47db-9986-f562cb9ee007 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 200 len: 1306 microversion: 2.1 time: 0.457401 Jul 18 13:02:27.408547 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1035/2136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:26 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 1306 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:27.436544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:27.441296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:27.442227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:27.447056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:27.504824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-235431729", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:27.721368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] validate_networks() for [('290d2741-2682-43c6-ac6f-47b8f2bbf745', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:02:28.080525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:28.170855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:28.183527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:28.186381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9a654bb-0a08-4b8f-8e90-6b7d26a5296d tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.807695 Jul 18 13:02:28.212322 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1102/2137] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:27 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:28.448969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:28.450194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] [instance: 918183c0-1c36-4fc3-8276-3d5b349dc98f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:28.460356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:28.490541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:28.491281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:28.494270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:28.496251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:28.552861 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] HTTP exception thrown: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Request method failure captured: Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f HTTP/1.1 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VlDmJ_XqBxEHMvxJjN7uZDBX2u0lruzRp2aAzCQQzaaHuy7EnVrU2CEIlWMip6xInaxUbWAr-q5xlSJRxD5JNlqpLGjNKYrYzmuwrwkvmRgF5jUc3w_ZiN-PxJXfXHPVXetYD56lMeYKnG7mkKbEVEGe5FEg6a7mzC_2-BKFh9QwYw Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:28.556095 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8282e6fd6e2a45a880e3d72dcb544540", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8282e6fd6e2a45a880e3d72dcb544540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 8282e6fd6e2a45a880e3d72dcb544540 Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2118092198 Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4a84d146f9454e538b97cf7f6d247885 Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerTestJSON-2118092198-project Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. Jul 18 13:02:28.557440 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '918183c0-1c36-4fc3-8276-3d5b349dc98f'} Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:28.558472 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. Jul 18 13:02:28.559568 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:28.564544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] Returning 404 to user: Instance 918183c0-1c36-4fc3-8276-3d5b349dc98f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:28.567050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb10424c-978f-4598-bf2d-5729196cb599 tempest-ImagesOneServerTestJSON-2118092198 tempest-ImagesOneServerTestJSON-2118092198-project] 10.222.0.88 "GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f" status: 404 len: 111 microversion: 2.1 time: 0.137554 Jul 18 13:02:28.572155 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1103/2138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:28 2022] GET /compute/v2.1/servers/918183c0-1c36-4fc3-8276-3d5b349dc98f => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:28.882141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:02:28.887926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:02:28.891387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:02:28.891828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:02:28.892396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:02:28.942349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:28.944554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:28.952978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:28.954080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:29.007461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:02:29.035352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for user 28072006ff234c14a8121c280adae603 and project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:02:29.091249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:02:29.095616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:02:29.222224 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8b98d1f1-6aee-4435-bc30-171f83f5368e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.721644 Jul 18 13:02:29.224409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1036/2139] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:02:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:02:29.232006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:29.243261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a2d9085-5267-45bf-bab8-28b8e5c1f846 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:29.244420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:29.244939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a2d9085-5267-45bf-bab8-28b8e5c1f846 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:29.290565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:29.292028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:29.296270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:29.299225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:29.453363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a2d9085-5267-45bf-bab8-28b8e5c1f846 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:29.468397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a2d9085-5267-45bf-bab8-28b8e5c1f846 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1224 microversion: 2.1 time: 0.232489 Jul 18 13:02:29.469464 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1037/2140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:29 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1224 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:30.060608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:30.104763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:30.113473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:30.117144 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eb75e1ee-eb02-4496-a957-809117505c92 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.890386 Jul 18 13:02:30.124788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1104/2141] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:29 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:02:30.544319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d89d9d26-d7ac-4658-8607-5b465880f533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:30.555329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d89d9d26-d7ac-4658-8607-5b465880f533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:30.906236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d89d9d26-d7ac-4658-8607-5b465880f533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:30.928144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d89d9d26-d7ac-4658-8607-5b465880f533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1224 microversion: 2.1 time: 0.433937 Jul 18 13:02:30.954800 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1038/2142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:30 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1224 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:31.153539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:31.160147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:31.161057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:31.178394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:31.178867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:31.179695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:31.190365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:31.691180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5a877c78-2661-48f3-92c5-0445c9940f89 req-fcd5cfe2-a3c3-4f80-aa53-61f5ffd7c56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "name": "network-vif-unplugged", "status": "completed", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:31.714808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5a877c78-2661-48f3-92c5-0445c9940f89 req-fcd5cfe2-a3c3-4f80-aa53-61f5ffd7c56a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:31.715920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5a877c78-2661-48f3-92c5-0445c9940f89 req-fcd5cfe2-a3c3-4f80-aa53-61f5ffd7c56a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:31.736608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5a877c78-2661-48f3-92c5-0445c9940f89 req-fcd5cfe2-a3c3-4f80-aa53-61f5ffd7c56a service nova] Creating event network-vif-unplugged:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:02:31.755563 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5a877c78-2661-48f3-92c5-0445c9940f89 req-fcd5cfe2-a3c3-4f80-aa53-61f5ffd7c56a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077032 Jul 18 13:02:31.757631 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1039/2143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:02:31.967907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:31.970413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:31.996286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:31.997273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:32.010585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:32.011665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:32.034065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:32.064127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:32.077051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:32.084358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abc64699-ef18-47b6-92cd-8e8e32b7bfbe tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.932413 Jul 18 13:02:32.093816 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1105/2144] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:31 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:02:32.935675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:32.996373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1393ecda-bab3-4d1f-a3ec-9175a0cea1b2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1276 microversion: 2.1 time: 1.031088 Jul 18 13:02:33.000168 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1040/2145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:31 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1276 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:33.132163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:33.133977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:33.170698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:33.171478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:33.181312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:33.182261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:34.032856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:34.035620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:34.090791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:34.095472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:34.098086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:34.103269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:34.492667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:34.542942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:34.552036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:34.558923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b177783-b47c-4a37-8438-eb51a04e63af tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.436070 Jul 18 13:02:34.566288 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1106/2146] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:33 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:35.334414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:35.367526 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f2891068-5e37-470a-98f6-a144abcb8c08 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1282 microversion: 2.1 time: 1.342846 Jul 18 13:02:35.373562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1041/2147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:34 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1282 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:35.604833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:35.606316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:35.631782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:35.632647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:35.634194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:35.635025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:36.633520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:36.637860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c1e418e-13c4-4929-b6a0-cedfc3a4a5a9 tempest-ListImageFiltersNegativeTestJSON-1489453327 tempest-ListImageFiltersNegativeTestJSON-1489453327-project] Calling method '.version_select at 0x7f96e41c1ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:36.669925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:36.672565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:36.674283 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b69fd1a0-e921-4087-8ba0-bdc54b743cfa tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.077740 Jul 18 13:02:36.690914 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1107/2148] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:35 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:36.708678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4a3c8e0c-c8d6-4992-b654-40f1c4c8e881 req-ff292db4-ecdd-4ea9-b391-592da142fb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:36.712537 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9c1e418e-13c4-4929-b6a0-cedfc3a4a5a9 tempest-ListImageFiltersNegativeTestJSON-1489453327 tempest-ListImageFiltersNegativeTestJSON-1489453327-project] HTTP exception thrown: Image not found. Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c1e418e-13c4-4929-b6a0-cedfc3a4a5a9 tempest-ListImageFiltersNegativeTestJSON-1489453327 tempest-ListImageFiltersNegativeTestJSON-1489453327-project] Request method failure captured: Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/images/33093cd3-6131-444e-b576-5a2743189726 HTTP/1.1 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VnrRXEeb9Kir72GGuBczG8KUYsVNunUeQs5CQwGJp5QiUbf-ekoR3qnMmPkcGzL_p9xewLAEN5dLivXf1jK6wis-ZQ45-J_LgSoJ9bqZWyYk5H0390tVBmGaoh6GT-nM0oryULLCYt3ekI3WdZZjUGXJq0LsDd0kHllb5fd09Gsyh8 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 4b5fdccb6ce340889c1f5a33247e4cfb Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1489453327 Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:02:36.715374 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4b5fdccb6ce340889c1f5a33247e4cfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5fdccb6ce340889c1f5a33247e4cfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4b5fdccb6ce340889c1f5a33247e4cfb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5fdccb6ce340889c1f5a33247e4cfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1489453327 Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 4b5fdccb6ce340889c1f5a33247e4cfb Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1489453327 Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListImageFiltersNegativeTestJSON-1489453327-project Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: c3949a7eeacc40dfa075b8aa7bd6d56b Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1489453327-project Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: exception: Image not found. Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '33093cd3-6131-444e-b576-5a2743189726'} Jul 18 13:02:36.716572 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:02:36.718217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33093cd3-6131-444e-b576-5a2743189726 Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:02:36.720264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33093cd3-6131-444e-b576-5a2743189726 could not be found. Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:02:36.722560 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:02:36.726127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:02:36.738539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c1e418e-13c4-4929-b6a0-cedfc3a4a5a9 tempest-ListImageFiltersNegativeTestJSON-1489453327 tempest-ListImageFiltersNegativeTestJSON-1489453327-project] Returning 404 to user: Image not found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:36.741440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c1e418e-13c4-4929-b6a0-cedfc3a4a5a9 tempest-ListImageFiltersNegativeTestJSON-1489453327 tempest-ListImageFiltersNegativeTestJSON-1489453327-project] 10.222.0.88 "GET /compute/v2.1/images/33093cd3-6131-444e-b576-5a2743189726" status: 404 len: 62 microversion: 2.1 time: 1.099089 Jul 18 13:02:36.743158 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1042/2149] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:02:35 2022] GET /compute/v2.1/images/33093cd3-6131-444e-b576-5a2743189726 => generated 62 bytes in 1104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:02:36.745669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4a3c8e0c-c8d6-4992-b654-40f1c4c8e881 req-ff292db4-ecdd-4ea9-b391-592da142fb32 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:36.748514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4a3c8e0c-c8d6-4992-b654-40f1c4c8e881 req-ff292db4-ecdd-4ea9-b391-592da142fb32 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:36.785114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:36.792665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:36.811390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4a3c8e0c-c8d6-4992-b654-40f1c4c8e881 req-ff292db4-ecdd-4ea9-b391-592da142fb32 service nova] Creating event network-changed:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:02:36.836325 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4a3c8e0c-c8d6-4992-b654-40f1c4c8e881 req-ff292db4-ecdd-4ea9-b391-592da142fb32 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143407 Jul 18 13:02:36.837783 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1108/2150] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:36.844192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:36.844771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:36.850809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:36.863133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:36.867582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:36.868601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:36.869035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:36.872945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:36.874638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:36.875523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:37.041259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:02:37.432302 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c208a704-e9d1-4cb5-8dd6-63a5424af397 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 204 len: 0 microversion: 2.1 time: 0.675776 Jul 18 13:02:37.438967 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1043/2151] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:02:36 2022] DELETE /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:02:37.461611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:37.464400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:37.492463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:37.494346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:37.497000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:37.498248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:37.979928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:38.022022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2fec639f-dbcc-4ede-8a94-ebda0622204a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.182250 Jul 18 13:02:38.039671 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1109/2152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:36 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:38.069043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:38.076275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:38.102481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:38.106708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:38.108734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:38.114282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:38.837304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:38.862192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:38.867476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:38.871305 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db0fd70f-980d-454e-9341-25534f6c4af5 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.820981 Jul 18 13:02:38.875076 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1110/2153] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:38 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:38.978073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:39.101108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:39.108706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:39.228911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:39.232217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:39.235089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:39.237479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:39.610099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:39.653122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1fa07233-28ca-4d9e-91ba-9b72d0b8e3c9 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1665 microversion: 2.1 time: 2.206332 Jul 18 13:02:39.662995 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1044/2154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:37 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1665 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:39.918541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:39.926710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:39.984898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:39.989860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:39.992134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:39.993121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:40.316493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:40.336416 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9790054-1821-4c2e-a6df-1194b6e8d091 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.279763 Jul 18 13:02:40.349325 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1111/2155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:39 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:40.701914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:40.704518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:40.719437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:40.724430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:40.728181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:40.733663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:40.926826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:41.526256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:41.651303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b62a2fb-34ad-4bba-81ac-497fd823ad24 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1665 microversion: 2.1 time: 0.961801 Jul 18 13:02:41.659207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1112/2156] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:40 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1665 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:41.679959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:41.684487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:41.700409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:41.704079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:41.705197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:41.709419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:42.699690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:42.738809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:42.750499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:42.758451 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db788fbf-fbaa-415f-a75e-572e24f09c04 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 2.848105 Jul 18 13:02:42.759817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1045/2157] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:39 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:02:42.791350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:42.794056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:42.807615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:42.811223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:42.814726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:42.815994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:42.953870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:42.992780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-44e28b46-c0fc-42df-a6c2-2d0ced43720c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.327695 Jul 18 13:02:43.000078 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1113/2158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:41 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:44.362332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:44.412888 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac377f96-dee5-4600-8a42-108ce8038a93 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1665 microversion: 2.1 time: 1.645438 Jul 18 13:02:44.433135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1046/2159] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:42 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1665 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:44.451105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:44.467667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:44.514543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:44.517398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:44.524104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:44.529013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:44.596025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:44.598212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:44.623499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:44.626652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:44.631841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:44.636014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:45.396570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:45.411885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:45.415516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:45.444457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a2baa75-94fc-4007-8633-2d62e7cf9d7c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.665056 Jul 18 13:02:45.455701 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1114/2160] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:43 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:45.479933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e2d8d0f7-fc81-42d5-83ba-421dcc9b2326 req-66e7e8d4-8391-48da-9b46-262c999caf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c0fa0a-e4c3-4182-a238-a2f997d2b947", "name": "network-vif-unplugged", "status": "completed", "tag": "09d2970e-4c5a-452a-a6a1-0ccc23c6b73e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:45.506207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e2d8d0f7-fc81-42d5-83ba-421dcc9b2326 req-66e7e8d4-8391-48da-9b46-262c999caf62 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:45.506920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e2d8d0f7-fc81-42d5-83ba-421dcc9b2326 req-66e7e8d4-8391-48da-9b46-262c999caf62 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:45.524333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e2d8d0f7-fc81-42d5-83ba-421dcc9b2326 req-66e7e8d4-8391-48da-9b46-262c999caf62 service nova] Creating event network-vif-unplugged:09d2970e-4c5a-452a-a6a1-0ccc23c6b73e for instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 on n-h2-850003-3 Jul 18 13:02:45.532468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e2d8d0f7-fc81-42d5-83ba-421dcc9b2326 req-66e7e8d4-8391-48da-9b46-262c999caf62 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079638 Jul 18 13:02:45.533501 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1115/2161] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:45.540998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-18ea8a3f-1868-49f4-80cc-a632f90acdb9 req-6cd981f8-b640-4e11-9a73-6e4502994db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9339b5-2805-4cd1-941a-9c31988525e9", "tag": "d3fee7cc-9baf-4cae-be06-3c165a523ba1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:45.581121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-18ea8a3f-1868-49f4-80cc-a632f90acdb9 req-6cd981f8-b640-4e11-9a73-6e4502994db5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:45.581973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-18ea8a3f-1868-49f4-80cc-a632f90acdb9 req-6cd981f8-b640-4e11-9a73-6e4502994db5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:45.620046 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-18ea8a3f-1868-49f4-80cc-a632f90acdb9 req-6cd981f8-b640-4e11-9a73-6e4502994db5 service nova] Creating event network-changed:d3fee7cc-9baf-4cae-be06-3c165a523ba1 for instance 8e9339b5-2805-4cd1-941a-9c31988525e9 on n-h1-850003-3 Jul 18 13:02:45.628515 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-18ea8a3f-1868-49f4-80cc-a632f90acdb9 req-6cd981f8-b640-4e11-9a73-6e4502994db5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092664 Jul 18 13:02:45.629415 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1116/2162] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:45.638432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:45.640175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:45.653013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:45.654028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:45.655344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:45.656010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:46.095604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:46.113429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7a6950e0-9ab6-46b3-801d-855ab6ffe897 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.678046 Jul 18 13:02:46.114675 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1047/2163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:44 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:46.379027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:46.413517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b215386e-7db2-4b95-92b5-b47738a913d8 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1665 microversion: 2.1 time: 0.778338 Jul 18 13:02:46.414920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1117/2164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:45 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1665 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:46.471781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:46.472580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:46.480265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:46.494574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:46.497451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:46.503880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:46.507807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:47.135502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:47.136643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:47.173871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:47.174767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:47.176155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:47.176889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:47.193073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:48.096222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:48.112348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:48.117037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:48.119456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61e3f3f2-e69d-4e6d-a492-b43605c18abd tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.657956 Jul 18 13:02:48.131789 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1048/2165] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:46 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:48.137864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:48.138886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:48.152781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:48.157741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:48.158565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:48.160061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:48.161419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:48.197812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa1c252f-6ced-4577-b036-f076eef316cb tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.068373 Jul 18 13:02:48.198966 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1118/2166] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:47 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:48.228339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-39cc3cc7-99fc-446a-9a43-df432e396505 req-e613276f-8547-42c2-8a92-c56efb3fd7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "name": "network-vif-unplugged", "status": "completed", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:48.254361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-39cc3cc7-99fc-446a-9a43-df432e396505 req-e613276f-8547-42c2-8a92-c56efb3fd7b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:48.255930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-39cc3cc7-99fc-446a-9a43-df432e396505 req-e613276f-8547-42c2-8a92-c56efb3fd7b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:48.298584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-39cc3cc7-99fc-446a-9a43-df432e396505 req-e613276f-8547-42c2-8a92-c56efb3fd7b7 service nova] Creating event network-vif-unplugged:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:02:48.316361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-39cc3cc7-99fc-446a-9a43-df432e396505 req-e613276f-8547-42c2-8a92-c56efb3fd7b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102980 Jul 18 13:02:48.317568 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1119/2167] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:48.777574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-998556836", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:48.904602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:48.938966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:02:48.946398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e49c5370-18d6-4cdf-9784-8f8ff447e2e5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1598 microversion: 2.1 time: 0.812621 Jul 18 13:02:48.949653 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1049/2168] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:48 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1598 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:49.172486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:49.175398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:49.212620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.214401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.223192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.228046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.258137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:49.306062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:02:49.307610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:02:49.308313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:02:49.308902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:02:49.309553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:02:49.341089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.342447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.345155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.345659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.396140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:02:49.407753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:02:49.427106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:02:49.431240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:02:49.499891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3863eeb4-296c-4b19-a226-720397922e28 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175175 Jul 18 13:02:49.501082 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1120/2169] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:02:49.507009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:49.507923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:49.516505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.517282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.518460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:49.519077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:49.899586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:49.976608 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e251194e-c5d1-41b4-b4e9-1a32b3aaaa6c tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 0.472988 Jul 18 13:02:49.978597 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1121/2170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:49 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:50.669394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:50.690731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:50.705381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:50.714451 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1e7e791d-30b3-43b2-89ff-ede5f1de4300 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.575471 Jul 18 13:02:50.718796 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1050/2171] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:49 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:02:50.729799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cff530c2-2f5b-4739-bc87-b5e93e93cc92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:50.738306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cff530c2-2f5b-4739-bc87-b5e93e93cc92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:51.036924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cff530c2-2f5b-4739-bc87-b5e93e93cc92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:51.063360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cff530c2-2f5b-4739-bc87-b5e93e93cc92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1212 microversion: 2.1 time: 0.342655 Jul 18 13:02:51.067871 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1051/2172] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:50 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1212 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:51.088013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fd24f3e6-5cce-4841-a0d7-563c16d67bcc req-3eb1e4f0-fbd0-4081-bc37-c5280736cfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "name": "network-vif-unplugged", "status": "completed", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:51.102738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1899749816", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:51.135205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fd24f3e6-5cce-4841-a0d7-563c16d67bcc req-3eb1e4f0-fbd0-4081-bc37-c5280736cfcc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:51.138379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fd24f3e6-5cce-4841-a0d7-563c16d67bcc req-3eb1e4f0-fbd0-4081-bc37-c5280736cfcc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:51.172511 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fd24f3e6-5cce-4841-a0d7-563c16d67bcc req-3eb1e4f0-fbd0-4081-bc37-c5280736cfcc service nova] Creating event network-vif-unplugged:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h1-850003-3 Jul 18 13:02:51.199799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fd24f3e6-5cce-4841-a0d7-563c16d67bcc req-3eb1e4f0-fbd0-4081-bc37-c5280736cfcc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129823 Jul 18 13:02:51.205799 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1052/2173] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:51.244641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:51.265144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:51.304987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:51.307577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:51.329443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:51.330060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:51.343681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] validate_networks() for [('b0bdfae1-d494-4fb3-a62d-c5da4a570f79', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:02:51.519748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:51.523308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:51.524435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lazy-loading 'fault' on Instance uuid b8c0fa0a-e4c3-4182-a238-a2f997d2b947 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:02:52.523525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9746694432704d258e2b9464f0e25c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd341ebfa385247cdb06dc238e1da521a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:52.557796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54ce39fa-c192-44a0-afbb-162452765ee5 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 200 len: 1316 microversion: 2.1 time: 1.344461 Jul 18 13:02:52.559004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1053/2174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:51 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 1316 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:52.588688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:52.589819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:52.617884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:52.619036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:52.621115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:52.622170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:53.001131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:02:53.002639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:02:53.004068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:02:53.004989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:02:53.005780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:02:53.022996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:53.023843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:53.024993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:53.025900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:53.100599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Getting quotas for project 05f9b284d97d41ac8afa7868c6cc6d9e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:02:53.126098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Getting quotas for user 0777c4a95337482bab188d2e052314d7 and project 05f9b284d97d41ac8afa7868c6cc6d9e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:02:53.193382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:02:53.202239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:02:53.330058 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72f2fa8a-5a41-4234-99f9-062f77e60b9c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.342628 Jul 18 13:02:53.331519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1122/2175] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:02:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:02:53.339957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:53.340651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:53.354664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:53.355462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:53.359820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:53.360875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.050837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.076765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.083322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.088511 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29d44ecb-f6d5-404d-88a9-16febb6d105c tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 0.751994 Jul 18 13:02:54.089364 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1123/2176] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:53 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:54.105209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:54.105844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:54.132561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:54.133500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.134631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:54.139434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.388067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.409591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0791557-9679-4641-88af-470e06e49b69 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1270 microversion: 2.1 time: 0.315873 Jul 18 13:02:54.411333 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1124/2177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:54 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:54.421797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4bde1679-b6e2-4e31-88b5-104315076e00 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:54.423747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4bde1679-b6e2-4e31-88b5-104315076e00 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:54.583286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4bde1679-b6e2-4e31-88b5-104315076e00 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.616368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4bde1679-b6e2-4e31-88b5-104315076e00 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1214 microversion: 2.1 time: 0.202587 Jul 18 13:02:54.619445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1125/2178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:54 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:54.628970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0ce3b34d-cfe7-4d82-ad55-19a4b0c9e96f req-4338fa7d-6a2e-47f9-b2ae-368c266f5d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c0fa0a-e4c3-4182-a238-a2f997d2b947", "name": "network-vif-deleted", "tag": "09d2970e-4c5a-452a-a6a1-0ccc23c6b73e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:54.655355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0ce3b34d-cfe7-4d82-ad55-19a4b0c9e96f req-4338fa7d-6a2e-47f9-b2ae-368c266f5d79 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:54.655989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0ce3b34d-cfe7-4d82-ad55-19a4b0c9e96f req-4338fa7d-6a2e-47f9-b2ae-368c266f5d79 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.720720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0ce3b34d-cfe7-4d82-ad55-19a4b0c9e96f req-4338fa7d-6a2e-47f9-b2ae-368c266f5d79 service nova] Creating event network-vif-deleted:09d2970e-4c5a-452a-a6a1-0ccc23c6b73e for instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 on n-h2-850003-3 Jul 18 13:02:54.743612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0ce3b34d-cfe7-4d82-ad55-19a4b0c9e96f req-4338fa7d-6a2e-47f9-b2ae-368c266f5d79 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120780 Jul 18 13:02:54.746574 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1126/2179] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:54.759590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:54.764002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] [instance: b8c0fa0a-e4c3-4182-a238-a2f997d2b947] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:54.795848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:54.796851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.797875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:54.798644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:54.900640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] HTTP exception thrown: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Request method failure captured: Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 HTTP/1.1 Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl5qv2C0dYcnh5MO9mDd--_pjlPIa_tzXvjV6hnd21OXIITgy80pegF7wKBWePlBhgebbupGFEOyslHyg3Na8sL03EwFIdpndToAQDOxgW8u_7d5x_ZFPOAPmUbkibJzoR4AJWDcibovYNourp6bxRcowXPCq51OSFubZqcwh8iNvo Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: d341ebfa385247cdb06dc238e1da521a Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestFqdnHostnames-1173035017 Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:02:54.919254 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d341ebfa385247cdb06dc238e1da521a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d341ebfa385247cdb06dc238e1da521a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d341ebfa385247cdb06dc238e1da521a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d341ebfa385247cdb06dc238e1da521a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestFqdnHostnames-1173035017 Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: d341ebfa385247cdb06dc238e1da521a Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1173035017 Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestFqdnHostnames-1173035017-project Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 9746694432704d258e2b9464f0e25c4a Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestFqdnHostnames-1173035017-project Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. Jul 18 13:02:54.921931 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b8c0fa0a-e4c3-4182-a238-a2f997d2b947'} Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:02:54.923422 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. Jul 18 13:02:54.925734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:02:54.930607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Returning 404 to user: Instance b8c0fa0a-e4c3-4182-a238-a2f997d2b947 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:02:54.936692 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c40053cc-d778-4297-a30e-0623226b5d2f tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947" status: 404 len: 111 microversion: 2.1 time: 0.186714 Jul 18 13:02:54.942062 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1127/2180] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:54 2022] GET /compute/v2.1/servers/b8c0fa0a-e4c3-4182-a238-a2f997d2b947 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:02:54.962351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:54.982763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-addb80af-4bfc-43ab-8645-fd4b97c98884 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] Calling method '.version_select at 0x7f96e9a7eca0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:54.997322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4bd5a7fc-203d-4769-ac6d-0445d965894a tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 2.433012 Jul 18 13:02:54.998601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1054/2181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:52 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:55.060990 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-addb80af-4bfc-43ab-8645-fd4b97c98884 tempest-ServersTestFqdnHostnames-1173035017 tempest-ServersTestFqdnHostnames-1173035017-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496046883" status: 202 len: 0 microversion: 2.1 time: 0.110343 Jul 18 13:02:55.062532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1128/2182] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496046883 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:02:55.131546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:55.138195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:55.188525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.193240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:55.200545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.206745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:55.443380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:55.464231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:55.522000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.522654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:55.523493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.523947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:55.745073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:55.798229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51b50e70-ca53-40b7-9c9d-d66db2e37146 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1270 microversion: 2.1 time: 0.363858 Jul 18 13:02:55.799169 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1129/2183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:55 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:55.818277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:55.819866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:55.834830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.835950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:55.838773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:55.839566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:56.016555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:56.038281 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1fba9a80-5734-4100-92e1-92711a4c4c2e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1266 microversion: 2.1 time: 0.230479 Jul 18 13:02:56.045175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1130/2184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:55 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:56.055625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:56.059663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:56.076632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:56.077936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:56.078988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:56.079435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:56.538941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:56.581641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7586aeaf-8d63-4bf1-b364-d2bcc4275e79 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 0.534343 Jul 18 13:02:56.589939 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1131/2185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:56 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:56.830281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:56.831090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:56.852289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:56.859103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:56.861280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:56.870206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:57.362428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:57.374088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37c81d18-a056-4e38-94f9-1f965246b2c2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1270 microversion: 2.1 time: 0.549836 Jul 18 13:02:57.375009 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1132/2186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:56 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1270 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:02:57.395165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:57.397657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:57.439704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:57.440271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:57.441125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:57.441611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:57.640654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:57.650541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ffb3c694-4192-46d0-a5db-cc15a8678887 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1272 microversion: 2.1 time: 0.259731 Jul 18 13:02:57.658004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1133/2187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:57 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:58.392598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:58.426709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:58.433895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:58.439158 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5cc37e7-6afb-403c-941b-14d3d3305656 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 3.318067 Jul 18 13:02:58.441320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1055/2188] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:02:55 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 3325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:02:58.465719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:58.470275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:58.496541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:58.499477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:58.504766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:58.506966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:58.552387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-778b43a2-9319-44ea-9f2f-2b443278dc1d tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e99be160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1545567878", "description": "tempest-description-777537707"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:02:59.186524 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-778b43a2-9319-44ea-9f2f-2b443278dc1d tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.520818 Jul 18 13:02:59.195124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1134/2189] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:02:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:02:59.204896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:59.206406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:59.209166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:02:59.220727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:59.221887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:59.223606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:59.224231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:59.334108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:59.376341 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f66cc099-822e-4c68-a877-8e8f49301872 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 0.928812 Jul 18 13:02:59.377854 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1056/2190] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:58 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:59.418063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:02:59.419614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:02:59.445478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:59.446329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:59.448244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:02:59.448896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:02:59.545680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:02:59.573539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9e3ebb0-948b-4905-8aa7-d3236924b222 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1270 microversion: 2.1 time: 0.379586 Jul 18 13:02:59.578365 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1135/2191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:59 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1270 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:02:59.612469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f917550-11f5-499b-af2d-9ffa5cc08d95 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e45ef8b0>, body: {"security_group_rule": {"parent_group_id": "1327d6c4-4075-4759-92d0-12bc52f8da0e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:00.568270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f917550-11f5-499b-af2d-9ffa5cc08d95 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.970230 Jul 18 13:03:00.570304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1136/2192] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:02:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:00.599560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:00.603120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:00.639834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:00.649404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:00.660054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:00.661505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:00.851374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:00.871584 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-16c54098-6443-49b1-8529-c5c9b0d3dc5a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 1.484520 Jul 18 13:03:00.884758 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1057/2193] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:02:59 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:00.908742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8f540a12-bdf7-4b8b-996a-30b9777b9d54 req-fdf42a6e-740c-4e6b-825f-3aa1823a2f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9339b5-2805-4cd1-941a-9c31988525e9", "name": "network-vif-plugged", "status": "completed", "tag": "d3fee7cc-9baf-4cae-be06-3c165a523ba1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:00.936166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8f540a12-bdf7-4b8b-996a-30b9777b9d54 req-fdf42a6e-740c-4e6b-825f-3aa1823a2f27 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:00.936864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8f540a12-bdf7-4b8b-996a-30b9777b9d54 req-fdf42a6e-740c-4e6b-825f-3aa1823a2f27 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:00.962833 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8f540a12-bdf7-4b8b-996a-30b9777b9d54 req-fdf42a6e-740c-4e6b-825f-3aa1823a2f27 service nova] Creating event network-vif-plugged:d3fee7cc-9baf-4cae-be06-3c165a523ba1 for instance 8e9339b5-2805-4cd1-941a-9c31988525e9 on n-h1-850003-3 Jul 18 13:03:00.978791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8f540a12-bdf7-4b8b-996a-30b9777b9d54 req-fdf42a6e-740c-4e6b-825f-3aa1823a2f27 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080284 Jul 18 13:03:00.982532 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1058/2194] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:00.996852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:00.997922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:01.011300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:01.014883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:01.016212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:01.016917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:01.059721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:01.974483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:01.994837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:02.000074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:02.008866 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39c7f81a-c3c7-4518-90a2-db45b4cdaced tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1486 microversion: 2.25 time: 1.433160 Jul 18 13:03:02.018701 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1137/2195] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:00 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1486 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:02.034775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7029741-822e-4185-899f-c2fb93e74f1b tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e99e6040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-542865053", "description": "tempest-description-1699883712"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:02.289852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:02.306303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-298e59e1-81bc-4bc1-b0bf-a0765b610ff2 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1324 microversion: 2.1 time: 1.321927 Jul 18 13:03:02.310818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1059/2196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:00 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1324 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:02.318081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:02.335123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:02.371419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:02.387515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:02.390237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:02.394019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:02.640380 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7029741-822e-4185-899f-c2fb93e74f1b tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.617719 Jul 18 13:03:02.641569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1138/2197] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:02.651799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:02.655522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:02.668165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:02.670209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:02.674118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:02.675328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:02.676798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:02.680343 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d99977e-6365-483c-a3cb-68c365348e72 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1270 microversion: 2.1 time: 0.367862 Jul 18 13:03:02.694081 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1060/2198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:02 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1270 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:02.699667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b3d7ee5a-1b67-4a0b-8c55-d38e60d50f01 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e48890d0>, body: {"security_group_rule": {"parent_group_id": "ac997903-0ba9-46c2-8703-234c43988415", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:03.053709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:03.369448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:03.435463 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76cbe2dd-3a68-4b1e-b4a1-9f5125e10e16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 0.791989 Jul 18 13:03:03.436942 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1139/2199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:02 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:03.446791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:03.448339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:03.481722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:03.482671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:03.484115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:03.484770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:03.906398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:03.927472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:03.938537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:03.945641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0543880f-e61d-4943-815e-1bc2f7c04c38 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1476 microversion: 2.25 time: 0.501920 Jul 18 13:03:03.948185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1140/2200] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:03 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:03.961019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f1abedeb-8e18-46a1-a11f-610873efd8c7 req-8ba24cfc-8f05-4190-b355-a77f82af19de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfedec2b-9b9c-492f-8415-943ee8a915fe", "tag": "0c82e20f-4a12-4268-8f19-dbf023d3dc0b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:04.036642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f1abedeb-8e18-46a1-a11f-610873efd8c7 req-8ba24cfc-8f05-4190-b355-a77f82af19de service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:04.049507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f1abedeb-8e18-46a1-a11f-610873efd8c7 req-8ba24cfc-8f05-4190-b355-a77f82af19de service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:04.096142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f1abedeb-8e18-46a1-a11f-610873efd8c7 req-8ba24cfc-8f05-4190-b355-a77f82af19de service nova] Creating event network-changed:0c82e20f-4a12-4268-8f19-dbf023d3dc0b for instance dfedec2b-9b9c-492f-8415-943ee8a915fe on n-h2-850003-3 Jul 18 13:03:04.119917 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f1abedeb-8e18-46a1-a11f-610873efd8c7 req-8ba24cfc-8f05-4190-b355-a77f82af19de service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169367 Jul 18 13:03:04.121906 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1141/2201] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:04.176491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:04.180842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:04.205958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:04.209693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:04.210831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:04.212142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:04.605548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:05.029412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:05.104677 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-124dd752-18a3-47c7-9af0-4b81b546ed53 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1521 microversion: 2.1 time: 0.979633 Jul 18 13:03:05.110414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1142/2202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:04 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1521 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:05.145948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:05.150620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:05.177134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:05.178601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:05.181157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:05.183869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:05.696916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:05.701402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:05.731686 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0107d22f-8650-48d5-bcc1-339e2c0cb729 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.618813 Jul 18 13:03:05.737043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1143/2203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:05 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:05.758515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b29277a5-7634-42d0-96f3-fb1659e76947 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '.version_select at 0x7f96e4584d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:05.764958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29277a5-7634-42d0-96f3-fb1659e76947 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:05.766298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29277a5-7634-42d0-96f3-fb1659e76947 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:05.812395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b29277a5-7634-42d0-96f3-fb1659e76947 tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.071416 Jul 18 13:03:05.822038 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1144/2204] 10.222.0.88 () {60 vars in 1183 bytes} [Mon Jul 18 13:03:05 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:05.841744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:05.843582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:05.875345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:05.875893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:05.878871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:05.880065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.099053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b3d7ee5a-1b67-4a0b-8c55-d38e60d50f01 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 3.401939 Jul 18 13:03:06.113273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1061/2205] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:03:02 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:06.122914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:06.125138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:06.138728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.140080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.141947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.143179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.163590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:06.180576 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c20b122-b354-4713-bc32-e9ac5ad61b73 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 0.356430 Jul 18 13:03:06.181732 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1145/2206] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:05 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:06.198983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:06.203973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:06.227243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.227693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.229176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.229768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.423288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] Lazy-loading 'services' on Instance uuid ebcc7198-f0ce-4873-9614-187cceacde6f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:03:06.444491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21d04355-c536-46f0-bf6f-6646a359e8ae tempest-LiveAutoBlockMigrationV225Test-512720841 tempest-LiveAutoBlockMigrationV225Test-512720841-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1969 microversion: 2.25 time: 0.248845 Jul 18 13:03:06.445578 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1146/2207] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:06 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1969 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:06.454949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38bfd51d-467d-4111-a066-d562c624ab04 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e9adb280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1695912613", "description": "tempest-description-1708812685"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:06.787819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:06.797584 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c31dc46d-804f-43dc-af5b-0feea8a9c8ac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1521 microversion: 2.1 time: 0.682164 Jul 18 13:03:06.810279 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1062/2208] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:06 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:06.816185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:06.817185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:06.825832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.826816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.827895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:06.829250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:06.860944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:03:06.960999 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38bfd51d-467d-4111-a066-d562c624ab04 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.513147 Jul 18 13:03:06.963136 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1147/2209] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:06.977605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:06.979156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:06.999960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.002891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.007366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.009331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.025090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5bd4b14-0bf6-4ed8-9bfc-59e9b5ff9cb6 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 204 len: 0 microversion: 2.25 time: 0.210898 Jul 18 13:03:07.031766 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1063/2210] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:03:06 2022] DELETE /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:03:07.049048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-310154522"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:07.067502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:07.107183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.109393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.111437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.112444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.388020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:07.416396 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5464d28a-ea45-40d4-8f58-4d3fa86f97cc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.450851 Jul 18 13:03:07.417873 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1148/2211] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:06 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:07.427902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-640f7ecf-7445-40a4-ad2d-db8f417c13ee tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e9a7eee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1960209960", "description": "tempest-description-1033576922"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:07.911192 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2adffcec-aeed-475c-b361-09f7004fb3e4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9/action" status: 202 len: 0 microversion: 2.1 time: 0.873065 Jul 18 13:03:07.923962 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1064/2212] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:03:07 2022] POST /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:03:07.937570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:07.939517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:07.957822 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-640f7ecf-7445-40a4-ad2d-db8f417c13ee tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.536995 Jul 18 13:03:07.959879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1149/2213] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:07.965697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.970755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.972352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:07.973831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:07.980737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:07.982306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:07.999468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:08.002980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:08.007158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:08.007856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:09.090373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:09.149829 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3eb79b3-6796-4ecc-a74f-cea84a207eb3 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 1.182363 Jul 18 13:03:09.153349 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1150/2214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:07 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:09.193825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c8c0a65-cd68-4e1d-9f67-4aefe6c2585d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e9a15b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:09.383923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:09.407426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:09.412195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:09.414748 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d9809e0-8c1c-42c0-af44-296827a78751 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1482 microversion: 2.25 time: 1.495764 Jul 18 13:03:09.431004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1065/2215] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:07 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1482 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:09.453174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd021b0e-250e-4fdf-a24c-71158e26b89c tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e41de1f0>, body: {"security_group_rule": {"parent_group_id": "f2672dfb-1fda-4538-9a79-a4c8279aa834", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d93447b4-86ee-4ae3-b095-7859df5f47de"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:09.461057 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c8c0a65-cd68-4e1d-9f67-4aefe6c2585d tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf" status: 204 len: 0 microversion: 2.1 time: 0.303632 Jul 18 13:03:09.462755 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1151/2216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:09 2022] DELETE /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:03:09.472671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:09.474567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:09.489557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:09.491635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:09.507738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:09.511818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:10.271326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:10.289704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-735b36c1-1eef-443c-92d2-4b9bc4e145a1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.825241 Jul 18 13:03:10.291105 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1152/2217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:09 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:10.296575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bed4ceee-94e3-41fb-890a-ba8d57d16222 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e9a7eee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:10.328079 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-bed4ceee-94e3-41fb-890a-ba8d57d16222 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Image not found. Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bed4ceee-94e3-41fb-890a-ba8d57d16222 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf HTTP/1.1 Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:03:10.330890 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf'} Jul 18 13:03:10.332305 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:03:10.333158 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:03:10.334398 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf could not be found. Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:03:10.335582 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:03:10.336712 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:10.338979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bed4ceee-94e3-41fb-890a-ba8d57d16222 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:03:10.340218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bed4ceee-94e3-41fb-890a-ba8d57d16222 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf" status: 404 len: 62 microversion: 2.1 time: 0.047892 Jul 18 13:03:10.342617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1153/2218] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jul 18 13:03:10 2022] GET /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:03:10.348363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:10.349379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:10.359253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:10.359966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:10.361237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:10.361868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:10.665930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:10.680737 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-940c6971-576d-466a-9653-2dd6392b3d27 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 0.336738 Jul 18 13:03:10.693751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1154/2219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:10 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:10.705632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:10.706487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:10.718735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:10.725504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:10.733992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:10.735557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:11.034700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:11.045603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5edc90e-819f-4e48-a81d-738160b19707 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1539 microversion: 2.1 time: 0.359094 Jul 18 13:03:11.050217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1155/2220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:10 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1539 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:11.066574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:11.067677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:11.081653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:11.085852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:11.088299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:11.091881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:11.514376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:11.532479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:11.534910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:11.536536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46418f67-916a-40ed-825e-720f0eeacc72 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1482 microversion: 2.25 time: 0.484949 Jul 18 13:03:11.551440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1156/2221] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:11 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1482 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:11.561974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b782aa41-1aa4-4fcb-a759-f4fbdcb6c013 req-46ef7d76-dd75-4896-aa76-a8e938404586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfedec2b-9b9c-492f-8415-943ee8a915fe", "name": "network-vif-plugged", "status": "completed", "tag": "0c82e20f-4a12-4268-8f19-dbf023d3dc0b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:11.575157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b782aa41-1aa4-4fcb-a759-f4fbdcb6c013 req-46ef7d76-dd75-4896-aa76-a8e938404586 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:11.575628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b782aa41-1aa4-4fcb-a759-f4fbdcb6c013 req-46ef7d76-dd75-4896-aa76-a8e938404586 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:11.604178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b782aa41-1aa4-4fcb-a759-f4fbdcb6c013 req-46ef7d76-dd75-4896-aa76-a8e938404586 service nova] Creating event network-vif-plugged:0c82e20f-4a12-4268-8f19-dbf023d3dc0b for instance dfedec2b-9b9c-492f-8415-943ee8a915fe on n-h2-850003-3 Jul 18 13:03:11.610947 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b782aa41-1aa4-4fcb-a759-f4fbdcb6c013 req-46ef7d76-dd75-4896-aa76-a8e938404586 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056996 Jul 18 13:03:11.612222 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1157/2222] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:11.622058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:11.624800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:11.650984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:11.651850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:11.652826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:11.653427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:12.105625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:12.133152 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39eea458-5893-43ff-b842-e541654554e2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.516532 Jul 18 13:03:12.139236 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1158/2223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:11 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:12.156790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1edb6c4e-ce60-4c85-bf6c-3fe5a5b8358d req-8ae21b53-a159-4c9b-a7a8-e36a0c097ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:12.203757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1edb6c4e-ce60-4c85-bf6c-3fe5a5b8358d req-8ae21b53-a159-4c9b-a7a8-e36a0c097ded service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:12.204584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1edb6c4e-ce60-4c85-bf6c-3fe5a5b8358d req-8ae21b53-a159-4c9b-a7a8-e36a0c097ded service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:12.238514 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1edb6c4e-ce60-4c85-bf6c-3fe5a5b8358d req-8ae21b53-a159-4c9b-a7a8-e36a0c097ded service nova] Creating event network-changed:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h2-850003-3 Jul 18 13:03:12.257443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1edb6c4e-ce60-4c85-bf6c-3fe5a5b8358d req-8ae21b53-a159-4c9b-a7a8-e36a0c097ded service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115547 Jul 18 13:03:12.258720 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1159/2224] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:12.276757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:12.286997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:12.313212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:12.314514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:12.316766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:12.317624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:12.922266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:12.936633 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a60d9b9-6c64-4bd1-b3ba-4dd3037e5a1b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1314 microversion: 2.1 time: 0.671256 Jul 18 13:03:12.938376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1160/2225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:12 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:12.957081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:12.957721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:12.980197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:12.980664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:12.981498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:12.981947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:13.381376 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd021b0e-250e-4fdf-a24c-71158e26b89c tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 3.946122 Jul 18 13:03:13.382870 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1066/2226] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:03:09 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:13.415519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:13.418132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:13.464561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:13.471302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:13.473099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:13.473861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:13.763134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:13.791526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96488c24-1fa3-434f-8082-96de601ce3b7 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1539 microversion: 2.1 time: 0.851386 Jul 18 13:03:13.804553 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1161/2227] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:12 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1539 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:13.820127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:13.820127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:13.853546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:13.854454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:13.856012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:13.861048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:14.081997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:14.099082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:14.105668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:14.114748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:14.117491 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ddfa832-a671-4e19-a1ad-74c21db1d196 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.731349 Jul 18 13:03:14.135464 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1067/2228] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:13 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:14.168014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5a94cf2-365d-47a1-958a-368eeb4adfe6 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e41bb700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-569354208", "description": "tempest-description-60667147"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:15.334401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:15.364708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e0003f6-445b-4953-a81c-7b6be2765687 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 1.568273 Jul 18 13:03:15.369595 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1162/2229] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:13 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:15.402121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:15.403966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:15.409923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5a94cf2-365d-47a1-958a-368eeb4adfe6 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.272201 Jul 18 13:03:15.416708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1068/2230] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:14 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:15.448034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-14f5b0b0-ea3e-433b-997a-0ee78fea463a req-c0185308-7ec6-40a7-bcc9-e9123b7076e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcc7198-f0ce-4873-9614-187cceacde6f", "name": "network-vif-deleted", "tag": "1363daa9-493f-479e-a7de-ae48b83dfc48"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:15.486101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14f5b0b0-ea3e-433b-997a-0ee78fea463a req-c0185308-7ec6-40a7-bcc9-e9123b7076e1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:15.490467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:15.491451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:15.497756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:15.499849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:15.505042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14f5b0b0-ea3e-433b-997a-0ee78fea463a req-c0185308-7ec6-40a7-bcc9-e9123b7076e1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:15.553259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-14f5b0b0-ea3e-433b-997a-0ee78fea463a req-c0185308-7ec6-40a7-bcc9-e9123b7076e1 service nova] Creating event network-vif-deleted:1363daa9-493f-479e-a7de-ae48b83dfc48 for instance ebcc7198-f0ce-4873-9614-187cceacde6f on n-h2-850003-3 Jul 18 13:03:15.574222 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-14f5b0b0-ea3e-433b-997a-0ee78fea463a req-c0185308-7ec6-40a7-bcc9-e9123b7076e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154149 Jul 18 13:03:15.574755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1069/2231] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:15.583651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:15.598709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:15.638319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:15.651774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:15.654246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:15.667323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:16.402084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:16.416023 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5d34ce8-5856-4e91-829c-6e13e2f2f052 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1521 microversion: 2.1 time: 0.836695 Jul 18 13:03:16.417023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1070/2232] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:15 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:16.429281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:16.430927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:16.450504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:16.450967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:16.451793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:16.452247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:16.530809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:16.593539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-77e0e1a5-cfff-4b57-b016-94e9a319782c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1499 microversion: 2.1 time: 1.212820 Jul 18 13:03:16.615930 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1163/2233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:15 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1499 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:16.649219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8fdeb59b-f76b-4fca-9b63-732acee49359 req-62d7f0c6-2e17-4d32-9c54-3a71a6743445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9339b5-2805-4cd1-941a-9c31988525e9", "name": "network-vif-plugged", "status": "completed", "tag": "d3fee7cc-9baf-4cae-be06-3c165a523ba1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:16.652022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:16.677558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:16.680819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:16.682140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf4d8dd5-ab07-49f0-9156-569edef8b367 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.263806 Jul 18 13:03:16.682882 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1071/2234] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:16 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:16.702468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8fdeb59b-f76b-4fca-9b63-732acee49359 req-62d7f0c6-2e17-4d32-9c54-3a71a6743445 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:16.703593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8fdeb59b-f76b-4fca-9b63-732acee49359 req-62d7f0c6-2e17-4d32-9c54-3a71a6743445 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:16.709695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c43ce56f-cd4e-481d-97b5-174668b65681 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e41b5ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1075077182", "description": "tempest-description-1747716792"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:16.751595 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8fdeb59b-f76b-4fca-9b63-732acee49359 req-62d7f0c6-2e17-4d32-9c54-3a71a6743445 service nova] Creating event network-vif-plugged:d3fee7cc-9baf-4cae-be06-3c165a523ba1 for instance 8e9339b5-2805-4cd1-941a-9c31988525e9 on n-h1-850003-3 Jul 18 13:03:16.780641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8fdeb59b-f76b-4fca-9b63-732acee49359 req-62d7f0c6-2e17-4d32-9c54-3a71a6743445 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159496 Jul 18 13:03:16.781788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1164/2235] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:16.808466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:16.809786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:16.845281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:16.845853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:16.846942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:16.848242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:17.610733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c43ce56f-cd4e-481d-97b5-174668b65681 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.910228 Jul 18 13:03:17.612310 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1072/2236] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:17.638312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:17.639117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:17.654807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:17.661476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:17.663127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:17.665031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:17.667121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:17.783448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:03:17.806683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:17.826966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80efc778-1a35-4db8-95de-437e0f2d65fc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 1.033753 Jul 18 13:03:17.832889 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1165/2237] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:16 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:17.874958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:17.880771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:17.923562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:17.924030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:17.924854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:17.925364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:18.020970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lazy-loading 'flavor' on Instance uuid dfedec2b-9b9c-492f-8415-943ee8a915fe {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:03:18.034269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:18.210905 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a63cd00-17c3-416c-a2c0-4fd81e4e045f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 204 len: 0 microversion: 2.1 time: 0.595240 Jul 18 13:03:18.218275 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1073/2238] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:03:17 2022] DELETE /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:03:18.239080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f173926-28d7-4a63-9cea-ce9e3e4653dc tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e415d040>, body: {"security_group_rule": {"parent_group_id": "967045f5-a86d-4e66-bb9a-328bf46ac5a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "69bfe3fa-2f17-4e2e-b720-3ad804675330"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:18.239934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be7579df-b673-44ad-9c5b-bf2188a1b948 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "POST /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe/action" status: 200 len: 32 microversion: 2.1 time: 0.402196 Jul 18 13:03:18.242793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1166/2239] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:03:17 2022] POST /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:03:18.258110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:18.260700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:18.281851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:18.283334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:18.289689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:18.291044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:18.485117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:18.504777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:18.513063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:18.513741 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-725e1167-168f-4496-be25-5d66767227ed tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.266765 Jul 18 13:03:18.514385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1167/2240] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:18 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:18.526750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:18.532109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:18.549752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:18.550302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:18.551174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:18.551629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:19.800545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:19.815334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9b86261-b1b2-4f86-b377-249ade49bf75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1527 microversion: 2.1 time: 1.299805 Jul 18 13:03:19.825629 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1168/2241] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:18 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1527 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:19.850988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:19.857810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:19.899661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:19.900246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:19.908905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:19.912364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:20.511101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:20.534277 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32889376-bdb8-4738-9a94-d00fa2658916 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.707313 Jul 18 13:03:20.536125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1169/2242] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:19 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:20.555880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:20.561738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:20.585259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:20.585760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:20.587714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:20.590438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:21.524836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f173926-28d7-4a63-9cea-ce9e3e4653dc tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 3.302557 Jul 18 13:03:21.527931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1074/2243] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:03:18 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:21.548744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-14ced3da-bb3f-474d-882f-878d4f09723f req-2c020e74-1318-4185-92a1-838f4f20ac3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9339b5-2805-4cd1-941a-9c31988525e9", "name": "network-vif-unplugged", "status": "completed", "tag": "d3fee7cc-9baf-4cae-be06-3c165a523ba1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:21.613217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14ced3da-bb3f-474d-882f-878d4f09723f req-2c020e74-1318-4185-92a1-838f4f20ac3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:21.614321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14ced3da-bb3f-474d-882f-878d4f09723f req-2c020e74-1318-4185-92a1-838f4f20ac3c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:21.652038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-14ced3da-bb3f-474d-882f-878d4f09723f req-2c020e74-1318-4185-92a1-838f4f20ac3c service nova] Creating event network-vif-unplugged:d3fee7cc-9baf-4cae-be06-3c165a523ba1 for instance 8e9339b5-2805-4cd1-941a-9c31988525e9 on n-h1-850003-3 Jul 18 13:03:21.668500 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-14ced3da-bb3f-474d-882f-878d4f09723f req-2c020e74-1318-4185-92a1-838f4f20ac3c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135141 Jul 18 13:03:21.671435 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1075/2244] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:21.684301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:21.686115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:21.704116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:21.705756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:21.707424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:21.708357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:21.746905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:21.796975 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c544ddb1-51c4-40cd-b27c-da409635bf0c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 1.229000 Jul 18 13:03:21.806406 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1170/2245] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:20 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:21.817390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:21.834836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:21.879657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:21.883414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:21.885418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:21.888265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:22.445715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:22.479063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:22.483874 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a003870-f182-42db-8af0-db5b8d48dbee tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1527 microversion: 2.1 time: 0.673774 Jul 18 13:03:22.487480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1171/2246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:21 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1527 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:22.505892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-22aef72a-bcb1-4707-80e4-bf3b1c2a032c tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e99ae3a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:22.533079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:22.536861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:22.564423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9c83276-6905-4245-9f33-bd4439a9f538 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.888716 Jul 18 13:03:22.577070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1076/2247] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:21 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:22.608409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:22.609550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:22.633163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:22.633993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:22.635571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:22.636364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:23.621783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:23.637319 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1043730-3f9d-4ca6-8fe7-b660b53a2fd6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 1.058977 Jul 18 13:03:23.637944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1077/2248] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:22 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:23.662315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:23.663069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:23.691705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:23.700123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:23.701056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:23.701527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:23.743547 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-22aef72a-bcb1-4707-80e4-bf3b1c2a032c tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/69bfe3fa-2f17-4e2e-b720-3ad804675330" status: 202 len: 0 microversion: 2.1 time: 1.253106 Jul 18 13:03:23.744649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1172/2249] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:22 2022] DELETE /compute/v2.1/os-security-groups/69bfe3fa-2f17-4e2e-b720-3ad804675330 => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:23.759488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:23.764514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:23.822320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:23.823563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:23.824664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:23.826958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.218141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:24.234177 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-327ba408-73cd-4140-9518-b13a1803bd1f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 200 len: 1485 microversion: 2.1 time: 0.488362 Jul 18 13:03:24.251114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1173/2250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:23 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 1485 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:24.263840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:24.268185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:24.280451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:24.281839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.284112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:24.287541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.511323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:24.531567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:24.539013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:24.540855 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f710330b-98dc-4b06-8f56-9722474c90d7 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.288345 Jul 18 13:03:24.556175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1174/2251] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:24 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:24.562527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8585af70-16c3-4cd0-a2c3-964bc3690560 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e99e1f70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:24.606385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:24.622402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3eac7e27-829e-473a-9e07-eeb3d6f45848 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.982716 Jul 18 13:03:24.639136 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1078/2252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:23 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:24.665584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5b446a47-1800-4963-8612-6517ca0441cd req-15210b9b-004b-4aa0-8da3-4052377a60a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9339b5-2805-4cd1-941a-9c31988525e9", "name": "network-vif-deleted", "tag": "d3fee7cc-9baf-4cae-be06-3c165a523ba1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:24.688501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5b446a47-1800-4963-8612-6517ca0441cd req-15210b9b-004b-4aa0-8da3-4052377a60a6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:24.690018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5b446a47-1800-4963-8612-6517ca0441cd req-15210b9b-004b-4aa0-8da3-4052377a60a6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.717067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8585af70-16c3-4cd0-a2c3-964bc3690560 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/967045f5-a86d-4e66-bb9a-328bf46ac5a9" status: 200 len: 245 microversion: 2.1 time: 0.159237 Jul 18 13:03:24.718573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1175/2253] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:03:24 2022] GET /compute/v2.1/os-security-groups/967045f5-a86d-4e66-bb9a-328bf46ac5a9 => generated 245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:24.735356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:24.736642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:24.740628 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5b446a47-1800-4963-8612-6517ca0441cd req-15210b9b-004b-4aa0-8da3-4052377a60a6 service nova] Creating event network-vif-deleted:d3fee7cc-9baf-4cae-be06-3c165a523ba1 for instance 8e9339b5-2805-4cd1-941a-9c31988525e9 on n-h1-850003-3 Jul 18 13:03:24.750585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:24.752892 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5b446a47-1800-4963-8612-6517ca0441cd req-15210b9b-004b-4aa0-8da3-4052377a60a6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110118 Jul 18 13:03:24.753313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.754604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:24.755048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1079/2254] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:24.758251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:24.777427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb6dd15f-555b-45fb-a019-85acb59c26a7 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e41c1c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-718283759", "description": "tempest-description-229205852"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:25.232025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:25.251817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d82c2b10-158b-464c-b928-6b6300d7b000 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.522604 Jul 18 13:03:25.255704 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1176/2255] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:24 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:25.292938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:25.296783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:25.308746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb6dd15f-555b-45fb-a019-85acb59c26a7 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.551085 Jul 18 13:03:25.310782 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1080/2256] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:03:24 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:25.326408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.327151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.328354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.333276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.340915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09db1de9-ce19-4047-a0bc-a1aa69a6be1b tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e9aae040>, body: {"security_group_rule": {"parent_group_id": "3341e27a-e636-4445-88df-e4aad551b7ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:25.382817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 HTTP/1.1 Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:03:25.401070 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:03:25.402653 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '8e9339b5-2805-4cd1-941a-9c31988525e9'} Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:03:25.403455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:03:25.404690 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:25.405711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:03:25.414253 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f4c3621-43f1-4852-a8e6-7d3a1245d548 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 404 len: 111 microversion: 2.1 time: 0.144929 Jul 18 13:03:25.415131 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1177/2257] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:25 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:03:25.560260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:25.560651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:25.584877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.585309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.586649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.587121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.831750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:25.851272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:25.860022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:25.863950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e466a926-455f-4997-843f-443d9e6ecc40 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 200 len: 1266 microversion: 2.25 time: 0.307326 Jul 18 13:03:25.876232 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1178/2258] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:25 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:25.891163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:25.894132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:25.907613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.911668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.914247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:25.916050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:25.998427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09db1de9-ce19-4047-a0bc-a1aa69a6be1b tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.680332 Jul 18 13:03:26.002340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1081/2259] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:03:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:26.023203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c922ceb1-de71-45b6-94f2-68cff85811f2 req-6863a554-06f7-4274-a7a6-be0334692ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "name": "network-vif-plugged", "status": "completed", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:26.091430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c922ceb1-de71-45b6-94f2-68cff85811f2 req-6863a554-06f7-4274-a7a6-be0334692ac1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:26.093459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c922ceb1-de71-45b6-94f2-68cff85811f2 req-6863a554-06f7-4274-a7a6-be0334692ac1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:26.138125 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c922ceb1-de71-45b6-94f2-68cff85811f2 req-6863a554-06f7-4274-a7a6-be0334692ac1 service nova] Creating event network-vif-plugged:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h2-850003-3 Jul 18 13:03:26.147127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c922ceb1-de71-45b6-94f2-68cff85811f2 req-6863a554-06f7-4274-a7a6-be0334692ac1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141139 Jul 18 13:03:26.157007 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1082/2260] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:26.171589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2076853699", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:26.287139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] validate_networks() for [('290d2741-2682-43c6-ac6f-47b8f2bbf745', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:03:26.328691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:26.345311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fea3596c-a881-42dd-a92b-172fcd869436 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1312 microversion: 2.1 time: 0.463809 Jul 18 13:03:26.348996 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1179/2261] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:25 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:26.354646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7386ca80-23d8-4d11-b77f-bf46358fdfaa tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Action: 'create', calling method: .version_select at 0x7f96e9964a60>, body: {"security_group_rule": {"parent_group_id": "3341e27a-e636-4445-88df-e4aad551b7ea", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:26.979850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7386ca80-23d8-4d11-b77f-bf46358fdfaa tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.629123 Jul 18 13:03:26.980821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1180/2262] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:03:26 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:26.988132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-780614660", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "3470f3e7-e24a-4847-afbd-3cb48fd397d0"}, {"uuid": "56a48554-827a-4c03-868b-5082e57de1a2"}, {"uuid": "3470f3e7-e24a-4847-afbd-3cb48fd397d0"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:27.192370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] validate_networks() for [('3470f3e7-e24a-4847-afbd-3cb48fd397d0', None, None, None, None, None), ('56a48554-827a-4c03-868b-5082e57de1a2', None, None, None, None, None), ('3470f3e7-e24a-4847-afbd-3cb48fd397d0', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:03:27.909361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:03:27.910238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:03:27.911183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:03:27.911952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:03:27.912913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:03:27.942500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:27.949179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:27.951352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:27.952581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:27.996248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:03:28.014594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Getting quotas for user 28072006ff234c14a8121c280adae603 and project dfdcb708fc204399bd4aacbced94348d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:03:28.062812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:03:28.068833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:03:28.281009 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6b017d7-840b-40b1-8e3b-ad47a9e6a653 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.116282 Jul 18 13:03:28.287802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1083/2263] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:03:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:03:28.315323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:28.324823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:28.354603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:28.354603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:28.357769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:28.358728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:28.733790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:28.759422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e967d880-1fbe-4ddb-90a0-8cd4e8de8669 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.469275 Jul 18 13:03:28.770436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1084/2264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:28 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:28.783107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:28.783107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ebcc7198-f0ce-4873-9614-187cceacde6f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:28.791305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:28.791974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:28.793657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:28.794578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:28.876532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] HTTP exception thrown: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Request method failure captured: Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f HTTP/1.1 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vd5K3zxkInX84yzQNmSYv7RhrNf9fnGKJhe_iZTDrxdZe8NQTue8yq8lKnda5qiEeJdFQZWqy7USVbJm6iq1Jug2iIZJl_pwhoLyL57Z-6KL7dOVMpn0ofqGZeuuFeDKiFeBJ-GZxGy8O0Z5qFwYAvL-I_imQHeZ4BE12FPyusiwjw Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:03:28.888176 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_788a3068f3ed4ccb84c3899673be6934", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f604cd53dad44c39944c7e7a57737941 Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. Jul 18 13:03:28.891123 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ebcc7198-f0ce-4873-9614-187cceacde6f'} Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:03:28.892723 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. Jul 18 13:03:28.895286 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:28.900636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Returning 404 to user: Instance ebcc7198-f0ce-4873-9614-187cceacde6f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:03:28.902524 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-319a707a-d537-49de-9478-c800546f8088 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f" status: 404 len: 111 microversion: 2.25 time: 0.138704 Jul 18 13:03:28.909981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1085/2265] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:28 2022] GET /compute/v2.1/servers/ebcc7198-f0ce-4873-9614-187cceacde6f => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:03:28.938002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6117a7be-48a4-4b3b-a6f3-630f1330e60e tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e415dc10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:29.257203 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6117a7be-48a4-4b3b-a6f3-630f1330e60e tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/3341e27a-e636-4445-88df-e4aad551b7ea" status: 200 len: 663 microversion: 2.1 time: 0.348724 Jul 18 13:03:29.258853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1086/2266] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:03:28 2022] GET /compute/v2.1/os-security-groups/3341e27a-e636-4445-88df-e4aad551b7ea => generated 663 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:29.272702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:29.275148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:29.318063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:29.319537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:29.321270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:29.322656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:29.911776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:29.955213 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17dd424d-894f-49d4-9510-c97ed938c0a4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1462 microversion: 2.1 time: 0.685676 Jul 18 13:03:29.956896 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1087/2267] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:29 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1462 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:29.996127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-682507d7-d383-4cf6-835c-b83256537490 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:29.997364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-682507d7-d383-4cf6-835c-b83256537490 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:30.261116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-682507d7-d383-4cf6-835c-b83256537490 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:30.306973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-682507d7-d383-4cf6-835c-b83256537490 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1225 microversion: 2.1 time: 0.342780 Jul 18 13:03:30.338066 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1088/2268] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:29 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1225 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:30.389171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fffe835b-19af-4606-9d08-597cb759daa8 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e415f820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:31.105438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fffe835b-19af-4606-9d08-597cb759daa8 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/eef59575-d236-499d-bfa5-0cfe8c267dc2" status: 202 len: 0 microversion: 2.1 time: 0.761887 Jul 18 13:03:31.116549 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1089/2269] 10.222.0.88 () {58 vars in 1286 bytes} [Mon Jul 18 13:03:30 2022] DELETE /compute/v2.1/os-security-group-rules/eef59575-d236-499d-bfa5-0cfe8c267dc2 => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:31.127800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:31.128986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:31.171924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:31.175550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:31.181960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:31.182522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:31.873987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:31.896998 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-149e3d3e-2790-4e7c-954e-4ee4f08f1802 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.778439 Jul 18 13:03:31.919226 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1090/2270] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:31 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:33.058985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:33.063765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:33.082447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:33.083824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:33.085577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:33.086685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:33.302855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:03:33.306464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:03:33.307552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:03:33.308991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:03:33.309995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:03:33.335639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=74 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:33.377269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:33.378616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:33.385716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:33.392664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:33.511622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Getting quotas for project ff8ce4457d364d45aafb4650e0eeaa13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:03:33.547601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Getting quotas for user 45a196974f5c40b5a62f0ed5ef73042f and project ff8ce4457d364d45aafb4650e0eeaa13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:03:33.615932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:03:33.630445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:03:33.864012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fee0d0a8-c446-404d-8276-59ec9ef46374 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.881720 Jul 18 13:03:33.878958 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1181/2271] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 6898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:03:33.897548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e86f2a5-3d9c-4959-be64-f27afa701667 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e99644c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:34.881786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b280de0e-3ff4-4ff1-a286-10890393a03b tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1613 microversion: 2.1 time: 2.964115 Jul 18 13:03:34.899425 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1091/2272] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:31 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1613 bytes in 2983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:34.919412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:34.946375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:34.977065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:34.981364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:34.988953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:34.990376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.014390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:36.037581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c02dcd5e-4c04-40ca-b735-d57bfd471b80 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 1.135821 Jul 18 13:03:36.038809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1092/2273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:34 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:36.066857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:36.082598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:36.124785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.125554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.127081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.128466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.346335 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e86f2a5-3d9c-4959-be64-f27afa701667 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/3341e27a-e636-4445-88df-e4aad551b7ea" status: 202 len: 0 microversion: 2.1 time: 2.464991 Jul 18 13:03:36.353135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1182/2274] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:33 2022] DELETE /compute/v2.1/os-security-groups/3341e27a-e636-4445-88df-e4aad551b7ea => generated 0 bytes in 2473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:36.368397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:36.369092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:36.387848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.388642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.398311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.399337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.704934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:36.738377 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a203ba83-ae44-4592-a0e0-52329a683df1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1264 microversion: 2.1 time: 0.381779 Jul 18 13:03:36.742250 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1183/2275] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:36 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1264 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:36.755227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:36.756195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:36.774709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.775482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.776888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:36.777664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:36.945614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '79372472644947c4a87cc680d2997ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452f22ec646d4724bca1c9b9e8fe38c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:36.947101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] flavor_id is None. Assuming migration. {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 13:03:36.948140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:03:37.830124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:37.869061 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39776eb9-25f6-4b95-b95e-6073ece5dacb tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 1.816957 Jul 18 13:03:37.870083 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1093/2276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:36 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:37.898805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e415dd30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:37.977382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:38.024856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:03:38.025690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Neutron security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:03:38.028674 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] HTTP exception thrown: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.028674 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Request method failure captured: Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-groups/69bfe3fa-2f17-4e2e-b720-3ad804675330 HTTP/1.1 Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VoAvVx2dBmy66BLhY7wcfIXnqPSWI_qoUwAomMaQDp08j4CEgDiBNvZ_-eA3XfCLrM2S45ngmqduv4ViKvpPUmNG0ZVuJQD7XU493VHpVYcKqm9H8oFk2u4OxUCciMQttEDaYYTUH4tnAHPONtEB6XfXtjNNbr0oG-KIf0OEGzWPCI Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 3e9e2101620444da866e59c48a07cb8d Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-356632903 Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:03:38.032485 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3e9e2101620444da866e59c48a07cb8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3e9e2101620444da866e59c48a07cb8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3e9e2101620444da866e59c48a07cb8d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3e9e2101620444da866e59c48a07cb8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesTestJSON-356632903 Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 3e9e2101620444da866e59c48a07cb8d Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-356632903 Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesTestJSON-356632903-project Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 30d14c7a93094fd8aee73140c26cb700 Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesTestJSON-356632903-project Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.035575 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '69bfe3fa-2f17-4e2e-b720-3ad804675330'} Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:03:38.042141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:03:38.045714 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.049795 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Returning 404 to user: Security group 69bfe3fa-2f17-4e2e-b720-3ad804675330 does not exist Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-5673e118-2e0e-4465-9764-b1f975150bef'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a913429d-d608-4e58-813d-d5cd654b1bc0 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/69bfe3fa-2f17-4e2e-b720-3ad804675330" status: 404 len: 194 microversion: 2.1 time: 0.161160 Jul 18 13:03:38.059104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1094/2277] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:37 2022] DELETE /compute/v2.1/os-security-groups/69bfe3fa-2f17-4e2e-b720-3ad804675330 => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:03:38.079879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:38.086220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:38.131173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:38.132560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:38.136472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:38.144529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:38.711926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-566c8287-8da3-436c-81f2-fbc668e76529 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7/action" status: 202 len: 0 microversion: 2.1 time: 1.967404 Jul 18 13:03:38.715180 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1184/2278] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:03:36 2022] POST /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7/action => generated 0 bytes in 1972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:38.734608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:38.739767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:38.765308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:38.766821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:38.769924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:38.771219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:38.781867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:39.200425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:39.235853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:39.249399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:39.260647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7001d2a1-8d16-4871-822c-4c0eb49a3d49 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 1.210268 Jul 18 13:03:39.282905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-948df92a-48d5-4bbf-b404-46582c7abeb1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1270 microversion: 2.1 time: 0.556666 Jul 18 13:03:39.282905 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1185/2280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:38 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1270 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:39.283609 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1095/2280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:38 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:39.303545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:39.304386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:39.318623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:39.319706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:39.321258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:39.322947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:39.325689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35158018-450c-4741-906b-06e1fffe5aef tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e9a1c310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:40.273617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:40.681571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:40.707896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5b93fd77-00bd-4056-8979-1ba5e9ec53d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1471 microversion: 2.1 time: 1.423070 Jul 18 13:03:40.731903 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1096/2281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:39 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1471 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:40.747408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:40.751248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:40.777780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:40.780019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:40.782267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:40.787938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:41.183761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-35158018-450c-4741-906b-06e1fffe5aef tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/967045f5-a86d-4e66-bb9a-328bf46ac5a9" status: 202 len: 0 microversion: 2.1 time: 1.898675 Jul 18 13:03:41.199844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1186/2282] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:39 2022] DELETE /compute/v2.1/os-security-groups/967045f5-a86d-4e66-bb9a-328bf46ac5a9 => generated 0 bytes in 1915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:41.233320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:41.234493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:41.299654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:41.300623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:41.302086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:41.302924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:42.086514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:42.145780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db73a10f-f881-408c-b770-beac36bbb1c4 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 0.935627 Jul 18 13:03:42.146868 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1187/2283] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:41 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:42.212945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:42.214273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:42.254304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:42.255050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:42.256599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:42.257398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:42.811801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:42.844145 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83dc46c6-0196-4116-befd-144e92d9e0b7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 2.110249 Jul 18 13:03:42.875478 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1097/2284] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:40 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:42.890436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8126b34b-da12-43d7-9117-c9831579099e tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e41bbdc0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:43.114384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:43.152097 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d18d10db-e1f6-4e7d-8d85-9f64425521da tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1312 microversion: 2.1 time: 0.975330 Jul 18 13:03:43.176988 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1188/2285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:42 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1312 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:43.210271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:43.211157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:43.248464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:43.249455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:43.249800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:43.250278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:43.391620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:03:43.535016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:43.627120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:43.672823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b36c42d-ee9a-4977-8606-a81b99a7e6a1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 204 len: 0 microversion: 2.25 time: 0.487994 Jul 18 13:03:43.677405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1189/2286] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:03:43 2022] DELETE /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:03:43.702805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:43.704028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:43.723385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:43.726549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:43.729110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:43.730496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:44.326689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:44.350437 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fde18cfc-2e80-4f83-ba64-5111e7faecb1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1471 microversion: 2.1 time: 0.669068 Jul 18 13:03:44.365715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1190/2287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:43 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1471 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:44.380376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3524a13d-d3ca-4eca-82e7-ed5051c3c957 req-00071057-1837-402b-bf40-dc2d9ea27a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db54c80d-e553-40e9-9062-f44b40b495e1", "tag": "e22cfb74-7fa7-45ab-9f8f-ac1696e336d3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:44.419115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3524a13d-d3ca-4eca-82e7-ed5051c3c957 req-00071057-1837-402b-bf40-dc2d9ea27a0f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:44.420383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3524a13d-d3ca-4eca-82e7-ed5051c3c957 req-00071057-1837-402b-bf40-dc2d9ea27a0f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:44.466843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3524a13d-d3ca-4eca-82e7-ed5051c3c957 req-00071057-1837-402b-bf40-dc2d9ea27a0f service nova] Creating event network-changed:e22cfb74-7fa7-45ab-9f8f-ac1696e336d3 for instance db54c80d-e553-40e9-9062-f44b40b495e1 on n-h1-850003-3 Jul 18 13:03:44.480108 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3524a13d-d3ca-4eca-82e7-ed5051c3c957 req-00071057-1837-402b-bf40-dc2d9ea27a0f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112149 Jul 18 13:03:44.485294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1191/2288] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:44.499318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:44.500562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:44.535220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:44.536684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:44.538718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:44.539642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:44.963663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:44.993247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a77c58cb-ed98-4547-8112-ea1b1976109f tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 0.505640 Jul 18 13:03:44.995080 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1192/2289] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:44 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:45.023826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:45.029822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:45.053286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:45.055450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:45.059162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:45.059719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:45.605667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:45.621945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:45.628802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:45.651265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-129d2fbf-84b3-4652-a245-e41e845f49f4 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1729 microversion: 2.25 time: 0.654287 Jul 18 13:03:45.654994 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1193/2290] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:44 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1729 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:45.662379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:45.667529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:45.703256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:45.704005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:45.713532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:45.714785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:46.230107 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8126b34b-da12-43d7-9117-c9831579099e tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/d93447b4-86ee-4ae3-b095-7859df5f47de" status: 202 len: 0 microversion: 2.1 time: 3.352371 Jul 18 13:03:46.231029 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1098/2291] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:42 2022] DELETE /compute/v2.1/os-security-groups/d93447b4-86ee-4ae3-b095-7859df5f47de => generated 0 bytes in 3354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:46.245321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:46.246424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:46.268664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:46.269887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:46.271463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:46.272469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:46.409958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:46.445668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9efdf6ab-93c1-4237-9324-ab0dc718a024 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.789174 Jul 18 13:03:46.447187 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1194/2292] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:45 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:46.456980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:46.460430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:46.499968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:46.503103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:46.508124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:46.513353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:46.895928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:46.926770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-105a4b6c-77b0-41e6-ba46-4941e3d8a6e1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1312 microversion: 2.1 time: 0.693950 Jul 18 13:03:46.934721 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1099/2293] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:46 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1312 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:46.951994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:46.966697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:47.004670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:47.010443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:47.013564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:47.019889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:47.129826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:47.177348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03c1be4c-25a0-4766-a57d-6ae05049ec48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1471 microversion: 2.1 time: 0.728338 Jul 18 13:03:47.180987 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1195/2294] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:46 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1471 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:47.207927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5db0caf-28f2-476a-9f48-dfc5e9e39dc8 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e9934e50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:47.634769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:47.669067 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f46ea10-d52b-4cc5-a6d0-1d0f6d025eac tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 0.728989 Jul 18 13:03:47.691077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1100/2295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:46 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:47.700493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:47.713359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:47.733631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:47.735304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:47.737429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:47.738729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:48.148092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:48.219536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:48.226361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:48.230805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4610b766-637c-4571-b702-c5c47bab392e tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1661 microversion: 2.25 time: 0.537632 Jul 18 13:03:48.256786 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1101/2296] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:47 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1661 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:48.264276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:48.266087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:48.273059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:48.275099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:48.276277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:48.302570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:48.306867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:49.114225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5db0caf-28f2-476a-9f48-dfc5e9e39dc8 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/f2672dfb-1fda-4538-9a79-a4c8279aa834" status: 202 len: 0 microversion: 2.1 time: 1.918714 Jul 18 13:03:49.124342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1196/2297] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:47 2022] DELETE /compute/v2.1/os-security-groups/f2672dfb-1fda-4538-9a79-a4c8279aa834 => generated 0 bytes in 1942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:49.137963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:49.141985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:49.159600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:49.160838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:49.163408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:49.164649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:49.871206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:49.888119 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e8f9d88-eb30-4f21-9a05-4022ab883593 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1333 microversion: 2.1 time: 0.759440 Jul 18 13:03:49.898263 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1197/2298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:49 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1333 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:49.913745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:49.919409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:49.944854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:49.945643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:49.947026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:49.947664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:49.994099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:50.038871 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5deab53e-f202-484d-91e7-046bea72b65b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 1.759660 Jul 18 13:03:50.039960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1102/2299] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:48 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:50.078630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:50.079768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:50.104193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:50.104908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:50.106858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:50.113867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:50.588716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:50.620365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c3883b5-c87f-485b-89f7-f77c5456ce31 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1471 microversion: 2.1 time: 0.720430 Jul 18 13:03:50.628361 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1198/2300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:49 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1471 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:50.656382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9629c27e-dd35-435e-9c1c-e2f234ab3800 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e42f2dc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:51.359329 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9629c27e-dd35-435e-9c1c-e2f234ab3800 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/ac997903-0ba9-46c2-8703-234c43988415" status: 202 len: 0 microversion: 2.1 time: 0.728713 Jul 18 13:03:51.366381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1199/2301] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:50 2022] DELETE /compute/v2.1/os-security-groups/ac997903-0ba9-46c2-8703-234c43988415 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:51.383763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:51.394637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:51.413099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.413647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:51.414736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.415228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:51.462777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:51.477570 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e1595251-059b-4b0c-ad0f-e5069da21533 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 1.422410 Jul 18 13:03:51.479370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1103/2302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:50 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:51.508210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:51.510764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:51.528723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.530777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:51.532800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.533744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:51.919459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:51.931687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:51.933946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:51.936304 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9731ff09-b119-454f-8b7f-c218dc4064a3 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 200 len: 1661 microversion: 2.25 time: 0.567475 Jul 18 13:03:51.941520 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1200/2303] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:51 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 1661 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:03:51.951630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:51.952997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:51.965109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.965685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:51.967189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:51.967880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:52.339071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:52.349254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac251604-03e1-4dc0-b544-32a6867b14b1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 0.408598 Jul 18 13:03:52.351162 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1201/2304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:51 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:52.688939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1272421240", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d6d11450-47b5-4d49-9cc1-2f61713f510a"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:52.867663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] validate_networks() for [('d6d11450-47b5-4d49-9cc1-2f61713f510a', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:03:53.781617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:53.815891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17bcd4d7-6e4f-49af-a26c-c2abf770d8d1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1333 microversion: 2.1 time: 2.333797 Jul 18 13:03:53.819061 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1104/2305] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:51 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1333 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:53.826626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:03:53.828189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:03:53.829216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:03:53.830305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:03:53.831276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:03:53.833316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-140ef603-0f2d-4333-95b7-c5ea2e7c2566 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] Calling method '.version_select at 0x7f96e41b5ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:53.878822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:53.879576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:53.881787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:53.881787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:53.968437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Getting quotas for project 0c45511f823644369bec04ea9f8892dc. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:03:53.989978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Getting quotas for user 88eec590efad4e87b8cc796e66f92ed3 and project 0c45511f823644369bec04ea9f8892dc. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:03:54.036769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Going to run 3 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:03:54.039292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:03:54.169147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=1f60c971-e60a-4d1d-9611-1850f5faa19e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:03:54.275353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=a18c55af-7625-4fe7-88c4-551b46c517d5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:03:54.537919 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bdd248f-8e42-4122-b8d5-125df98d9c0c tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184901 Jul 18 13:03:54.543330 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1202/2306] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:03:54.566687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:54.572090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:54.604181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:54.607880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:54.612176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:54.616677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:55.192749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:55.215470 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1269f00-893e-4f63-8af8-bd59e6847fa0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1476 microversion: 2.1 time: 0.670014 Jul 18 13:03:55.217765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1203/2307] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:54 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1476 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:55.227095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:55.228689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:55.237691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:55.238578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:55.239834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:55.240547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:55.264445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:03:55.710196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:55.741982 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb502926-1d15-49f5-93fe-d27cd030a0ce tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 0.521270 Jul 18 13:03:55.761924 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1204/2308] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:55 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:55.784935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:55.786417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: 3c749356-da67-4bef-80b0-71624a06486e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:55.809161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:55.810472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:55.812191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:55.813429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:55.874478 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] HTTP exception thrown: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Request method failure captured: Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e HTTP/1.1 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vd5K3zxkInX84yzQNmSYv7RhrNf9fnGKJhe_iZTDrxdZe8NQTue8yq8lKnda5qiEeJdFQZWqy7USVbJm6iq1Jug2iIZJl_pwhoLyL57Z-6KL7dOVMpn0ofqGZeuuFeDKiFeBJ-GZxGy8O0Z5qFwYAvL-I_imQHeZ4BE12FPyusiwjw Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:03:55.889708 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_788a3068f3ed4ccb84c3899673be6934", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f604cd53dad44c39944c7e7a57737941 Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. Jul 18 13:03:55.892126 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3c749356-da67-4bef-80b0-71624a06486e'} Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:03:55.893990 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. Jul 18 13:03:55.896196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:03:55.916381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Returning 404 to user: Instance 3c749356-da67-4bef-80b0-71624a06486e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:03:55.928543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8c26bf4-41e0-4f31-8272-3e77f94e7807 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e" status: 404 len: 111 microversion: 2.25 time: 0.159669 Jul 18 13:03:55.933709 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1205/2309] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:03:55 2022] GET /compute/v2.1/servers/3c749356-da67-4bef-80b0-71624a06486e => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:03:55.975637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5370333b-9c0e-44f7-bb4c-9747740810f3 req-2d5c17d4-ece4-45e8-9220-e7249f7b871e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c749356-da67-4bef-80b0-71624a06486e", "name": "network-vif-deleted", "tag": "f6c3dd2a-b48d-493f-8d3a-427cd5b30f99"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:56.026816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5370333b-9c0e-44f7-bb4c-9747740810f3 req-2d5c17d4-ece4-45e8-9220-e7249f7b871e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.027762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5370333b-9c0e-44f7-bb4c-9747740810f3 req-2d5c17d4-ece4-45e8-9220-e7249f7b871e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.058162 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-140ef603-0f2d-4333-95b7-c5ea2e7c2566 tempest-SecurityGroupRulesTestJSON-356632903 tempest-SecurityGroupRulesTestJSON-356632903-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/1327d6c4-4075-4759-92d0-12bc52f8da0e" status: 202 len: 0 microversion: 2.1 time: 2.237405 Jul 18 13:03:56.060012 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1105/2310] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:03:53 2022] DELETE /compute/v2.1/os-security-groups/1327d6c4-4075-4759-92d0-12bc52f8da0e => generated 0 bytes in 2239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:03:56.066286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:56.067099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:56.091070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.091589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.093406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.094918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.151468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5370333b-9c0e-44f7-bb4c-9747740810f3 req-2d5c17d4-ece4-45e8-9220-e7249f7b871e service nova] Creating event network-vif-deleted:f6c3dd2a-b48d-493f-8d3a-427cd5b30f99 for instance 3c749356-da67-4bef-80b0-71624a06486e on n-h2-850003-3 Jul 18 13:03:56.197603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5370333b-9c0e-44f7-bb4c-9747740810f3 req-2d5c17d4-ece4-45e8-9220-e7249f7b871e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250265 Jul 18 13:03:56.198774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1206/2311] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:56.237020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dce03f8f-a975-4103-8750-4f7e667dad5f req-43980f4c-dcc2-4e14-aa62-6b9a0450218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db54c80d-e553-40e9-9062-f44b40b495e1", "name": "network-vif-plugged", "status": "completed", "tag": "e22cfb74-7fa7-45ab-9f8f-ac1696e336d3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:56.269360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dce03f8f-a975-4103-8750-4f7e667dad5f req-43980f4c-dcc2-4e14-aa62-6b9a0450218b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.270074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dce03f8f-a975-4103-8750-4f7e667dad5f req-43980f4c-dcc2-4e14-aa62-6b9a0450218b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.307031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dce03f8f-a975-4103-8750-4f7e667dad5f req-43980f4c-dcc2-4e14-aa62-6b9a0450218b service nova] Creating event network-vif-plugged:e22cfb74-7fa7-45ab-9f8f-ac1696e336d3 for instance db54c80d-e553-40e9-9062-f44b40b495e1 on n-h1-850003-3 Jul 18 13:03:56.343939 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dce03f8f-a975-4103-8750-4f7e667dad5f req-43980f4c-dcc2-4e14-aa62-6b9a0450218b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126812 Jul 18 13:03:56.348106 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1207/2312] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:56.368731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:56.373500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:56.375491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:03:56.408895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.409635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.410846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.411674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.447605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9165f28c-5425-48e7-8b6d-475c9c465104 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.097877 Jul 18 13:03:56.454113 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1208/2313] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:03:56 2022] GET /compute/v2.1/servers => generated 1018 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:56.463290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:56.465530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:56.477806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.479113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:56.481042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:56.481921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:57.171278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:57.184502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:57.200437 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b4711cc-5a9f-49be-8934-15dcafa0db7d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 1.135516 Jul 18 13:03:57.213048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1106/2314] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:56 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:57.213602 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82cd19d0-a27f-48c3-91af-223a825196a1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.756819 Jul 18 13:03:57.235393 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1209/2315] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:56 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:57.239770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68b8df69-3ce8-48f6-8a6f-2c1ee7fbbae8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '.version_select at 0x7f96e9acc550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:57.245745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:57.246687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:57.272663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:57.273771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:57.276797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:57.277868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:57.331620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68b8df69-3ce8-48f6-8a6f-2c1ee7fbbae8 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463633431" status: 204 len: 0 microversion: 2.25 time: 0.098212 Jul 18 13:03:57.339175 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1107/2316] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 18 13:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463633431 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:03:57.357247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf9b529e-bbc8-4105-8f83-36965f693bd6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:57.364613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf9b529e-bbc8-4105-8f83-36965f693bd6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:57.537580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf9b529e-bbc8-4105-8f83-36965f693bd6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:57.547862 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf9b529e-bbc8-4105-8f83-36965f693bd6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1223 microversion: 2.1 time: 0.205820 Jul 18 13:03:57.567444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1108/2317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:57 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:57.572711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:57.573349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:57.605849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:57.606365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:57.607198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:57.607650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:57.867613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:57.880517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3fb96920-9528-4209-bc8e-7827e444fd34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1476 microversion: 2.1 time: 0.640575 Jul 18 13:03:57.905165 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1210/2318] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:57 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1476 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:58.184899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:58.239010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-02b249fe-f7ae-48cf-a63f-3a97e512e241 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1325 microversion: 2.1 time: 0.670256 Jul 18 13:03:58.242350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:58.243466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:58.258804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1109/2319] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:57 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1325 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:58.266922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:58.273729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:58.329661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:58.339330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:58.346647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:58.347563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:58.352192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:58.352967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:58.370522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:58.373169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.145263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:59.161750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-557ccf13-4068-4df6-9a90-eeb780de1025 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.898841 Jul 18 13:03:59.166742 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1110/2320] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:58 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:59.213328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:59.220849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:59.242699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.243867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.246966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.248013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.552091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:59.623360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d4b546e-1d5c-459e-b7d0-eab494c3a197 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1275 microversion: 2.1 time: 0.449224 Jul 18 13:03:59.631356 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1111/2321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:59 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:03:59.664233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:59.665365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:59.696651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.697861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.701851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.703208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.812660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:03:59.827522 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5a9a02d-e5bc-446a-9a08-b90e4fef2023 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1505 microversion: 2.1 time: 1.592906 Jul 18 13:03:59.831047 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1211/2322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:58 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1505 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:03:59.858809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-08094090-db74-4a1e-8772-66998fa15d1a req-3e4d1aa1-0656-4e80-895b-18e3901b231c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "tag": "20aaae6e-b0eb-4733-b64b-5356a7c316eb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:03:59.891342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-08094090-db74-4a1e-8772-66998fa15d1a req-3e4d1aa1-0656-4e80-895b-18e3901b231c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.892474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-08094090-db74-4a1e-8772-66998fa15d1a req-3e4d1aa1-0656-4e80-895b-18e3901b231c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.916735 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-08094090-db74-4a1e-8772-66998fa15d1a req-3e4d1aa1-0656-4e80-895b-18e3901b231c service nova] Creating event network-changed:20aaae6e-b0eb-4733-b64b-5356a7c316eb for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:03:59.926765 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-08094090-db74-4a1e-8772-66998fa15d1a req-3e4d1aa1-0656-4e80-895b-18e3901b231c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093607 Jul 18 13:03:59.929289 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1212/2323] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:03:59.941882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:03:59.943624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:03:59.959983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.961138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:03:59.962824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:03:59.963838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:00.615340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:00.645846 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b2b9248-ddf7-4bce-bcfe-1eba00844797 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1476 microversion: 2.1 time: 1.005255 Jul 18 13:04:00.648322 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1112/2324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:59 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1476 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:00.701779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:00.722741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:00.762380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:00.763667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:00.780840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:00.785627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.034629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:01.052584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d246c8b-0aa1-4787-8b95-4c44095c44fa tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1521 microversion: 2.1 time: 1.120797 Jul 18 13:04:01.055157 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1213/2325] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:03:59 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1521 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:01.078358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:01.081078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:01.091982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:01.097929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.099531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.101537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.102785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.339884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:01.367226 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d577a756-e306-4456-9eee-b296d6b2d514 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1281 microversion: 2.1 time: 0.309278 Jul 18 13:04:01.369405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1214/2326] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:01 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:01.380661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:01.382921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:01.395431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.396428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.397966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.398913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.649155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:01.665024 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e61fcab-a6da-4a02-b10d-3e6b85ffd49c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.013833 Jul 18 13:04:01.665647 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1113/2327] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:00 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:01.682414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:01.682945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:01.691569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.692363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.693509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.694224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.746783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:04:01.859588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:01.935174 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e7c7c05-b106-481f-80ed-b8b330e85cbd tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 204 len: 0 microversion: 2.1 time: 0.267097 Jul 18 13:04:01.937121 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1114/2328] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:04:01 2022] DELETE /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:04:01.952436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:01.953954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:01.970049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.974915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:01.974915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:01.974915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:02.757782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:02.773786 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27364cbd-d8d0-43cc-ba29-cb0b1974b6c1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1485 microversion: 2.1 time: 1.401907 Jul 18 13:04:02.774750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1215/2329] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:01 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1485 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:02.784617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:02.786227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:02.799521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:02.800817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:02.802703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:02.803793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:03.178851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:03.192411 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-493b41d7-5a7a-4428-88c7-b120b2dc9219 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1476 microversion: 2.1 time: 1.252340 Jul 18 13:04:03.193654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1115/2330] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:01 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1476 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:03.199406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:03.200226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:03.220725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:03.223748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:03.225822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:03.227437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:03.379467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:03.395420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-48326aa7-49df-4b1d-910c-87a9c841097e tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1527 microversion: 2.1 time: 0.618538 Jul 18 13:04:03.397818 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1216/2331] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:02 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1527 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:03.408801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:03.409967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:03.421543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:03.422850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:03.425257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:03.426063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:03.958556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:04.000039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97e422ab-1965-454e-862e-07b97db8acc3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1281 microversion: 2.1 time: 0.804213 Jul 18 13:04:04.003465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1116/2332] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:03 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1281 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:04.014228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:04.044420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:04.045300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:04.075894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:04.076429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:04.077430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:04.077877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:04.123080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:04.123416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:04:04.145657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4dd51b37-8d95-4f61-a5db-062813224f59 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.745317 Jul 18 13:04:04.163223 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1217/2333] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:03 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:04.171919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-661219648", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:04.270568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] validate_networks() for [('b0bdfae1-d494-4fb3-a62d-c5da4a570f79', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:04:04.315122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5467975-77d1-4a46-991c-7ad39e5be00b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 204 len: 0 microversion: 2.25 time: 0.282198 Jul 18 13:04:04.317329 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1117/2334] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:04:04 2022] DELETE /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:04:04.327634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:04.328424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:04.363697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:04.366770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:04.369650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:04.375443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:05.375662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:05.409731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62f603fa-98ba-41f1-ba83-9565c97ef240 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1476 microversion: 2.1 time: 1.089766 Jul 18 13:04:05.412283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1118/2335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:04 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1476 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:05.425809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:05.427742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:05.455575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:05.456399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:05.457933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:05.458819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.232242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:04:06.232987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:04:06.233207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:04:06.233631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:04:06.234484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:04:06.260504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.261089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.262047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.262536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.331411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Getting quotas for project 05f9b284d97d41ac8afa7868c6cc6d9e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:04:06.343055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Getting quotas for user 0777c4a95337482bab188d2e052314d7 and project 05f9b284d97d41ac8afa7868c6cc6d9e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:04:06.379372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:04:06.382649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:04:06.515337 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56eb9477-8da2-4f16-9278-aabd85004cd1 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.358764 Jul 18 13:04:06.519403 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1218/2336] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:04:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:04:06.527553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-829cf3fb-ad81-4e32-b717-6a60582ed9f4 req-3378585a-ec65-4c81-99d4-9ef071ce090a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "tag": "02d986e6-414c-4750-943c-14ccb34d7d64"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:06.552232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-829cf3fb-ad81-4e32-b717-6a60582ed9f4 req-3378585a-ec65-4c81-99d4-9ef071ce090a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.553121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-829cf3fb-ad81-4e32-b717-6a60582ed9f4 req-3378585a-ec65-4c81-99d4-9ef071ce090a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.570651 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-829cf3fb-ad81-4e32-b717-6a60582ed9f4 req-3378585a-ec65-4c81-99d4-9ef071ce090a service nova] Creating event network-changed:02d986e6-414c-4750-943c-14ccb34d7d64 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:04:06.580972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-829cf3fb-ad81-4e32-b717-6a60582ed9f4 req-3378585a-ec65-4c81-99d4-9ef071ce090a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058018 Jul 18 13:04:06.582467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1219/2337] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:06.591863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:06.593180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:06.603693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.619382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.620588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.624097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.806286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:06.808825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:06.809490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lazy-loading 'fault' on Instance uuid db54c80d-e553-40e9-9062-f44b40b495e1 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:04:07.376409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072006ff234c14a8121c280adae603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdcb708fc204399bd4aacbced94348d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:07.390578 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9c55667-9442-4beb-af7f-ff657318102b tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 200 len: 1315 microversion: 2.1 time: 0.804325 Jul 18 13:04:07.391621 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1220/2338] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:06 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:07.406073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:07.407025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:07.427384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:07.429995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:07.432563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:07.434037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:07.542630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:07.831916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:07.858655 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4fa35817-1b44-4108-bb6d-9e0137fbb64b tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1281 microversion: 2.1 time: 0.464268 Jul 18 13:04:07.864174 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1221/2339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:07 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:07.895713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:07.897051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:07.924301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:07.935277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:07.952425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:07.953135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:08.594596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:08.608076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:08.613342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:08.616206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cdb57dec-e3c0-42ff-8774-224843d681b2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1547 microversion: 2.25 time: 3.201726 Jul 18 13:04:08.618584 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1119/2340] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:05 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1547 bytes in 3205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:08.644091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2b421e51-76f1-4989-9cbe-ac37d4291cb4 req-faa35256-0397-4ad2-bd11-e96b3eed1816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db54c80d-e553-40e9-9062-f44b40b495e1", "name": "network-vif-deleted", "tag": "e22cfb74-7fa7-45ab-9f8f-ac1696e336d3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:08.676909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2b421e51-76f1-4989-9cbe-ac37d4291cb4 req-faa35256-0397-4ad2-bd11-e96b3eed1816 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:08.678287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2b421e51-76f1-4989-9cbe-ac37d4291cb4 req-faa35256-0397-4ad2-bd11-e96b3eed1816 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:08.709929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2b421e51-76f1-4989-9cbe-ac37d4291cb4 req-faa35256-0397-4ad2-bd11-e96b3eed1816 service nova] Creating event network-vif-deleted:e22cfb74-7fa7-45ab-9f8f-ac1696e336d3 for instance db54c80d-e553-40e9-9062-f44b40b495e1 on n-h1-850003-3 Jul 18 13:04:08.728830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2b421e51-76f1-4989-9cbe-ac37d4291cb4 req-faa35256-0397-4ad2-bd11-e96b3eed1816 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107352 Jul 18 13:04:08.731157 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1120/2341] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:08.746984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:08.749989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:08.764305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:08.766317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:08.768096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:08.781072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.184854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:09.216273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81b160f9-2c1f-4750-a825-0b82cfbb1d24 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.349900 Jul 18 13:04:09.217873 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1222/2342] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:07 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:09.230951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:09.232498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:09.252056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.253295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.257312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.259349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.441144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:09.494914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0bf1a10-497f-479a-8c78-d1a24f286cdc tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1283 microversion: 2.1 time: 0.271873 Jul 18 13:04:09.497139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1223/2343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:09 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:09.508855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:09.512041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: db54c80d-e553-40e9-9062-f44b40b495e1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:09.557500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.559263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.560982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.562416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.602507 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 HTTP/1.1 Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:09.608185 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. Jul 18 13:04:09.610581 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'db54c80d-e553-40e9-9062-f44b40b495e1'} Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:09.611997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. Jul 18 13:04:09.614499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:09.617434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance db54c80d-e553-40e9-9062-f44b40b495e1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:09.622080 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5758a301-665a-4b36-8ba0-83dafd22e0ff tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1" status: 404 len: 111 microversion: 2.1 time: 0.121336 Jul 18 13:04:09.630555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1224/2344] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:09 2022] GET /compute/v2.1/servers/db54c80d-e553-40e9-9062-f44b40b495e1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:04:09.643415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:09.644969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:09.661811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.664398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:09.664668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:09.665467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:10.472111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:10.505038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8fa2377-3bcd-4134-abdd-cd1b0f5d5fa0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1281 microversion: 2.1 time: 0.864501 Jul 18 13:04:10.506137 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1225/2345] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:09 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1281 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:10.536724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "name": "network-vif-unplugged", "status": "completed", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:10.560278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:10.564504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:10.578966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:10.610472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] Creating event network-vif-unplugged:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h1-850003-3 Jul 18 13:04:10.640176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] Instance 151b6010-7f23-4448-9249-c1124c76aed7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:04:10.666220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c91dfa98-7fff-4000-837a-7d9c8e6ff607 req-8d705a6f-6836-4b6b-92d8-0c51e415d814 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158219 Jul 18 13:04:10.667712 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1226/2346] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:10.674840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46432c0c-f82c-48a0-9a8f-c8b9b9d87a38 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e9a72790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:10.708088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-46432c0c-f82c-48a0-9a8f-c8b9b9d87a38 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Image not found. Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46432c0c-f82c-48a0-9a8f-c8b9b9d87a38 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf HTTP/1.1 Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:10.710861 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf'} Jul 18 13:04:10.712128 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf to delete Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:10.713431 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf could not be found. Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:10.714608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:04:10.715670 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:10.718610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46432c0c-f82c-48a0-9a8f-c8b9b9d87a38 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:10.720061 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46432c0c-f82c-48a0-9a8f-c8b9b9d87a38 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf" status: 404 len: 62 microversion: 2.1 time: 0.050862 Jul 18 13:04:10.722379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1227/2347] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:10 2022] DELETE /compute/v2.1/images/bfa5150a-f3ef-4ebf-a40b-186f3f75ccbf => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:04:10.732396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:10.738839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:10.743237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:10.748859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-676d6056-4f98-4d84-a4c2-4506c024ba14 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1475 microversion: 2.1 time: 2.015113 Jul 18 13:04:10.752534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1121/2348] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:08 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1475 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:10.761195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:10.763997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:10.764772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:10.765766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:10.767631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:10.771392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:10.788047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:10.789116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:10.790771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:10.791828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.043230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:11.068616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:11.071793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:11.073459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e6c7ae3-cb77-42f4-8846-b6e00beb6a05 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 200 len: 1505 microversion: 2.25 time: 0.349137 Jul 18 13:04:11.074320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1228/2349] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:10 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:11.080563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:11.082310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:11.097970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.101004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.102991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.106538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.350804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:11.379515 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8513434-e55b-46b2-ac7a-1e9775570c0c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1271 microversion: 2.1 time: 0.300345 Jul 18 13:04:11.381436 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1229/2350] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:11 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:11.404049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:11.406023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:11.417403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.418273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.419509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.420381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.444871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 HTTP/1.1 Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:11.447183 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.448424 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '8e9339b5-2805-4cd1-941a-9c31988525e9'} Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:11.449084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.450196 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.453762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:11.455779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21076e08-3cf1-499e-aef5-fe3cbe83d243 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 404 len: 111 microversion: 2.1 time: 0.063919 Jul 18 13:04:11.457786 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1230/2351] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:04:11 2022] DELETE /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:04:11.466790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:11.467430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 8e9339b5-2805-4cd1-941a-9c31988525e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:11.476794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.477588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.478061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.478535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.500285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 HTTP/1.1 Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:11.502782 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.504022 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '8e9339b5-2805-4cd1-941a-9c31988525e9'} Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:11.504737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. Jul 18 13:04:11.506200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:11.510669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 8e9339b5-2805-4cd1-941a-9c31988525e9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:11.513118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b9e06b5-6b5a-44b1-b2f5-0d7972e4e572 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9" status: 404 len: 111 microversion: 2.1 time: 0.049987 Jul 18 13:04:11.520177 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1231/2352] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:11 2022] GET /compute/v2.1/servers/8e9339b5-2805-4cd1-941a-9c31988525e9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:04:11.527516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96a5a224-5492-42b3-8ac7-d5683d17f1ad tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e999b280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:11.574761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96a5a224-5492-42b3-8ac7-d5683d17f1ad tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213097824" status: 202 len: 0 microversion: 2.1 time: 0.053094 Jul 18 13:04:11.583088 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1232/2353] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213097824 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:04:11.591732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:11.592574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:11.601662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.602125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:11.603529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:11.604387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.479805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:12.501880 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c2cfdc8-30c7-466b-b892-f138990d7121 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 0.916726 Jul 18 13:04:12.523295 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1233/2354] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:11 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:12.544077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:12.545544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:12.558268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.559844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.565282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.567574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.669427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:12.700211 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e61f89e-a865-4881-b2a5-26f203e079a9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.944138 Jul 18 13:04:12.717552 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1122/2355] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:10 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:12.724139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:12.724382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: ac89aacc-32a4-4e77-bdff-005c2b85de0d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:12.732152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.732948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.733776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.734255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.760810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] HTTP exception thrown: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Request method failure captured: Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d HTTP/1.1 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vd5K3zxkInX84yzQNmSYv7RhrNf9fnGKJhe_iZTDrxdZe8NQTue8yq8lKnda5qiEeJdFQZWqy7USVbJm6iq1Jug2iIZJl_pwhoLyL57Z-6KL7dOVMpn0ofqGZeuuFeDKiFeBJ-GZxGy8O0Z5qFwYAvL-I_imQHeZ4BE12FPyusiwjw Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:04:12.768656 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_788a3068f3ed4ccb84c3899673be6934", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f604cd53dad44c39944c7e7a57737941 Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. Jul 18 13:04:12.771258 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ac89aacc-32a4-4e77-bdff-005c2b85de0d'} Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:12.775782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. Jul 18 13:04:12.782205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:12.791032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Returning 404 to user: Instance ac89aacc-32a4-4e77-bdff-005c2b85de0d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:12.791032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b74d86e-b4e5-461e-ace2-a52e3f76d778 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d" status: 404 len: 111 microversion: 2.25 time: 0.062999 Jul 18 13:04:12.791032 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1123/2356] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:12 2022] GET /compute/v2.1/servers/ac89aacc-32a4-4e77-bdff-005c2b85de0d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:04:12.791032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:12.791032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:12.794063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.796240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:12.796240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:12.796847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:13.640197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:13.661798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68c0e67e-a816-4f5d-aec3-130b374bf9b1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1475 microversion: 2.1 time: 1.129719 Jul 18 13:04:13.662820 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1234/2357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:12 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1475 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:13.696647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:13.697869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:13.722794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:13.723916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:13.733050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:13.733899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:13.806548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:04:14.112655 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd15df3f-5eb3-43b9-91be-7becca2d9fb0 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 204 len: 0 microversion: 2.25 time: 0.435513 Jul 18 13:04:14.113968 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1235/2358] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:04:13 2022] DELETE /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:04:14.133414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "tag": "d645de39-6738-45ce-bc45-281c0df1bcd0"}, {"server_uuid": "ac89aacc-32a4-4e77-bdff-005c2b85de0d", "name": "network-vif-deleted", "tag": "55c88a66-590e-4e15-8edd-6e29669ee7c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:14.163218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.165529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.206581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] Creating event network-changed:d645de39-6738-45ce-bc45-281c0df1bcd0 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:04:14.207519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] Creating event network-vif-deleted:55c88a66-590e-4e15-8edd-6e29669ee7c2 for instance ac89aacc-32a4-4e77-bdff-005c2b85de0d on n-h2-850003-3 Jul 18 13:04:14.228327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c6a31be7-adba-4e62-9791-a1020b14d7da req-efe6f618-a614-484b-954e-ea98a128ba28 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108178 Jul 18 13:04:14.230339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1236/2359] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:14.243404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:14.245047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:14.258823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.259726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.260719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.261549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.370095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:14.393874 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a66ac365-50c2-4329-be6b-32b8a9d66d17 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 1.614455 Jul 18 13:04:14.398961 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1124/2360] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:12 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:14.432594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:14.433589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:14.449705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.450850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.455189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.456042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.891247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:14.911867 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60c9bfdf-7db5-4970-8f45-e71a2958a7ec tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 0.678938 Jul 18 13:04:14.912576 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1237/2361] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:14 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:14.918511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:14.919615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:14.929696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.930326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:14.931284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:14.931761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:15.724100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:15.764472 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62b98fc6-1ce3-4a67-808f-715018f68379 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.363104 Jul 18 13:04:15.774640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1125/2362] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:14 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:15.781699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:15.785146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:15.804181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:15.809268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:15.810773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:15.811533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:16.288344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:16.367637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:16.493425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:16.519973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:16.528468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:16.531412 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88244d00-18a0-4070-a1b9-c4b54c2a275f tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1563 microversion: 2.25 time: 1.616790 Jul 18 13:04:16.549024 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1238/2363] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:14 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1563 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:16.572439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:16.575984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:16.607976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:16.608859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:16.610481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:16.611859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:17.059530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:17.107308 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-338afe27-3d31-4ff6-9517-13999fcccf1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1475 microversion: 2.1 time: 1.330021 Jul 18 13:04:17.118374 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1126/2364] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:15 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1475 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:17.122790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:17.125437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:17.141419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:17.145157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:17.148241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:17.149559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:17.472754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:17.505316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e160b31-1fd5-4098-98b1-4a68ab788d6d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 0.951087 Jul 18 13:04:17.508718 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1239/2365] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:16 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:17.542268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}, {"name": "network-changed", "server_uuid": "a18c55af-7625-4fe7-88c4-551b46c517d5", "tag": "9d156aa0-20b1-4db6-af83-e738971e5fad"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:17.594444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:17.595510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:17.658357 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Creating event network-changed:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h1-850003-3 Jul 18 13:04:17.659666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Creating event network-changed:9d156aa0-20b1-4db6-af83-e738971e5fad for instance a18c55af-7625-4fe7-88c4-551b46c517d5 on n-h1-850003-3 Jul 18 13:04:17.667673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] Instance 151b6010-7f23-4448-9249-c1124c76aed7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:04:17.707727 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a0110c2d-8b48-493e-a37d-e6bbe42e672d req-c1a73976-d210-4ed4-8fb3-95cadb27b54b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.182874 Jul 18 13:04:17.712063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1240/2366] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:17.727989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d4486ac-52f3-4c79-a2d0-930d3ef991f3 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '.version_select at 0x7f96e9b11040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:17.814559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5d4486ac-52f3-4c79-a2d0-930d3ef991f3 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Image not found. Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d4486ac-52f3-4c79-a2d0-930d3ef991f3 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/images/8fcb5e3e-2b9e-4408-9dfa-08885d1416e1 HTTP/1.1 Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:17.820642 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: exception: Image not found. Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '8fcb5e3e-2b9e-4408-9dfa-08885d1416e1'} Jul 18 13:04:17.823423 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8fcb5e3e-2b9e-4408-9dfa-08885d1416e1 to delete Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:17.825143 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fcb5e3e-2b9e-4408-9dfa-08885d1416e1 could not be found. Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:17.827763 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 13:04:17.830453 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:17.837216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d4486ac-52f3-4c79-a2d0-930d3ef991f3 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Image not found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:17.842853 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d4486ac-52f3-4c79-a2d0-930d3ef991f3 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/images/8fcb5e3e-2b9e-4408-9dfa-08885d1416e1" status: 404 len: 62 microversion: 2.1 time: 0.124133 Jul 18 13:04:17.844474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1241/2367] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:17 2022] DELETE /compute/v2.1/images/8fcb5e3e-2b9e-4408-9dfa-08885d1416e1 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:04:17.861426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:17.862817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:17.910535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:17.911408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:17.912992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:17.919627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:18.748274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:18.773659 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c727381-88ab-4d43-b080-abd42ac5cc5d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.927351 Jul 18 13:04:18.775525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1242/2368] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:17 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:18.790081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3fc594ac-fa41-4433-84ff-33d1852e0d22 req-59231c18-827c-498a-98f5-73e76c9859ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f5ad91-7534-4e02-9f65-390805be077a", "tag": "361e3bb5-be3b-4ae8-86ec-aebedf3025ec"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:18.820192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3fc594ac-fa41-4433-84ff-33d1852e0d22 req-59231c18-827c-498a-98f5-73e76c9859ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:18.821346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3fc594ac-fa41-4433-84ff-33d1852e0d22 req-59231c18-827c-498a-98f5-73e76c9859ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:18.859412 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3fc594ac-fa41-4433-84ff-33d1852e0d22 req-59231c18-827c-498a-98f5-73e76c9859ea service nova] Creating event network-changed:361e3bb5-be3b-4ae8-86ec-aebedf3025ec for instance 03f5ad91-7534-4e02-9f65-390805be077a on n-h1-850003-3 Jul 18 13:04:18.869226 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3fc594ac-fa41-4433-84ff-33d1852e0d22 req-59231c18-827c-498a-98f5-73e76c9859ea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091215 Jul 18 13:04:18.870726 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1243/2369] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:18.884352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:18.886073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:18.907150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:18.910069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:18.912246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:18.913681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.168937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:19.195368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:19.204841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:19.207316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e4a9d28-37f5-458f-be0d-cf5529f7d439 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1521 microversion: 2.25 time: 0.330936 Jul 18 13:04:19.212827 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1244/2370] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:18 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:19.235211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:19.236660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:19.261564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.263368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.265710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.266925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.296641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc HTTP/1.1 Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:19.300919 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:19.303447 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc'} Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:19.304760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:19.306892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:19.312242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:19.315601 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d19c1d32-09d6-46b8-81e0-aa83a5749c75 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 404 len: 111 microversion: 2.1 time: 0.100907 Jul 18 13:04:19.317035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1245/2371] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:04:19 2022] DELETE /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:04:19.330833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:19.332015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:19.349982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.350755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.352423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.354693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.464924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:19.482639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f5d17f3-3b17-4e03-a0c5-926bcb9025f3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 2.368341 Jul 18 13:04:19.483670 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1127/2372] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:17 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:19.497122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:19.499348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:19.510333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:19.514063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.515650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.517487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.518516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.913226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:19.943342 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9928432e-f58c-4d36-93ca-28aecaee2661 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1475 microversion: 2.1 time: 0.624006 Jul 18 13:04:19.944836 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1246/2373] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:19 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1475 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:19.961105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:19.962736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] [instance: 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:19.987124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.988820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:19.990170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:19.991043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.027852 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] HTTP exception thrown: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Request method failure captured: Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc HTTP/1.1 Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vl-hXNVHL7t9OmrTg_WfZKxM6BD86Hmpm472k31OONvoUhpilhnyyBHJm_WhGcGkfcKlsUCAegXiIENS2gysPyU7LAZeWqPSVuc0RFunoSEvb3FWgc-H4L8nuH2oNFuLgfYn-5PH8XLKvZEMrSaZis__PbXxNJpxibbh-PKfKRtvcY Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:20.031953 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dfdcb708fc204399bd4aacbced94348d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dfdcb708fc204399bd4aacbced94348d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: dfdcb708fc204399bd4aacbced94348d Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749408032 Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 28072006ff234c14a8121c280adae603 Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749408032-project Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:20.035066 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc'} Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:20.036647 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. Jul 18 13:04:20.039407 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:20.052392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] Returning 404 to user: Instance 4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:20.056267 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-963c2a36-1d90-41b7-a66b-3113e10a43b0 tempest-ImagesOneServerNegativeTestJSON-749408032 tempest-ImagesOneServerNegativeTestJSON-749408032-project] 10.222.0.88 "GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc" status: 404 len: 111 microversion: 2.1 time: 0.108830 Jul 18 13:04:20.058703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1247/2374] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:19 2022] GET /compute/v2.1/servers/4025fe8c-8a2e-48e1-b44b-1d3cfd85f3dc => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:04:20.075977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:20.077200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:20.098754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.099610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.101323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.102099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.125809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:20.149240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b013482e-a165-47e6-81b4-59bc5070ac3b tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 0.663330 Jul 18 13:04:20.163929 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1128/2375] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:19 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:20.177224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f2d5f6ec-9463-4647-af63-06785b925483 req-b41c7d51-6556-489b-b3e0-fb186be2b234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f60c971-e60a-4d1d-9611-1850f5faa19e", "tag": "cc216706-bb36-49b3-818f-9b469bad616b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:20.212697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f2d5f6ec-9463-4647-af63-06785b925483 req-b41c7d51-6556-489b-b3e0-fb186be2b234 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.213744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f2d5f6ec-9463-4647-af63-06785b925483 req-b41c7d51-6556-489b-b3e0-fb186be2b234 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.244991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f2d5f6ec-9463-4647-af63-06785b925483 req-b41c7d51-6556-489b-b3e0-fb186be2b234 service nova] Creating event network-changed:cc216706-bb36-49b3-818f-9b469bad616b for instance 1f60c971-e60a-4d1d-9611-1850f5faa19e on n-h2-850003-3 Jul 18 13:04:20.258690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f2d5f6ec-9463-4647-af63-06785b925483 req-b41c7d51-6556-489b-b3e0-fb186be2b234 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092367 Jul 18 13:04:20.260479 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1129/2376] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:20.277890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:20.279209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:20.300824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.302243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.303834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.304565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.649644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:20.662119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:20.667896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:20.669217 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e2ae741-aa4f-4a1e-a635-d10d942f0f12 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1347 microversion: 2.25 time: 0.400804 Jul 18 13:04:20.669821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1130/2377] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:20 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1347 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:20.681626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:20.688210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:20.701146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.703707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.705826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:20.706464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:20.987545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:20.994584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:21.006621 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3fbf1ac-4b75-4698-bc99-a47ce9989340 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.941220 Jul 18 13:04:21.007981 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1248/2378] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:20 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:21.020021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-278b4a7b-2c71-4933-af93-465b6e2096f1 req-185a9269-7e42-4c1f-bb0b-ca84cef22815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49ba3be-ae98-4b73-a0b4-f3f0f35886ea", "name": "network-vif-deleted", "tag": "4d7b7e14-1074-4284-8c46-fd0983cd7b59"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:21.040901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-278b4a7b-2c71-4933-af93-465b6e2096f1 req-185a9269-7e42-4c1f-bb0b-ca84cef22815 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.041882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-278b4a7b-2c71-4933-af93-465b6e2096f1 req-185a9269-7e42-4c1f-bb0b-ca84cef22815 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.069123 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-278b4a7b-2c71-4933-af93-465b6e2096f1 req-185a9269-7e42-4c1f-bb0b-ca84cef22815 service nova] Creating event network-vif-deleted:4d7b7e14-1074-4284-8c46-fd0983cd7b59 for instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea on n-h1-850003-3 Jul 18 13:04:21.082390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-278b4a7b-2c71-4933-af93-465b6e2096f1 req-185a9269-7e42-4c1f-bb0b-ca84cef22815 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071070 Jul 18 13:04:21.085247 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1249/2379] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:21.099352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:21.101170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:21.114670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.116178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.118544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.119446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.633938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:21.658910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a62b421-717e-4f8a-ab06-26cf6d66cb84 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1473 microversion: 2.1 time: 0.570498 Jul 18 13:04:21.659660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1250/2380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:21 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1473 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:21.691347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:21.693529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:21.697330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:21.708212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:21.709919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.710861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.713160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.715896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7117da39-3bb5-4b8a-bda3-77ad0406c7a3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 1.044648 Jul 18 13:04:21.716529 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1131/2381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:20 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:21.719384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.724854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:21.725507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:21.733824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.734431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.739620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.745711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.838396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:21.839208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:21.840146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lazy-loading 'fault' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:04:21.946527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:21.999372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:22.010412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:22.015215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9bb79de1-90c2-4911-b272-ed1e01e23f7b tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1352 microversion: 2.25 time: 0.294521 Jul 18 13:04:22.017366 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1132/2382] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:21 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1352 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:22.044575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:22.045905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:22.071808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.072702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.073941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.074673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.315399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:22.349123 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-428191f5-cd5d-4b8e-b11b-83a0df7dec16 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 0.684669 Jul 18 13:04:22.364328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1251/2383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:21 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:22.376487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0142be71-8994-466b-83c7-f8cdce626880 req-1f34fb23-c9f9-4433-9fa8-d8c624d64ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c719db8-7550-4aed-8855-6202224b1e08", "tag": "99700406-94eb-4f96-9c0d-ac9cbee04b6c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:22.392055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0142be71-8994-466b-83c7-f8cdce626880 req-1f34fb23-c9f9-4433-9fa8-d8c624d64ba3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.393615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0142be71-8994-466b-83c7-f8cdce626880 req-1f34fb23-c9f9-4433-9fa8-d8c624d64ba3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.421214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0142be71-8994-466b-83c7-f8cdce626880 req-1f34fb23-c9f9-4433-9fa8-d8c624d64ba3 service nova] Creating event network-changed:99700406-94eb-4f96-9c0d-ac9cbee04b6c for instance 5c719db8-7550-4aed-8855-6202224b1e08 on n-h2-850003-3 Jul 18 13:04:22.433174 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0142be71-8994-466b-83c7-f8cdce626880 req-1f34fb23-c9f9-4433-9fa8-d8c624d64ba3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063605 Jul 18 13:04:22.434841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1252/2384] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:22.691285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:22.693508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:22.708555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.710597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.712569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.713846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.829746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:22.843222 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e408d849-f32a-4b74-8f98-11a04f007f64 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.805363 Jul 18 13:04:22.845929 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1133/2385] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:22 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:22.854021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:22.855778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:22.867829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.868965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:22.870497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:22.871485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:23.784355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:23.802679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f9a5835-35dc-4c05-b399-f5a16235c427 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1473 microversion: 2.1 time: 1.120651 Jul 18 13:04:23.818790 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1253/2386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:22 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1473 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:23.831953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:23.833087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:23.838316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:23.846178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:23.847366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:23.848611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:23.849364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:23.974449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:23.976012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:23.977323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lazy-loading 'fault' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:04:24.045284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:24.092421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:24.096360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:24.100893 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd4e5a44-260d-4053-a72c-1ad232eac151 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1352 microversion: 2.25 time: 0.280483 Jul 18 13:04:24.102683 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1254/2387] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:23 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:24.114634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:24.115343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:24.175827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:24.177512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:24.179832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:24.181116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:24.361943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:24.381561 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bff7ad18-5b5c-42bd-9ca0-d5627fda3a22 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 1.533243 Jul 18 13:04:24.389418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1134/2388] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:22 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:24.397998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:24.401022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:24.412786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:24.413572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:24.432579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:24.434309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:24.955598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:24.972594 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34f5db28-baf0-48d2-8e9c-58e3c4074514 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.581239 Jul 18 13:04:24.987409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1135/2389] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:24 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:24.996540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:24.997353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:25.007148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.008129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.009576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.010473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.183703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:25.221307 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3ee0f41-77a6-45ad-87ba-2d96f6984f7c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 1.109875 Jul 18 13:04:25.222988 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1255/2390] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:24 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:25.245226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:25.257664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:25.278114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.279556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.280943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.282987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.461065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.464398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.471501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lazy-loading 'fault' on Instance uuid d49ba3be-ae98-4b73-a0b4-f3f0f35886ea {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:04:25.599077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:25.641509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:25.659399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f604cd53dad44c39944c7e7a57737941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788a3068f3ed4ccb84c3899673be6934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:25.665955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-48b5c015-d7cc-457b-bfd5-8c266f9d73e1 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 200 len: 1352 microversion: 2.25 time: 0.439084 Jul 18 13:04:25.666619 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1256/2391] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:25 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 1352 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:04:25.715724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:25.718232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:25.754769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.759099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:25.763600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:25.764674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:26.413107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:26.436239 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2ad1e73a-d261-4faf-a260-ff1b860a00fd tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 0.747959 Jul 18 13:04:26.446209 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1257/2392] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:25 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:26.461028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:26.461667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:26.483433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:26.483897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:26.484741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:26.490490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:26.524874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:26.554361 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba14e966-177b-475c-9939-4f2ea9f15f34 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1473 microversion: 2.1 time: 1.564811 Jul 18 13:04:26.571606 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1136/2393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:24 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1473 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:26.596604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:26.599216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:26.621244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:26.625476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:26.631585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:26.632510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:27.541756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:27.571409 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1a2c7c9-7030-4d1b-baa6-219f0cdbc8df tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.122006 Jul 18 13:04:27.586039 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1258/2394] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:26 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:27.613090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:27.622467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] [instance: d49ba3be-ae98-4b73-a0b4-f3f0f35886ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:27.637240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:27.638495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:27.640261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:27.641481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:27.691674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] HTTP exception thrown: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Request method failure captured: Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea HTTP/1.1 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vd5K3zxkInX84yzQNmSYv7RhrNf9fnGKJhe_iZTDrxdZe8NQTue8yq8lKnda5qiEeJdFQZWqy7USVbJm6iq1Jug2iIZJl_pwhoLyL57Z-6KL7dOVMpn0ofqGZeuuFeDKiFeBJ-GZxGy8O0Z5qFwYAvL-I_imQHeZ4BE12FPyusiwjw Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:27.695904 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_788a3068f3ed4ccb84c3899673be6934", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/788a3068f3ed4ccb84c3899673be6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 788a3068f3ed4ccb84c3899673be6934 Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-510363793 Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f604cd53dad44c39944c7e7a57737941 Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-510363793-project Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. Jul 18 13:04:27.699109 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd49ba3be-ae98-4b73-a0b4-f3f0f35886ea'} Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:27.700682 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. Jul 18 13:04:27.703514 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:27.705837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] Returning 404 to user: Instance d49ba3be-ae98-4b73-a0b4-f3f0f35886ea could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:27.705837 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9828bce-9c9d-443e-8b31-ac5e76d017c2 tempest-LiveAutoBlockMigrationV225Test-510363793 tempest-LiveAutoBlockMigrationV225Test-510363793-project] 10.222.0.88 "GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea" status: 404 len: 111 microversion: 2.25 time: 0.112063 Jul 18 13:04:27.708485 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1259/2395] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:04:27 2022] GET /compute/v2.1/servers/d49ba3be-ae98-4b73-a0b4-f3f0f35886ea => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:04:27.721780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-13623f9a-875f-4684-9484-92a968b40eb3 req-c6d865bb-1c0a-4c5f-bb86-7b5a614079c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18c55af-7625-4fe7-88c4-551b46c517d5", "name": "network-vif-plugged", "status": "completed", "tag": "9d156aa0-20b1-4db6-af83-e738971e5fad"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:27.743829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-13623f9a-875f-4684-9484-92a968b40eb3 req-c6d865bb-1c0a-4c5f-bb86-7b5a614079c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:27.744854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-13623f9a-875f-4684-9484-92a968b40eb3 req-c6d865bb-1c0a-4c5f-bb86-7b5a614079c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:27.833841 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-13623f9a-875f-4684-9484-92a968b40eb3 req-c6d865bb-1c0a-4c5f-bb86-7b5a614079c0 service nova] Creating event network-vif-plugged:9d156aa0-20b1-4db6-af83-e738971e5fad for instance a18c55af-7625-4fe7-88c4-551b46c517d5 on n-h1-850003-3 Jul 18 13:04:27.853332 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-13623f9a-875f-4684-9484-92a968b40eb3 req-c6d865bb-1c0a-4c5f-bb86-7b5a614079c0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142312 Jul 18 13:04:27.854821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1260/2396] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:27.867772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:27.869625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:27.883388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:27.884722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:27.900599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:27.903743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:28.919266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:28.935406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4a93fad-3bfe-4788-a127-89f750d38c4a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 1.078327 Jul 18 13:04:28.946808 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1261/2397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:27 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:28.947473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:28.959132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:28.960045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:28.972301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad6aaf3f-61e1-4c68-83d5-7ea8abbfe195 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 2.398467 Jul 18 13:04:28.978070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1137/2398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:26 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:28.982479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:28.983171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:28.984220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:28.985099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:29.002250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:29.003475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:29.041874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:29.042942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:29.044332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:29.045094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:29.878329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:29.888798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5fb8d052-d967-4d1c-a483-390555121bfa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1470 microversion: 2.1 time: 0.940086 Jul 18 13:04:29.902015 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1262/2399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:28 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1470 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:29.912225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:29.913168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:29.936613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:29.938514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:29.941160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:29.941900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:29.987109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:30.043879 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a9d5589-ece9-4453-8e81-11916b11a534 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.063384 Jul 18 13:04:30.066404 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1138/2400] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:28 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:30.088052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:30.089382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:30.104955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.105961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:30.107559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.108918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:30.185428 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c51cd7f-9be5-47ff-b4cd-35493e95a66f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7/action" status: 204 len: 0 microversion: 2.1 time: 0.277951 Jul 18 13:04:30.194373 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1263/2401] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:04:29 2022] POST /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7/action => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:04:30.224775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:30.228579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:30.273765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.283633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:30.285351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.291625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:30.808763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:30.822860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e9bd36b-95cd-4309-bc0f-70ad1c909eaa tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 0.625655 Jul 18 13:04:30.824032 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1264/2402] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:30 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:30.832749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:30.834030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:30.842555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.843159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:30.844268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:30.845388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:31.201170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:31.221632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d38699cb-88d0-46e5-b4d3-4d5d28cc83e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1470 microversion: 2.1 time: 0.396083 Jul 18 13:04:31.226640 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1265/2403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:30 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:31.241761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:31.244731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:31.272740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:31.273199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:31.274020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:31.274499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:31.279624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:31.411431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:31.430267 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf8c99f5-36ae-4d0c-86de-619ed85e4f2d tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 1.361510 Jul 18 13:04:31.431383 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1139/2404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:30 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:31.781942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:31.807765 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0650e21-6e8f-4aba-bf49-a6ff3059866d tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.575644 Jul 18 13:04:31.819758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1266/2405] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:31 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:31.853407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:31.854610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:31.868511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:31.869426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:31.871052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:31.872132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:32.245706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:32.248934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:32.291923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:32.293452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:32.295906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:32.296721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.290561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:33.321894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3fd8dee7-7344-44f2-b160-ba429e835e6b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1470 microversion: 2.1 time: 1.083479 Jul 18 13:04:33.324048 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1267/2406] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:32 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1470 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:33.338108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0b881b10-1fec-43da-a27a-37ce6ce254c1 req-4e0ccf9d-7d7c-494a-8333-dcc7f2e95de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f60c971-e60a-4d1d-9611-1850f5faa19e", "name": "network-vif-plugged", "status": "completed", "tag": "cc216706-bb36-49b3-818f-9b469bad616b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:33.357359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b881b10-1fec-43da-a27a-37ce6ce254c1 req-4e0ccf9d-7d7c-494a-8333-dcc7f2e95de2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:33.358604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b881b10-1fec-43da-a27a-37ce6ce254c1 req-4e0ccf9d-7d7c-494a-8333-dcc7f2e95de2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.385181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0b881b10-1fec-43da-a27a-37ce6ce254c1 req-4e0ccf9d-7d7c-494a-8333-dcc7f2e95de2 service nova] Creating event network-vif-plugged:cc216706-bb36-49b3-818f-9b469bad616b for instance 1f60c971-e60a-4d1d-9611-1850f5faa19e on n-h2-850003-3 Jul 18 13:04:33.392067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0b881b10-1fec-43da-a27a-37ce6ce254c1 req-4e0ccf9d-7d7c-494a-8333-dcc7f2e95de2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065304 Jul 18 13:04:33.393385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1268/2407] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:33.421587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:33.429715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:33.448091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:33.448565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.449747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:33.455986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.663615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:33.692817 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9f8d3be-9186-4515-af2e-eb5be512387c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 1.848098 Jul 18 13:04:33.696140 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1140/2408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:31 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:33.706358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:33.708173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:33.723108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:33.724488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.726693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:33.728645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:33.966321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:33.995993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ace8266f-bc6e-4d0d-b6a4-ba60e2149a47 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 0.599275 Jul 18 13:04:33.998957 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1269/2409] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:33 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:34.345943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:34.351645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:34.397050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:34.397050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:34.397050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:34.397050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:35.012713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:35.032119 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-834b0bd5-4545-41d4-ace6-270ead51c75a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.333642 Jul 18 13:04:35.038211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1141/2410] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:33 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:35.059589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:35.067085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:35.098509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:35.100523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:35.103710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:35.107946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:35.487787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:35.516820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e421b5ef-6dba-45eb-844d-eb3b8372fcbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1470 microversion: 2.1 time: 1.177837 Jul 18 13:04:35.563541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1270/2411] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:34 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1470 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:04:35.586243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:35.601016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:35.655206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:35.661246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:35.671761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:35.676396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:36.089164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:36.114224 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0638b112-b97a-4dc8-bf4e-c003fb9c3446 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 1.073339 Jul 18 13:04:36.147932 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1142/2412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:35 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:36.159481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c719db8-7550-4aed-8855-6202224b1e08", "name": "network-vif-plugged", "status": "completed", "tag": "99700406-94eb-4f96-9c0d-ac9cbee04b6c"}, {"server_uuid": "03f5ad91-7534-4e02-9f65-390805be077a", "name": "network-vif-plugged", "status": "completed", "tag": "361e3bb5-be3b-4ae8-86ec-aebedf3025ec"}, {"server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "name": "network-vif-plugged", "status": "completed", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:36.212521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:36.213869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:36.260284 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Creating event network-vif-plugged:99700406-94eb-4f96-9c0d-ac9cbee04b6c for instance 5c719db8-7550-4aed-8855-6202224b1e08 on n-h2-850003-3 Jul 18 13:04:36.261280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Creating event network-vif-plugged:361e3bb5-be3b-4ae8-86ec-aebedf3025ec for instance 03f5ad91-7534-4e02-9f65-390805be077a on n-h1-850003-3 Jul 18 13:04:36.262942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Creating event network-vif-plugged:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h1-850003-3 Jul 18 13:04:36.275904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] Instance 151b6010-7f23-4448-9249-c1124c76aed7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:04:36.305066 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d17df316-e27c-4ec1-8228-e1c20abd3232 req-0a2a2c4b-9293-408b-b5b5-45322582e9a8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.154143 Jul 18 13:04:36.307009 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1143/2413] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:36.318497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:36.319617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:36.332438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:36.335270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:36.338469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:36.340529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:37.261900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:37.286638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf3f2f02-0ebd-40c4-853f-fff1c0448d8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.977121 Jul 18 13:04:37.287737 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1144/2414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:36 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:37.299508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:37.314511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:37.316304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:37.330617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-653dcffa-4fd9-42d6-ab0d-aa3de4504bad tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1323 microversion: 2.1 time: 1.764438 Jul 18 13:04:37.333834 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1271/2415] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:35 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1323 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:37.348713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:37.349071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:37.349685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:37.351156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:37.354209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:37.356867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:37.380252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:37.381590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:37.383766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:37.385897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:37.860461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:37.884898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57452920-cf48-4d5b-8270-90a92e65886a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1470 microversion: 2.1 time: 0.590015 Jul 18 13:04:37.890085 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1145/2416] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:37 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:38.328368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:38.331617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:38.366039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:38.367317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:38.369442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:38.370555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:39.356403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:39.477254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1753bc3b-5d63-44a1-b85a-94178a3806c7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1313 microversion: 2.1 time: 2.140174 Jul 18 13:04:39.478976 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1272/2417] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:37 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1313 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:39.488978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:39.490568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:39.507873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:39.509065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:39.510908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:39.511991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:40.209167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:40.271551 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-067aa64f-d630-49a4-991d-8ccef3629fec tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 1.956057 Jul 18 13:04:40.275462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1146/2418] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:38 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:40.301274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:40.308236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:40.341233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:40.342514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:40.344269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:40.345811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:41.212651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:41.230639 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-309a607d-917a-4987-9d97-ec27fe14b5f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 200 len: 1517 microversion: 2.1 time: 1.747228 Jul 18 13:04:41.231350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1273/2419] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:39 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 1517 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:41.242566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:41.256217 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57c5f167-998b-4b72-bb73-a4e09cc1db8a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1462 microversion: 2.1 time: 0.978006 Jul 18 13:04:41.257552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:41.261254 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1147/2420] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:40 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1462 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:41.262630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:41.299131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:41.300854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:41.304008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:41.305793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:41.319421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:41.321845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:41.328078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:41.328965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:41.333762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:41.335275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:41.463993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:42.009545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:42.034658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c518481c-cb10-475b-908f-a59acf335a20 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 200 len: 1516 microversion: 2.1 time: 0.764278 Jul 18 13:04:42.035885 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1148/2421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:41 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 1516 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:42.045400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:42.053279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:42.070204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:42.075926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.076652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.077535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.078185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.081509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26ff3891-6945-41c2-a821-486b09debdf7 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1499 microversion: 2.1 time: 0.846036 Jul 18 13:04:42.098435 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1274/2422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:41 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1499 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:42.119189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:42.120086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:42.134873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.143630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.145000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.145765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.445990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e23bc17-dd67-4350-bb7e-1d0102f9b6c4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1613 microversion: 2.1 time: 0.405485 Jul 18 13:04:42.447084 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1149/2423] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:42 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1613 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:42.748921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:42.758382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] Calling method '.version_select at 0x7f96e421b940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:42.763202 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f4adbdd-b77f-40e8-b986-04d7b29aba78 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.663035 Jul 18 13:04:42.774784 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1275/2424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:42 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:42.782928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.784227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.786539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.787700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.791832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:42.792796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:42.803951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.804722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.806201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.806987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.848112 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c830ecd3-2fda-4142-9cff-b13c42250056 tempest-AbsoluteLimitsTestJSON-2110779271 tempest-AbsoluteLimitsTestJSON-2110779271-project] 10.222.0.88 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.392806 Jul 18 13:04:42.861693 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1150/2425] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jul 18 13:04:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:42.864374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:42.867471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:42.882697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.883843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.885512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:42.886979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:42.970740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lazy-loading 'flavor' on Instance uuid 03f5ad91-7534-4e02-9f65-390805be077a {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:04:43.313886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a20240f2-3177-4e50-a275-69bf53a3774d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "POST /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a/action" status: 200 len: 32 microversion: 2.1 time: 0.461427 Jul 18 13:04:43.315671 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1151/2426] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:04:42 2022] POST /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:04:43.348913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94895290-49a2-4500-823a-21b358da7298 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '.version_select at 0x7f96e42199d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:43.357214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94895290-49a2-4500-823a-21b358da7298 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:43.358991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94895290-49a2-4500-823a-21b358da7298 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:43.381123 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94895290-49a2-4500-823a-21b358da7298 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.062931 Jul 18 13:04:43.409584 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1152/2427] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 13:04:43 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:43.644484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:43.693336 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0175a97-955f-4d9a-a798-1df25fcdadbb tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 200 len: 1516 microversion: 2.1 time: 0.916187 Jul 18 13:04:43.705503 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1276/2428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:42 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 1516 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:43.719754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:43.721089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:43.737245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:43.738543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:43.740323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:43.741395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:44.025817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5855d566-6316-49b1-876e-27bbb2bd83d9 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Action: 'create', calling method: .version_select at 0x7f96e9acc9d0>, body: {"keypair": {"name": "tempest-keypair-141974879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt61UeofEzHZ62HFQhuaXyc8emxR43VMhJ5Q7jnQptubI+CZVMDFxKnsuG2U4NKwY/xiDK6Shc4TD31IX9MqUWT9cGQSY5Q6PQ5Da9p11oT4+ghhwMSL7Wgv8Lwfr0TvQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:44.072989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5855d566-6316-49b1-876e-27bbb2bd83d9 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:04:44.099717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5855d566-6316-49b1-876e-27bbb2bd83d9 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for user 7edac715758b45858ce825c02ac327d9 and project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:04:44.181633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5855d566-6316-49b1-876e-27bbb2bd83d9 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.776256 Jul 18 13:04:44.192558 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1153/2429] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:04:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:44.194623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2083149662", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:44.326452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:04:44.626043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:44.658457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6b66966-9007-4fdf-9a3c-c93e8424cb2a tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.958729 Jul 18 13:04:44.673081 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1277/2430] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:43 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:44.707883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:44.709158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:44.731981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:44.734132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:44.736423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:44.737580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:44.805911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:04:44.969494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:04:44.970453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:04:44.971851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:04:44.972386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:04:44.972976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:04:45.011660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.033826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.035415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.035971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.105871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f35c240f-2ebb-4f0e-8667-c9a4d16a0db6 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 204 len: 0 microversion: 2.1 time: 0.411376 Jul 18 13:04:45.112756 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1278/2431] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:04:44 2022] DELETE /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:04:45.122534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:45.125830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:45.138881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:04:45.150958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.152603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.155831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.155831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.169474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:04:45.232034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:04:45.236332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:04:45.369323 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97f34cfa-60b8-4c1c-87c2-4ed4533e9658 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179465 Jul 18 13:04:45.379925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1154/2432] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:04:45.388195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8471a5ff-4440-480a-9ec3-c3518f0c7d08 req-84912ada-8afb-4157-8bb6-829183d61a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-plugged", "status": "completed", "tag": "20aaae6e-b0eb-4733-b64b-5356a7c316eb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:45.433320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8471a5ff-4440-480a-9ec3-c3518f0c7d08 req-84912ada-8afb-4157-8bb6-829183d61a18 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.442922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8471a5ff-4440-480a-9ec3-c3518f0c7d08 req-84912ada-8afb-4157-8bb6-829183d61a18 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.484137 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8471a5ff-4440-480a-9ec3-c3518f0c7d08 req-84912ada-8afb-4157-8bb6-829183d61a18 service nova] Creating event network-vif-plugged:20aaae6e-b0eb-4733-b64b-5356a7c316eb for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:04:45.507144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8471a5ff-4440-480a-9ec3-c3518f0c7d08 req-84912ada-8afb-4157-8bb6-829183d61a18 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123116 Jul 18 13:04:45.508779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1155/2433] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:45.534041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:45.534943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:45.567062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.568057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:45.573284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:45.577155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:46.199720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:46.230930 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7237ed0c-fc72-4475-a8f7-d3cc349a4061 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 200 len: 1522 microversion: 2.1 time: 0.715008 Jul 18 13:04:46.234947 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1156/2434] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:45 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 1522 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:46.255848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8fc706e-82bf-439d-800a-1b21865cfaed tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:46.258221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8fc706e-82bf-439d-800a-1b21865cfaed tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:46.577290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8fc706e-82bf-439d-800a-1b21865cfaed tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:46.607250 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8fc706e-82bf-439d-800a-1b21865cfaed tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1213 microversion: 2.1 time: 0.369904 Jul 18 13:04:46.624902 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1157/2435] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:46 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1213 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:46.655172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:46.661857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:46.690706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:46.692934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:46.699278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:46.700425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.262416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:47.284322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca94d273-ad68-4176-99b1-dd57577a23c5 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.648923 Jul 18 13:04:47.300475 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1158/2436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:46 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:47.322043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:47.330803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:47.333993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:47.366834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20bfeaf1-ae32-4856-bdb1-8fc1e37a9582 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 2.257708 Jul 18 13:04:47.372483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:47.372483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.374120 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1279/2437] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:45 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:47.380281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:47.383512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.600386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-plugged", "status": "completed", "tag": "d645de39-6738-45ce-bc45-281c0df1bcd0"}, {"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-plugged", "status": "completed", "tag": "02d986e6-414c-4750-943c-14ccb34d7d64"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:47.644108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:47.649326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.720210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] Creating event network-vif-plugged:d645de39-6738-45ce-bc45-281c0df1bcd0 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:04:47.721200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] Creating event network-vif-plugged:02d986e6-414c-4750-943c-14ccb34d7d64 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:04:47.743798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-166188d2-304e-4476-bbd4-22e0ade49242 req-02caf7a3-db18-4e7d-9cca-fc4688b100e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.146076 Jul 18 13:04:47.748549 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1280/2438] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:04:47.773286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:47.779172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:47.796815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:47.799046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.803930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:47.804891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:47.979029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:47.999189 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0f18949-9c71-4876-b3bb-ac8ae75d92ca tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1209 microversion: 2.1 time: 0.244107 Jul 18 13:04:48.002294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1281/2439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:47 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1209 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:48.351903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:48.354310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:48.368007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:48.369496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:48.372307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:48.373590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:48.462114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:49.551863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:49.577471 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bbdd91ab-58d0-45aa-b00f-9b769f52f931 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 1.261823 Jul 18 13:04:49.579392 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1282/2440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:48 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:49.586057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:49.587085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:49.596621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:49.597408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:49.598639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:49.599262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:49.628029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:49.657898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e9daff4-c143-41ef-9246-2913ebfb0384 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 200 len: 1522 microversion: 2.1 time: 2.352746 Jul 18 13:04:49.667223 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1159/2441] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:47 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 1522 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:49.693424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:49.696280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:49.700084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:49.713556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:49.714838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:49.716886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:49.717956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:49.953396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:49.976364 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6d76957-8e94-4f3b-845e-25e58fe3bcd1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1271 microversion: 2.1 time: 0.305847 Jul 18 13:04:49.978320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1160/2442] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:49 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:50.349908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:50.395752 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b59d22af-7400-455d-b0f1-105a8f16b2f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1354 microversion: 2.1 time: 0.811103 Jul 18 13:04:50.397115 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1283/2443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:49 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1354 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:50.614849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:50.616889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:50.644424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:50.650791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:50.653014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:50.655491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:50.688893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:50.694985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:50.724044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:50.724964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:50.726393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:50.727431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:51.326510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:51.350175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8aa5ce5e-0626-4fcd-94ea-6ee0a07db5e2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 200 len: 1522 microversion: 2.1 time: 0.667336 Jul 18 13:04:51.351854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1284/2444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:50 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:51.358069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:51.360641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:51.384598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:51.386996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:51.389324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:51.391617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:51.526121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:51.544948 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47ca69d9-df7a-4c6c-9e74-8f450dcbdb4f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.938789 Jul 18 13:04:51.547557 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1161/2445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:50 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:51.556782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:51.558274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:51.615653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:51.616504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:51.618004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:51.630435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:52.316232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:52.335290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6a50a2a-45fb-4d66-a819-fd9cdeaf16f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1271 microversion: 2.1 time: 0.981397 Jul 18 13:04:52.336884 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1285/2446] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:51 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1271 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:52.386518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:52.388081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:52.400422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:52.401714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:52.403593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:52.404918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:52.744043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:52.769444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d12ad08-5e2f-4bf4-8aba-d6cc9897ab66 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 200 len: 1480 microversion: 2.1 time: 0.390374 Jul 18 13:04:52.774914 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1286/2447] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:52 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 1480 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:04:52.965889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:53.031838 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d6404eb-8c9c-4ce4-8fda-fc442e3b52f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1804 microversion: 2.1 time: 1.471540 Jul 18 13:04:53.040316 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1162/2448] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:51 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1804 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:53.055828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:53.056490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:53.087095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.088155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.093104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.095885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.373225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f9e13960-bb3d-4cce-af06-52f7d18a9fbb req-5adaea8e-445e-46f9-a972-8a2c59fe9b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f60c971-e60a-4d1d-9611-1850f5faa19e", "name": "network-vif-deleted", "tag": "cc216706-bb36-49b3-818f-9b469bad616b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:53.427046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f9e13960-bb3d-4cce-af06-52f7d18a9fbb req-5adaea8e-445e-46f9-a972-8a2c59fe9b03 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.428347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f9e13960-bb3d-4cce-af06-52f7d18a9fbb req-5adaea8e-445e-46f9-a972-8a2c59fe9b03 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.454653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f9e13960-bb3d-4cce-af06-52f7d18a9fbb req-5adaea8e-445e-46f9-a972-8a2c59fe9b03 service nova] Creating event network-vif-deleted:cc216706-bb36-49b3-818f-9b469bad616b for instance 1f60c971-e60a-4d1d-9611-1850f5faa19e on n-h2-850003-3 Jul 18 13:04:53.466421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f9e13960-bb3d-4cce-af06-52f7d18a9fbb req-5adaea8e-445e-46f9-a972-8a2c59fe9b03 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.688541 Jul 18 13:04:53.471315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1287/2449] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:53.488573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:53.490475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:53.505501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.506384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.508831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.510221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.577526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d378a00-1d94-4661-85d1-5571485fc263 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d/ips" status: 200 len: 218 microversion: 2.1 time: 0.102557 Jul 18 13:04:53.579716 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1288/2450] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:04:53 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d/ips => generated 218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:53.591634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:53.593714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:53.607215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.608426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.610403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.612015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.779447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:53.804199 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c59b881a-7de9-4fc5-8171-a7428f2c1b48 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1271 microversion: 2.1 time: 0.221229 Jul 18 13:04:53.806730 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1289/2451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:53 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:53.813551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:53.814578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:53.824894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.826010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.827728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:53.830477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:53.900713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:04:54.077662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:54.174286 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6bc6e5af-11b0-412d-ae29-057bf4e3528b tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 204 len: 0 microversion: 2.1 time: 0.365606 Jul 18 13:04:54.178912 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1290/2452] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:04:53 2022] DELETE /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:04:54.196578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:54.205573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:54.231456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.232283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.233808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.239662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.299022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] HTTP exception thrown: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e HTTP/1.1 Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:04:54.302434 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:04:54.305431 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1f60c971-e60a-4d1d-9611-1850f5faa19e'} Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:54.309447 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:04:54.313821 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:04:54.318876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 404 to user: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:54.318876 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88f4de15-a676-4aa8-814b-2b563f3b8ae4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 404 len: 111 microversion: 2.1 time: 0.123753 Jul 18 13:04:54.322741 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1291/2453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:54 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:04:54.341012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:54.347351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:54.420108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.421133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.431179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.435292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.446686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:54.507484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b241af46-bc22-473a-a34c-e4b3f0077d41 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 1.460597 Jul 18 13:04:54.523464 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1163/2454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:53 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:54.552657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:54.574284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:54.590862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:54.618422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.630212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.632326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:54.639088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:54.946657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d26c38ca-79ae-444f-9eff-c7c6b46892d2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.420776 Jul 18 13:04:54.962912 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1164/2455] 10.222.0.88 () {58 vars in 1229 bytes} [Mon Jul 18 13:04:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:04:54.975478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:54.977443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:55.003339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:55.004306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:55.005879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:55.007096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:55.530913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:55.563283 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8ae3262-9f97-4285-96a4-2bac81cd3686 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 0.597608 Jul 18 13:04:55.572367 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1165/2456] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:54 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:55.591134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc916c65-e9ca-4d92-adb0-55a8d4ad41d1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc916c65-e9ca-4d92-adb0-55a8d4ad41d1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:04:55.604903 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 13:04:55.610431 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:55.614495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:55.616802 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:55.623124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:04:55.623124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:04:55.623124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 13:04:55.623124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:55.646714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc916c65-e9ca-4d92-adb0-55a8d4ad41d1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:55.650206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc916c65-e9ca-4d92-adb0-55a8d4ad41d1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.074140 Jul 18 13:04:55.655278 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1166/2457] 10.222.0.88 () {58 vars in 1181 bytes} [Mon Jul 18 13:04:55 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:04:55.677980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:55.680739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:55.716855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:55.723672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:55.729089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:55.730334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.008703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.041741 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a39c600-1755-4725-84a2-3a72b6e0538f tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1810 microversion: 2.1 time: 1.712502 Jul 18 13:04:56.045857 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1292/2458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:54 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1810 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:56.076549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.099408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.105985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:56.130520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.134276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.137934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.140486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.175792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.194760 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80b6fdd6-2919-47de-98f2-32b3c664598e tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.534041 Jul 18 13:04:56.196453 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1167/2459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:55 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:56.239497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:04:56.328543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a46c78b3-5cc3-489e-b4aa-5a48146160d7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.279963 Jul 18 13:04:56.330546 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1293/2460] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:56.356217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.383426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.384518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.servers [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Removing options 'limit' from query {{(pid=131367) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 13:04:56.387636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:56.413379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.423546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.425754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.433099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.532669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:04:56.612421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.613475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:56.616304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:56.641698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.647052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.648973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.649946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.695166 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2da9134a-a71b-46ff-b1bf-4773a838122a tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.343812 Jul 18 13:04:56.712288 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1168/2461] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:56.725044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b1a20ca-1e1a-400a-ae0f-bb99660bc6a4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b1a20ca-1e1a-400a-ae0f-bb99660bc6a4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:04:56.741833 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 13:04:56.744239 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '-1' Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:56.745536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.748142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b1a20ca-1e1a-400a-ae0f-bb99660bc6a4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:56.753324 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b1a20ca-1e1a-400a-ae0f-bb99660bc6a4 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.031127 Jul 18 13:04:56.770891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1169/2462] 10.222.0.88 () {58 vars in 1141 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:04:56.785273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-975becff-9fe9-440d-a6f5-8d2aa3d58504 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-975becff-9fe9-440d-a6f5-8d2aa3d58504 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:04:56.799140 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 13:04:56.801249 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'testing' Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:04:56.802761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.805087 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-975becff-9fe9-440d-a6f5-8d2aa3d58504 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:04:56.807196 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-975becff-9fe9-440d-a6f5-8d2aa3d58504 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029245 Jul 18 13:04:56.820952 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1170/2463] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:04:56.837786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6953fe69-bed1-4f3c-b627-416f18318d15 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.849839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6953fe69-bed1-4f3c-b627-416f18318d15 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.851158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6953fe69-bed1-4f3c-b627-416f18318d15 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:56.893852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.servers [None req-6953fe69-bed1-4f3c-b627-416f18318d15 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Flavor 'non_existing_flavor' could not be found {{(pid=131367) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 18 13:04:56.896993 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6953fe69-bed1-4f3c-b627-416f18318d15 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.073161 Jul 18 13:04:56.914779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1171/2464] 10.222.0.88 () {58 vars in 1177 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:04:56.934567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:56.949950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:56.959365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:56.981532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.987250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:56.990503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:56.993100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:57.233898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:04:57.242058 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b3957939-fa2f-4846-a07c-1f777e61d2b7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.325248 Jul 18 13:04:57.256251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1172/2465] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:04:57.268435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:57.272328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:57.291986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:57.292524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:57.293504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:57.293955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:57.978378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:58.026814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-463b2acc-b82a-4cc9-9abf-c964de9a2b8a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1810 microversion: 2.1 time: 0.761476 Jul 18 13:04:58.028297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1173/2466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:57 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1810 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:58.052654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:58.058591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:58.091774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:58.092592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:58.102249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:58.105411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:58.787237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:58.804882 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ff4ef3f-7510-4022-91c6-c32b103c130f tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.774230 Jul 18 13:04:58.806354 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1174/2467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:58 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:58.823196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:58.833272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:58.846579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:58.879207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:58.880184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:58.883593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:58.887761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.200737 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6238fb8d-fc80-4678-b562-733a5b6986f9 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.392791 Jul 18 13:04:59.203670 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1175/2468] 10.222.0.88 () {58 vars in 1183 bytes} [Mon Jul 18 13:04:58 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:04:59.214989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b3863824-cec6-4209-b06f-0ace49d547d7 req-317ba480-093f-44e1-856b-9946d2c87eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:04:59.231462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b3863824-cec6-4209-b06f-0ace49d547d7 req-317ba480-093f-44e1-856b-9946d2c87eca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.233052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b3863824-cec6-4209-b06f-0ace49d547d7 req-317ba480-093f-44e1-856b-9946d2c87eca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.266769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b3863824-cec6-4209-b06f-0ace49d547d7 req-317ba480-093f-44e1-856b-9946d2c87eca service nova] Creating event network-changed:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h2-850003-3 Jul 18 13:04:59.274419 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b3863824-cec6-4209-b06f-0ace49d547d7 req-317ba480-093f-44e1-856b-9946d2c87eca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068438 Jul 18 13:04:59.284963 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1176/2469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:04:59.296128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:59.301389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:59.318764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.323836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.326111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.328219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.676688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:59.698482 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95c9d5f8-84de-4b63-a0d5-51e3694f8f2a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 3.100072 Jul 18 13:04:59.700689 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1294/2470] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:56 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 3103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:59.708242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:59.715942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:59.717734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:04:59.750610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.756969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.760571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.769635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.819380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:04:59.840684 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10359ac7-b0a4-480f-a841-79ab4e8dad44 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1810 microversion: 2.1 time: 0.551841 Jul 18 13:04:59.842757 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1177/2471] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:59 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1810 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:04:59.853853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:04:59.855866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:04:59.889269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:04:59.896293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.903833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:04:59.905804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:04:59.906662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:00.047042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:00.063799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:00.064815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:00.364426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:00.397425 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dff48761-409e-486c-ad36-d3d2202f9cfe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.551929 Jul 18 13:05:00.403103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1178/2472] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:04:59 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:00.438779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-43afb1e3-0369-4d51-9b97-b3508382d86a req-aef3f8e9-4e4e-4327-8335-28a546a76e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-unplugged", "status": "completed", "tag": "20aaae6e-b0eb-4733-b64b-5356a7c316eb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:00.503167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-43afb1e3-0369-4d51-9b97-b3508382d86a req-aef3f8e9-4e4e-4327-8335-28a546a76e41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:00.503744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-43afb1e3-0369-4d51-9b97-b3508382d86a req-aef3f8e9-4e4e-4327-8335-28a546a76e41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:01.082007 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91617f4b-eb13-4adc-9efb-32a3ade18e31 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.379178 Jul 18 13:05:01.089179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1295/2473] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:04:59 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:01.108489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:01.109951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:01.121117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:01.127445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:01.128611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:01.129230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:01.237861 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-43afb1e3-0369-4d51-9b97-b3508382d86a req-aef3f8e9-4e4e-4327-8335-28a546a76e41 service nova] Creating event network-vif-unplugged:20aaae6e-b0eb-4733-b64b-5356a7c316eb for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:05:01.251355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-43afb1e3-0369-4d51-9b97-b3508382d86a req-aef3f8e9-4e4e-4327-8335-28a546a76e41 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.845723 Jul 18 13:05:01.252945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1179/2474] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:01.272374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:01.274706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:01.299448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:01.300496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:01.303458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:01.314424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:01.954817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:01.994372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b8bbb63-4b6e-4c45-9fd9-8641cb327c55 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1789 microversion: 2.1 time: 0.730728 Jul 18 13:05:01.999003 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1180/2475] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:01 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1789 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:02.011082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-640c3f91-fea3-40fd-8dbe-3fe81b51a353 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:02.039182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-640c3f91-fea3-40fd-8dbe-3fe81b51a353 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:02.049181 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-640c3f91-fea3-40fd-8dbe-3fe81b51a353 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.043188 Jul 18 13:05:02.063764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1181/2476] 10.222.0.88 () {58 vars in 1177 bytes} [Mon Jul 18 13:05:01 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:05:02.077590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:02.078932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:02.100199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.101533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.104649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.108679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.653909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:02.654732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:02.666716 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7f857d3-7006-4be7-8dc2-7cc7296f453c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 1.575605 Jul 18 13:05:02.668097 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1296/2477] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:01 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:02.674117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:02.680113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:02.681755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Searching by: {'deleted': False, 'project_id': '0c45511f823644369bec04ea9f8892dc'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:05:02.683936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ede857f4-f259-47b8-8f2f-3ba0f132ad03 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.627505 Jul 18 13:05:02.691849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.692562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.693578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.694208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.700278 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1182/2478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:02 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:02.718122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-af99df75-8a41-4dab-b0c7-6ab754cad6f1 req-29108ca0-1b4d-415d-88c1-d12beed12758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-deleted", "tag": "d645de39-6738-45ce-bc45-281c0df1bcd0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:02.746194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:05:02.754110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-af99df75-8a41-4dab-b0c7-6ab754cad6f1 req-29108ca0-1b4d-415d-88c1-d12beed12758 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.756403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-af99df75-8a41-4dab-b0c7-6ab754cad6f1 req-29108ca0-1b4d-415d-88c1-d12beed12758 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.817152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:02.820390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6166c116-75b1-4126-965f-d6c286b70009 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.150726 Jul 18 13:05:02.829371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-af99df75-8a41-4dab-b0c7-6ab754cad6f1 req-29108ca0-1b4d-415d-88c1-d12beed12758 service nova] Creating event network-vif-deleted:d645de39-6738-45ce-bc45-281c0df1bcd0 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:05:02.829577 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1297/2479] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:05:02 2022] GET /compute/v2.1/servers => generated 683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:02.836985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:02.837505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:02.848061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.848537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.849541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.849996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.863855 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-af99df75-8a41-4dab-b0c7-6ab754cad6f1 req-29108ca0-1b4d-415d-88c1-d12beed12758 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158506 Jul 18 13:05:02.866214 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1183/2480] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:02.871181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] HTTP exception thrown: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e HTTP/1.1 Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:05:02.873782 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:02.876942 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1f60c971-e60a-4d1d-9611-1850f5faa19e'} Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:02.879292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:02.882060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:02.884063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 404 to user: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:02.884063 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cabfbfed-9f32-4aa1-bb82-76f2ecfd98d3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 404 len: 111 microversion: 2.1 time: 0.045678 Jul 18 13:05:02.884063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1298/2481] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:05:02 2022] DELETE /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:02.905098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:02.907573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:02.935762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.936281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.938314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:02.938502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:02.988168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:05:03.032037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:03.034895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:03.054235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.055096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.062745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.063782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.132254 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-906e7a29-c9a7-4c6b-a155-26e5adf240b2 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 204 len: 0 microversion: 2.1 time: 0.244617 Jul 18 13:05:03.133839 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1184/2482] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:05:02 2022] DELETE /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:05:03.150551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:03.152158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:03.169630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.171101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.173404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.174719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.234709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:05:03.430028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9666e3f7-13ba-4416-88db-9931210184f5 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 204 len: 0 microversion: 2.1 time: 0.289743 Jul 18 13:05:03.434988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1185/2483] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:05:03 2022] DELETE /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:05:03.453352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0aaa72bb-4994-48c8-a277-e5d8b9c9925b req-a66e7c3d-d897-4b48-840f-79a9d0264590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-unplugged", "status": "completed", "tag": "02d986e6-414c-4750-943c-14ccb34d7d64"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:03.493011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0aaa72bb-4994-48c8-a277-e5d8b9c9925b req-a66e7c3d-d897-4b48-840f-79a9d0264590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.493691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0aaa72bb-4994-48c8-a277-e5d8b9c9925b req-a66e7c3d-d897-4b48-840f-79a9d0264590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.524186 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0aaa72bb-4994-48c8-a277-e5d8b9c9925b req-a66e7c3d-d897-4b48-840f-79a9d0264590 service nova] Creating event network-vif-unplugged:02d986e6-414c-4750-943c-14ccb34d7d64 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:05:03.534530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0aaa72bb-4994-48c8-a277-e5d8b9c9925b req-a66e7c3d-d897-4b48-840f-79a9d0264590 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094253 Jul 18 13:05:03.535894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1186/2484] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:03.544129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:03.545349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 1f60c971-e60a-4d1d-9611-1850f5faa19e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:03.559130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.559130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.559569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.560251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.582593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] HTTP exception thrown: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e HTTP/1.1 Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:03.588332 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:03.596008 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1f60c971-e60a-4d1d-9611-1850f5faa19e'} Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:03.597588 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. Jul 18 13:05:03.611867 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:03.618082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 404 to user: Instance 1f60c971-e60a-4d1d-9611-1850f5faa19e could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:03.618082 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e91f889-241e-4bd8-bbcc-ae1efdc86ce3 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e" status: 404 len: 111 microversion: 2.1 time: 0.051161 Jul 18 13:05:03.618082 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1187/2485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:03 2022] GET /compute/v2.1/servers/1f60c971-e60a-4d1d-9611-1850f5faa19e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:03.618082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:03.618082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:03.619387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.619387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.619387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.619387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:03.925522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:03.950032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37fea605-8228-4ea0-83c6-b2feaaf7d51f tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 200 len: 1522 microversion: 2.1 time: 0.352568 Jul 18 13:05:03.953119 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1188/2486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:03 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:03.964462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:03.966385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:03.999459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:03.999459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:04.001630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:04.004234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:04.185934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:04.206818 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5ff6104-5ccd-4168-954a-174b7c70306c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1675 microversion: 2.1 time: 1.182818 Jul 18 13:05:04.208829 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1299/2487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:03 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1675 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:04.220961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:04.222530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:04.236313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:04.237469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:04.239158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:04.240550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:04.316352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:04.342611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f8e9d9b-6b5d-429a-87c5-3f5680114b90 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 0.386524 Jul 18 13:05:04.343778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1189/2488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:03 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:04.991239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:04.993258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:05.017113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.021397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:05.042104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.048683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:05.550362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:05.565981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-41159d88-f72f-46ac-8520-c18cf83b4cb0 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 200 len: 1522 microversion: 2.1 time: 0.585843 Jul 18 13:05:05.569132 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1190/2489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:04 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:05.583636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:05.586455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:05.607059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.607923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:05.617585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.618099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:05.637854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:05.651589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29914ebe-9e39-485d-8e90-bd9871f55118 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 1.440380 Jul 18 13:05:05.663892 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1300/2490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:04 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:05.689448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:05.696116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:05.697509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:05.719085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.721067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:05.723597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:05.728930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:06.696426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:06.721916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac9f3078-0c72-485f-8d7b-a163dc1fcb5a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1675 microversion: 2.1 time: 1.150532 Jul 18 13:05:06.742295 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1191/2491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:05 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1675 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:06.751537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-54a8727a-f724-49e4-9c17-e838fe466f88 req-f59d6827-f1bc-439b-a2d0-0669f24fe91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "name": "network-vif-plugged", "status": "completed", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:06.769229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-54a8727a-f724-49e4-9c17-e838fe466f88 req-f59d6827-f1bc-439b-a2d0-0669f24fe91b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:06.770005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-54a8727a-f724-49e4-9c17-e838fe466f88 req-f59d6827-f1bc-439b-a2d0-0669f24fe91b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:06.803189 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-54a8727a-f724-49e4-9c17-e838fe466f88 req-f59d6827-f1bc-439b-a2d0-0669f24fe91b service nova] Creating event network-vif-plugged:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h2-850003-3 Jul 18 13:05:06.822927 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-54a8727a-f724-49e4-9c17-e838fe466f88 req-f59d6827-f1bc-439b-a2d0-0669f24fe91b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078066 Jul 18 13:05:06.842864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1192/2492] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:06.883083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:06.886522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:06.931461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:06.931923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:06.932757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:06.933203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.083451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:07.114833 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61b297c3-5b83-4030-9368-bbe2d0643aa7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 1.448007 Jul 18 13:05:07.117821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1301/2493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:05 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:07.131447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:07.141447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:07.169213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:07.171511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.172862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:07.175259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.786298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:07.798896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:07.809589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32935c60-a2dc-4bb1-89c2-656e4af9f9a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.689801 Jul 18 13:05:07.814746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1302/2494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:07 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:07.824579 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-569a3fb3-1c0c-4531-888d-7d98fafa3532 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 200 len: 1522 microversion: 2.1 time: 0.972772 Jul 18 13:05:07.827267 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1193/2495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:06 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 1522 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:07.856386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:07.857627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f7d0269c-800c-4357-b20a-cf2d73658366 req-05d620f1-d5a4-4017-bd51-f5545ffd9cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-deleted", "tag": "02d986e6-414c-4750-943c-14ccb34d7d64"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:07.861592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:07.875199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f7d0269c-800c-4357-b20a-cf2d73658366 req-05d620f1-d5a4-4017-bd51-f5545ffd9cee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:07.877338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f7d0269c-800c-4357-b20a-cf2d73658366 req-05d620f1-d5a4-4017-bd51-f5545ffd9cee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.902473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:07.907798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.914008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:07.916599 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f7d0269c-800c-4357-b20a-cf2d73658366 req-05d620f1-d5a4-4017-bd51-f5545ffd9cee service nova] Creating event network-vif-deleted:02d986e6-414c-4750-943c-14ccb34d7d64 for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:05:07.918244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:07.928173 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f7d0269c-800c-4357-b20a-cf2d73658366 req-05d620f1-d5a4-4017-bd51-f5545ffd9cee service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109018 Jul 18 13:05:07.942689 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1303/2496] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:08.144503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:08.150601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:08.174729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:08.176132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:08.178469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:08.179045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:08.860830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:08.913167 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bde4545-5c66-49e9-9a51-a8945b110d86 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 200 len: 1654 microversion: 2.1 time: 1.081493 Jul 18 13:05:08.914609 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1194/2497] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:07 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 1654 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:08.935269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:08.936907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:08.966389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:08.967662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:08.969950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:08.971105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:09.029574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:09.671276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:09.691722 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3620d7e-f349-459f-9cbc-dd9eb2937c03 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1313 microversion: 2.1 time: 1.558892 Jul 18 13:05:09.712701 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1304/2498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:08 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1313 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:09.731962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:09.734252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:09.794005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:09.794995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:09.799940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:09.804980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:09.931319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:09.932526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:09.933691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lazy-loading 'fault' on Instance uuid a18c55af-7625-4fe7-88c4-551b46c517d5 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:05:10.037202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:10.391304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:10.413149 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5a79812-c3f8-4620-9487-f11e8b2c4b95 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1485 microversion: 2.1 time: 1.496718 Jul 18 13:05:10.420399 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1195/2499] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:08 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1485 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:10.436156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:10.441373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:10.451770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.453054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.454266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.455974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.482078 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d HTTP/1.1 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:10.486364 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:05:10.488119 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'd5f69411-1903-437a-8da1-13d8ab06b75d'} Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:10.489103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:05:10.490536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:10.494643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:10.496140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-203d1ec9-71f6-4922-9bc6-9c34e97a2268 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 404 len: 111 microversion: 2.1 time: 0.072573 Jul 18 13:05:10.497804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1196/2500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:10 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:10.516438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-44dec73e-b4bf-439e-84df-799b2bea98d8 req-d3965e5b-852e-4828-928a-5bfd592be9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f69411-1903-437a-8da1-13d8ab06b75d", "name": "network-vif-deleted", "tag": "20aaae6e-b0eb-4733-b64b-5356a7c316eb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:10.527684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-44dec73e-b4bf-439e-84df-799b2bea98d8 req-d3965e5b-852e-4828-928a-5bfd592be9ab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.528488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-44dec73e-b4bf-439e-84df-799b2bea98d8 req-d3965e5b-852e-4828-928a-5bfd592be9ab service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.548129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-44dec73e-b4bf-439e-84df-799b2bea98d8 req-d3965e5b-852e-4828-928a-5bfd592be9ab service nova] Creating event network-vif-deleted:20aaae6e-b0eb-4733-b64b-5356a7c316eb for instance d5f69411-1903-437a-8da1-13d8ab06b75d on n-h1-850003-3 Jul 18 13:05:10.557227 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-44dec73e-b4bf-439e-84df-799b2bea98d8 req-d3965e5b-852e-4828-928a-5bfd592be9ab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056943 Jul 18 13:05:10.558715 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1197/2501] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:10.567233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ded70924-9e45-4c41-a253-1677e8eb33ff req-905c1f4e-4edb-4f25-83b1-4a41c1afd434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18c55af-7625-4fe7-88c4-551b46c517d5", "name": "network-vif-deleted", "tag": "9d156aa0-20b1-4db6-af83-e738971e5fad"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:10.578855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ded70924-9e45-4c41-a253-1677e8eb33ff req-905c1f4e-4edb-4f25-83b1-4a41c1afd434 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.579744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ded70924-9e45-4c41-a253-1677e8eb33ff req-905c1f4e-4edb-4f25-83b1-4a41c1afd434 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.603530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ded70924-9e45-4c41-a253-1677e8eb33ff req-905c1f4e-4edb-4f25-83b1-4a41c1afd434 service nova] Creating event network-vif-deleted:9d156aa0-20b1-4db6-af83-e738971e5fad for instance a18c55af-7625-4fe7-88c4-551b46c517d5 on n-h1-850003-3 Jul 18 13:05:10.612388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ded70924-9e45-4c41-a253-1677e8eb33ff req-905c1f4e-4edb-4f25-83b1-4a41c1afd434 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051812 Jul 18 13:05:10.613668 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1198/2502] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:10.622581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:10.623933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:10.628165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eec590efad4e87b8cc796e66f92ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c45511f823644369bec04ea9f8892dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:10.646434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.648217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.648399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6246e232-b24e-414e-94b0-7858768786f1 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 200 len: 1313 microversion: 2.1 time: 0.933523 Jul 18 13:05:10.649571 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1305/2503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:09 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 1313 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:10.650496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.651156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.730582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:10.731686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:10.752292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.753246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.754331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.754948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.905241 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f505c18-2d36-4773-91cf-cc66eb6c8a43 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "POST /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a/action" status: 202 len: 0 microversion: 2.1 time: 0.286316 Jul 18 13:05:10.914255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1199/2504] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:05:10 2022] POST /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:10.925232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:10.926919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:10.943698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.949841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:10.952913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:10.963771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:11.627866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:11.636501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4450c71-602c-4bb1-8bf5-6a2f4928bcc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1462 microversion: 2.1 time: 0.910439 Jul 18 13:05:11.648722 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1306/2505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:10 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1462 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:11.655068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:11.656221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:11.668791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:11.669519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:11.670398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:11.670855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.006524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:12.043635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f396c632-06ab-49de-98c4-f8e7819daff6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1493 microversion: 2.1 time: 1.126405 Jul 18 13:05:12.048482 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1200/2506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:10 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1493 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:12.069865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:12.073413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: a18c55af-7625-4fe7-88c4-551b46c517d5] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:12.100309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.101108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.110375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.111199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.135809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:12.145261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:05:12.178407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:05:12.182041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] HTTP exception thrown: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. Jul 18 13:05:12.190825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:05:12.191368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:05:12.191789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:05:12.192203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 HTTP/1.1 Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:12.192475 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. Jul 18 13:05:12.194840 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a18c55af-7625-4fe7-88c4-551b46c517d5'} Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:12.196293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. Jul 18 13:05:12.198580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.200539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 404 to user: Instance a18c55af-7625-4fe7-88c4-551b46c517d5 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:12.200539 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63d3f0b2-32ae-4bf1-89d7-a77e09fc0350 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5" status: 404 len: 111 microversion: 2.1 time: 0.144805 Jul 18 13:05:12.215077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1201/2507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:12 2022] GET /compute/v2.1/servers/a18c55af-7625-4fe7-88c4-551b46c517d5 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:12.225596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:12.226845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] [instance: 5c719db8-7550-4aed-8855-6202224b1e08] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:12.253753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.262025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.264997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.267387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.309487 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] HTTP exception thrown: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Request method failure captured: Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 HTTP/1.1 Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vo2ACKDE8cvw9O6BS2GgVLN_ornRmmU2vuNJaz1UR5NHyLm9ZzDsmeyqbPVuXjwLaRJRJVOgSBNHLWjiSemCb-es8U4LZoMlOXjBkjH0pb8yXprDYXLqQSSOTDRov8bNm7THCtfy2SzMzepVzhEmIHEDloTn8WVdrKPWdqd5IaOb_k Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:12.314435 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0c45511f823644369bec04ea9f8892dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0c45511f823644369bec04ea9f8892dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0c45511f823644369bec04ea9f8892dc Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1876752232 Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 88eec590efad4e87b8cc796e66f92ed3 Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServersNegativeTestJSON-1876752232-project Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. Jul 18 13:05:12.317137 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5c719db8-7550-4aed-8855-6202224b1e08'} Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:12.319785 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. Jul 18 13:05:12.331363 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:12.337431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] Returning 404 to user: Instance 5c719db8-7550-4aed-8855-6202224b1e08 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:12.337431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-851d3cf8-5167-4269-8c4c-6c1de72414f7 tempest-ListServersNegativeTestJSON-1876752232 tempest-ListServersNegativeTestJSON-1876752232-project] 10.222.0.88 "GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08" status: 404 len: 111 microversion: 2.1 time: 0.104643 Jul 18 13:05:12.337431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1202/2508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:12 2022] GET /compute/v2.1/servers/5c719db8-7550-4aed-8855-6202224b1e08 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:12.493876 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a56421e-52a9-4fa6-9dc4-ad6e7c098a9f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79/action" status: 202 len: 0 microversion: 2.1 time: 0.842662 Jul 18 13:05:12.500144 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1307/2509] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:05:11 2022] POST /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:12.519946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:12.525967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:12.557609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.558808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.565634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.567579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.804864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:12.816098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ced2b47a-95fa-429f-bf55-cbba39cda0d1 req-8268ad14-b5a8-4a6e-8cad-4625e5510475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c719db8-7550-4aed-8855-6202224b1e08", "name": "network-vif-deleted", "tag": "99700406-94eb-4f96-9c0d-ac9cbee04b6c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:12.886977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ced2b47a-95fa-429f-bf55-cbba39cda0d1 req-8268ad14-b5a8-4a6e-8cad-4625e5510475 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:12.904986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ced2b47a-95fa-429f-bf55-cbba39cda0d1 req-8268ad14-b5a8-4a6e-8cad-4625e5510475 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:12.974972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ced2b47a-95fa-429f-bf55-cbba39cda0d1 req-8268ad14-b5a8-4a6e-8cad-4625e5510475 service nova] Creating event network-vif-deleted:99700406-94eb-4f96-9c0d-ac9cbee04b6c for instance 5c719db8-7550-4aed-8855-6202224b1e08 on n-h2-850003-3 Jul 18 13:05:12.999996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ced2b47a-95fa-429f-bf55-cbba39cda0d1 req-8268ad14-b5a8-4a6e-8cad-4625e5510475 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195483 Jul 18 13:05:13.006100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1308/2510] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:13.087555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:13.089993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:13.126302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:13.127750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:13.133084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:13.134200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:13.147729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:13.157451 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d02fc83-1e7d-4e37-88c8-b6b280c2db2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1471 microversion: 2.1 time: 0.651282 Jul 18 13:05:13.177119 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1203/2511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:12 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:13.878520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:13.909789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7fd2f57-4c07-4d3a-9bdf-ddfe71ad9edf tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1493 microversion: 2.1 time: 0.836293 Jul 18 13:05:13.917580 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1309/2512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:13 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1493 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:14.190839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:14.196594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:14.215182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:14.227902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:14.228968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:14.229444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:14.947428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:14.961232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:15.012038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:15.013441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:15.015884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:15.017106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:15.492023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:15.563845 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b86975d9-d8a5-4878-be17-141078445903 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1471 microversion: 2.1 time: 1.352781 Jul 18 13:05:15.568135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1204/2513] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:14 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1471 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:15.841895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:15.861259 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b76298d5-c614-40f0-9887-99b44268191c tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1493 microversion: 2.1 time: 0.914059 Jul 18 13:05:15.863222 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1310/2514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:14 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1493 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:16.594451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:16.595235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:16.613818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:16.614537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:16.615494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:16.615971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:16.921593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:16.923249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:16.937645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:16.938051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:16.945113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:16.949259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:17.582547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:17.621590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0dc86d0a-e811-4135-8003-1a53182e8168 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1471 microversion: 2.1 time: 1.030113 Jul 18 13:05:17.622683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1205/2515] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:16 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1471 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:18.630403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:18.645391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:18.647959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:18.651359 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fcb33d14-1762-4933-bb61-82683be5bebd tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1493 microversion: 2.1 time: 1.761000 Jul 18 13:05:18.656481 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1311/2516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:16 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1493 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:18.689857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:18.691529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:18.693658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:18.694830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:19.391751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c60333a-b7a9-4d8d-ae9f-565920c4b4d0 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] Action: 'create', calling method: .version_select at 0x7f96e9b1b4c0>, body: {"security_group": {"name": "tempest-securitygroup-500015386", "description": "tempest-description-765652819"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:20.011744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:20.035461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54e125b0-82b1-43c4-8191-fece0e06a415 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1471 microversion: 2.1 time: 1.397981 Jul 18 13:05:20.055222 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1206/2517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:18 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1471 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:05:20.062763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:20.068916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:20.091122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:20.125063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:20.127620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:20.138681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:20.147836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:20.247546 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c60333a-b7a9-4d8d-ae9f-565920c4b4d0 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.206515 Jul 18 13:05:20.260859 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1312/2518] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:05:20.435598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d9df57a-970d-4c7f-920f-3e6be74b306c tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e4f1b160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1290451405", "description": "tempest-description-1796854848"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:20.841680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d9df57a-970d-4c7f-920f-3e6be74b306c tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.575297 Jul 18 13:05:20.843974 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1313/2519] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:20 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:20.875571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-adfaed32-17c1-4e7e-a97f-62e22478fc8c tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] Action: 'create', calling method: .version_select at 0x7f96e5259b80>, body: {"security_group": {"name": "tempest-securitygroup-604279940", "description": "tempest-description-1450243624"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:21.410756 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-adfaed32-17c1-4e7e-a97f-62e22478fc8c tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.564268 Jul 18 13:05:21.412719 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1314/2520] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:21.428018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efb1f517-a3af-4d39-8cb0-7922c65bb71e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e4efa0d0>, body: {"security_group_rule": {"parent_group_id": "cbe1f69f-61e1-43bd-9cd2-3e4865958934", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:21.477226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:21.509414 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a7442f4-dc67-4517-9ce0-6bece6ea7c69 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1499 microversion: 2.1 time: 1.440615 Jul 18 13:05:21.512483 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1207/2521] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:20 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1499 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:21.527793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:21.530129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:21.562724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:21.572570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:21.579853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:21.585745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:22.313282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-efb1f517-a3af-4d39-8cb0-7922c65bb71e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.898494 Jul 18 13:05:22.315311 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1315/2522] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:22.475161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7004278c-45fe-4086-bc5f-fe009c60a77b tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Action: 'create', calling method: .version_select at 0x7f96e9b06f70>, body: {"security_group": {"name": "tempest-securitygroup-260773342", "description": "tempest-description-253560599"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:22.674286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:22.742411 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11b1a367-acc3-419d-9df4-95be0f905c71 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1471 microversion: 2.1 time: 1.227570 Jul 18 13:05:22.746085 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1208/2523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:21 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1471 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:22.775964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:22.781960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:22.862020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:22.864066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:22.871227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:22.876197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:23.022733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:05:23.115644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:23.228502 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b62fd46-6c97-4212-b6e5-f27d0181927d tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "DELETE /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 204 len: 0 microversion: 2.1 time: 0.477046 Jul 18 13:05:23.234616 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1209/2524] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:05:22 2022] DELETE /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:05:23.253812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-338abb57-5ae9-44a9-ac14-03c0af4debe6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e418a820>, body: {"security_group_rule": {"parent_group_id": "cbe1f69f-61e1-43bd-9cd2-3e4865958934", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:23.455078 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7004278c-45fe-4086-bc5f-fe009c60a77b tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.137790 Jul 18 13:05:23.456102 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1316/2525] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:22 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:23.463373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:23.464582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:23.477888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:23.481049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:23.482584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:23.483721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:23.661004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-338abb57-5ae9-44a9-ac14-03c0af4debe6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-338abb57-5ae9-44a9-ac14-03c0af4debe6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 138 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:23.664080 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "cbe1f69f-61e1-43bd-9cd2-3e4865958934", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 13:05:23.665983 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: exception: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbe1f69f-61e1-43bd-9cd2-3e4865958934', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:23.667080 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 Jul 18 13:05:23.668912 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:23.672371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-338abb57-5ae9-44a9-ac14-03c0af4debe6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: This rule already exists in group cbe1f69f-61e1-43bd-9cd2-3e4865958934 {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:23.673891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-338abb57-5ae9-44a9-ac14-03c0af4debe6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.437586 Jul 18 13:05:23.675250 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1210/2526] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:23 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:05:23.686813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f366d725-7b38-4aa1-ae49-44d4041e4356 tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Action: 'create', calling method: .version_select at 0x7f96e9ab8ca0>, body: {"security_group": {"name": "tempest-securitygroup-513917132", "description": "tempest-description-1236529137"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:23.947286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:23.970436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4922f183-7ec6-4c46-ad1b-abc89da2bac2 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.511502 Jul 18 13:05:23.971471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1317/2527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:23 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:24.004693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f11fc4c3-6d4c-436d-a464-19601fd3d519 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e4c53b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:24.635763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f11fc4c3-6d4c-436d-a464-19601fd3d519 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/8dba23de-b221-43c2-a4ea-10f4fe701bac" status: 202 len: 0 microversion: 2.1 time: 0.660336 Jul 18 13:05:24.636750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1318/2528] 10.222.0.88 () {58 vars in 1286 bytes} [Mon Jul 18 13:05:23 2022] DELETE /compute/v2.1/os-security-group-rules/8dba23de-b221-43c2-a4ea-10f4fe701bac => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:24.642779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:24.643503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:24.660484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:24.667806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:24.668383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:24.670736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:24.671228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:25.235005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:25.255483 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6a823b0-17f3-43a9-b70a-9a329c49de4d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.617772 Jul 18 13:05:25.256691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1319/2529] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:24 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:25.289222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e96bbfd0-d2b0-42cd-9f12-3482bd235401 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e4c53940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1784577675", "description": "tempest-description-595622179"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:25.469346 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f366d725-7b38-4aa1-ae49-44d4041e4356 tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.791714 Jul 18 13:05:25.470253 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1211/2530] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:25.480286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:25.481311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:25.534587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:25.535056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:25.535937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:25.536387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:25.859334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e96bbfd0-d2b0-42cd-9f12-3482bd235401 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.599344 Jul 18 13:05:25.860444 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1320/2531] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:25.865472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Calling method '.version_select at 0x7f96e4f75940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:26.072813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:26.101492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4fcc4d73-d9cd-4216-b28c-3e98f4805584 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.625758 Jul 18 13:05:26.102980 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1212/2532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:25 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:26.125505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68907796-d785-4350-9e1f-cfca9ee2a323 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e98a68b0>, body: {"security_group_rule": {"parent_group_id": "5eb62f0e-5d4f-4fdf-9664-a909f5d7746c", "ip_protocol": "tcp", "from_port": 354447553, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:26.418692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-68907796-d785-4350-9e1f-cfca9ee2a323 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Invalid port range 354447553:22. Former value cannot be greater than the later Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68907796-d785-4350-9e1f-cfca9ee2a323 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 145 Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:26.422766 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "5eb62f0e-5d4f-4fdf-9664-a909f5d7746c", "ip_protocol": "tcp", "from_port": 354447553, "to_port": 22}} Jul 18 13:05:26.424517 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid port range 354447553:22. Former value cannot be greater than the later Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5eb62f0e-5d4f-4fdf-9664-a909f5d7746c', 'ip_protocol': 'tcp', 'from_port': 354447553, 'to_port': 22}}} Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 354447553:22. Former value cannot be greater than the later Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:26.425368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 354447553:22. Former value cannot be greater than the later Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 354447553:22. Former value cannot be greater than the later Jul 18 13:05:26.427068 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:26.431305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68907796-d785-4350-9e1f-cfca9ee2a323 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: Invalid port range 354447553:22. Former value cannot be greater than the later {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:26.431305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68907796-d785-4350-9e1f-cfca9ee2a323 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.324579 Jul 18 13:05:26.435965 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1213/2533] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:26 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:05:26.461575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:26.463800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:26.489839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:26.492117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:26.495386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:26.496576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:27.033991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:27.049530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00a5f40d-a384-4222-b12d-640292874594 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.606235 Jul 18 13:05:27.050642 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1214/2534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:26 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:27.072901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-143283f8-1cac-445c-8d99-40c57db75459 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e419d430>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1887114894", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:27.075373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-143283f8-1cac-445c-8d99-40c57db75459 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Security group id should be uuid Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-143283f8-1cac-445c-8d99-40c57db75459 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 131 Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:27.077936 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1887114894", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:27.079911 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group id should be uuid Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1887114894', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:27.081373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 18 13:05:27.083418 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:27.089180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-143283f8-1cac-445c-8d99-40c57db75459 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: Security group id should be uuid {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:27.091194 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-143283f8-1cac-445c-8d99-40c57db75459 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028166 Jul 18 13:05:27.093309 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1215/2535] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:05:27.108956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b725adcd-14eb-4596-bc69-f6c1e3983d64 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e9a91820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-526166368", "description": "tempest-description-977880098"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:28.240114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b725adcd-14eb-4596-bc69-f6c1e3983d64 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.137750 Jul 18 13:05:28.259215 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1216/2536] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:27 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:05:28.268092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:28.276650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:28.285567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:28.286044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:28.286950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:28.292369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:29.106093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:29.155739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7270c63e-8571-4245-a76b-62f89be137da tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 200 len: 1505 microversion: 2.1 time: 0.897887 Jul 18 13:05:29.157912 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1217/2537] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:28 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 1505 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:29.179535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:29.182341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:29.217880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:29.224294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:29.228060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:29.230503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:30.188889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:30.212903 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b493478-d5b4-4895-bdbf-59c837698fdc tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 1.044576 Jul 18 13:05:30.220711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1218/2538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:29 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:30.243545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f43b467-a44d-48a6-9da4-cdf9b2524a92 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e9a91670>, body: {"security_group_rule": {"parent_group_id": "c9a5b2c5-21ac-4998-a2d5-e77908d1b30b", "ip_protocol": "tempest-999-340988920", "from_port": 22, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:30.459000 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9f43b467-a44d-48a6-9da4-cdf9b2524a92 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Invalid IP protocol tempest-999-340988920. Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f43b467-a44d-48a6-9da4-cdf9b2524a92 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 156 Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:30.461310 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "c9a5b2c5-21ac-4998-a2d5-e77908d1b30b", "ip_protocol": "tempest-999-340988920", "from_port": 22, "to_port": 22}} Jul 18 13:05:30.464218 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid IP protocol tempest-999-340988920. Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c9a5b2c5-21ac-4998-a2d5-e77908d1b30b', 'ip_protocol': 'tempest-999-340988920', 'from_port': 22, 'to_port': 22}}} Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-340988920. Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:30.465761 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-340988920. Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-340988920. Jul 18 13:05:30.468898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.471050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f43b467-a44d-48a6-9da4-cdf9b2524a92 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: Invalid IP protocol tempest-999-340988920. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:30.471050 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f43b467-a44d-48a6-9da4-cdf9b2524a92 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.241976 Jul 18 13:05:30.471050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1219/2539] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:30 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:05:30.481854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-15ac0695-969f-4ec7-8887-4e130fcdc14b req-8dd1b8da-8146-4923-9942-8241bc8149aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f5ad91-7534-4e02-9f65-390805be077a", "name": "network-vif-deleted", "tag": "361e3bb5-be3b-4ae8-86ec-aebedf3025ec"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:30.520681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-15ac0695-969f-4ec7-8887-4e130fcdc14b req-8dd1b8da-8146-4923-9942-8241bc8149aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:30.522568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-15ac0695-969f-4ec7-8887-4e130fcdc14b req-8dd1b8da-8146-4923-9942-8241bc8149aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:30.564792 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-15ac0695-969f-4ec7-8887-4e130fcdc14b req-8dd1b8da-8146-4923-9942-8241bc8149aa service nova] Creating event network-vif-deleted:361e3bb5-be3b-4ae8-86ec-aebedf3025ec for instance 03f5ad91-7534-4e02-9f65-390805be077a on n-h1-850003-3 Jul 18 13:05:30.588891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-15ac0695-969f-4ec7-8887-4e130fcdc14b req-8dd1b8da-8146-4923-9942-8241bc8149aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114426 Jul 18 13:05:30.594323 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1220/2540] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:30.622305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:30.628724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: 03f5ad91-7534-4e02-9f65-390805be077a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:30.651534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:30.658026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:30.660078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:30.662778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:30.702916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] HTTP exception thrown: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Request method failure captured: Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a HTTP/1.1 Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vn481kDZ5B60AaeDIHycPfLe0EdjWG8bK02PZUEtavSoy1PAywNGEW-Ui6lfzJC5YQxE18e3lZSa_xibx5lsoBl5XLh0dcDGvmShzl-IkH86wdDOZt_Ds_o3J8xlqbL9kJvRHzDqhvDmbPWKCQddh42ysKRTtAMnwbyyXJnlBfn55I Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 05f9b284d97d41ac8afa7868c6cc6d9e Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:30.707139 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_05f9b284d97d41ac8afa7868c6cc6d9e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 05f9b284d97d41ac8afa7868c6cc6d9e Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueTestJSON-1073498307-project Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0777c4a95337482bab188d2e052314d7 Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueTestJSON-1073498307-project Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. Jul 18 13:05:30.710038 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '03f5ad91-7534-4e02-9f65-390805be077a'} Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:30.711799 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. Jul 18 13:05:30.714477 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:30.719126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Returning 404 to user: Instance 03f5ad91-7534-4e02-9f65-390805be077a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:30.721088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7567ef1-70d3-4ccd-a3f9-babfd470b9be tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a" status: 404 len: 111 microversion: 2.1 time: 0.120324 Jul 18 13:05:30.722424 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1221/2541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:30 2022] GET /compute/v2.1/servers/03f5ad91-7534-4e02-9f65-390805be077a => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:30.739820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-312344015", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "651361b2-be11-43c3-be96-e6ad49bc3d9c"}, {"uuid": "0507f2e4-3c52-44a9-819f-84b378fa2af5"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:30.880217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] validate_networks() for [('651361b2-be11-43c3-be96-e6ad49bc3d9c', None, None, None, None, None), ('0507f2e4-3c52-44a9-819f-84b378fa2af5', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:05:32.835326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:05:32.837380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:05:32.838616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:05:32.840024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:05:32.841021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:05:32.861518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:32.862745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:32.865799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:32.866869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:32.913203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Getting quotas for project ff8ce4457d364d45aafb4650e0eeaa13. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:05:32.925682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Getting quotas for user 45a196974f5c40b5a62f0ed5ef73042f and project ff8ce4457d364d45aafb4650e0eeaa13. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:05:32.952859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:05:32.957818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:05:33.096093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b83f2dd-87d7-4dbf-bdb5-11abe9b5783c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.363084 Jul 18 13:05:33.101294 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1222/2542] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:05:33.126875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49c7b5ba-846d-4d8a-9d38-b5490034ce90 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e419db80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-803341996", "description": "tempest-description-1871080808"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:33.404594 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49c7b5ba-846d-4d8a-9d38-b5490034ce90 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.299143 Jul 18 13:05:33.411147 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1223/2543] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:33.458978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:33.469825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:33.503139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:33.509806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:33.513836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:33.515924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:33.597833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:05:33.854861 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59023b89-8218-4eee-a87a-1fc3eb903107 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "DELETE /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 204 len: 0 microversion: 2.1 time: 0.433640 Jul 18 13:05:33.855946 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1224/2544] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:05:33 2022] DELETE /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:05:33.905061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:33.907186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:33.959023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:33.960172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:33.979009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:33.984945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:34.727903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:34.751482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:34.777129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-664cfc2e-7751-4a0a-affb-34074df5cd5c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.894249 Jul 18 13:05:34.791020 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1225/2545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:33 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:34.817099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:34.818418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:34.835741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:34.837312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:34.838931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:34.839898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:35.074668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:35.129052 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0db7bee9-25f1-432b-acd8-8d5efe23ad91 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1216 microversion: 2.1 time: 0.327785 Jul 18 13:05:35.135355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1226/2546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:34 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1216 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:35.171656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c3ed6d9-253b-418a-9ae8-82ffd77e418a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e9ab8430>, body: {"security_group_rule": {"parent_group_id": "1c4b71ae-0645-489a-a91b-08a36630804a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:35.240476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:35.320792 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-1c3ed6d9-253b-418a-9ae8-82ffd77e418a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c3ed6d9-253b-418a-9ae8-82ffd77e418a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 138 Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:35.324285 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "1c4b71ae-0645-489a-a91b-08a36630804a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 18 13:05:35.327578 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1c4b71ae-0645-489a-a91b-08a36630804a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:35.329072 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 13:05:35.331565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:35.336445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c3ed6d9-253b-418a-9ae8-82ffd77e418a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:35.346557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c3ed6d9-253b-418a-9ae8-82ffd77e418a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.200787 Jul 18 13:05:35.357311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1227/2547] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:35 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:05:35.367439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:35.382672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:35.405755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:35.407017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:35.408380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:35.409148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:36.203242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:36.215896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eac8db65-1263-46f0-a4e3-da5da76bd1fe tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1491 microversion: 2.1 time: 0.855882 Jul 18 13:05:36.219162 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1228/2548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:35 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1491 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:36.240665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25a63d88-6d0e-4c73-a679-5b32c256341b tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e418c8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-314222671", "description": "tempest-description-1135334078"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:36.535309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:05:36.537356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Neutron security group cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:05:36.539109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.security_groups [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Security Group ID cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 does not exist {{(pid=131366) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 18 13:05:36.600356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG neutronclient.v2_0.client [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 does not exist", "detail": ""}} {{(pid=131366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:05:36.601664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Neutron security group cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 not found {{(pid=131366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:05:36.602563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.security_groups [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Security Group ID cdf2d2f8-2bf0-4d2d-bc53-2825370e3c79 does not exist {{(pid=131366) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 18 13:05:36.604731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-590238b7-a8aa-47d2-ab3d-4a0a2bfe709c tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] 10.222.0.88 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10326 microversion: 2.1 time: 10.742605 Jul 18 13:05:36.605355 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1321/2549] 10.222.0.88 () {58 vars in 1190 bytes} [Mon Jul 18 13:05:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10326 bytes in 10744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:05:36.629816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:36.632226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:36.647482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:36.648760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:36.651059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:36.652664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:37.341887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25a63d88-6d0e-4c73-a679-5b32c256341b tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.120578 Jul 18 13:05:37.343923 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1229/2550] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:05:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:37.355493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:37.369327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:37.388772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:37.390032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:37.391517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:37.392286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:37.616520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:37.633986 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dfcd6a82-809b-46d0-ae0e-7a39245b8364 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1270 microversion: 2.1 time: 0.287926 Jul 18 13:05:37.635171 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1230/2551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:37 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:37.644798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da0a9981-523b-4520-a7c7-0e2a337651d4 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] Calling method '.version_select at 0x7f96e419d040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:37.693924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:37.708921 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4630cae-7d60-4daf-9178-62a271c2123f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 1.101713 Jul 18 13:05:37.709810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1322/2552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:36 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:37.716462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:37.718359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:37.728972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:37.729826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:37.731395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:37.732183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:38.216944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0777c4a95337482bab188d2e052314d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f9b284d97d41ac8afa7868c6cc6d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:38.228801 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e31f76f8-c3cf-445d-8cda-d97d89871db6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 200 len: 1491 microversion: 2.1 time: 0.517467 Jul 18 13:05:38.234292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1323/2553] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:37 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 1491 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:38.235293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3f69453-c672-403b-a353-79a9df0b45a6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e4741430>, body: {"security_group_rule": {"parent_group_id": "3b2da09a-abb9-4384-9441-45d8612b7085", "ip_protocol": "tcp", "from_port": 22, "to_port": 1041000726}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:38.499860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f3f69453-c672-403b-a353-79a9df0b45a6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3f69453-c672-403b-a353-79a9df0b45a6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 146 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:05:38.504929 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: {"security_group_rule": {"parent_group_id": "3b2da09a-abb9-4384-9441-45d8612b7085", "ip_protocol": "tcp", "from_port": 22, "to_port": 1041000726}} Jul 18 13:05:38.507687 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3b2da09a-abb9-4384-9441-45d8612b7085', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1041000726}}} Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:38.509057 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 Jul 18 13:05:38.512886 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:05:38.523369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3f69453-c672-403b-a353-79a9df0b45a6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 400 to user: Invalid port range 22:1041000726. Valid TCP ports should be between 1-65535 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:38.525363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3f69453-c672-403b-a353-79a9df0b45a6 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.294210 Jul 18 13:05:38.526960 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1324/2554] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:38 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:05:38.538676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1398563921", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6230f282-918e-4216-94c1-2b73f0f96e2c"}], "security_groups": [{"name": "tempest-securitygroup--1125183347"}], "key_name": "tempest-keypair-141974879", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4766e877-693e-4b52-8dac-ae886c0941e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:38.871349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] validate_networks() for [('6230f282-918e-4216-94c1-2b73f0f96e2c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:05:39.122393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da0a9981-523b-4520-a7c7-0e2a337651d4 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.485490 Jul 18 13:05:39.123387 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1231/2555] 10.222.0.88 () {58 vars in 1190 bytes} [Mon Jul 18 13:05:37 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:39.133179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Action: 'create', calling method: .version_select at 0x7f96e99f7670>, body: {"security_group_rule": {"parent_group_id": "9b56703f-1355-4e3c-8fef-c6fed38a7db7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:39.213828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:05:39.215496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Neutron security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 not found {{(pid=131367) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 13:05:39.216699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.216699 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 138 Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:39.222744 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: {"security_group_rule": {"parent_group_id": "9b56703f-1355-4e3c-8fef-c6fed38a7db7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 13:05:39.224184 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9b56703f-1355-4e3c-8fef-c6fed38a7db7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:05:39.224882 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 18 13:05:39.226679 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.230121 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 404 to user: Security group 9b56703f-1355-4e3c-8fef-c6fed38a7db7 does not exist Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-71b120f4-b6ac-422c-9efa-c57473af219c'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:39.233921 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ab6e5f8-eb05-4388-8927-0391eb287fdf tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.105841 Jul 18 13:05:39.239072 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1232/2556] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 18 13:05:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:39.252058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:39.253472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:39.263360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:39.263828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:39.265209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:39.265644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:39.817505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:39.831680 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ef49bba-23b5-47a4-9c72-be3dd92cc431 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1312 microversion: 2.1 time: 0.587579 Jul 18 13:05:39.832745 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1233/2557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:39 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:39.851151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:39.852912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:39.871214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:39.872177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:39.874124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:39.875829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:40.267371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:40.286641 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5def210-cef2-43f9-ab7b-92f3b8e55eb6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.451659 Jul 18 13:05:40.307611 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1234/2558] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:39 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:40.321570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58058167-c37a-42c0-a400-0d2e5a3c9ac9 tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Calling method '.version_select at 0x7f96e9a7cf70>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:40.831936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:05:40.845791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for user 7edac715758b45858ce825c02ac327d9 and project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:05:40.878891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:05:40.880152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:05:40.881466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:05:40.882625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:05:40.883840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:05:40.901864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:40.903673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:40.906617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:40.907945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:40.947682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:05:40.964822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Getting quotas for user 7edac715758b45858ce825c02ac327d9 and project b8c45bbe6bdc4f9e814c009b5d1ead58. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:05:41.013699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58058167-c37a-42c0-a400-0d2e5a3c9ac9 tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/eacd0199-c38f-43df-b7fb-28e4dce863fa" status: 202 len: 0 microversion: 2.1 time: 0.703721 Jul 18 13:05:41.016347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1235/2559] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:40 2022] DELETE /compute/v2.1/os-security-groups/eacd0199-c38f-43df-b7fb-28e4dce863fa => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:41.033947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e41b5b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:41.109900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:05:41.114140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4766e877-693e-4b52-8dac-ae886c0941e9',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:05:41.135468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG neutronclient.v2_0.client [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist", "detail": ""}} {{(pid=131367) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 13:05:41.136529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.security_group_api [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Neutron security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 not found {{(pid=131367) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 18 13:05:41.137422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] HTTP exception thrown: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.137422 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Request method failure captured: Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-security-group-rules/044c39cf-7e97-48e2-968f-6a3f587e1fc9 HTTP/1.1 Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VqPxb4m7u60IWIEWvZHHmVF0YjDNO5GcmB65tmF75W_N9dkJgSMqpXWY_wpPGC2XEvaPLPyqedH28unoT30j1XucktKgwWGo2DUkV2-ZLaprVcTBUJep_BrGe0DNA6u7a-jSJeA5cfw4Rpusq0boif7TN9E7_56xund7pAky2FAsDE Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:41.142213 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d3e02f8f1d349b099de4f0305d1211e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d3e02f8f1d349b099de4f0305d1211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d3e02f8f1d349b099de4f0305d1211e Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703 Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: f79994b98eca4ee894f2e1b761e13513 Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: exception: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.145134 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '044c39cf-7e97-48e2-968f-6a3f587e1fc9'} Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:41.146223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 18 13:05:41.147956 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.149517 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] Jul 18 13:05:41.151974 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.159868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Returning 404 to user: Security group rule 044c39cf-7e97-48e2-968f-6a3f587e1fc9 does not exist Jul 18 13:05:41.159868 n-d-850003-3 devstack@n-api.service[131367]: Neutron server returns request_ids: ['req-e61c0afb-7472-4dcd-ac4c-56566e386cad'] {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:41.162382 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e64cc67e-73b5-42b7-ba49-e9ef59b7ed1e tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/044c39cf-7e97-48e2-968f-6a3f587e1fc9" status: 404 len: 199 microversion: 2.1 time: 0.143587 Jul 18 13:05:41.166539 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1236/2560] 10.222.0.88 () {58 vars in 1286 bytes} [Mon Jul 18 13:05:41 2022] DELETE /compute/v2.1/os-security-group-rules/044c39cf-7e97-48e2-968f-6a3f587e1fc9 => generated 199 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:41.190432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:41.191928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] [instance: dfedec2b-9b9c-492f-8415-943ee8a915fe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:41.215865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:41.218761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:41.220413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:41.221516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:41.254007 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] HTTP exception thrown: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Request method failure captured: Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe HTTP/1.1 Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vn481kDZ5B60AaeDIHycPfLe0EdjWG8bK02PZUEtavSoy1PAywNGEW-Ui6lfzJC5YQxE18e3lZSa_xibx5lsoBl5XLh0dcDGvmShzl-IkH86wdDOZt_Ds_o3J8xlqbL9kJvRHzDqhvDmbPWKCQddh42ysKRTtAMnwbyyXJnlBfn55I Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 05f9b284d97d41ac8afa7868c6cc6d9e Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:05:41.258844 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_05f9b284d97d41ac8afa7868c6cc6d9e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05f9b284d97d41ac8afa7868c6cc6d9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 05f9b284d97d41ac8afa7868c6cc6d9e Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueTestJSON-1073498307 Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueTestJSON-1073498307-project Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0777c4a95337482bab188d2e052314d7 Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueTestJSON-1073498307-project Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. Jul 18 13:05:41.261558 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'dfedec2b-9b9c-492f-8415-943ee8a915fe'} Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:05:41.263205 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. Jul 18 13:05:41.266720 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:05:41.272325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] Returning 404 to user: Instance dfedec2b-9b9c-492f-8415-943ee8a915fe could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:05:41.274336 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f24a9e99-58b2-4946-bc50-d1bc20a311a6 tempest-ServerRescueTestJSON-1073498307 tempest-ServerRescueTestJSON-1073498307-project] 10.222.0.88 "GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe" status: 404 len: 111 microversion: 2.1 time: 0.105144 Jul 18 13:05:41.276176 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1237/2561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:41 2022] GET /compute/v2.1/servers/dfedec2b-9b9c-492f-8415-943ee8a915fe => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:05:41.290261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-76fa2ed0-3204-4392-9bf9-f82190f75123 req-9fced44d-e78d-46b1-8a99-68c1368a7cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfedec2b-9b9c-492f-8415-943ee8a915fe", "name": "network-vif-deleted", "tag": "0c82e20f-4a12-4268-8f19-dbf023d3dc0b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:41.329247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-76fa2ed0-3204-4392-9bf9-f82190f75123 req-9fced44d-e78d-46b1-8a99-68c1368a7cce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:41.332394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-76fa2ed0-3204-4392-9bf9-f82190f75123 req-9fced44d-e78d-46b1-8a99-68c1368a7cce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:41.354291 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-76fa2ed0-3204-4392-9bf9-f82190f75123 req-9fced44d-e78d-46b1-8a99-68c1368a7cce service nova] Creating event network-vif-deleted:0c82e20f-4a12-4268-8f19-dbf023d3dc0b for instance dfedec2b-9b9c-492f-8415-943ee8a915fe on n-h2-850003-3 Jul 18 13:05:41.360654 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-76fa2ed0-3204-4392-9bf9-f82190f75123 req-9fced44d-e78d-46b1-8a99-68c1368a7cce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082185 Jul 18 13:05:41.362512 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1238/2562] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:41.370219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:41.370995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:41.379734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:41.380287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:41.381391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:41.382040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:41.494344 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-424f8709-1371-4064-bcd1-0f93b835cb91 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.965277 Jul 18 13:05:41.496023 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1325/2563] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:05:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 2968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:05:41.504512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c66b2b9b-236c-4d47-a911-04b7e70fbd2a tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] Calling method '.version_select at 0x7f96e4f75dc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:41.935823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:41.968738 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2608393-4b1b-40ef-b864-298842adf6fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1312 microversion: 2.1 time: 0.602643 Jul 18 13:05:41.970318 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1239/2564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:41 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1312 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:41.989441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-488ede57-8afb-4d24-9cbd-2b02910e65ed tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e41f6d30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:42.887107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:42.941583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:43.089389 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-488ede57-8afb-4d24-9cbd-2b02910e65ed tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/3b2da09a-abb9-4384-9441-45d8612b7085" status: 202 len: 0 microversion: 2.1 time: 1.106563 Jul 18 13:05:43.090898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1240/2565] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:41 2022] DELETE /compute/v2.1/os-security-groups/3b2da09a-abb9-4384-9441-45d8612b7085 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:43.127532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:43.131847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:43.193905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.195197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:43.200244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.204229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:43.282919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:43.668284 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c66b2b9b-236c-4d47-a911-04b7e70fbd2a tempest-SecurityGroupsTestAdminJSON-720272572 tempest-SecurityGroupsTestAdminJSON-720272572-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/57b71b9c-5ddf-4fee-9956-d38b4ce32059" status: 202 len: 0 microversion: 2.1 time: 2.170041 Jul 18 13:05:43.672240 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1326/2566] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:41 2022] DELETE /compute/v2.1/os-security-groups/57b71b9c-5ddf-4fee-9956-d38b4ce32059 => generated 0 bytes in 2175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:43.687312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:43.689203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:43.705941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.706714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:43.707957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.708651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:43.881606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:43.911692 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29aee42a-8dc7-416c-95fd-e891c76be7a6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1219 microversion: 2.1 time: 0.234234 Jul 18 13:05:43.914210 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1327/2567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:43 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:43.925369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:43.927238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:43.950012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.954563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:43.956753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:43.957645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:44.017665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:44.048923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81ea27b9-ac82-403e-b42a-b3416d5d5688 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.955821 Jul 18 13:05:44.055953 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1241/2568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:43 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:44.081467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ef8322e9-4ac7-4d62-9642-630f75017a49 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e41f68b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:44.394093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:44.403482 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a12a4fd-79e2-40bc-90ec-6aaa2fea5813 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 0.487052 Jul 18 13:05:44.404374 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1328/2569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:43 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:44.420947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-360c01e5-b052-460e-a8b1-f285aa7ad895 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] Calling method '.version_select at 0x7f96e9a139d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:45.721570 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-360c01e5-b052-460e-a8b1-f285aa7ad895 tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/8d2405c3-1809-404d-a7ac-807eed5bef87" status: 202 len: 0 microversion: 2.1 time: 1.315250 Jul 18 13:05:45.723423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1329/2570] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:44 2022] DELETE /compute/v2.1/os-security-groups/8d2405c3-1809-404d-a7ac-807eed5bef87 => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:45.735817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:45.737035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:45.769573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:45.770801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:45.772331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:45.773159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:45.994599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:46.020622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-55d565ed-0033-43f6-865b-dd46847ca39c tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1237 microversion: 2.1 time: 0.295481 Jul 18 13:05:46.021696 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1330/2571] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:45 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1237 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:46.043409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:46.045226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:46.078113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:46.079730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:46.081663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:46.082977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:46.556054 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ef8322e9-4ac7-4d62-9642-630f75017a49 tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/1c4b71ae-0645-489a-a91b-08a36630804a" status: 202 len: 0 microversion: 2.1 time: 2.498514 Jul 18 13:05:46.556892 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1242/2572] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:44 2022] DELETE /compute/v2.1/os-security-groups/1c4b71ae-0645-489a-a91b-08a36630804a => generated 0 bytes in 2500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:46.563653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:46.564578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:46.586648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:46.587118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:46.587934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:46.588379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:46.590525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:46.630719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-197d4f21-cc68-4414-b921-735f64eacaf9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 0.594377 Jul 18 13:05:46.631779 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1331/2573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:46 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:46.690801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4679253-c920-4e57-bda7-d93d8356c29c tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] Calling method '.version_select at 0x7f96e9b1bee0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:47.279248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4679253-c920-4e57-bda7-d93d8356c29c tempest-SecurityGroupsTestAdminJSON-943221116 tempest-SecurityGroupsTestAdminJSON-943221116-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/3a7d653f-06ff-4106-969e-a9f0c1c4ffb4" status: 202 len: 0 microversion: 2.1 time: 0.626518 Jul 18 13:05:47.281242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1332/2574] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:46 2022] DELETE /compute/v2.1/os-security-groups/3a7d653f-06ff-4106-969e-a9f0c1c4ffb4 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:47.301470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c651429-7f89-41da-b9bb-b8b44f34d42f tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e9b1b430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:48.494929 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c651429-7f89-41da-b9bb-b8b44f34d42f tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/c9a5b2c5-21ac-4998-a2d5-e77908d1b30b" status: 202 len: 0 microversion: 2.1 time: 1.208810 Jul 18 13:05:48.498373 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1333/2575] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:47 2022] DELETE /compute/v2.1/os-security-groups/c9a5b2c5-21ac-4998-a2d5-e77908d1b30b => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:48.545678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:48.546359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:48.574561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:48.576120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:48.577350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:48.587102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:48.668883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:48.695243 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d281955-3dbe-43c5-8913-d82e5d709873 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 2.137175 Jul 18 13:05:48.702844 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1243/2576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:46 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:48.729324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:48.730812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:48.764350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:48.765257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:48.766856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:48.771798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:49.504960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:49.521497 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-530207de-bada-4f18-af17-649fe9aeea60 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1305 microversion: 2.1 time: 1.020578 Jul 18 13:05:49.547133 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1334/2577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:48 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1305 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:49.558407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9253ac34-2aa1-413c-98e6-f3b324098109 req-7098a7c0-491c-45d0-9b4d-3ad5f79cdd2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "tag": "9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:49.574054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9253ac34-2aa1-413c-98e6-f3b324098109 req-7098a7c0-491c-45d0-9b4d-3ad5f79cdd2f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:49.575590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9253ac34-2aa1-413c-98e6-f3b324098109 req-7098a7c0-491c-45d0-9b4d-3ad5f79cdd2f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:49.598676 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9253ac34-2aa1-413c-98e6-f3b324098109 req-7098a7c0-491c-45d0-9b4d-3ad5f79cdd2f service nova] Creating event network-changed:9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:05:49.607971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9253ac34-2aa1-413c-98e6-f3b324098109 req-7098a7c0-491c-45d0-9b4d-3ad5f79cdd2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056955 Jul 18 13:05:49.609424 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1335/2578] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:49.618983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6f6ee87-8c84-4a19-83dd-772932645a5a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e42cf940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:50.023141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:50.061485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a92e361f-038c-4a1c-8f42-00d695387f06 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 1.350355 Jul 18 13:05:50.069224 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1244/2579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:48 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:50.084485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:50.092179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:50.121017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:50.122296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:50.124645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:50.135475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:50.925985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:50.983854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:51.747007 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6f6ee87-8c84-4a19-83dd-772932645a5a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5eb62f0e-5d4f-4fdf-9664-a909f5d7746c" status: 202 len: 0 microversion: 2.1 time: 2.135406 Jul 18 13:05:51.748634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1336/2580] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:49 2022] DELETE /compute/v2.1/os-security-groups/5eb62f0e-5d4f-4fdf-9664-a909f5d7746c => generated 0 bytes in 2138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:51.757533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:51.765739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:51.774528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:51.817183 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c8938ac-4978-479a-9212-38c5ab1cbb9a tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.745833 Jul 18 13:05:51.821826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:51.823869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1245/2581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:50 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:51.829097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:51.831020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:51.832257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:51.842515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:51.843754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:51.876195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:05:51.907399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:51.908327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:51.909822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:51.912459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:53.297535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:53.321503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6fc923e7-6e4b-4057-bc98-88815fb59070 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 1.495566 Jul 18 13:05:53.322503 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1246/2582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:51 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:53.334809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09f80ca7-400d-4a7c-be30-601d6796144a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] Calling method '.version_select at 0x7f96e4202ee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:54.045305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:54.087829 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15881dce-bd8d-4c65-81a7-9fc95380c79d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1305 microversion: 2.1 time: 2.335760 Jul 18 13:05:54.100164 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1337/2583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:51 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1305 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:54.107683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:54.108745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:54.119051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:54.120118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:54.121469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:54.123884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:55.285404 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09f80ca7-400d-4a7c-be30-601d6796144a tempest-SecurityGroupRulesNegativeTestJSON-2105495703 tempest-SecurityGroupRulesNegativeTestJSON-2105495703-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/cbe1f69f-61e1-43bd-9cd2-3e4865958934" status: 202 len: 0 microversion: 2.1 time: 1.961198 Jul 18 13:05:55.286702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1247/2584] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:05:53 2022] DELETE /compute/v2.1/os-security-groups/cbe1f69f-61e1-43bd-9cd2-3e4865958934 => generated 0 bytes in 1963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:05:55.299092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c90d9118-253a-41b1-afe3-402084ba0a94 req-98436989-7791-4aef-ad15-f4849a99c848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "tag": "e5668153-ea5a-4ebe-9dc4-12c94a908857"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:55.312660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c90d9118-253a-41b1-afe3-402084ba0a94 req-98436989-7791-4aef-ad15-f4849a99c848 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:55.313543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c90d9118-253a-41b1-afe3-402084ba0a94 req-98436989-7791-4aef-ad15-f4849a99c848 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:55.338975 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c90d9118-253a-41b1-afe3-402084ba0a94 req-98436989-7791-4aef-ad15-f4849a99c848 service nova] Creating event network-changed:e5668153-ea5a-4ebe-9dc4-12c94a908857 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:05:55.346542 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c90d9118-253a-41b1-afe3-402084ba0a94 req-98436989-7791-4aef-ad15-f4849a99c848 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057692 Jul 18 13:05:55.350346 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1248/2585] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:55.358498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:55.360149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:55.379629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:55.381434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:55.384607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:55.385510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:55.590126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:55.615374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c173b26-8a95-4f56-b8fc-e0692e8f2640 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.512456 Jul 18 13:05:55.630830 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1338/2586] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:54 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:55.638549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:55.639473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:55.657471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:55.658601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:55.660319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:55.662973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:56.351158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:56.363461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0268c801-b74f-4de1-8bd4-77e99bffc4d6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1305 microversion: 2.1 time: 0.730969 Jul 18 13:05:56.376116 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1339/2587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:55 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1305 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:56.485708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:56.500832 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1622c8a8-ff2f-447c-9238-c3aae5e6ae43 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1476 microversion: 2.1 time: 1.147761 Jul 18 13:05:56.504819 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1249/2588] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:55 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1476 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:56.588946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-546205230", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:56.666266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:56.679952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:56.715457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:56.718276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:56.724494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:56.731419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:56.765080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:05:57.801310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:05:57.802387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:05:57.803098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:05:57.803739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:05:57.804411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:05:57.836790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:57.837778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:57.841034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:57.843058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:57.912961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Getting quotas for project c933ade754c74ccfb275dc4f93232ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:05:57.929543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Getting quotas for user f7c9bfbcb2a646d78f5ef5032fe8d778 and project c933ade754c74ccfb275dc4f93232ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:05:57.968817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:05:57.974126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:05:58.077466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d736b4c-7fd7-413d-9f9d-b9926229fcad tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700062 Jul 18 13:05:58.085670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1340/2589] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:05:58.118652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:58.154875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b53d4c81-a244-47f6-97ea-b22d9f1cc797 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.514804 Jul 18 13:05:58.158485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1250/2590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:56 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:58.175466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:58.178110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:58.231706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:58.232218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:58.237557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:58.238594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:58.283928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a91f947d-9b53-4c9c-b177-126faaf8e41e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: .version_select at 0x7f96e4c3c310>, body: {"keypair": {"name": "tempest-keypair-1415955086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlHH72+abM5zIe/J7eyiQnGZw1Dh1V2PWvviyjPy6kEmxjBeHV8oXa0ktjKzab2V1ai8IC0qFpVeYdhY1lNftmG6Og1P2zc0wj9H3OuqT+W7qPZ93va83tpnrI3hFzGdg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:58.370985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a91f947d-9b53-4c9c-b177-126faaf8e41e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:05:58.405782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a91f947d-9b53-4c9c-b177-126faaf8e41e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:05:58.520324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a91f947d-9b53-4c9c-b177-126faaf8e41e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.433018 Jul 18 13:05:58.521383 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1341/2591] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:05:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:58.531818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-74244bb4-0879-46f2-83c4-c31c9cfcfb8d req-0396089f-6d9f-4c03-bc87-fb5c943d65fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8af146-685a-4aeb-85d7-b843e0ae3ff0", "tag": "e8ef0a7a-903e-4c2b-81b7-0da1f6670f15"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:05:58.568774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-74244bb4-0879-46f2-83c4-c31c9cfcfb8d req-0396089f-6d9f-4c03-bc87-fb5c943d65fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:58.573071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-74244bb4-0879-46f2-83c4-c31c9cfcfb8d req-0396089f-6d9f-4c03-bc87-fb5c943d65fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:58.613756 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-74244bb4-0879-46f2-83c4-c31c9cfcfb8d req-0396089f-6d9f-4c03-bc87-fb5c943d65fb service nova] Creating event network-changed:e8ef0a7a-903e-4c2b-81b7-0da1f6670f15 for instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 on n-h2-850003-3 Jul 18 13:05:58.647099 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-74244bb4-0879-46f2-83c4-c31c9cfcfb8d req-0396089f-6d9f-4c03-bc87-fb5c943d65fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123741 Jul 18 13:05:58.656598 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1342/2592] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:05:58.681731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:58.696494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:58.716841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:58.718250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:58.720070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:05:58.721216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:05:59.264134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:59.299486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de155639-7df2-484d-b32a-af60ec73be40 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1475 microversion: 2.1 time: 0.636597 Jul 18 13:05:59.323310 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1343/2593] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:58 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1475 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:59.355519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36ca78e0-039d-482a-8211-6cc67d67329a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:59.356626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36ca78e0-039d-482a-8211-6cc67d67329a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:05:59.903292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36ca78e0-039d-482a-8211-6cc67d67329a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:05:59.936166 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36ca78e0-039d-482a-8211-6cc67d67329a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1221 microversion: 2.1 time: 0.605491 Jul 18 13:05:59.938814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1344/2594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:59 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1221 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:05:59.978086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:05:59.983710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:00.025308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:00.037832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:00.039266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:00.046589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:00.231739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:00.280398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92765484-a82f-4b8d-82e2-260f57deaae8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 2.118867 Jul 18 13:06:00.283177 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1251/2595] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:58 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:00.309862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "name": "network-vif-unplugged", "status": "completed", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:00.358803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:00.364861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:00.403479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] Creating event network-vif-unplugged:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h1-850003-3 Jul 18 13:06:00.416027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:06:00.456792 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c80d5abc-d53f-44fb-a4e3-11ac14b5dd92 req-0c83d280-d3e3-4ec5-a0bd-0591fa97860b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169908 Jul 18 13:06:00.460126 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1252/2596] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:00.475934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:00.477649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:00.500651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:00.501804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:00.504848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:00.505852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:01.047125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:01.082712 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aefa8441-34ac-4325-8e08-4db13cdb2f14 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.133091 Jul 18 13:06:01.102828 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1345/2597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:05:59 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:01.119176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:01.131602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:01.148647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:01.150499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:01.152242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:01.153272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:01.365488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:01.380705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9a90818-b344-4de2-b853-088e5e550a61 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1281 microversion: 2.1 time: 0.275959 Jul 18 13:06:01.383096 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1346/2598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:01 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:01.390622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:01.393098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:01.413480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:01.414610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:01.416481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:01.417366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:01.667332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:01.682089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a7c024a-edf7-477b-96f2-3ea97387471a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1475 microversion: 2.1 time: 1.214739 Jul 18 13:06:01.703087 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1253/2599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:00 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1475 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:01.946116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:01.956582 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-747cff01-650d-4cda-a1c4-2a66aa4449bc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 0.571987 Jul 18 13:06:01.961325 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1347/2600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:01 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:02.116055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:02.117906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:02.139313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.140153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.142451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.145343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.411555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:02.413397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:02.423456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.424551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.425825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.426643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.551422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:02.562429 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a9b8538-2f16-47f6-86a7-3f2c27686727 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1281 microversion: 2.1 time: 0.155508 Jul 18 13:06:02.563383 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1348/2601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:02 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:02.571306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:02.584419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.585213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.592124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:02.606422 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] Creating event network-changed:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h1-850003-3 Jul 18 13:06:02.615144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:06:02.634816 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-45114013-3c7d-4bd1-bbc2-4848e4d6ca8c req-5ff4e621-28e1-4af9-8a27-4f0c0f50dc26 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069169 Jul 18 13:06:02.636620 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1349/2602] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:02.725697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:02.727121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:02.740244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.741178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:02.742535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:02.743337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:03.617024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:03.630790 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3341da8-94fa-4f49-9947-0f2152077fa8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1475 microversion: 2.1 time: 0.914473 Jul 18 13:06:03.631904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1350/2603] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:02 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1475 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:03.647909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:03.649308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:03.660969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:03.661618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:03.663009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:03.663751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:03.924108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:03.964990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-def40ae5-4dac-40bd-89b0-cd3d037de6f6 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.857798 Jul 18 13:06:03.965606 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1254/2604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:02 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:03.978384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:03.978384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:03.999322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:04.004048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:04.005692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:04.008106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:04.183200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:04.209757 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd7c47a0-8a75-456b-b8f5-e2333390f383 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 0.575984 Jul 18 13:06:04.214970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1351/2605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:03 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:04.377109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:04.409866 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-948d287a-b9bc-43dd-8145-0ef5e8aa99fc tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1279 microversion: 2.1 time: 0.442720 Jul 18 13:06:04.410789 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1255/2606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:03 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1279 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:04.656285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:04.657455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:04.694864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:04.706113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:04.714469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:04.720182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:04.722780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:04.998377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:04.999151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:05.012001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.012763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:05.014363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.014989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:05.330731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:05.344102 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-856fd10e-99fd-4c93-a2d3-753faf342479 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1475 microversion: 2.1 time: 0.697172 Jul 18 13:06:05.345192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1352/2607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:04 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1475 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:05.354349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:05.359035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:05.372002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.377266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:05.378711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.379278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:05.830839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:05.846053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42205a38-24b5-4462-856a-17881fffdfb5 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 0.851903 Jul 18 13:06:05.859034 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1256/2608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:04 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:05.875836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:05.877351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:05.889336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.890846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:05.892816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:05.893979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:06.025421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:06.100045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:06.110443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c761541-231e-4fb5-8758-2afaf4df4245 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 0.762941 Jul 18 13:06:06.113430 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1353/2609] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:05 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:06.126488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-18547804-05a7-48a1-b639-dd535849e9f2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1279 microversion: 2.1 time: 0.264850 Jul 18 13:06:06.140101 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1257/2610] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:05 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:06.376342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:06.377924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:06.389449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:06.390878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:06.392554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:06.393536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:06.883353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:06.890311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:06.911721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:06.918360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:06.920576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:06.921449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:07.541185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:07.567836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-248bdf47-18ea-487e-b9b3-510810953d8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1475 microversion: 2.1 time: 1.199507 Jul 18 13:06:07.571984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1354/2611] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:06 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1475 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:07.585370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:07.586516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:07.611495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:07.613162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:07.621250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:07.622682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:07.879960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:07.908538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:07.933160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e98c1cb1-b5ca-43a6-b1eb-a29771b440d0 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.059124 Jul 18 13:06:07.935228 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1258/2612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:06 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:07.973319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:07.978117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:07.998963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:08.000357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:08.001355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:08.001969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:08.594681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:08.613464 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1fa0138-88db-4887-a8c8-11bbb4ad9578 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 1.039121 Jul 18 13:06:08.621205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1355/2613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:07 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:08.636678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-6764519", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "609839e4-f25f-4b03-a576-8c39127f230c"}], "security_groups": [{"name": "tempest-securitygroup--58202453"}], "key_name": "tempest-keypair-1415955086", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:08.753218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:08.770698 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c05596e1-ee7b-4b21-a22b-caf10db5cbf2 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.828718 Jul 18 13:06:08.773474 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1259/2614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:07 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:09.086833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c75addf8-412b-45ed-be80-99bdd6021d33 req-b1b0f42a-31ab-4de8-8416-200ffd0b200f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "name": "network-vif-plugged", "status": "completed", "tag": "e5668153-ea5a-4ebe-9dc4-12c94a908857"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:09.130003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c75addf8-412b-45ed-be80-99bdd6021d33 req-b1b0f42a-31ab-4de8-8416-200ffd0b200f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:09.130803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c75addf8-412b-45ed-be80-99bdd6021d33 req-b1b0f42a-31ab-4de8-8416-200ffd0b200f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:09.210344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c75addf8-412b-45ed-be80-99bdd6021d33 req-b1b0f42a-31ab-4de8-8416-200ffd0b200f service nova] Creating event network-vif-plugged:e5668153-ea5a-4ebe-9dc4-12c94a908857 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:06:09.225141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c75addf8-412b-45ed-be80-99bdd6021d33 req-b1b0f42a-31ab-4de8-8416-200ffd0b200f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.447943 Jul 18 13:06:09.227380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1260/2615] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:09.239997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:09.241883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:09.248940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] validate_networks() for [('609839e4-f25f-4b03-a576-8c39127f230c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:06:09.258272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:09.259452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:09.261268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:09.262457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:09.927492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:10.149997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:10.180325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:10.219780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f48d2c78-4377-4f69-9e18-8d31b517da19 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1473 microversion: 2.1 time: 0.990014 Jul 18 13:06:10.222024 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1261/2616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:09 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1473 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:10.234245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:10.255827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:10.274787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.276068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:10.277218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.277941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:10.680443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:06:10.681172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:06:10.681937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:06:10.682837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:06:10.683965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:06:10.720925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.721212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:10.722540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.723683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:10.781825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:10.789436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:10.814831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:06:10.819686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:06:10.895022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e275f91-ae18-44f5-9324-652c445e2ac9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.272470 Jul 18 13:06:10.896865 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1356/2617] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:06:08 2022] POST /compute/v2.1/servers => generated 407 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:06:10.905753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:10.906803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:10.918994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.920381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:10.921512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:10.922425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:11.403343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:11.422861 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cefe6a8c-d362-4a47-8318-74ced9ec6a3c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.191670 Jul 18 13:06:11.424800 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1262/2618] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:10 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:11.469090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:11.471065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:11.488292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:11.509165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:11.514788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:11.516061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:11.805409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:11.839441 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ad6cb11-f2a1-41f4-979b-c26f0513094e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 0.939335 Jul 18 13:06:11.846978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1357/2619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:10 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:11.863618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8595327-6731-46ed-a357-7aa2b8285a7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:11.871774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8595327-6731-46ed-a357-7aa2b8285a7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:12.052638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8595327-6731-46ed-a357-7aa2b8285a7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:12.074472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8595327-6731-46ed-a357-7aa2b8285a7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1236 microversion: 2.1 time: 0.225685 Jul 18 13:06:12.076468 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1358/2620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:11 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1236 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:12.094581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:12.095466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:12.103432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.104089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.105159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.105721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.360916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:12.373190 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60c9b4eb-76fe-41a7-86db-944e941912ce tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.946348 Jul 18 13:06:12.374813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1263/2621] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:11 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:12.394706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "name": "network-vif-plugged", "status": "completed", "tag": "9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2"}, {"server_uuid": "9f8af146-685a-4aeb-85d7-b843e0ae3ff0", "name": "network-vif-plugged", "status": "completed", "tag": "e8ef0a7a-903e-4c2b-81b7-0da1f6670f15"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:12.435296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.438556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.487228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] Creating event network-vif-plugged:9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:06:12.488465 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] Creating event network-vif-plugged:e8ef0a7a-903e-4c2b-81b7-0da1f6670f15 for instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 on n-h2-850003-3 Jul 18 13:06:12.514710 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b0524f9d-acae-47cb-87a5-247c50c8b141 req-6e944516-1847-4802-a023-0d8919ed84b0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134439 Jul 18 13:06:12.516314 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1264/2622] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:12.536569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:12.538679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:12.560070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.562048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.564734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.566608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.841255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:12.863526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4cd1e5c-2ec9-40f8-955e-4ea5bcf2339c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1470 microversion: 2.1 time: 0.784533 Jul 18 13:06:12.864945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1359/2623] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:12 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1470 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:12.892736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:12.893792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:12.910870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.911533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:12.912550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:12.913165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.517940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:13.535262 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c599c44-2865-4766-bf1e-6cdee28d07fc tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 0.649636 Jul 18 13:06:13.536259 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1360/2624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:12 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:13.554592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:13.555132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:13.571160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.571636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.572625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.573226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.648529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:13.675918 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e0a5fa3-750f-4e9c-8c2a-203caba7183c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1333 microversion: 2.1 time: 1.156209 Jul 18 13:06:13.677229 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1265/2625] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:12 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1333 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:13.700037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:13.701613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:13.713212 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d5bd535-ba51-49fe-b970-7165d6a884b7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79/action" status: 204 len: 0 microversion: 2.1 time: 0.172507 Jul 18 13:06:13.715151 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1361/2626] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:06:13 2022] POST /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79/action => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:06:13.722823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.723424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.727464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.727934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.732053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:13.733018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:13.752126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.752803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:13.753883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:13.754369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:14.326212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:14.350216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46a58bf2-76f9-4738-93ca-f113bb14e4ba tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.631634 Jul 18 13:06:14.351250 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1362/2627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:13 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:14.384615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:14.386229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:14.397887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:14.398463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:14.399349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:14.399812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:14.492049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:14.504652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9bcb794-3b0d-4693-baf3-c6464d5fe6a1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1294 microversion: 2.1 time: 0.818736 Jul 18 13:06:14.505166 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1266/2628] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1294 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:14.580823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:14.583293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:14.602835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:14.603938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:14.607411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:14.609388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.224642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:15.287600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b2900de-cf86-40f0-be7e-29f4cc816a4a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1470 microversion: 2.1 time: 0.922198 Jul 18 13:06:15.292645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1363/2629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:14 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1470 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:15.321003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "name": "network-vif-plugged", "status": "completed", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:15.383081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.384080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.455361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] Creating event network-vif-plugged:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h1-850003-3 Jul 18 13:06:15.489082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:06:15.538983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-154716df-484d-4070-90ea-c92f3631622a req-fa1543ef-416f-4612-a7d3-3d49e0f90a64 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239187 Jul 18 13:06:15.541216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1364/2630] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:15.558286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:15.558286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:15.576473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:15.593255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.593755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.594625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.603515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.609517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd7f5d8d-de24-41e0-98ff-a86b03230911 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1293 microversion: 2.1 time: 1.044700 Jul 18 13:06:15.617055 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1267/2631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:14 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1293 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:15.635391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-64be8211-aa08-4030-9186-008888b91504 req-40ef4cd8-4d5f-43e2-969f-1905df459fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c047da-fdf5-4905-aa89-5ac9009ba51d", "tag": "8291b449-3998-4223-8bfb-cb6ae8ab713c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:15.668027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-64be8211-aa08-4030-9186-008888b91504 req-40ef4cd8-4d5f-43e2-969f-1905df459fe2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.670886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-64be8211-aa08-4030-9186-008888b91504 req-40ef4cd8-4d5f-43e2-969f-1905df459fe2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.704438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-64be8211-aa08-4030-9186-008888b91504 req-40ef4cd8-4d5f-43e2-969f-1905df459fe2 service nova] Creating event network-changed:8291b449-3998-4223-8bfb-cb6ae8ab713c for instance 07c047da-fdf5-4905-aa89-5ac9009ba51d on n-h1-850003-3 Jul 18 13:06:15.715240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-64be8211-aa08-4030-9186-008888b91504 req-40ef4cd8-4d5f-43e2-969f-1905df459fe2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092883 Jul 18 13:06:15.716949 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1268/2632] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:15.726838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:15.728583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:15.736949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.738127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:15.739490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:15.740224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.511691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:16.527014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eea98355-72df-4bd1-b102-c9c53c0ca143 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1667 microversion: 2.1 time: 0.975219 Jul 18 13:06:16.528811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1365/2633] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:15 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1667 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:16.539292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:16.541002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:16.552909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.553563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.554860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.555464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.582119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:16.608539 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6afdb49-0d91-4964-80ff-117589c1f750 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.887691 Jul 18 13:06:16.609985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1269/2634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:15 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:16.625421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:16.626197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:16.635392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.636221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.637296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.638058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.699391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:16.723470 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b17a555c-0d51-4669-9f03-bbf42e658cd7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1294 microversion: 2.1 time: 0.192474 Jul 18 13:06:16.741192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1366/2635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:16 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1294 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:16.753284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:16.761428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:16.781319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.782559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.783902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.784710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.830557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:16.857452 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-903e1b48-6e3d-4472-80d6-cf8d83f54b7c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360/ips" status: 200 len: 178 microversion: 2.1 time: 0.114160 Jul 18 13:06:16.858950 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1367/2636] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:06:16 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360/ips => generated 178 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:16.866221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:16.867504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:16.878844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.879720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:16.881879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:16.882876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.327547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:17.348765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:17.362976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6bce54f-149b-4141-8bed-7b39417f7cae tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1470 microversion: 2.1 time: 0.746155 Jul 18 13:06:17.363244 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fbf473fc-a3ec-4a21-a3d0-8de771c86d8e tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1484 microversion: 2.1 time: 0.502421 Jul 18 13:06:17.364093 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1270/2637] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:16 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1470 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:17.380973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1368/2638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:16 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1484 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:17.393986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:17.394914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:17.400618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:17.401514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:17.402514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.403297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.404469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.405404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.423500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.426322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.431695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.432590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.480802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:06:17.730789 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4b81084-3e5b-4394-95d5-2f633d59bef1 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "DELETE /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 204 len: 0 microversion: 2.1 time: 0.364555 Jul 18 13:06:17.753957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1271/2639] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:06:17 2022] DELETE /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:06:17.763087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:17.765063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:17.776999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.779599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.781476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:17.782685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:17.961215 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62e1aadd-82d9-4b45-b482-ec53151830d1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.567730 Jul 18 13:06:17.961954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1369/2640] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:06:17 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0/os-interface => generated 284 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:06:17.968169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:17.970968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:17.994726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:18.003235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:18.005501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:18.007091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:18.709916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:18.742674 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f71a1046-719a-4e1c-b135-36f72102f031 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.986493 Jul 18 13:06:18.743370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1272/2641] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:17 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:18.764849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:18.765865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:18.772819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:18.773587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:18.774693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:18.775147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:18.925191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:18.968759 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-748da5de-8fd9-42f7-a50d-f487c4a685dd tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1673 microversion: 2.1 time: 1.004254 Jul 18 13:06:18.973750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1370/2642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:17 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1673 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:18.996563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:19.004546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:19.055796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:19.063360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:19.071492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:19.074115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:19.605895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:19.642364 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac554266-54e1-4a15-900f-771a3765de4f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 0.888186 Jul 18 13:06:19.644327 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1273/2643] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:18 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:19.689002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:19.710449 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fdda95ce-447c-4563-abc1-8da39d94f2ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1470 microversion: 2.1 time: 0.734258 Jul 18 13:06:19.711521 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1371/2644] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:18 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1470 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:19.764212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:19.765345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:19.788619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:19.789400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:19.790860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:19.791685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:19.988064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:19.988952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:20.006741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:20.007484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:20.008576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:20.014756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:20.289991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:20.306921 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f33e241-e1da-40a5-a00d-feb883d01273 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.550313 Jul 18 13:06:20.322341 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1274/2645] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:19 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:20.670380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:20.672961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:20.681895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:20.683149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:20.684390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:20.685022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:20.738938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:20.979326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:20.992180 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81075b55-64c8-4040-b326-3f77ae367819 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1673 microversion: 2.1 time: 1.007336 Jul 18 13:06:20.995079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1372/2646] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:19 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1673 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:21.004312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:21.005817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:21.019868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:21.020557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:21.021951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:21.022740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:21.238306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:21.274483 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3b042af-1eb8-4e66-8d76-89ac50c4487e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 0.610013 Jul 18 13:06:21.297234 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1275/2647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:20 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:21.339073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:21.345062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:21.382856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:21.384809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:21.386783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:21.388503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:21.954523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:21.970180 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a37bec61-1424-4232-93ec-0a7093efe7ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1462 microversion: 2.1 time: 0.972760 Jul 18 13:06:21.987379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1373/2648] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:20 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1462 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:21.993483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:21.995040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:22.004425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:22.005262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:22.006389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:22.007410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:22.074167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:22.372562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:22.416177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-673592c4-e670-4707-b6dc-974ad898441d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 1.083819 Jul 18 13:06:22.418227 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1276/2649] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:21 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:22.853688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-90ab6126-8481-4e76-93bf-937a49256d22 req-27250cf9-fda0-4f0f-a526-1825d6941449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8af146-685a-4aeb-85d7-b843e0ae3ff0", "tag": "e8ef0a7a-903e-4c2b-81b7-0da1f6670f15"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:22.859417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:22.879928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-90ab6126-8481-4e76-93bf-937a49256d22 req-27250cf9-fda0-4f0f-a526-1825d6941449 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:22.880880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-90ab6126-8481-4e76-93bf-937a49256d22 req-27250cf9-fda0-4f0f-a526-1825d6941449 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:22.897381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-90ab6126-8481-4e76-93bf-937a49256d22 req-27250cf9-fda0-4f0f-a526-1825d6941449 service nova] Creating event network-changed:e8ef0a7a-903e-4c2b-81b7-0da1f6670f15 for instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 on n-h2-850003-3 Jul 18 13:06:22.906643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-90ab6126-8481-4e76-93bf-937a49256d22 req-27250cf9-fda0-4f0f-a526-1825d6941449 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485017 Jul 18 13:06:22.907714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1277/2650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:22.916345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:22.919738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:22.921887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:22.930076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:22.931103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:22.933792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:22.934663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:22.946894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c31807e2-0b92-4f64-bd1d-77bf07110746 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1484 microversion: 2.1 time: 0.957290 Jul 18 13:06:22.957291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1374/2651] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:21 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1484 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:22.974211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:22.975992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:23.004324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:23.005288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:23.006559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:23.007358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:23.933230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:23.966720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0267a030-dc8b-4516-b758-0869babc21fb tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1673 microversion: 2.1 time: 1.007365 Jul 18 13:06:23.973840 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1375/2652] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:22 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1673 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:23.985042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:23.988989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:24.005371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:24.011857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:24.014044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:24.015780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:25.085437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:25.111018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53a2546d-d7d4-4d40-a19d-298463e051d5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 1.131931 Jul 18 13:06:25.126382 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1376/2653] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:23 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:25.131957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b3265f2b-eef3-4318-b945-8db679dc2e84 req-378c7a22-0b41-423e-8628-8a1a59150887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:25.144371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b3265f2b-eef3-4318-b945-8db679dc2e84 req-378c7a22-0b41-423e-8628-8a1a59150887 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:25.146547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b3265f2b-eef3-4318-b945-8db679dc2e84 req-378c7a22-0b41-423e-8628-8a1a59150887 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:25.160999 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b3265f2b-eef3-4318-b945-8db679dc2e84 req-378c7a22-0b41-423e-8628-8a1a59150887 service nova] Creating event network-changed:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:06:25.170397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b3265f2b-eef3-4318-b945-8db679dc2e84 req-378c7a22-0b41-423e-8628-8a1a59150887 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041892 Jul 18 13:06:25.172103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1377/2654] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:25.180022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:25.181862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:25.192290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:25.193161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:25.194425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:25.195395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:25.295010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:25.311032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:25.356690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9814f452-4743-4274-94f9-d30da05b5031 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1462 microversion: 2.1 time: 2.446273 Jul 18 13:06:25.358109 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1278/2655] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:22 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1462 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:25.379585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:25.381696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:25.416275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:25.419554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:25.421898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:25.423268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:26.179086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:26.203129 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3b471d4-00a8-404d-9ddf-2495c540382f tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 1.028378 Jul 18 13:06:26.205297 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1378/2656] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:25 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:26.216873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e737d349-4354-485c-bf7b-ee3ea425a9de req-b7e2b002-415f-4fde-9f85-96a2d42b942a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "name": "network-vif-deleted", "tag": "e5668153-ea5a-4ebe-9dc4-12c94a908857"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:26.253491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e737d349-4354-485c-bf7b-ee3ea425a9de req-b7e2b002-415f-4fde-9f85-96a2d42b942a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:26.254637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e737d349-4354-485c-bf7b-ee3ea425a9de req-b7e2b002-415f-4fde-9f85-96a2d42b942a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:26.284009 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e737d349-4354-485c-bf7b-ee3ea425a9de req-b7e2b002-415f-4fde-9f85-96a2d42b942a service nova] Creating event network-vif-deleted:e5668153-ea5a-4ebe-9dc4-12c94a908857 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:06:26.310474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e737d349-4354-485c-bf7b-ee3ea425a9de req-b7e2b002-415f-4fde-9f85-96a2d42b942a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101458 Jul 18 13:06:26.314607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1379/2657] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:26.335819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68bcdca8-dd28-4372-b0b8-1040e5e94b92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'create', calling method: .version_select at 0x7f96e4662040>, body: {"keypair": {"name": "tempest-keypair-539742680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwQeP/vfB5JmiwlvP9rylT7rWKja0kvkWAgB+/4nqki/CzjhUarUytWBecpU4TykVqnq/C2xeBo9jNzYIGdqisK4ae9qUJA+ijBsshlv0HCoGuoftMdbBbObO8MTvRANw=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:26.423947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a196974f5c40b5a62f0ed5ef73042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ce4457d364d45aafb4650e0eeaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:26.426047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-68bcdca8-dd28-4372-b0b8-1040e5e94b92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:26.437393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-68bcdca8-dd28-4372-b0b8-1040e5e94b92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:26.449089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-836a6b9b-2fb7-4cf8-b761-4571068d4346 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 200 len: 1652 microversion: 2.1 time: 1.088853 Jul 18 13:06:26.449861 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1279/2658] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:25 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 1652 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:26.460092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5d87a1db-f19a-4b1c-bf45-f29c05f02726 req-8a4ab71b-102b-4a75-a6e5-55564dd55b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:26.483468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5d87a1db-f19a-4b1c-bf45-f29c05f02726 req-8a4ab71b-102b-4a75-a6e5-55564dd55b95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:26.484300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5d87a1db-f19a-4b1c-bf45-f29c05f02726 req-8a4ab71b-102b-4a75-a6e5-55564dd55b95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:26.508113 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5d87a1db-f19a-4b1c-bf45-f29c05f02726 req-8a4ab71b-102b-4a75-a6e5-55564dd55b95 service nova] Creating event network-vif-unplugged:9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:06:26.516651 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68bcdca8-dd28-4372-b0b8-1040e5e94b92 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199865 Jul 18 13:06:26.517762 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1380/2659] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:06:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:26.523540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5d87a1db-f19a-4b1c-bf45-f29c05f02726 req-8a4ab71b-102b-4a75-a6e5-55564dd55b95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072299 Jul 18 13:06:26.526219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:26.526827 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1280/2660] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:26.528753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:26.552928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:26.554374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:26.555892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:26.557006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:27.236710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:27.237961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:27.249629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:27.250429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:27.251984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:27.252626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:27.943483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:27.968770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53733830-b100-484a-a4ca-f1741e63d17c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 1.448727 Jul 18 13:06:27.975673 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1381/2661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:26 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:27.998028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:27.999896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:28.034989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:28.036522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:28.040105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:28.040821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:28.094571 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 HTTP/1.1 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:06:28.098739 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:28.100930 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'efa85ab6-ba9e-4f3d-ace3-664824344360'} Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:28.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:28.105124 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:28.107794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:28.109018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8fd8a7d-f21c-4399-bcfa-81ec6bf9ce15 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 404 len: 111 microversion: 2.1 time: 0.129656 Jul 18 13:06:28.110751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1382/2662] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:27 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:28.328347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:28.351230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-515b14eb-2a88-4d00-b516-f7ce6803ad55 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 1.120920 Jul 18 13:06:28.357005 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1281/2663] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:27 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:28.425876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-32482b9b-806b-489b-ab59-454ee2a77e3a req-64bbeca7-7342-4067-91d6-1c2cc8a4421b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa85ab6-ba9e-4f3d-ace3-664824344360", "name": "network-vif-deleted", "tag": "9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:28.463870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-32482b9b-806b-489b-ab59-454ee2a77e3a req-64bbeca7-7342-4067-91d6-1c2cc8a4421b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:28.464946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-32482b9b-806b-489b-ab59-454ee2a77e3a req-64bbeca7-7342-4067-91d6-1c2cc8a4421b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:28.507361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-32482b9b-806b-489b-ab59-454ee2a77e3a req-64bbeca7-7342-4067-91d6-1c2cc8a4421b service nova] Creating event network-vif-deleted:9b3b7ce4-ea0a-431e-a042-30b00d7b2ff2 for instance efa85ab6-ba9e-4f3d-ace3-664824344360 on n-h1-850003-3 Jul 18 13:06:28.515640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-32482b9b-806b-489b-ab59-454ee2a77e3a req-64bbeca7-7342-4067-91d6-1c2cc8a4421b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098534 Jul 18 13:06:28.517051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1383/2664] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:28.543956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-cb6119b4-157f-4e9d-8754-a4ac2dc28752 req-f9444eee-dadf-4901-a5af-c81bef05722d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c047da-fdf5-4905-aa89-5ac9009ba51d", "name": "network-vif-plugged", "status": "completed", "tag": "8291b449-3998-4223-8bfb-cb6ae8ab713c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:28.568468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cb6119b4-157f-4e9d-8754-a4ac2dc28752 req-f9444eee-dadf-4901-a5af-c81bef05722d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:28.569058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cb6119b4-157f-4e9d-8754-a4ac2dc28752 req-f9444eee-dadf-4901-a5af-c81bef05722d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:28.622862 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-cb6119b4-157f-4e9d-8754-a4ac2dc28752 req-f9444eee-dadf-4901-a5af-c81bef05722d service nova] Creating event network-vif-plugged:8291b449-3998-4223-8bfb-cb6ae8ab713c for instance 07c047da-fdf5-4905-aa89-5ac9009ba51d on n-h1-850003-3 Jul 18 13:06:28.631788 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-cb6119b4-157f-4e9d-8754-a4ac2dc28752 req-f9444eee-dadf-4901-a5af-c81bef05722d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092179 Jul 18 13:06:28.632945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1282/2665] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:28.997798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:29.000229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:29.015813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:29.019029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:29.021236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:29.025898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:29.233865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-123735673", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "f5e38885-88e0-4339-9ed3-4985374e393f"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:29.378585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] validate_networks() for [('f5e38885-88e0-4339-9ed3-4985374e393f', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:06:29.437994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:29.465689 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d15e031-a1b9-42c4-b84e-44fe742bd8b3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 0.474889 Jul 18 13:06:29.467802 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1384/2666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:28 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:29.489372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:29.490181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:29.523884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:29.527504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:29.531807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:29.533608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:29.978385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:30.008484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-122b9f5d-edff-4fd3-b103-85b6bcc7619d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1321 microversion: 2.1 time: 0.537023 Jul 18 13:06:30.011219 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1385/2667] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:29 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:30.503290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:30.508639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:30.555291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:30.560895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:30.586027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:30.606644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:31.274434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:31.326289 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-067b1b36-49bb-4c1e-a27d-9d49cd134320 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 0.842786 Jul 18 13:06:31.347844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1386/2668] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:30 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:31.358283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:31.360149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:31.376646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:31.378029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:31.380157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:31.381365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:32.413096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:32.447357 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afee4023-d188-4cbb-b45d-453b751bad8d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1471 microversion: 2.1 time: 1.084425 Jul 18 13:06:32.452967 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1387/2669] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:31 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1471 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:32.462033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:32.474719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:32.522331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:32.525273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:32.526068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:32.528458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:32.536554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:32.551240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:33.607055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:06:33.607906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:06:33.608648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:06:33.609417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:06:33.610519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:06:33.660377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:33.661065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:33.662182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:33.665717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:33.689588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:33.716698 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-533edb82-66ae-4e61-810a-e65096073a12 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 1.259779 Jul 18 13:06:33.718121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1388/2670] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:32 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:33.742135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Getting quotas for project aa1b5f4b484a46baaf8bf1fa54879424. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:33.765495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Getting quotas for user 9d5e4b0acd9949a6abd2a0cbe939dfba and project aa1b5f4b484a46baaf8bf1fa54879424. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:33.825584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:06:33.830568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:06:34.008091 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c4b26e40-e95e-42c8-88d9-d5f23423d2e1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.921551 Jul 18 13:06:34.010633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1283/2671] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:06:34.052138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:34.053388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:34.056350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:34.056350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] [instance: 36d83570-47be-4172-a666-88c1904769c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:34.069391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] HTTP exception thrown: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Request method failure captured: Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/36d83570-47be-4172-a666-88c1904769c2/action HTTP/1.1 Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 15 Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vqzmh5Guj4NFKR9UhMqgEwABpZs5c4MBFrNYX6eI7DlNuwrnzqUSbw201KeiclaKNSzKpM_PpxYHdkB6EL8mNp7j1C3tNQo7DVSWMwoIH0YopuVV8JRV7IYJHygzNZfvElgLNt0Vn2H8AH9ojc5xHUJPEIFg3-xCpPNAVCg0VHN2xU Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:06:34.072377 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25c5cbe3a6364a299f67aafd2cd543fb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: b30761f5614c498f85a048c3e3a63969 Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: {"migrate": {}} Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:06:34.073939 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '36d83570-47be-4172-a666-88c1904769c2', 'body': {'migrate': {}}} Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:34.074909 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. Jul 18 13:06:34.076268 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:34.083953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Returning 404 to user: Instance 36d83570-47be-4172-a666-88c1904769c2 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:34.085019 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10845b6a-ef0f-4351-80b2-98f664efb79d tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/36d83570-47be-4172-a666-88c1904769c2/action" status: 404 len: 111 microversion: 2.1 time: 0.361410 Jul 18 13:06:34.086178 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1389/2672] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:06:33 2022] POST /compute/v2.1/servers/36d83570-47be-4172-a666-88c1904769c2/action => generated 111 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:34.325877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-65887205", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:34.415233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:34.455229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:34.462782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:34.471702 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8c57902-adcd-4ae2-bcc9-705493a0cb7c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1261 microversion: 2.26 time: 0.454353 Jul 18 13:06:34.477251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1284/2673] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:34 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1261 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:34.495726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-739098db-8de5-4882-8374-cfec062613fa req-abfad9d3-72e3-42bb-a167-d3f0ed051e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-plugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:34.530965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:06:34.536808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-739098db-8de5-4882-8374-cfec062613fa req-abfad9d3-72e3-42bb-a167-d3f0ed051e33 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:34.538627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-739098db-8de5-4882-8374-cfec062613fa req-abfad9d3-72e3-42bb-a167-d3f0ed051e33 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:34.577666 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-739098db-8de5-4882-8374-cfec062613fa req-abfad9d3-72e3-42bb-a167-d3f0ed051e33 service nova] Creating event network-vif-plugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:06:34.590034 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-739098db-8de5-4882-8374-cfec062613fa req-abfad9d3-72e3-42bb-a167-d3f0ed051e33 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110030 Jul 18 13:06:34.598869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1285/2674] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:34.751337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:34.761633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:34.783720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:34.786855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:34.789061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:34.793351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:35.723542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:06:35.724369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:06:35.725170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:06:35.726404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:06:35.727590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:06:35.775633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:35.776865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:35.779004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:35.780139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:35.823175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Getting quotas for project c933ade754c74ccfb275dc4f93232ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:35.838105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Getting quotas for user f7c9bfbcb2a646d78f5ef5032fe8d778 and project c933ade754c74ccfb275dc4f93232ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:35.871003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:06:35.877050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:06:36.013445 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5e23a23-9dd7-4bfe-b0d3-13b8bf6a1993 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691291 Jul 18 13:06:36.029311 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1390/2675] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:06:36.054978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:36.082842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:36.107447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:36.113442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:36.119379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:36.120217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:36.133019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:36.175754 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-570fdd8f-729d-4a97-b56c-c430d3f0ecf0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 1.433895 Jul 18 13:06:36.201829 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1286/2676] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:34 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:36.236294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54718225-37b2-4e43-9eb1-34d30789f41d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:36.240186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54718225-37b2-4e43-9eb1-34d30789f41d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:36.385464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54718225-37b2-4e43-9eb1-34d30789f41d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:36.408558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54718225-37b2-4e43-9eb1-34d30789f41d tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1220 microversion: 2.1 time: 0.197050 Jul 18 13:06:36.409232 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1287/2677] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:36 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1220 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:36.443851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f00e7599-c968-4f56-a90a-5e6eb6bc5417 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '.version_select at 0x7f96e49621f0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:36.451062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f00e7599-c968-4f56-a90a-5e6eb6bc5417 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:36.452079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f00e7599-c968-4f56-a90a-5e6eb6bc5417 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:36.478299 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f00e7599-c968-4f56-a90a-5e6eb6bc5417 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.050535 Jul 18 13:06:36.479119 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1288/2678] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 13:06:36 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:36.510410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6e7a72d-f97a-434e-908c-17ae60d95325 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:36.530894 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6e7a72d-f97a-434e-908c-17ae60d95325 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025840 Jul 18 13:06:36.537035 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1289/2679] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:06:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:06:36.565021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51ea947b-046f-44b3-92c5-c1afca80cbe5 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-944556257", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:36.569649 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:06:36.569649 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:06:36.636219 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51ea947b-046f-44b3-92c5-c1afca80cbe5 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.086663 Jul 18 13:06:36.638809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1290/2680] 10.222.0.88 () {60 vars in 1145 bytes} [Mon Jul 18 13:06:36 2022] POST /compute/v2.1/flavors => generated 498 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:36.660159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34c3b8b6-8e08-4ffb-a97b-2a8ce25b96fa tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:36.690038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34c3b8b6-8e08-4ffb-a97b-2a8ce25b96fa tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040684 Jul 18 13:06:36.699968 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1291/2681] 10.222.0.88 () {58 vars in 1181 bytes} [Mon Jul 18 13:06:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 13:06:37.101948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-238270285", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "59ddc40b-ff38-4b8b-9262-b6e5cde93e44"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:37.211713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:37.242699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:37.252040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:37.256230 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c45eb061-a6b3-447f-9290-82b77b0f643d tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1313 microversion: 2.26 time: 1.224321 Jul 18 13:06:37.270811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1391/2682] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:36 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1313 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:37.279869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:06:37.284387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:37.286304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:37.307730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:37.310283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:37.312302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:37.314100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.017640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:38.045294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e06cf5d-0f34-4fde-b822-bcd90d7869da tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1360 microversion: 2.1 time: 0.769922 Jul 18 13:06:38.048753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1392/2683] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:37 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1360 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:38.068367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:38.068367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:38.079416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.080561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.083056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.083928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.254773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:38.266390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2858be0-ca8f-4143-8c39-9a65baae5420 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1272 microversion: 2.1 time: 0.215860 Jul 18 13:06:38.269328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1393/2684] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:38 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:38.292310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:38.294445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:38.304373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:06:38.305263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:06:38.306198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:06:38.307511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:06:38.308525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:06:38.309258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.313364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.315159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.315798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.344045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.355385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.357821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:38.358934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:38.426194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:38.443695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:38.511841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:06:38.517158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:06:38.704447 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a82df25b-62a5-426f-8d74-1710c8ac568f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611332 Jul 18 13:06:38.706956 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1292/2685] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:06:38.707383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:38.726854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:38.737232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2347f9c1-ade8-4c61-b914-e6c132de3905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:38.742496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2347f9c1-ade8-4c61-b914-e6c132de3905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:38.745244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:38.747053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2307e8cc-ffb4-4c5d-9a7d-8821a77993d1 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1319 microversion: 2.26 time: 0.462470 Jul 18 13:06:38.748131 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1394/2686] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:38 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:06:39.081535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:39.108682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2347f9c1-ade8-4c61-b914-e6c132de3905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:39.112636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:39.142071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2347f9c1-ade8-4c61-b914-e6c132de3905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1278 microversion: 2.1 time: 0.425000 Jul 18 13:06:39.170882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.175435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.177483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.178104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1293/2687] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:38 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1278 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:39.180702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.292142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:39.299723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:39.332472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.334623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.338741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.342739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.840091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:39.865705 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-623e51e8-d9d7-422a-b3f1-ff205a9d1890 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1278 microversion: 2.1 time: 0.582351 Jul 18 13:06:39.879483 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1294/2688] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:39 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1278 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:39.888630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:39.889725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:39.917153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.918531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.920026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:39.921595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:39.998571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:40.058659 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3d4f08d-d327-43cc-b302-747760dd200b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1547 microversion: 2.1 time: 0.985185 Jul 18 13:06:40.075486 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1395/2689] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:39 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1547 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:40.090472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:40.097213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:40.128655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:40.138020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:40.141567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:40.144143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:40.685175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dfb34373-8626-42d6-b233-f5465973c9e6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.601881 Jul 18 13:06:40.687505 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1396/2690] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:06:40 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/os-interface => generated 284 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:06:40.706575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:40.711298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:40.748271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:40.749104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:40.755390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:40.759918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:41.255701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:41.312996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2828cf2d-2fcd-4907-b371-eff1d0562726 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1330 microversion: 2.1 time: 0.623086 Jul 18 13:06:41.315242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1397/2691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:40 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1330 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:41.325729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:41.327508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:41.341391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:41.342817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:41.345229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:41.346370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:41.921082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:41.941616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2dba502c-8134-498b-88f4-2801c8705370 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1278 microversion: 2.1 time: 0.623687 Jul 18 13:06:41.946036 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1398/2692] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:41 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1278 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:42.110611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:42.124299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:42.127715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:42.130294 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8cf1463d-95f7-4fbd-8547-f2c58f70e0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 2.248842 Jul 18 13:06:42.131990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1295/2693] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:39 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:42.357901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:42.361032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:42.380033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:42.381902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:42.385389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:42.386594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:42.590510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:42.610844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e8d13fa2-e29b-4f57-9830-354404a11490 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1336 microversion: 2.1 time: 0.263493 Jul 18 13:06:42.634237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1399/2694] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:42 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1336 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:42.968815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:42.974521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:42.990268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:42.991749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:42.993527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:42.994664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:43.178203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:43.179436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:43.206599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:43.207484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:43.208958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:43.209790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:43.764032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:43.783479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42693dea-da4c-45ad-83b7-b7298f896a40 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1278 microversion: 2.1 time: 0.821723 Jul 18 13:06:43.794396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1296/2695] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:42 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1278 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:43.805782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b35e761e-2469-41cd-b4dc-42f7dd42293c req-b572ec8b-898b-4b5e-8599-c49a74eab69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f4a31c-1257-4501-b41a-c0b2a9dffbb2", "tag": "378649c1-1b2b-49d4-bb7f-5cfdb0502701"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:43.829257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b35e761e-2469-41cd-b4dc-42f7dd42293c req-b572ec8b-898b-4b5e-8599-c49a74eab69b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:43.830736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b35e761e-2469-41cd-b4dc-42f7dd42293c req-b572ec8b-898b-4b5e-8599-c49a74eab69b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:43.863276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b35e761e-2469-41cd-b4dc-42f7dd42293c req-b572ec8b-898b-4b5e-8599-c49a74eab69b service nova] Creating event network-changed:378649c1-1b2b-49d4-bb7f-5cfdb0502701 for instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 on n-h1-850003-3 Jul 18 13:06:43.896463 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b35e761e-2469-41cd-b4dc-42f7dd42293c req-b572ec8b-898b-4b5e-8599-c49a74eab69b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092339 Jul 18 13:06:43.899735 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1297/2696] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:43.920247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:43.921889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:43.955603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:43.956960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:43.958764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:43.959806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.045416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:44.082493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:44.086057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:44.088443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0cbd9374-e2f2-4f59-a516-b989495f9842 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 0.922527 Jul 18 13:06:44.090992 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1400/2697] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:43 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:44.264749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:44.282748 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4dde2b1a-beb1-4607-a5c4-92cbac098de7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1336 microversion: 2.1 time: 0.370946 Jul 18 13:06:44.283705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1298/2698] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:43 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1336 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:44.316666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:44.316666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:44.326008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.326656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.328007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.328562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.348142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 HTTP/1.1 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:06:44.350060 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.351649 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'efa85ab6-ba9e-4f3d-ace3-664824344360'} Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:44.352795 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.354308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.358790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:44.360118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21ee013b-5851-4373-847b-6b1d09f8b701 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "DELETE /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 404 len: 111 microversion: 2.1 time: 0.050756 Jul 18 13:06:44.373948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:44.374591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1401/2699] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:06:44 2022] DELETE /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:44.375450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: efa85ab6-ba9e-4f3d-ace3-664824344360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:44.384427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.384882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.385676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.386107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.422620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 HTTP/1.1 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:06:44.426122 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.428757 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'efa85ab6-ba9e-4f3d-ace3-664824344360'} Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:44.429939 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. Jul 18 13:06:44.431738 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.437787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance efa85ab6-ba9e-4f3d-ace3-664824344360 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:44.439011 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd00947f-1215-494f-adcb-cdfeae4ef22c tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360" status: 404 len: 111 microversion: 2.1 time: 0.072058 Jul 18 13:06:44.446284 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1299/2700] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:44 2022] GET /compute/v2.1/servers/efa85ab6-ba9e-4f3d-ace3-664824344360 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:44.455363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:44.455973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:44.478434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.478831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.480558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.481196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.501596 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d HTTP/1.1 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:06:44.503796 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.506607 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd5f69411-1903-437a-8da1-13d8ab06b75d'} Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:44.508746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.511364 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.514456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:44.514456 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5df9b4e4-6df8-4cb7-b4c5-82cb96cf7692 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 404 len: 111 microversion: 2.1 time: 0.058101 Jul 18 13:06:44.514456 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1402/2701] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:06:44 2022] DELETE /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:44.522226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:44.523213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] [instance: d5f69411-1903-437a-8da1-13d8ab06b75d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:44.532101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.532554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.533521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.534116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.566558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] HTTP exception thrown: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Request method failure captured: Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d HTTP/1.1 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VoTj3YBmR4zsL639is9F9YiebN_JjSXLlGyCG2Eos-WSb-7F0szu9dg0Ms7PHuGnBckXlqLsT4WsYpmw2uhCBE_IeR3VKCzcOHkt2f8ZGzAew5kJ7Htj1SF0lAHEVrz6lCniExlpouyo4JST5abhPOf7WHefT9fC85ZHhLisLJb6dk Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:06:44.568989 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ff8ce4457d364d45aafb4650e0eeaa13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ff8ce4457d364d45aafb4650e0eeaa13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ff8ce4457d364d45aafb4650e0eeaa13 Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestMultiNic-1472897360 Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 45a196974f5c40b5a62f0ed5ef73042f Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestMultiNic-1472897360-project Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.571975 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'd5f69411-1903-437a-8da1-13d8ab06b75d'} Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:06:44.575416 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. Jul 18 13:06:44.577816 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:06:44.580508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] Returning 404 to user: Instance d5f69411-1903-437a-8da1-13d8ab06b75d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:06:44.580508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e5629a5-6adf-47ed-8691-e6995885ade9 tempest-ServersTestMultiNic-1472897360 tempest-ServersTestMultiNic-1472897360-project] 10.222.0.88 "GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d" status: 404 len: 111 microversion: 2.1 time: 0.054680 Jul 18 13:06:44.580508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1300/2702] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:44 2022] GET /compute/v2.1/servers/d5f69411-1903-437a-8da1-13d8ab06b75d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:06:44.808997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:44.810506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:44.825330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.826173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:44.827648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:44.828427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:45.120074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:45.123658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:45.141464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:45.143074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:45.146346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:45.147623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:45.250353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:45.263977 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfbfa8c0-515f-4898-a5f5-31683c79e112 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1278 microversion: 2.1 time: 0.464823 Jul 18 13:06:45.265440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1403/2703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:44 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1278 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:45.314778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:45.316098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:45.326242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:45.327282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:45.328957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:45.329626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:45.649073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:45.666877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91015349-0c0a-4f3e-b466-9716f152fc6d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1336 microversion: 2.1 time: 0.360957 Jul 18 13:06:45.668378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1404/2704] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:45 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1336 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:46.161584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:46.202729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:46.205718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:46.209332 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9dfb8fbc-2bbc-4c50-9418-d5de9a9e1f21 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 1.100738 Jul 18 13:06:46.210352 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1301/2705] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:45 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:46.287566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:46.290005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:46.296005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:46.297316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:46.305625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:46.306499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:46.307791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:46.309029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:46.697063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:46.698619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:46.716992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:46.717780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:46.719263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:46.720342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:46.938758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:46.966355 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b3e3630-8b08-4e97-b626-34d2fd5dd034 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.678103 Jul 18 13:06:46.968503 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1405/2706] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:46 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:47.041571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:47.062912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e60483c-42ba-4252-9445-a6207e56d2ce tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1336 microversion: 2.1 time: 0.372981 Jul 18 13:06:47.064755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1302/2707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:46 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1336 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:47.245373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:47.247718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:47.263139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:47.263967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:47.265413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:47.266559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:48.012610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:48.019559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:48.055903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:48.056950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:48.058952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:48.060798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:48.100247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:48.123081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:48.124982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:48.127571 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b26f363-d7bc-46d0-a6cc-5dd6ef6a6d51 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 0.890957 Jul 18 13:06:48.129191 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1406/2708] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:47 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:06:48.162551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:48.164538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:48.180634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:48.183117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:48.185879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:48.187907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:48.385491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:48.825991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:48.854783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd57e03e-f733-4434-87b1-5f8c5901f22c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.714255 Jul 18 13:06:48.858105 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1407/2709] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:48 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:49.007204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-de387c8c-29f3-4f22-b576-cdb0363a2a1d req-298d54f0-6ed3-4370-bfef-1872e1f8e52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:49.034619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-de387c8c-29f3-4f22-b576-cdb0363a2a1d req-298d54f0-6ed3-4370-bfef-1872e1f8e52f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:49.035405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-de387c8c-29f3-4f22-b576-cdb0363a2a1d req-298d54f0-6ed3-4370-bfef-1872e1f8e52f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:49.063061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:49.098629 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-de387c8c-29f3-4f22-b576-cdb0363a2a1d req-298d54f0-6ed3-4370-bfef-1872e1f8e52f service nova] Creating event network-changed:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:06:49.135431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-de387c8c-29f3-4f22-b576-cdb0363a2a1d req-298d54f0-6ed3-4370-bfef-1872e1f8e52f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135927 Jul 18 13:06:49.140991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=18 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:49.155959 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1408/2710] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:49.176205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:49.180461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:49.204160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:49.206560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:49.209087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:49.210483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:49.727001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:49.763803 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22b6095e-f4c4-49c2-af8d-eb1da0ee378a tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 1.764606 Jul 18 13:06:49.765114 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1303/2711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:47 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:49.890967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:49.899738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:49.925013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:49.926660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:49.928505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:49.929705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:50.407816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:50.431790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:50.434017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:50.435526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12339ca8-6472-49d0-8168-98498aa65712 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 1.268203 Jul 18 13:06:50.451355 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1409/2712] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:49 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:50.788102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:50.789182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:50.819431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:50.820180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:50.821535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:50.822224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:51.359579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:51.392719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e1e78b24-dbd2-4e90-8579-d272e06934ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 1.513573 Jul 18 13:06:51.394941 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1304/2713] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:49 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:51.465174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:51.470973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:51.505517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:51.509764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:51.512119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:51.512915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:52.244049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:52.286989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8fb0360-e311-48fe-ae7b-8d095326f425 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 1.505246 Jul 18 13:06:52.311345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:52.319702 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1410/2714] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:50 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:52.345164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:52.372914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:52.376903 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4aefa2d7-a02b-47da-ae6b-9f4716334f4f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 0.920578 Jul 18 13:06:52.393604 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1305/2715] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:51 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:06:52.414917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a0504fdc-8507-417d-8f40-3b57d9a80ced req-9e90b1aa-3a24-4d23-9a0e-60aec0ea18a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f4a31c-1257-4501-b41a-c0b2a9dffbb2", "name": "network-vif-plugged", "status": "completed", "tag": "378649c1-1b2b-49d4-bb7f-5cfdb0502701"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:52.434583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a0504fdc-8507-417d-8f40-3b57d9a80ced req-9e90b1aa-3a24-4d23-9a0e-60aec0ea18a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:52.436119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a0504fdc-8507-417d-8f40-3b57d9a80ced req-9e90b1aa-3a24-4d23-9a0e-60aec0ea18a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:52.463095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a0504fdc-8507-417d-8f40-3b57d9a80ced req-9e90b1aa-3a24-4d23-9a0e-60aec0ea18a4 service nova] Creating event network-vif-plugged:378649c1-1b2b-49d4-bb7f-5cfdb0502701 for instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 on n-h1-850003-3 Jul 18 13:06:52.473916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a0504fdc-8507-417d-8f40-3b57d9a80ced req-9e90b1aa-3a24-4d23-9a0e-60aec0ea18a4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067900 Jul 18 13:06:52.475839 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1306/2716] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:52.491249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:52.493310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:52.508779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:52.510825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:52.527339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:52.530803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:52.564930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-539eb6c9-bf4e-4856-bc7c-82180948021d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Action: 'create', calling method: .version_select at 0x7f96e4bf5ca0>, body: {"keypair": {"name": "tempest-keypair-747094484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGoS5t/voSqBC8eDcDZ8s1viS59wOLfY0eKXYEeOp9OOPxItv4B3/aQsbbMKYtxk7JREbpPFnE1xd3Uxfffi2hw42E9bAxH10eLs6NSxR+AEfT+sYPQHcmVNKDK+5gIsw=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:52.629617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-539eb6c9-bf4e-4856-bc7c-82180948021d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:06:52.651523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-539eb6c9-bf4e-4856-bc7c-82180948021d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for user f87a5208d191416395d977d5efb1c8b2 and project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:06:52.733587 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-539eb6c9-bf4e-4856-bc7c-82180948021d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.410924 Jul 18 13:06:52.735793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1411/2717] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:06:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:53.323983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:53.326972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:53.369061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:53.370325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:53.372577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:53.373648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:54.265115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:54.294449 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dffbefe5-6f76-4dc3-b0cf-6d949cb1e5ff tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 1.816205 Jul 18 13:06:54.299894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1307/2718] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:52 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:54.340265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:54.343990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:54.372511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:54.380542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:54.382633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:54.392098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:54.394382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:54.522282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:06:54.858823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:54.909573 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a4e70eab-9749-490c-a5dd-038411572e4e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 1.595155 Jul 18 13:06:54.928423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1412/2719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:53 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:06:54.959372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7b85d160-e472-4c57-96be-73731401ee54 req-0f53e10c-3f9e-4f4b-b224-d801850b87c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab9d78ea-f460-417d-a72d-f77ad0495496", "tag": "6b5278e8-4d6d-4e03-a63f-ebc264987b39"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:54.998203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7b85d160-e472-4c57-96be-73731401ee54 req-0f53e10c-3f9e-4f4b-b224-d801850b87c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:55.002698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7b85d160-e472-4c57-96be-73731401ee54 req-0f53e10c-3f9e-4f4b-b224-d801850b87c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:55.082975 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7b85d160-e472-4c57-96be-73731401ee54 req-0f53e10c-3f9e-4f4b-b224-d801850b87c6 service nova] Creating event network-changed:6b5278e8-4d6d-4e03-a63f-ebc264987b39 for instance ab9d78ea-f460-417d-a72d-f77ad0495496 on n-h2-850003-3 Jul 18 13:06:55.132674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7b85d160-e472-4c57-96be-73731401ee54 req-0f53e10c-3f9e-4f4b-b224-d801850b87c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194804 Jul 18 13:06:55.139179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1413/2720] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:55.337539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:55.342624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:55.370380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:55.374356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:55.378956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:55.381736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:55.719990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:55.745506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:55.751321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:55.757006 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-44eff5d1-dbdd-4fb3-a5a6-cdcc31869f6a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1361 microversion: 2.26 time: 1.438828 Jul 18 13:06:55.757814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1308/2721] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:54 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1361 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:55.944824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:55.958459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:55.986251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:55.990393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:55.991742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:55.992382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:56.026308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:56.048291 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37fd8013-2598-4a07-9252-89bf04af9111 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.719301 Jul 18 13:06:56.061913 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1414/2722] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:55 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:56.801259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:56.802036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:56.858448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:56.863694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:56.871260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:56.873557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:57.257141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:57.276121 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b949a174-9f42-4ce1-a47c-29c3366f3cda tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 1.337436 Jul 18 13:06:57.296015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1309/2723] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:55 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:57.331150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:57.333090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:57.369158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:57.373286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:57.378848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:57.381474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:57.841279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:57.867011 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57d05910-5b8a-484b-8e49-1c6926c306aa tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.566453 Jul 18 13:06:57.867011 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1310/2724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:57 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:57.888624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a3500551-bb90-4343-a5ff-b9d41d9d23c8 req-5c2f47ce-a87a-4063-85e1-ed4e2bad7dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:06:57.934094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a3500551-bb90-4343-a5ff-b9d41d9d23c8 req-5c2f47ce-a87a-4063-85e1-ed4e2bad7dfd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:57.935139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a3500551-bb90-4343-a5ff-b9d41d9d23c8 req-5c2f47ce-a87a-4063-85e1-ed4e2bad7dfd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:57.979122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a3500551-bb90-4343-a5ff-b9d41d9d23c8 req-5c2f47ce-a87a-4063-85e1-ed4e2bad7dfd service nova] Creating event network-changed:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:06:57.992957 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a3500551-bb90-4343-a5ff-b9d41d9d23c8 req-5c2f47ce-a87a-4063-85e1-ed4e2bad7dfd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123748 Jul 18 13:06:57.994439 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1311/2725] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:06:58.347350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:58.349189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:58.403468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.403993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.405441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.405986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.681391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:58.701810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:58.704544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:58.705667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0cf6150-732c-4943-81d6-b1ce4715b601 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1546 microversion: 2.26 time: 1.921995 Jul 18 13:06:58.706379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1415/2726] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:06:56 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1546 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:06:58.727651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e45ef0d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:58.749100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.749766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.753084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:58.775298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.776009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.783631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.788450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.923577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.924144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:58.984836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:58.986361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.070311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:06:59.129368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd9ecb3b-664c-423c-b10b-eea6e69952de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-271598651" status: 201 len: 0 microversion: 2.26 time: 0.407084 Jul 18 13:06:59.130547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1416/2727] 10.222.0.88 () {62 vars in 1376 bytes} [Mon Jul 18 13:06:58 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-271598651 => generated 0 bytes in 410 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 18 13:06:59.153054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:59.154020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:59.175943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.176786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.177832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.178560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.613399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:59.654488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13493937-5c91-4e65-8e19-c5038259292e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 1.332697 Jul 18 13:06:59.655651 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1312/2728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:58 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:59.662650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3db8867-d234-4e38-8cf0-b64c833f314f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e49629d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:59.691195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3db8867-d234-4e38-8cf0-b64c833f314f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.691899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3db8867-d234-4e38-8cf0-b64c833f314f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.748448 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3db8867-d234-4e38-8cf0-b64c833f314f tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-271598651" status: 204 len: 0 microversion: 2.26 time: 0.091285 Jul 18 13:06:59.751945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1313/2729] 10.222.0.88 () {60 vars in 1357 bytes} [Mon Jul 18 13:06:59 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-271598651 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:06:59.759927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e419d310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:59.772002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.773168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.774312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:06:59.786793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.787972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.789773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.791017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.832223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.833062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:06:59.865763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:06:59.871255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:06:59.889431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4feae448-9cf3-4212-b87a-c061106084f5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.742141 Jul 18 13:06:59.899476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1417/2730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:06:59 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:06:59.913292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70067cda-f8ce-4b46-9a48-edb523c34291 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 204 len: 0 microversion: 2.26 time: 0.157313 Jul 18 13:06:59.914830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1314/2731] 10.222.0.88 () {60 vars in 1294 bytes} [Mon Jul 18 13:06:59 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:06:59.931161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36b96ddd-6562-4ad8-8828-f15c2a0fe622 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e46624c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:06:59.971578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b96ddd-6562-4ad8-8828-f15c2a0fe622 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:06:59.974758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b96ddd-6562-4ad8-8828-f15c2a0fe622 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.016457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36b96ddd-6562-4ad8-8828-f15c2a0fe622 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 12 microversion: 2.26 time: 0.093524 Jul 18 13:07:00.023267 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1418/2732] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 13:06:59 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 12 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:00.037669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4c7a550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:00.081230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.081949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.087306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:00.110704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.111458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.118433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.120415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.205919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.206407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.253588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.257783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.368696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:00.451565 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6209bc6c-03d0-49c6-8260-0b3c7a61f848 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1448184274" status: 201 len: 0 microversion: 2.26 time: 0.422981 Jul 18 13:07:00.454138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1315/2733] 10.222.0.88 () {62 vars in 1379 bytes} [Mon Jul 18 13:07:00 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1448184274 => generated 0 bytes in 431 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 18 13:07:00.468398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba0362d8-ec3b-4096-8d51-47d763af6a5c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4662790>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:00.512805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0362d8-ec3b-4096-8d51-47d763af6a5c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.521328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0362d8-ec3b-4096-8d51-47d763af6a5c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.573339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba0362d8-ec3b-4096-8d51-47d763af6a5c tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 36 microversion: 2.26 time: 0.111044 Jul 18 13:07:00.575598 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1419/2734] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 13:07:00 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 36 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:00.591054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e428bd30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:00.626971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.630106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.630712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:00.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.689423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:00.690578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:00.719993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.720764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.750048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.768155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.776347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:00.782461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.784445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.810490 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-667e50a8-af4b-46f5-9357-19615be41f46 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1448184274" status: 204 len: 0 microversion: 2.26 time: 0.226468 Jul 18 13:07:00.826367 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1316/2735] 10.222.0.88 () {60 vars in 1363 bytes} [Mon Jul 18 13:07:00 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1448184274 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:00.867046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec027e13-2c8b-41fd-935e-e9da23dd1e26 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e47bfe50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:00.900382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec027e13-2c8b-41fd-935e-e9da23dd1e26 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:00.901182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec027e13-2c8b-41fd-935e-e9da23dd1e26 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:00.942095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec027e13-2c8b-41fd-935e-e9da23dd1e26 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 12 microversion: 2.26 time: 0.113986 Jul 18 13:07:00.943300 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1317/2736] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 13:07:00 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 12 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:00.979245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1687783306", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "26396904-016a-4675-b01d-d8c66d4db198"}], "security_groups": [{"name": "tempest-securitygroup--727134889"}], "key_name": "tempest-keypair-747094484", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:01.535760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:01.569976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7580b2d7-9e9c-4444-9efb-66af670ff099 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.897121 Jul 18 13:07:01.601159 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1420/2737] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:00 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:01.621531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:01.623252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:01.652845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:01.653504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:01.654930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:01.655598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:01.692587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] validate_networks() for [('26396904-016a-4675-b01d-d8c66d4db198', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:07:02.182638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:02.210025 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ff4f4ea-d970-4656-b791-61cb36e46e21 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.605251 Jul 18 13:07:02.226192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1421/2738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:01 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:02.241905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e45aa430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:02.269457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.270335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.271198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:02.291641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.292425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.293812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.294619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.399979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.400840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.428324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:02.499370 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef6d384e-6c93-4891-8173-a2772fbae0bb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 204 len: 0 microversion: 2.26 time: 0.273150 Jul 18 13:07:02.503805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1422/2739] 10.222.0.88 () {60 vars in 1294 bytes} [Mon Jul 18 13:07:02 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:02.520572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e46870d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:02.534990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.537531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.538461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:02.553491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:02.561253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.561879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.564059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.564648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.656272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.657592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.685164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.686390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.709934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:02.752622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:02.762236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:02.794566 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f89d1c3-e6f9-4b42-9f34-8969bef9b956 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1651241398" status: 201 len: 0 microversion: 2.26 time: 0.281604 Jul 18 13:07:02.796666 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1423/2740] 10.222.0.88 () {62 vars in 1379 bytes} [Mon Jul 18 13:07:02 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1651241398 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 13:07:02.805901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:02.807496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:02.826993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.827776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:02.831746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:02.833042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.335104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:03.349150 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a74eeb7d-12e9-4300-b477-41c3fd1724f9 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.550018 Jul 18 13:07:03.350940 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1424/2741] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:02 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:03.358313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4bf54c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:03.385227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.393369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.395029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:03.434923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.435815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.438407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.440340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.492602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.492963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.504304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.504774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.584471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:03.612042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d0580f8-1644-495f-83f1-b98329844c88 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1072014626" status: 201 len: 0 microversion: 2.26 time: 0.258876 Jul 18 13:07:03.624308 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1425/2742] 10.222.0.88 () {62 vars in 1379 bytes} [Mon Jul 18 13:07:03 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-1072014626 => generated 0 bytes in 272 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 13:07:03.635394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:03.637062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:03.670357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.671127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:03.672954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:03.673712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.071097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:04.091812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82dd3a11-8281-4dbf-a320-47c31e53a804 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.464010 Jul 18 13:07:04.096814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1426/2743] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:03 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:04.109519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4662d30>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:04.134558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.139740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.141255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:04.177333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.189570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.191198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.191943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.274745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.275755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.311944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:04.352724 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c0223cb-ebea-4533-bc4e-47bdf65898cf tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 204 len: 0 microversion: 2.26 time: 0.253339 Jul 18 13:07:04.356893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1427/2744] 10.222.0.88 () {60 vars in 1294 bytes} [Mon Jul 18 13:07:04 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:04.378141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fffa9c8c-8b60-474f-8f4d-85c7e155a0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e46f59d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:04.399848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fffa9c8c-8b60-474f-8f4d-85c7e155a0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.402487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fffa9c8c-8b60-474f-8f4d-85c7e155a0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.436136 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fffa9c8c-8b60-474f-8f4d-85c7e155a0f3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 12 microversion: 2.26 time: 0.065912 Jul 18 13:07:04.437794 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1428/2745] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 13:07:04 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:04.447750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:04.449475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:04.466664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.467683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.469157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.470073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.738894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:07:04.754429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for user f87a5208d191416395d977d5efb1c8b2 and project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: dict_keys(['metadata_items']) {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:07:04.785205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:04.789700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:07:04.793782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:07:04.795128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:07:04.795805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:07:04.796544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:07:04.806503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb71a01e-66a2-4ba1-83e2-b8854f612160 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.366479 Jul 18 13:07:04.824414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1429/2746] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:04 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:04.832472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.833774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.834568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.834775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e9b11b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:04.835370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.849866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.850906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.851805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:04.863551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.864335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.865767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.866682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.872328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:07:04.884344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Getting quotas for user f87a5208d191416395d977d5efb1c8b2 and project 875bdc8865da4f55a4d0deaf2e2fbfab. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:07:04.911984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:07:04.915378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:04.916275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:04.916815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:07:04.940439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:04.969643 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45ea3bc7-e3df-4592-bd1d-ba6dbcf4fcdb tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 204 len: 0 microversion: 2.26 time: 0.142962 Jul 18 13:07:04.971956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1430/2747] 10.222.0.88 () {60 vars in 1294 bytes} [Mon Jul 18 13:07:04 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:04.994894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e46f5550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.022690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.025055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.028017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.030574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-664b759b-1e7f-4ef3-911a-4cbbc10cb1b4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.076250 Jul 18 13:07:05.032678 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1318/2748] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:07:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 4081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:07:05.037605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.038394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.039370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.040229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.051679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3618eabe-ccce-48ca-8f12-b427c508f2b5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.053760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3618eabe-ccce-48ca-8f12-b427c508f2b5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.095823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.096862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.112612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.113473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.165927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:05.210689 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d06812e0-c5e7-4d6d-9e90-a21ee00d0c0a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-2092932362" status: 201 len: 0 microversion: 2.26 time: 0.219759 Jul 18 13:07:05.216521 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1431/2749] 10.222.0.88 () {62 vars in 1379 bytes} [Mon Jul 18 13:07:04 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-2092932362 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 18 13:07:05.227167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.227829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.238342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.238795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.239587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.240026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.325913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3618eabe-ccce-48ca-8f12-b427c508f2b5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:05.341972 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3618eabe-ccce-48ca-8f12-b427c508f2b5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1277 microversion: 2.1 time: 0.298112 Jul 18 13:07:05.345530 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1319/2750] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:05 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:05.358318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e419dca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.393101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.393601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.394112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.416875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.417849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.418674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.419115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.474515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.474873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.519334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.521621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.580916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:05.603169 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d12844f-a1ad-43a5-b801-6b7124a727ad tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-617917122" status: 201 len: 0 microversion: 2.26 time: 0.249897 Jul 18 13:07:05.605276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1320/2751] 10.222.0.88 () {62 vars in 1376 bytes} [Mon Jul 18 13:07:05 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags/tempest-tag-617917122 => generated 0 bytes in 258 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 18 13:07:05.637049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Action: 'update_all', calling method: .version_select at 0x7f96e48c8a60>, body: {"tags": ["tempest-tag-1890471458", "tempest-tag-1822982012"]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:05.654605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.655069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.655585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.666729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.668627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.671078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.671759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.731147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:05.731453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.732129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.752758 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de6c1aaf-e56e-4b3c-b23e-79bc7359ae52 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.534518 Jul 18 13:07:05.755893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1432/2752] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:05 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:05.793432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:05.830529 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-803960b6-859a-4d7e-91d2-90bea00b3890 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 62 microversion: 2.26 time: 0.216427 Jul 18 13:07:05.831665 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1321/2753] 10.222.0.88 () {62 vars in 1311 bytes} [Mon Jul 18 13:07:05 2022] PUT /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 62 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:05.837045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.837921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.847997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b07fd5db-2996-45b1-adc8-ed19c44e91d3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4c7a3a0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.859004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.865585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.867718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.870680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b07fd5db-2996-45b1-adc8-ed19c44e91d3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.871960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.872335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b07fd5db-2996-45b1-adc8-ed19c44e91d3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.895595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:05.904849 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b07fd5db-2996-45b1-adc8-ed19c44e91d3 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 200 len: 62 microversion: 2.26 time: 0.064358 Jul 18 13:07:05.908982 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1322/2754] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 13:07:05 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 62 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:05.944782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '.version_select at 0x7f96e4ed51f0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:05.967924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.971440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.972695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:05.985266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.986393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:05.988848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:05.990025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.042919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.044311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.079368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lazy-loading 'flavor' on Instance uuid 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:06.117140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aef54a96-708d-442d-9dd8-553685d53af4 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags" status: 204 len: 0 microversion: 2.26 time: 0.202710 Jul 18 13:07:06.135281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1323/2755] 10.222.0.88 () {60 vars in 1294 bytes} [Mon Jul 18 13:07:05 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2/tags => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:06.145949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8966fa0e-5d65-451b-8506-e43e7550064a req-e5d17ea0-ce1b-46cd-adfc-505049400310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9d78ea-f460-417d-a72d-f77ad0495496", "name": "network-vif-plugged", "status": "completed", "tag": "6b5278e8-4d6d-4e03-a63f-ebc264987b39"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:06.162965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8966fa0e-5d65-451b-8506-e43e7550064a req-e5d17ea0-ce1b-46cd-adfc-505049400310 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.163682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8966fa0e-5d65-451b-8506-e43e7550064a req-e5d17ea0-ce1b-46cd-adfc-505049400310 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.188259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8966fa0e-5d65-451b-8506-e43e7550064a req-e5d17ea0-ce1b-46cd-adfc-505049400310 service nova] Creating event network-vif-plugged:6b5278e8-4d6d-4e03-a63f-ebc264987b39 for instance ab9d78ea-f460-417d-a72d-f77ad0495496 on n-h2-850003-3 Jul 18 13:07:06.199715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8966fa0e-5d65-451b-8506-e43e7550064a req-e5d17ea0-ce1b-46cd-adfc-505049400310 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061424 Jul 18 13:07:06.201590 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1324/2756] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:06.211035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:06.212280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:06.224800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.225890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.233279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.234702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.283618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:07:06.304142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:06.321486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de5fe64d-7876-4248-bcbe-b3211d866dc4 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.491332 Jul 18 13:07:06.330375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1433/2757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:05 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:06.378562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:06.379526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:06.399387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.400740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.403511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.404813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.563888 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8da6ce4-e06f-4ad9-a6cb-24d97f72521a tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 204 len: 0 microversion: 2.26 time: 0.359139 Jul 18 13:07:06.569103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1325/2758] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:07:06 2022] DELETE /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:07:06.585584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:06.588276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:06.610044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.610762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.612164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.613002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.715328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:06.739459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49fa077b-7e9a-4cd4-b53c-4a39d61a9a59 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1281 microversion: 2.1 time: 0.366241 Jul 18 13:07:06.762397 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1434/2759] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:06 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:06.790806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:06.792834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:06.808933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.810743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:06.814948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:06.816422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:07.234070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.246464 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a01a15b-c43d-4e0d-8e21-b8adabc95dfb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.465505 Jul 18 13:07:07.265522 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1435/2760] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:06 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:07.344000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:07.344770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:07.364271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:07.365036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:07.366025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:07.366908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:07.400632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:07.450575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.470881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.474386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.477041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e2ee9659-3d0f-4480-8c10-237f3815baef tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1552 microversion: 2.26 time: 0.904897 Jul 18 13:07:07.489375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1326/2761] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:07:06 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1552 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:07:07.666430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.682563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c48572e3-bc7c-458f-823b-55c12bd90f37 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.344533 Jul 18 13:07:07.684166 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1436/2762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:07 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:07.770000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:07.771147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:07.780076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:07.780746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:07.781996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:07.782575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:07.977058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:07.989376 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b8d7354-8415-40ca-bb78-336215ab1ab5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1337 microversion: 2.1 time: 0.225075 Jul 18 13:07:08.002210 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1327/2763] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:07 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1337 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:08.274547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:08.276551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:08.288755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.289888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.291381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.293051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.471397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-42f158ce-a2c2-4c2f-bc6b-45dad9288dc5 req-6a7f4bd1-96c9-453a-a973-b6f81c4e6ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-plugged", "status": "completed", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:08.492138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-42f158ce-a2c2-4c2f-bc6b-45dad9288dc5 req-6a7f4bd1-96c9-453a-a973-b6f81c4e6ccb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.494593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-42f158ce-a2c2-4c2f-bc6b-45dad9288dc5 req-6a7f4bd1-96c9-453a-a973-b6f81c4e6ccb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.524628 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-42f158ce-a2c2-4c2f-bc6b-45dad9288dc5 req-6a7f4bd1-96c9-453a-a973-b6f81c4e6ccb service nova] Creating event network-vif-plugged:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:07:08.541391 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-42f158ce-a2c2-4c2f-bc6b-45dad9288dc5 req-6a7f4bd1-96c9-453a-a973-b6f81c4e6ccb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077483 Jul 18 13:07:08.544585 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1328/2764] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:08.556640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:08.560211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:08.579050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.580745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.584375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.585565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.658526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:08.676340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7cf4b9e2-6146-42ca-8597-4985c9e2b11b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.407223 Jul 18 13:07:08.678402 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1437/2765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:08 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:08.719396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:08.720957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:08.733377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.734801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:08.735904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:08.736666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:09.018609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:09.035763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f97b79e8-7b49-445e-8d93-ee66d24e99b3 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1320 microversion: 2.1 time: 0.325532 Jul 18 13:07:09.039701 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1438/2766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:08 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:09.049867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:09.050669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:09.064285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:09.064285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:09.064830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:09.065408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:09.204351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:09.222419 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2421f9a-91ea-4eb7-9ee1-eaf50623c42d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1335 microversion: 2.1 time: 0.180550 Jul 18 13:07:09.223486 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1439/2767] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:09 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:09.342349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:09.358488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:09.362863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:09.365201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c71bc9cc-e543-46b1-b899-8f93cb6b1749 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1552 microversion: 2.26 time: 0.818025 Jul 18 13:07:09.366962 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1329/2768] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:07:08 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1552 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:07:09.718170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:09.720612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:09.743558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:09.745492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:09.751517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:09.752821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.066461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:10.070304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:10.096603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.107573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.109981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.113536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.242218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:10.267357 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9b74847-dfc4-488c-93bb-d3c0780f3092 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1378 microversion: 2.1 time: 0.559092 Jul 18 13:07:10.283370 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1440/2769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:09 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1378 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:10.291939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:10.294072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:10.302898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.303543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.304768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.305394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.676270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:10.710838 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4360ee27-23fd-44aa-b3f4-7dcbc92046b7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1335 microversion: 2.1 time: 0.425309 Jul 18 13:07:10.737691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1441/2770] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:10 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1335 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:10.756520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:10.758364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:10.791691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.792591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:10.806236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:10.807004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.018129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:11.036704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:11.040300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e4b0acd9949a6abd2a0cbe939dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1b5f4b484a46baaf8bf1fa54879424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:11.042590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4b85837-c760-4e9b-b0ab-edd8dc1c8fa9 tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 200 len: 1510 microversion: 2.26 time: 0.301131 Jul 18 13:07:11.043545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1442/2771] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:07:10 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:07:11.303619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:11.305179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:11.318358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:11.320482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.322048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:11.323776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.413930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:11.438805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f55d3a53-d0f4-474e-97f8-8d3557620c80 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1470 microversion: 2.1 time: 1.379707 Jul 18 13:07:11.454229 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1330/2772] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:10 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1470 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:11.465464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4fbac5f9-77c9-42ce-9410-da434c818e00 req-a9c9d115-b20c-47f1-a610-d215196324dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f4a31c-1257-4501-b41a-c0b2a9dffbb2", "name": "network-vif-deleted", "tag": "378649c1-1b2b-49d4-bb7f-5cfdb0502701"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:11.485817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4fbac5f9-77c9-42ce-9410-da434c818e00 req-a9c9d115-b20c-47f1-a610-d215196324dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:11.487032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4fbac5f9-77c9-42ce-9410-da434c818e00 req-a9c9d115-b20c-47f1-a610-d215196324dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.533836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4fbac5f9-77c9-42ce-9410-da434c818e00 req-a9c9d115-b20c-47f1-a610-d215196324dd service nova] Creating event network-vif-deleted:378649c1-1b2b-49d4-bb7f-5cfdb0502701 for instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 on n-h1-850003-3 Jul 18 13:07:11.583220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4fbac5f9-77c9-42ce-9410-da434c818e00 req-a9c9d115-b20c-47f1-a610-d215196324dd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119343 Jul 18 13:07:11.585048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1331/2773] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:11.623145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:11.624984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:11.646514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:11.648911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.651660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:11.653009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:11.758558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lazy-loading 'flavor' on Instance uuid ab9d78ea-f460-417d-a72d-f77ad0495496 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:11.902310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:11.931535 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26d6a8a7-faac-4e43-b5cb-295259a39291 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1527 microversion: 2.1 time: 0.631838 Jul 18 13:07:11.960627 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1443/2774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:11 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1527 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:11.964439 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0930efa7-520a-41d2-9681-0308d0fc2aab tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496/action" status: 202 len: 0 microversion: 2.1 time: 0.375286 Jul 18 13:07:11.966262 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1332/2775] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:11 2022] POST /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:07:11.971162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:11.972317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:11.981038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:11.982630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:12.001719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.001719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.003769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.005109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.007933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.012131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.014183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.015077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.320847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:12.350977 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5074229f-aaa8-4cf5-963a-b410b1de16c4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1335 microversion: 2.1 time: 0.387781 Jul 18 13:07:12.353035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1444/2776] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:11 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1335 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:12.367469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:12.369292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:12.400226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.407866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.411116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.413317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.826789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:12.855015 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c10ab86a-5268-4d4a-8f5f-e3e3c746edf3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1527 microversion: 2.1 time: 0.886205 Jul 18 13:07:12.860138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1333/2777] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:11 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1527 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:12.886037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:12.888204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] [instance: 32f4a31c-1257-4501-b41a-c0b2a9dffbb2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:12.909682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.910982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.912629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:12.913461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:12.952726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] HTTP exception thrown: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Request method failure captured: Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 HTTP/1.1 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VrUHYOrViq7-RgtdX8wHRfyFn0yrydFkJ2fZNP_U7JLAMebBgp-UsH_3voO0kbdWraU_AnyU3DNiC4EXnbIXzODIlRUbjxkbp_36e2tN8gmk-jppU1u4z8P-KW5xb53YZHCtyukN-EiHMfG6jn8SQOdnTCJS8DUv1Rt80BlQfm8ahA Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.26 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: aa1b5f4b484a46baaf8bf1fa54879424 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerTagsTestJSON-2113441126 Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:07:12.956797 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aa1b5f4b484a46baaf8bf1fa54879424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aa1b5f4b484a46baaf8bf1fa54879424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aa1b5f4b484a46baaf8bf1fa54879424", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aa1b5f4b484a46baaf8bf1fa54879424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerTagsTestJSON-2113441126 Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: aa1b5f4b484a46baaf8bf1fa54879424 Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerTagsTestJSON-2113441126 Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerTagsTestJSON-2113441126-project Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 9d5e4b0acd9949a6abd2a0cbe939dfba Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerTagsTestJSON-2113441126-project Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. Jul 18 13:07:12.962170 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '32f4a31c-1257-4501-b41a-c0b2a9dffbb2'} Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:12.963368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. Jul 18 13:07:12.965975 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:12.972850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] Returning 404 to user: Instance 32f4a31c-1257-4501-b41a-c0b2a9dffbb2 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:12.974997 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-efa027d1-5ea5-42f8-bd3a-f8080fd325de tempest-ServerTagsTestJSON-2113441126 tempest-ServerTagsTestJSON-2113441126-project] 10.222.0.88 "GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2" status: 404 len: 111 microversion: 2.26 time: 0.112574 Jul 18 13:07:12.983018 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1334/2778] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:07:12 2022] GET /compute/v2.1/servers/32f4a31c-1257-4501-b41a-c0b2a9dffbb2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:07:12.994359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-02359171-3697-4d08-8ee1-e5f948a1bd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:12.997211 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:07:12.997211 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:07:13.013836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:13.056891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-02359171-3697-4d08-8ee1-e5f948a1bd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/59ddc40b-ff38-4b8b-9262-b6e5cde93e44" status: 202 len: 0 microversion: 2.1 time: 0.070910 Jul 18 13:07:13.058991 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1335/2779] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:07:12 2022] DELETE /compute/v2.1/flavors/59ddc40b-ff38-4b8b-9262-b6e5cde93e44 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:07:13.078111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd642ac3-b4f5-4f57-8933-f9450f4bbd6c tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:13.121953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd642ac3-b4f5-4f57-8933-f9450f4bbd6c tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054998 Jul 18 13:07:13.123538 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1336/2780] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:07:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:13.164470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:13.168923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:13.193510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:13.194575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:13.196167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:13.197272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:13.511866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:13.527026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Old instance type tempest-test_resize_flavor_-944556257, new instance type m1.heat {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:07:13.543464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:07:13.544924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:07:13.546116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:07:13.547277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:07:13.548287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:07:13.991254 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd0fb14d-0f50-4826-a46d-8e1228601540 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba/action" status: 202 len: 0 microversion: 2.1 time: 0.834526 Jul 18 13:07:13.995967 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1337/2781] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:13 2022] POST /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:07:14.017858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:14.019499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:14.064644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:14.071006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:14.078768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:14.085906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:14.806479 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-986b5293-1a59-408d-bde6-67686104baa4 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1629 microversion: 2.1 time: 2.448533 Jul 18 13:07:14.829014 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1445/2782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:12 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1629 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:14.841472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:14.848194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:14.850715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Searching by: {'deleted': False, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:07:14.857031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:14.869681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:14.871312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:14.876113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:14.877402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:14.932505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:07:14.989821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43e384d0-29ad-43c4-9f6b-065cf0dff31a tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.158571 Jul 18 13:07:14.993543 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1446/2783] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:07:14 2022] GET /compute/v2.1/servers => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:15.001874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:15.003676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:15.018140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.019544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.020581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.021179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.228846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:15.235226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=1,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:15.272271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ee488e7-2289-45ba-a337-907bcd27a9a0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.270754 Jul 18 13:07:15.298889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1338/2784] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:13 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:15.344197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:15.361870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:15.363457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Searching by: {'deleted': False, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:07:15.387416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:15.392167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.393617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.400483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.401455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.484024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:07:15.614857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:15.632522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.634062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.695164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:15.717056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c669bcbe-d0ba-4222-9f17-bcb848e8e537 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1536 microversion: 2.1 time: 0.721454 Jul 18 13:07:15.735369 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1447/2785] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:14 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1536 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:15.837932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:15.840169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:15.853134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.860109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:15.860109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:15.860109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:16.678802 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d4874c6-f3f6-4fd2-9930-41ddad844071 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1612 microversion: 2.1 time: 0.845551 Jul 18 13:07:16.679941 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1448/2786] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:15 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1612 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:16.733446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:16.735162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:16.753490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:16.754712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:16.758335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:16.769213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:17.756304 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6f950e1-62b0-422f-aa8b-e4c1c094137b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 2.444497 Jul 18 13:07:17.757340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1339/2787] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:07:15 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:17.764461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:17.772354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:17.795523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:17.796773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:17.798749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:17.807647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:17.967195 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] HTTP exception thrown: Cannot 'migrate' instance ab9d78ea-f460-417d-a72d-f77ad0495496 while it is in vm_state suspended Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Request method failure captured: Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496/action HTTP/1.1 Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 15 Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vqzmh5Guj4NFKR9UhMqgEwABpZs5c4MBFrNYX6eI7DlNuwrnzqUSbw201KeiclaKNSzKpM_PpxYHdkB6EL8mNp7j1C3tNQo7DVSWMwoIH0YopuVV8JRV7IYJHygzNZfvElgLNt0Vn2H8AH9ojc5xHUJPEIFg3-xCpPNAVCg0VHN2xU Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 13:07:17.969309 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25c5cbe3a6364a299f67aafd2cd543fb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: b30761f5614c498f85a048c3e3a63969 Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: {"migrate": {}} Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:07:17.971876 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'migrate' instance ab9d78ea-f460-417d-a72d-f77ad0495496 while it is in vm_state suspended Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ab9d78ea-f460-417d-a72d-f77ad0495496', 'body': {'migrate': {}}} Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 in vm_state suspended. Cannot resize while the instance is in this state. Jul 18 13:07:17.973213 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ab9d78ea-f460-417d-a72d-f77ad0495496 while it is in vm_state suspended Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:17.975219 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ab9d78ea-f460-417d-a72d-f77ad0495496 while it is in vm_state suspended Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Returning 409 to user: Cannot 'migrate' instance ab9d78ea-f460-417d-a72d-f77ad0495496 while it is in vm_state suspended {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-022b3713-084f-43e8-bc79-5ba3d4eeb53c tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496/action" status: 409 len: 148 microversion: 2.1 time: 0.213013 Jul 18 13:07:17.977019 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1340/2788] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:17 2022] POST /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496/action => generated 148 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:07:17.978884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:17.980736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:17.997133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:17.998008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:17.999504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:18.000155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:18.196552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:18.210986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b1f4bd1-93dd-43f2-896b-b0a8ac14374d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.503792 Jul 18 13:07:18.226668 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1449/2789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:16 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:18.234409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cde60930-e771-4230-8912-94324131d914 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:18.266459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cde60930-e771-4230-8912-94324131d914 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038222 Jul 18 13:07:18.267861 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1450/2790] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:07:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:18.281141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-911dac37-649d-4c41-b2fa-c8937ef48c8a tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-911dac37-649d-4c41-b2fa-c8937ef48c8a tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Request method failure captured: Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action HTTP/1.1 Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 39 Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vqzmh5Guj4NFKR9UhMqgEwABpZs5c4MBFrNYX6eI7DlNuwrnzqUSbw201KeiclaKNSzKpM_PpxYHdkB6EL8mNp7j1C3tNQo7DVSWMwoIH0YopuVV8JRV7IYJHygzNZfvElgLNt0Vn2H8AH9ojc5xHUJPEIFg3-xCpPNAVCg0VHN2xU Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:07:18.290963 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25c5cbe3a6364a299f67aafd2cd543fb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: b30761f5614c498f85a048c3e3a63969 Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: {"os-resetState": {"state": "invalid"}} Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:07:18.292847 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '07c047da-fdf5-4905-aa89-5ac9009ba51d', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:18.293868 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 13:07:18.295251 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.300443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-911dac37-649d-4c41-b2fa-c8937ef48c8a tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:18.304634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-911dac37-649d-4c41-b2fa-c8937ef48c8a tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action" status: 400 len: 144 microversion: 2.1 time: 0.031580 Jul 18 13:07:18.308973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1451/2791] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:18 2022] POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action => generated 144 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:07:18.329171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0c275c0-a6ff-4b36-8505-c2034a6d2341 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0c275c0-a6ff-4b36-8505-c2034a6d2341 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Request method failure captured: Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action HTTP/1.1 Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 31 Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vqzmh5Guj4NFKR9UhMqgEwABpZs5c4MBFrNYX6eI7DlNuwrnzqUSbw201KeiclaKNSzKpM_PpxYHdkB6EL8mNp7j1C3tNQo7DVSWMwoIH0YopuVV8JRV7IYJHygzNZfvElgLNt0Vn2H8AH9ojc5xHUJPEIFg3-xCpPNAVCg0VHN2xU Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:07:18.334029 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25c5cbe3a6364a299f67aafd2cd543fb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: b30761f5614c498f85a048c3e3a63969 Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: {"os-resetState": {"state": 1}} Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:07:18.336720 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '07c047da-fdf5-4905-aa89-5ac9009ba51d', 'body': {'os-resetState': {'state': 1}}} Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 1 Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:18.338138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 13:07:18.341241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.347952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0c275c0-a6ff-4b36-8505-c2034a6d2341 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:18.350405 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0c275c0-a6ff-4b36-8505-c2034a6d2341 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action" status: 400 len: 120 microversion: 2.1 time: 0.027665 Jul 18 13:07:18.358166 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1452/2792] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:18 2022] POST /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d/action => generated 120 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:07:18.365499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:18.368349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Failed to fetch instance by id 999 {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 13:07:18.370481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Request method failure captured: Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 37 Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vqzmh5Guj4NFKR9UhMqgEwABpZs5c4MBFrNYX6eI7DlNuwrnzqUSbw201KeiclaKNSzKpM_PpxYHdkB6EL8mNp7j1C3tNQo7DVSWMwoIH0YopuVV8JRV7IYJHygzNZfvElgLNt0Vn2H8AH9ojc5xHUJPEIFg3-xCpPNAVCg0VHN2xU Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:07:18.378891 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25c5cbe3a6364a299f67aafd2cd543fb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25c5cbe3a6364a299f67aafd2cd543fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 25c5cbe3a6364a299f67aafd2cd543fb Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-5344517 Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: b30761f5614c498f85a048c3e3a63969 Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-5344517-project-admin Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: {"os-resetState": {"state": "error"}} Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:07:18.381345 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 999 could not be found. Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:07:18.382208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 13:07:18.383620 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:18.389574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:18.391285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23f5aa7a-c5b7-48b6-a91f-ebfb00c57370 tempest-ServersAdminNegativeTestJSON-5344517 tempest-ServersAdminNegativeTestJSON-5344517-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030124 Jul 18 13:07:18.397902 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1453/2793] 10.222.0.88 () {60 vars in 1178 bytes} [Mon Jul 18 13:07:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:07:18.405403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:18.406406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:18.415692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:18.416738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:18.418041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:18.419412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:18.468041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:07:18.673578 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57c9252d-e222-4332-896d-7f70c70c9a33 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 204 len: 0 microversion: 2.1 time: 0.272914 Jul 18 13:07:18.689287 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1454/2794] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:07:18 2022] DELETE /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:07:18.695838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:18.699453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:18.719234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:18.719908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:18.721055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:18.730818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:18.750617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:19.223510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:19.237990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a4ef3595-31f5-4124-adbf-9a5df0ec3aea tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1536 microversion: 2.1 time: 1.264108 Jul 18 13:07:19.244355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1341/2795] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:17 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1536 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:19.257342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:19.257788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:19.290351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:19.291184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:19.299378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:19.300125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:19.414955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:07:19.662670 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8096e3a-93c2-40a8-a8ba-247929bc8955 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 204 len: 0 microversion: 2.1 time: 0.414499 Jul 18 13:07:19.665022 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1342/2796] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:07:19 2022] DELETE /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:07:19.674425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7dab428f-d6b5-4c33-b3ee-8cc8e5bb4e99 req-a62a92ed-c6f6-4d13-bd3e-0f4897dc5036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94670aef-bd37-4a58-94a0-72df215cd4c2", "tag": "eef70485-4df8-49a4-a9d6-fab142d0da32"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:19.687443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7dab428f-d6b5-4c33-b3ee-8cc8e5bb4e99 req-a62a92ed-c6f6-4d13-bd3e-0f4897dc5036 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:19.688170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7dab428f-d6b5-4c33-b3ee-8cc8e5bb4e99 req-a62a92ed-c6f6-4d13-bd3e-0f4897dc5036 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:19.717544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7dab428f-d6b5-4c33-b3ee-8cc8e5bb4e99 req-a62a92ed-c6f6-4d13-bd3e-0f4897dc5036 service nova] Creating event network-changed:eef70485-4df8-49a4-a9d6-fab142d0da32 for instance 94670aef-bd37-4a58-94a0-72df215cd4c2 on n-h2-850003-3 Jul 18 13:07:19.730349 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7dab428f-d6b5-4c33-b3ee-8cc8e5bb4e99 req-a62a92ed-c6f6-4d13-bd3e-0f4897dc5036 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060303 Jul 18 13:07:19.731496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1343/2797] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:19.742602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:19.743990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:19.759585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:19.760470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:19.761459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:19.762076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:20.062423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:20.116261 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b50c9368-80e0-4857-b680-abf633a8f4d1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1467 microversion: 2.1 time: 1.424798 Jul 18 13:07:20.117280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1455/2798] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:18 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1467 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:20.126824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:20.129085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:20.169490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:20.170343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:20.171833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:20.172575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:20.352258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:20.372243 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db46e391-8d41-4a1a-a797-8100107d36e5 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.638513 Jul 18 13:07:20.373611 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1344/2799] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:19 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:20.387566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:20.389231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:20.405548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:20.408771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:20.412432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:20.417102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:20.976446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:20.993424 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1c5165c-d358-432e-a2de-542e7a657b9b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1536 microversion: 2.1 time: 0.617466 Jul 18 13:07:20.995951 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1345/2800] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:20 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1536 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:21.148188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:21.148730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:21.164134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:21.165001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:21.167164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:21.169000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:21.284655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:21.302870 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd514485-654e-49fd-97eb-5e2cce05fee2 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1609 microversion: 2.1 time: 1.183790 Jul 18 13:07:21.303735 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1456/2801] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:20 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1609 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:21.408942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:21.409874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:21.422445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:21.423066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:21.441183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:21.442296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:21.530726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:21.556994 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2a6dc13-c6e2-41e1-b483-26dc0acc18fe tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1467 microversion: 2.1 time: 0.415461 Jul 18 13:07:21.558927 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1346/2802] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:21 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1467 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:22.022987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:22.023628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:22.033629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.034189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.035431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.036194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.316660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:22.334722 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05ece290-2dad-482e-8355-a4f8acd0b4e7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1536 microversion: 2.1 time: 0.316609 Jul 18 13:07:22.336415 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1347/2803] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:22 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1536 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:22.349414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:22.351051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:22.364285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.365512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.367478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.368556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.641642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:22.656125 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0edc9aa3-5046-4162-8281-ee46360910c7 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1609 microversion: 2.1 time: 0.316605 Jul 18 13:07:22.656681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1348/2804] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:22 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1609 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:22.665270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:22.667366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:22.689495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.690278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.691942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:22.692997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:22.821462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:22.851985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-adb69964-95d6-475d-81a5-d3ac06ff0ed0 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.453029 Jul 18 13:07:22.854698 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1457/2805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:21 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:23.364810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:23.376640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:23.410578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:23.419513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:23.427435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:23.428986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:24.113052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:24.137255 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d807b595-462f-4f74-b089-fb5b91a29fc1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.778939 Jul 18 13:07:24.138688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1458/2806] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:23 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:24.165324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:24.168068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:24.199647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:24.200865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:24.204321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:24.205478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:24.480780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:24.501162 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-076adea6-75fb-471a-b079-b685704e43a7 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1467 microversion: 2.1 time: 1.842612 Jul 18 13:07:24.524152 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1349/2807] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:22 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1467 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:24.534544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:24.536287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:24.565035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:24.566571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:24.568570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:24.569855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:24.900361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:24.996339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:25.007944 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f853587-94f8-493b-a8e9-0ffc15afd10d tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1609 microversion: 2.1 time: 0.863405 Jul 18 13:07:25.008941 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1459/2808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:24 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1609 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:25.160071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:25.161051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:25.168059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:25.168959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:25.170034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:25.170834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:25.441194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:25.606027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:25.801110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:25.817167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17ad3465-b2b8-47dc-a9c3-d01041cfedde tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.661365 Jul 18 13:07:25.819140 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1460/2809] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:25 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:25.835430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:25.842352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:25.863652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:25.868491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:25.870120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:25.871060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:26.077764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:26.087807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b113e5a4-6100-42eb-8e59-57b9d84ff935 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.560834 Jul 18 13:07:26.125664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1350/2810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:24 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:26.247539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1789814160", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:26.361384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:07:26.651373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:26.674616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69ed9d5a-dd07-42af-bebf-c439d4e65c7e tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1467 microversion: 2.1 time: 0.852224 Jul 18 13:07:26.676129 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1461/2811] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:25 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1467 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:26.682319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:26.691271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:26.708333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:26.709195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:26.710652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:26.711627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:27.204377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:27.223935 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e14ae0b2-4746-4a0f-872d-a35106dc4df8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1609 microversion: 2.1 time: 0.546011 Jul 18 13:07:27.224956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1462/2812] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:26 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1609 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:27.253959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1c5c591e-ee3d-443f-aa03-571e165e93a2 req-dfd44a2d-b80b-46a2-8c17-e0741aba2423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8af146-685a-4aeb-85d7-b843e0ae3ff0", "name": "network-vif-unplugged", "status": "completed", "tag": "e8ef0a7a-903e-4c2b-81b7-0da1f6670f15"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:27.294120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1c5c591e-ee3d-443f-aa03-571e165e93a2 req-dfd44a2d-b80b-46a2-8c17-e0741aba2423 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:27.295463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1c5c591e-ee3d-443f-aa03-571e165e93a2 req-dfd44a2d-b80b-46a2-8c17-e0741aba2423 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:27.329092 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1c5c591e-ee3d-443f-aa03-571e165e93a2 req-dfd44a2d-b80b-46a2-8c17-e0741aba2423 service nova] Creating event network-vif-unplugged:e8ef0a7a-903e-4c2b-81b7-0da1f6670f15 for instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 on n-h2-850003-3 Jul 18 13:07:27.335511 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1c5c591e-ee3d-443f-aa03-571e165e93a2 req-dfd44a2d-b80b-46a2-8c17-e0741aba2423 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102625 Jul 18 13:07:27.337197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1463/2813] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:27.346533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:27.347695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:27.356225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:27.357122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:27.358652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:27.359894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:27.944918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:27.957324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68eda8cd-7e69-47f0-8fb9-9b9e568129c8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.617660 Jul 18 13:07:27.960853 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1464/2814] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:27 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:27.967323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:27.975166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:27.991348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:27.993746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:27.996489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:27.997393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:28.485070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:28.506090 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-86b54f1c-0ead-4e7a-9f2d-e9900840b978 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.543730 Jul 18 13:07:28.507224 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1465/2815] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:27 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:28.528286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:28.548271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:28.564909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:28.565742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:28.567267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:28.568909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:28.723566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:28.724275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:28.725068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lazy-loading 'fault' on Instance uuid ab9d78ea-f460-417d-a72d-f77ad0495496 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:28.897687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:28.928181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4aedafb0-72d5-4475-a48b-c3abda04d260 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 200 len: 1310 microversion: 2.1 time: 0.417520 Jul 18 13:07:28.930281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1466/2816] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:28 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 1310 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:28.941514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4d1a5554-300d-4b71-8322-459a73300953 req-295044b6-67ff-4f23-a063-ea4dad337c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9d78ea-f460-417d-a72d-f77ad0495496", "name": "network-vif-deleted", "tag": "6b5278e8-4d6d-4e03-a63f-ebc264987b39"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:28.969312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4d1a5554-300d-4b71-8322-459a73300953 req-295044b6-67ff-4f23-a063-ea4dad337c05 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:28.973075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4d1a5554-300d-4b71-8322-459a73300953 req-295044b6-67ff-4f23-a063-ea4dad337c05 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.030122 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4d1a5554-300d-4b71-8322-459a73300953 req-295044b6-67ff-4f23-a063-ea4dad337c05 service nova] Creating event network-vif-deleted:6b5278e8-4d6d-4e03-a63f-ebc264987b39 for instance ab9d78ea-f460-417d-a72d-f77ad0495496 on n-h2-850003-3 Jul 18 13:07:29.045579 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4d1a5554-300d-4b71-8322-459a73300953 req-295044b6-67ff-4f23-a063-ea4dad337c05 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112111 Jul 18 13:07:29.047318 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1467/2817] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:29.066133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:29.068226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:29.087085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:29.097355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.099333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.101718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.103278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.396248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:07:29.397386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:07:29.397386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:07:29.397905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:07:29.398506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:07:29.424522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.428314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.429940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.430644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.453676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:29.491809 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3c57d32-b090-46f1-bef6-a09d5cb64df6 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1541 microversion: 2.1 time: 0.428644 Jul 18 13:07:29.492952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1468/2818] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:29 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1541 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:29.502394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:07:29.512248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:29.513357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:29.530021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:07:29.537715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.538375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.540821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.546198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.563736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:07:29.568932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:07:29.679380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49764876-cd36-4b7c-98db-17ddcaef070d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.551522 Jul 18 13:07:29.686832 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1351/2819] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:07:29.696223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:29.697959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:29.716503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.717827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:29.726645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:29.731948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:30.402120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:30.438698 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17492f22-0020-4540-b2fd-98d0c7fa2ae7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.943328 Jul 18 13:07:30.440675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1469/2820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:29 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:30.455879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b24b39c0-4f24-4664-8223-d606c6264710 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:30.463874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b24b39c0-4f24-4664-8223-d606c6264710 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:30.712167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b24b39c0-4f24-4664-8223-d606c6264710 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:30.764605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b24b39c0-4f24-4664-8223-d606c6264710 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1215 microversion: 2.1 time: 0.321728 Jul 18 13:07:30.765354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:30.767194 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1470/2821] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:30 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:30.790078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:30.792487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: ab9d78ea-f460-417d-a72d-f77ad0495496] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:30.798215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c4ce089a-5ba5-45b3-b86c-ac6f1e12ffd4 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.098543 Jul 18 13:07:30.809218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1352/2822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:29 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:30.838719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:30.839555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:30.846319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:30.847526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:30.847713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:30.849192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:30.867268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:30.869135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:30.873347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:30.878737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:30.949311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] HTTP exception thrown: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Request method failure captured: Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 HTTP/1.1 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VqyFSbumRD6xilZnubRz-cDuniOD1J9yrar2mNbuCtTRP6e3eZvcbbtKB6RjGozdp8HUCBQD6y6FtswxbTVDcQYnFN8m4ezID6UDVN_lhYVkABO-EK_eVqszShBcu26raorHM1qYQ7gjtwA8d-PL7osLayZ-Pey52QZsobnSGPvGkg Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c933ade754c74ccfb275dc4f93232ce1 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:07:30.953278 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c933ade754c74ccfb275dc4f93232ce1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c933ade754c74ccfb275dc4f93232ce1 Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-1868403946-project Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f7c9bfbcb2a646d78f5ef5032fe8d778 Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1868403946-project Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. Jul 18 13:07:30.956496 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ab9d78ea-f460-417d-a72d-f77ad0495496'} Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:30.958264 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. Jul 18 13:07:30.960961 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:30.970902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Returning 404 to user: Instance ab9d78ea-f460-417d-a72d-f77ad0495496 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:30.972121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94080312-c8ec-41a3-b4a6-0798b8917aaf tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496" status: 404 len: 111 microversion: 2.1 time: 0.203299 Jul 18 13:07:30.977661 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1471/2823] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:30 2022] GET /compute/v2.1/servers/ab9d78ea-f460-417d-a72d-f77ad0495496 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:07:30.990438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:30.994905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:31.004745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.006636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.008318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.009147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.121861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:07:31.195084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:31.238621 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b022407b-77db-4eec-8a5d-bce96cd88035 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1541 microversion: 2.1 time: 0.423298 Jul 18 13:07:31.241450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1353/2824] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:30 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1541 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:31.397524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:31.477440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:31.488656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:31.500626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-278643bb-f7b1-4b45-8d0b-659a8e9cf8e1 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "DELETE /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 204 len: 0 microversion: 2.1 time: 0.508901 Jul 18 13:07:31.505023 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1472/2825] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:07:30 2022] DELETE /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:07:31.532663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f2f198ea-8d21-4333-a777-f29aeb97941c req-e27e44ce-dee6-4ae4-b04e-5d7b00393015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8af146-685a-4aeb-85d7-b843e0ae3ff0", "name": "network-vif-deleted", "tag": "e8ef0a7a-903e-4c2b-81b7-0da1f6670f15"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:31.536246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.547240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.553025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.563596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.575651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f2f198ea-8d21-4333-a777-f29aeb97941c req-e27e44ce-dee6-4ae4-b04e-5d7b00393015 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.576615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f2f198ea-8d21-4333-a777-f29aeb97941c req-e27e44ce-dee6-4ae4-b04e-5d7b00393015 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.679597 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f2f198ea-8d21-4333-a777-f29aeb97941c req-e27e44ce-dee6-4ae4-b04e-5d7b00393015 service nova] Creating event network-vif-deleted:e8ef0a7a-903e-4c2b-81b7-0da1f6670f15 for instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 on n-h2-850003-3 Jul 18 13:07:31.705838 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f2f198ea-8d21-4333-a777-f29aeb97941c req-e27e44ce-dee6-4ae4-b04e-5d7b00393015 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195942 Jul 18 13:07:31.720613 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1473/2826] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:31.763420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:31.765468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:31.785939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.786174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:31.787774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:31.789396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:32.599086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:32.626198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-411b72df-594d-42c6-a545-ee236b79c832 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1477 microversion: 2.1 time: 0.901742 Jul 18 13:07:32.628494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1474/2827] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:31 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1477 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:32.637778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:32.639310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:32.663511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:32.667097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:32.674205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:32.676075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:32.829984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:32.841171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:32.908695 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5daf2b85-3b58-4db3-b9b0-bf1b18b66a61 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 1.445772 Jul 18 13:07:32.918666 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1354/2828] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:31 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:32.938018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:32.939748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:32.958002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:32.961539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:32.965102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:32.966817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:33.101680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:33.143162 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d8af13e-599f-4724-88db-4c24d4ff1eff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1267 microversion: 2.1 time: 0.512253 Jul 18 13:07:33.148545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1475/2829] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:32 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1267 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:33.168733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:33.171268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:33.193551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:33.194124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:33.204246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:33.204974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:33.902710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:33.953141 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e8fcabb-2d88-4213-b8fb-21664fe8beaa tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.795162 Jul 18 13:07:33.955682 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1476/2830] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:33 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:33.976015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:33.977637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:33.999930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:34.001198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:34.004236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:34.019497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:34.383533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:34.406043 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ba785d2-aad4-4063-b62a-c27b67ce2b5e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 1.484852 Jul 18 13:07:34.411407 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1355/2831] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:32 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:34.428374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:34.430324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:34.448822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:34.449660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:34.450905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:34.451628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.075141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:35.094097 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a675a8df-5d61-4045-bb10-b45faa5db110 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.679996 Jul 18 13:07:35.096368 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1356/2832] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:34 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:35.102275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:35.103544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:35.114195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.115099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.116379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.117360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.279899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:35.288463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:35.320116 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fc3315b7-cfba-486a-b16d-c280e7c6d958 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1273 microversion: 2.1 time: 0.221440 Jul 18 13:07:35.321296 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1357/2833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:35 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:35.325454 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-047ff60c-46f6-4f71-a6b1-31fb415a3957 tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1477 microversion: 2.1 time: 1.367174 Jul 18 13:07:35.338858 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1477/2834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:33 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1477 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:35.352575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:35.354822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:35.362294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.362875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.364028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.365060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.434376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:35.435487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:35.461326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.467559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.469392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:35.470500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:35.497142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:35.514139 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10d43c61-e2c7-49cb-9fe3-f8de29bb4bed tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.191386 Jul 18 13:07:35.516125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1358/2835] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:35 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:36.099950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:36.129797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:36.133663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:36.144203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7984370-21ef-431f-8000-1eb66c762ef8 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.686094 Jul 18 13:07:36.146573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1478/2836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:35 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:36.171566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.172372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.173878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.174672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.348833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:36.349931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:36.365537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.366124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.368108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.368691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.555788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:36.575039 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf4a13f1-dc73-4590-8c1e-184b4787487d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1273 microversion: 2.1 time: 0.236155 Jul 18 13:07:36.590787 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1479/2837] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:36 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:36.607986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:36.616430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:36.628711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.630102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.631969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.633130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.768546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c9bfbcb2a646d78f5ef5032fe8d778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c933ade754c74ccfb275dc4f93232ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:36.796502 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d508eed3-2383-4a9c-b375-8cac1d5b49ab tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 200 len: 1435 microversion: 2.1 time: 0.195982 Jul 18 13:07:36.798375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1480/2838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:36 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 1435 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:36.812199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:36.814483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:36.832692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.835553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:36.837998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:36.839099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:37.042325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:37.058494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:37.073183 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93e8d9a5-d625-469f-930e-ed444db34251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.950486 Jul 18 13:07:37.074054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1359/2839] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:36 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:37.096330 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6cd9e4a5-74db-4871-9ac7-db6f2f08d520 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.295647 Jul 18 13:07:37.109061 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1481/2840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:36 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:37.112203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-302dc53d-a232-4931-bc88-0057147892bf req-42be6a5f-760c-47fe-959d-d0e81cc8b579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c047da-fdf5-4905-aa89-5ac9009ba51d", "name": "network-vif-deleted", "tag": "8291b449-3998-4223-8bfb-cb6ae8ab713c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:37.155781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-302dc53d-a232-4931-bc88-0057147892bf req-42be6a5f-760c-47fe-959d-d0e81cc8b579 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:37.156942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-302dc53d-a232-4931-bc88-0057147892bf req-42be6a5f-760c-47fe-959d-d0e81cc8b579 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:37.187637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:37.195833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:37.205351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-302dc53d-a232-4931-bc88-0057147892bf req-42be6a5f-760c-47fe-959d-d0e81cc8b579 service nova] Creating event network-vif-deleted:8291b449-3998-4223-8bfb-cb6ae8ab713c for instance 07c047da-fdf5-4905-aa89-5ac9009ba51d on n-h1-850003-3 Jul 18 13:07:37.226051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:37.226839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:37.227390 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-302dc53d-a232-4931-bc88-0057147892bf req-42be6a5f-760c-47fe-959d-d0e81cc8b579 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139044 Jul 18 13:07:37.229074 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1360/2841] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:37.250790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:37.251699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:37.612183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:37.615401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:37.656765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:37.657998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:37.660816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:37.665189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.123199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:38.151742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6729ac87-292d-4fd5-8631-44ed2531e971 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.971146 Jul 18 13:07:38.152701 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1482/2842] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:37 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:38.172348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:38.173496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] [instance: 07c047da-fdf5-4905-aa89-5ac9009ba51d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:38.237279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.238217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.246299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.247119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.295055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:38.320699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c604e45f-042e-4a05-8ad3-dd9bc75176d0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 0.716263 Jul 18 13:07:38.322057 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1361/2843] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:37 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:38.342069 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] HTTP exception thrown: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. Jul 18 13:07:38.343425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Request method failure captured: Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d HTTP/1.1 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VqyFSbumRD6xilZnubRz-cDuniOD1J9yrar2mNbuCtTRP6e3eZvcbbtKB6RjGozdp8HUCBQD6y6FtswxbTVDcQYnFN8m4ezID6UDVN_lhYVkABO-EK_eVqszShBcu26raorHM1qYQ7gjtwA8d-PL7osLayZ-Pey52QZsobnSGPvGkg Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c933ade754c74ccfb275dc4f93232ce1 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:07:38.360532 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c933ade754c74ccfb275dc4f93232ce1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c933ade754c74ccfb275dc4f93232ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c933ade754c74ccfb275dc4f93232ce1 Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1868403946 Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-1868403946-project Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f7c9bfbcb2a646d78f5ef5032fe8d778 Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1868403946-project Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. Jul 18 13:07:38.362295 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '07c047da-fdf5-4905-aa89-5ac9009ba51d'} Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:38.363184 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. Jul 18 13:07:38.364799 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:07:38.368128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:38.373122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] Returning 404 to user: Instance 07c047da-fdf5-4905-aa89-5ac9009ba51d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:38.382206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ff3791a-6fcc-45d9-80fb-c23def7788db tempest-ServersAdminNegativeTestJSON-1868403946 tempest-ServersAdminNegativeTestJSON-1868403946-project] 10.222.0.88 "GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d" status: 404 len: 111 microversion: 2.1 time: 0.225991 Jul 18 13:07:38.394449 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1483/2844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:38 2022] GET /compute/v2.1/servers/07c047da-fdf5-4905-aa89-5ac9009ba51d => generated 111 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:07:38.416719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.423457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.430715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:38.432559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.437094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.438628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:38.464668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.468343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.471613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.472663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.674837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:38.696387 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b17c1f2-73da-432b-960e-5fab8b4017d0 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.294861 Jul 18 13:07:38.722182 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1484/2845] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:38 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:38.727797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-665aa24e-6526-41e6-9c14-823530b183e7 req-c3774c54-3ffd-4574-a81b-37f01ca62789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94670aef-bd37-4a58-94a0-72df215cd4c2", "name": "network-vif-plugged", "status": "completed", "tag": "eef70485-4df8-49a4-a9d6-fab142d0da32"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:38.766613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-665aa24e-6526-41e6-9c14-823530b183e7 req-c3774c54-3ffd-4574-a81b-37f01ca62789 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.767142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-665aa24e-6526-41e6-9c14-823530b183e7 req-c3774c54-3ffd-4574-a81b-37f01ca62789 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.815995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-665aa24e-6526-41e6-9c14-823530b183e7 req-c3774c54-3ffd-4574-a81b-37f01ca62789 service nova] Creating event network-vif-plugged:eef70485-4df8-49a4-a9d6-fab142d0da32 for instance 94670aef-bd37-4a58-94a0-72df215cd4c2 on n-h2-850003-3 Jul 18 13:07:38.831361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-665aa24e-6526-41e6-9c14-823530b183e7 req-c3774c54-3ffd-4574-a81b-37f01ca62789 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117634 Jul 18 13:07:38.834799 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1485/2846] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:38.856945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:38.858816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:38.891839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.892334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:38.896923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:38.897440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:39.108327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:39.131636 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f871b235-73cf-4e88-9d22-fb36e7565fbe tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1541 microversion: 2.1 time: 0.806351 Jul 18 13:07:39.138635 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1362/2847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:38 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1541 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:39.190796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:39.192006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:39.223025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:39.224026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:39.225389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:39.229757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:39.463522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:39.550385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:40.048290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:40.089049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2afaddc5-7e42-45a0-bcda-6afff03b909e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.251277 Jul 18 13:07:40.090188 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1486/2848] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:38 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:40.111726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:40.116307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:40.118001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:40.145750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71e28c01-e780-4aac-a753-cbe9925ddde7 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.957049 Jul 18 13:07:40.146629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.148148 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1363/2849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:39 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:40.155254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.165238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:40.169663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.171066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:40.172322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.188821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.189522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.197630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.202717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.486919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:40.502556 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-165deb85-ea36-4d26-adcd-6dea36d51eba tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.350415 Jul 18 13:07:40.519164 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1364/2850] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:40 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:40.529081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:40.541509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:40.551663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.553266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.554806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:40.555629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:40.759506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:41.051295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:41.094063 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7998835-3b50-42c8-a289-a8916d5dc7f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.572067 Jul 18 13:07:41.096533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1365/2851] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:40 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:41.111835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:41.112485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:41.124429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.124994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.126460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.127579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.390188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:41.418458 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-818d2a4f-a224-4537-957b-0b81858d411f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1540 microversion: 2.1 time: 0.319653 Jul 18 13:07:41.426747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1366/2852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:41 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:41.438034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-32664c81-bbc8-4246-90c1-de1168a4e9c3 req-bf5dd900-f9b6-4f35-a722-8933d3a6998e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609fd767-a1e1-4348-bce9-97ad87b2aae6", "tag": "c64f7552-bcde-488d-b0a6-c03c07352b31"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:41.453972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:41.461723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-32664c81-bbc8-4246-90c1-de1168a4e9c3 req-bf5dd900-f9b6-4f35-a722-8933d3a6998e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.463746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-32664c81-bbc8-4246-90c1-de1168a4e9c3 req-bf5dd900-f9b6-4f35-a722-8933d3a6998e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.476052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff528e63-0c86-4112-9707-4ead142403a6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 1.383709 Jul 18 13:07:41.492772 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-32664c81-bbc8-4246-90c1-de1168a4e9c3 req-bf5dd900-f9b6-4f35-a722-8933d3a6998e service nova] Creating event network-changed:c64f7552-bcde-488d-b0a6-c03c07352b31 for instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 on n-h2-850003-3 Jul 18 13:07:41.496770 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1487/2853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:40 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:41.523629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:41.526283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:41.528010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-32664c81-bbc8-4246-90c1-de1168a4e9c3 req-bf5dd900-f9b6-4f35-a722-8933d3a6998e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096170 Jul 18 13:07:41.532944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1367/2854] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:41.546732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.547874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.549409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.550285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.551312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:41.554047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:41.568592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.570944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:41.572892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:41.574057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.171553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:42.208220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec4edf55-a887-4781-be5d-8c982cf42f7f tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1402 microversion: 2.1 time: 0.667813 Jul 18 13:07:42.212579 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1368/2855] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:41 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1402 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:42.241909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:42.243833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:42.272556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.274857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.281253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.285201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.523673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:42.549498 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5b5d4103-91af-493d-b78e-d204da0465db tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.334520 Jul 18 13:07:42.565823 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1369/2856] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:42 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:42.583440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:42.595770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:42.614470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:42.617413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.618349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.622818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.623795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.830911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:42.856421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6f8412f-81b9-4f95-b00d-51867bdd20c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.357660 Jul 18 13:07:42.857043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1488/2857] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:41 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:42.874306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:42.879694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:42.902682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.904044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:42.906015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:42.909907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.050248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:43.069816 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3502be9-0dc5-4b98-a16e-fd78e446c6ba tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1540 microversion: 2.1 time: 0.501436 Jul 18 13:07:43.090172 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1370/2858] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:42 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1540 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:43.097705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1188423110"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:43.099395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:43.132385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.132835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.133883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.135119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.525902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:43.556846 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4f85364-23d1-4b90-af28-6f0d9b1c4a7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 0.683449 Jul 18 13:07:43.576844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1489/2859] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:42 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:43.603940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:43.609642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:43.640132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.641295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.646213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.651322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.719007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:43.772202 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d49aba5e-a5f4-41b2-aa48-6efb432578ef tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.679377 Jul 18 13:07:43.777120 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1371/2860] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:43 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 13:07:43.813927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:43.819272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:43.844894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.846001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:43.850997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:43.852166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.160277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:44.174375 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5f436bb-694d-4305-b6b3-41d2be4d1ee1 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1252 microversion: 2.1 time: 0.378561 Jul 18 13:07:44.175511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1372/2861] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:43 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1252 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:44.184869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:44.186373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:44.197833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.198679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.200632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.201473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.230122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:44.261776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3aafe19-b696-451b-9aaf-c878a82f02f3 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1589 microversion: 2.1 time: 0.680538 Jul 18 13:07:44.262777 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1490/2862] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:43 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1589 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:44.295620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:44.298099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:44.321706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.324405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.328466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.331724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.400898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:44.591878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e25d7dc-b41c-4228-a42c-0a615399c34e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302568 Jul 18 13:07:44.592958 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1491/2863] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:07:44 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2/os-interface => generated 284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:44.608540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:44.610097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:44.625357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.627588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.629752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:44.631336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:44.942823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:44.975715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ea8c84d-106e-4d96-86e3-996042426e3b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1540 microversion: 2.1 time: 0.797328 Jul 18 13:07:44.977168 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1373/2864] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:44 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1540 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:45.197309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:45.198566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:45.246945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:45.248374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:45.250066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:45.252785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:45.372110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:45.373180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:45.374536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lazy-loading 'fault' on Instance uuid 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:07:45.626503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edac715758b45858ce825c02ac327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c45bbe6bdc4f9e814c009b5d1ead58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:45.672777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-607d5efe-f060-4d2a-abbb-3b869e703108 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 200 len: 1257 microversion: 2.1 time: 0.480434 Jul 18 13:07:45.675122 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1374/2865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:45 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 1257 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:45.702622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-unplugged", "status": "completed", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:45.722004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:45.763809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:45.764499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:45.769834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d2fc180-a6c9-44d8-9fba-feda72ad452f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 1.158754 Jul 18 13:07:45.772297 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1492/2866] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:44 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:45.833662 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] Creating event network-vif-unplugged:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:07:45.862639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] Instance c3b78d57-1a15-4070-b759-0d65d34955ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:07:45.901506 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1a2401d4-dd7c-46dc-9a32-65ceeb46de79 req-282d9081-46b7-4df2-83a8-daa2ef7d0c2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.215291 Jul 18 13:07:45.905986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1375/2867] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:46.005655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:46.006650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:46.085391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.085854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.089156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.089774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.655496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:46.692277 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69c18c1d-417e-461b-a78c-da4c4992a26e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1472 microversion: 2.1 time: 0.693372 Jul 18 13:07:46.693651 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1493/2868] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:45 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1472 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:46.719959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:46.724726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] [instance: 9f8af146-685a-4aeb-85d7-b843e0ae3ff0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:46.752697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.753645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.755479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.767095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.809770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] HTTP exception thrown: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Request method failure captured: Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 HTTP/1.1 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VpqgEC4WORyOvMzCwb7BBKwfut_aTLuiFNVgYbGgBiTAaTPuG4xpiBF7x8eXgmWi8v4AKGiy5KvYV-jeS91E9Fja4TLCsdv7SD8bi1H9A1v41VBPoZICnHy8iyKyxI3aLW7efO2NBNDN4ebSDW0_msGRPpqKINi406D-stxjU3wtm8 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: b8c45bbe6bdc4f9e814c009b5d1ead58 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestBootFromVolume-227180375 Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:07:46.814288 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b8c45bbe6bdc4f9e814c009b5d1ead58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8c45bbe6bdc4f9e814c009b5d1ead58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b8c45bbe6bdc4f9e814c009b5d1ead58", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8c45bbe6bdc4f9e814c009b5d1ead58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestBootFromVolume-227180375 Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: b8c45bbe6bdc4f9e814c009b5d1ead58 Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestBootFromVolume-227180375 Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestBootFromVolume-227180375-project Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 7edac715758b45858ce825c02ac327d9 Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestBootFromVolume-227180375-project Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. Jul 18 13:07:46.817102 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '9f8af146-685a-4aeb-85d7-b843e0ae3ff0'} Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:07:46.819489 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. Jul 18 13:07:46.824055 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:07:46.831844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Returning 404 to user: Instance 9f8af146-685a-4aeb-85d7-b843e0ae3ff0 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:07:46.833098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:46.834372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc7ef796-e7cc-4329-9d81-afa77d328fe8 tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0" status: 404 len: 111 microversion: 2.1 time: 0.118287 Jul 18 13:07:46.834862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:46.836576 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1376/2869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:46 2022] GET /compute/v2.1/servers/9f8af146-685a-4aeb-85d7-b843e0ae3ff0 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:07:46.863219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.864882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad9d1ad0-3dda-4571-819c-d6c221e3d59b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] Calling method '.version_select at 0x7f96e4cc0ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:46.865523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.869891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:46.875571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:46.923112 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad9d1ad0-3dda-4571-819c-d6c221e3d59b tempest-ServersTestBootFromVolume-227180375 tempest-ServersTestBootFromVolume-227180375-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141974879" status: 202 len: 0 microversion: 2.1 time: 0.078825 Jul 18 13:07:46.923892 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1377/2870] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141974879 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:07:47.723941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:47.727262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:47.764093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:47.770317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:47.775986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:47.782446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:48.034990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:48.057823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-800ea2eb-201e-49c6-8d20-1bf1df6a6e92 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 1.256860 Jul 18 13:07:48.076565 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1494/2871] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:46 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:49.103707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:49.104471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:49.126557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:49.127521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:49.130679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:49.132062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:49.255366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:49.280599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ac69b3a-0d17-48b2-8193-b90847932984 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1469 microversion: 2.1 time: 1.561379 Jul 18 13:07:49.283212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1378/2872] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:47 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1469 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:49.649791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:49.663362 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41217528-3a62-4184-83d1-e26c1ee46139 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 0.565461 Jul 18 13:07:49.667156 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1495/2873] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:49 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:49.681949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:49.685723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:49.717726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:49.719684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:49.721475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:49.722767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:50.101053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:50.110931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:50.123294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:50.124169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:50.125237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:50.126618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:50.342100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:50.353285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:50.355415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:50.356361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:50.452097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:07:50.469126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:07:50.916346 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e193a6e1-86cf-4430-a730-5caaa25d57f6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba/action" status: 202 len: 0 microversion: 2.1 time: 1.608257 Jul 18 13:07:50.928276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1379/2874] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:07:49 2022] POST /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:07:50.953464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fe616108-ae6a-4687-a74b-7bbda365ed17 req-4ff60094-40bb-419a-be69-ff1ea321374e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94670aef-bd37-4a58-94a0-72df215cd4c2", "tag": "eef70485-4df8-49a4-a9d6-fab142d0da32"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:50.988630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fe616108-ae6a-4687-a74b-7bbda365ed17 req-4ff60094-40bb-419a-be69-ff1ea321374e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:50.990605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fe616108-ae6a-4687-a74b-7bbda365ed17 req-4ff60094-40bb-419a-be69-ff1ea321374e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:51.015796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:51.038708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5d64a3d-7589-40b0-824f-f8455440faec tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1589 microversion: 2.1 time: 1.368624 Jul 18 13:07:51.040617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1496/2875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:49 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1589 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:51.045672 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fe616108-ae6a-4687-a74b-7bbda365ed17 req-4ff60094-40bb-419a-be69-ff1ea321374e service nova] Creating event network-changed:eef70485-4df8-49a4-a9d6-fab142d0da32 for instance 94670aef-bd37-4a58-94a0-72df215cd4c2 on n-h2-850003-3 Jul 18 13:07:51.063188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:51.081772 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fe616108-ae6a-4687-a74b-7bbda365ed17 req-4ff60094-40bb-419a-be69-ff1ea321374e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150897 Jul 18 13:07:51.090177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:51.090918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1380/2876] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:51.115243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:51.116606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:51.128903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:51.130084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:51.131767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:51.132997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:51.136696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:51.163069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:51.164523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:51.165324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:52.369368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:52.427023 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b9b48fc1-5381-4242-8468-c48008e4cf95 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1468 microversion: 2.1 time: 1.333377 Jul 18 13:07:52.439452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1381/2877] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:51 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1468 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:52.631968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:52.683905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a82711c-b88d-4168-9986-31e3a31e7ecb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 1.636034 Jul 18 13:07:52.689537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1497/2878] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:51 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:53.463962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:53.466964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:53.511644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:53.512066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:53.512894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:53.513352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:53.727204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:53.729885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:53.761859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:53.766949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:53.770587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:53.771949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:54.861216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:54.888403 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-693aa2c1-d3c6-4ba3-9d9c-d5283d4e6d91 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 1.171260 Jul 18 13:07:54.902189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1498/2879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:53 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:55.926436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:55.927641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:55.967266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:55.968037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:55.969507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:55.970475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:56.374449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:56.405453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd225e69-1dd2-4298-a9dd-771a49ffdccd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1468 microversion: 2.1 time: 2.947534 Jul 18 13:07:56.408508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1382/2880] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:53 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1468 bytes in 2953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:07:56.564417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:56.594918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32f40a20-1177-4cac-8f0f-457e5753726e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 0.675475 Jul 18 13:07:56.599049 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1499/2881] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:55 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:56.708514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-plugged", "status": "completed", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:56.779460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:56.781065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:56.811420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] Creating event network-vif-plugged:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:07:56.823545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] Instance c3b78d57-1a15-4070-b759-0d65d34955ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:07:56.836431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2ed4dd6c-e461-4b75-afd0-dcd1b0b5e2cf req-23b75534-24c7-444e-a4df-b5e5c17da5b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137026 Jul 18 13:07:56.839197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1383/2882] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:07:57.452712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:57.457966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:57.491295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:57.494431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:57.496967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:57.501912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:57.629540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:57.630903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:57.647822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:57.650342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:57.652180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:57.655369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:57.862864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:57.980775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-543321ec-e72c-4664-a046-4843b6f591ad tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1468 microversion: 2.1 time: 0.537696 Jul 18 13:07:57.991123 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1500/2883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:57 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1468 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:58.940358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e995716f-baac-4a5e-8b14-e65620ed8322 req-3b2664a5-8e3d-4286-91a4-090dd783f403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609fd767-a1e1-4348-bce9-97ad87b2aae6", "name": "network-vif-plugged", "status": "completed", "tag": "c64f7552-bcde-488d-b0a6-c03c07352b31"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:07:59.015437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e995716f-baac-4a5e-8b14-e65620ed8322 req-3b2664a5-8e3d-4286-91a4-090dd783f403 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:59.016485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e995716f-baac-4a5e-8b14-e65620ed8322 req-3b2664a5-8e3d-4286-91a4-090dd783f403 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:59.072925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e995716f-baac-4a5e-8b14-e65620ed8322 req-3b2664a5-8e3d-4286-91a4-090dd783f403 service nova] Creating event network-vif-plugged:c64f7552-bcde-488d-b0a6-c03c07352b31 for instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 on n-h2-850003-3 Jul 18 13:07:59.105049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e995716f-baac-4a5e-8b14-e65620ed8322 req-3b2664a5-8e3d-4286-91a4-090dd783f403 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171852 Jul 18 13:07:59.110746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1501/2884] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:07:59.122577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:07:59.123366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:07:59.144231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:07:59.146625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:59.147192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:59.148054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:07:59.148505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:07:59.713407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:59.755503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee3e7769-292c-4b1b-8681-46594ed08d21 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 2.130812 Jul 18 13:07:59.757918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1384/2885] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:57 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:07:59.813278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:07:59.845633 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-18225193-28e1-4d9c-b800-2a0fa83383a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1534 microversion: 2.1 time: 0.721225 Jul 18 13:07:59.847280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1502/2886] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:07:59 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1534 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:00.802595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:00.817354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:00.852098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:00.869209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:00.870991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:00.881321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:00.882843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:00.928982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:00.933197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:00.987865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:00.988623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:00.990021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:01.002203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:01.705539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:01.729559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a3a7323-1089-4140-bdbc-090ecadc2bf5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1534 microversion: 2.1 time: 0.832045 Jul 18 13:08:01.742111 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1503/2887] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:00 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1534 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:01.744141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-plugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}, {"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-unplugged", "status": "completed", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:01.776846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:01.781202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:01.809599 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Creating event network-vif-plugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:08:01.812408 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Creating event network-vif-unplugged:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:08:01.823494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] Instance c3b78d57-1a15-4070-b759-0d65d34955ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:08:01.847095 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-edef242a-9906-4d5b-9dbc-b46137893b47 req-f9028ff6-f97a-4156-9fbd-c6dcc45d1a46 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.111240 Jul 18 13:08:01.855769 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1504/2888] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:02.755239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:02.768579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:02.812018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:02.814168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:02.821021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:02.822612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:03.194335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:03.229404 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e45dc654-becf-4884-9e46-d8d263bb43e8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1315 microversion: 2.1 time: 2.443242 Jul 18 13:08:03.237289 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1385/2889] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:00 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1315 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:03.977562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:04.010575 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa6bb298-e0d2-4510-940c-e10b0183f476 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1534 microversion: 2.1 time: 1.258444 Jul 18 13:08:04.012042 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1505/2890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:02 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1534 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:04.262085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:04.268849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:04.300909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:04.302111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:04.308626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:04.312663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:05.051265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:05.052504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:05.087802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:05.088873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:05.097403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:05.098582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:06.536469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:06.565516 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8fb08e05-cf70-461f-b012-724ada57f40f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1534 microversion: 2.1 time: 1.528441 Jul 18 13:08:06.578380 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1506/2891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:05 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1534 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:06.982201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:07.026309 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72338f69-c576-4503-84a1-e7e9e76fd0f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1501 microversion: 2.1 time: 2.771412 Jul 18 13:08:07.028650 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1386/2892] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:04 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1501 bytes in 2777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:07.067135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:07.071250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:07.113863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.114800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:07.118490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.119579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:07.244616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:08:07.511971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:07.619757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:07.623648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:07.686842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39d7a2ac-0590-49d1-b6d1-4e5c4b905db4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 204 len: 0 microversion: 2.1 time: 0.626680 Jul 18 13:08:07.689263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.690085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:07.699135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1507/2893] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:08:07 2022] DELETE /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:08:07.701004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.702288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:07.725052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:07.728935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:07.762406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.766896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:07.770895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:07.772338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:08.395051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:08.424402 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1aba372-d81e-4e75-ae78-30c8ac15a482 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1507 microversion: 2.1 time: 0.713721 Jul 18 13:08:08.427428 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1508/2894] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:07 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1507 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:09.459283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:09.461324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:09.503453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:09.504279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:09.505750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:09.506536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:09.685005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:09.691389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:09.753733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0877354-992c-4f6e-ab1c-65702315367e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1527 microversion: 2.1 time: 2.123972 Jul 18 13:08:09.755152 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1387/2895] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:07 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1527 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:09.785758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:09.804451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:09.845984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:09.851442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:09.860274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:09.867321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:10.944653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:10.974022 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae493426-1f8e-47ed-a247-7a26ed768116 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1527 microversion: 2.1 time: 1.195520 Jul 18 13:08:11.000209 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1388/2896] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:09 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1527 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:11.037049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8210e2d-678b-4581-a99f-fd5716b97ca4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:11.039454 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:08:11.039454 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:08:11.085539 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d8210e2d-678b-4581-a99f-fd5716b97ca4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] HTTP exception thrown: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8210e2d-678b-4581-a99f-fd5716b97ca4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Request method failure captured: Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/flavors/59ddc40b-ff38-4b8b-9262-b6e5cde93e44 HTTP/1.1 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vn3pSWTDUFpexWGrR0HU1iJLeEBDmM7JinaltmqafaAAq8MSsg4Vl2qroW8-TukXthxDnx4G8wska50nuCsQ8aWk7YbHIQRg6mSitl-6t4AQFQG-4y86tiWuOyQTSqiqzFHiZ9QsjPBYNu-J6rC94AnyF-oKKT7XmIbHkDx6eskbtI Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 452f22ec646d4724bca1c9b9e8fe38c4 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MigrationsAdminTest-12801773 Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 13:08:11.097912 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/452f22ec646d4724bca1c9b9e8fe38c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/452f22ec646d4724bca1c9b9e8fe38c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_452f22ec646d4724bca1c9b9e8fe38c4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/452f22ec646d4724bca1c9b9e8fe38c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MigrationsAdminTest-12801773 Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 452f22ec646d4724bca1c9b9e8fe38c4 Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MigrationsAdminTest-12801773 Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MigrationsAdminTest-12801773-project-admin Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 79372472644947c4a87cc680d2997ce8 Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MigrationsAdminTest-12801773-project-admin Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: exception: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. Jul 18 13:08:11.100862 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '59ddc40b-ff38-4b8b-9262-b6e5cde93e44'} Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:11.103110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. Jul 18 13:08:11.105827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:11.113158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8210e2d-678b-4581-a99f-fd5716b97ca4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Returning 404 to user: Flavor 59ddc40b-ff38-4b8b-9262-b6e5cde93e44 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:08:11.113158 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8210e2d-678b-4581-a99f-fd5716b97ca4 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/59ddc40b-ff38-4b8b-9262-b6e5cde93e44" status: 404 len: 109 microversion: 2.1 time: 0.086898 Jul 18 13:08:11.113158 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1389/2897] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:08:11 2022] DELETE /compute/v2.1/flavors/59ddc40b-ff38-4b8b-9262-b6e5cde93e44 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:08:11.186228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:11.231752 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb9e7aa4-780f-4611-993e-7476d69efe75 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1507 microversion: 2.1 time: 1.778540 Jul 18 13:08:11.246939 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1509/2898] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:09 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1507 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:11.316875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-528390711", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:11.341018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5d50eccb-cf4a-4c82-a159-f760f44725aa req-a4e105f7-b614-4336-8af3-98d9a33fcae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-plugged", "status": "completed", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:11.356182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5d50eccb-cf4a-4c82-a159-f760f44725aa req-a4e105f7-b614-4336-8af3-98d9a33fcae6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:11.357112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5d50eccb-cf4a-4c82-a159-f760f44725aa req-a4e105f7-b614-4336-8af3-98d9a33fcae6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:11.379213 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5d50eccb-cf4a-4c82-a159-f760f44725aa req-a4e105f7-b614-4336-8af3-98d9a33fcae6 service nova] Creating event network-vif-plugged:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:08:11.391807 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5d50eccb-cf4a-4c82-a159-f760f44725aa req-a4e105f7-b614-4336-8af3-98d9a33fcae6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064980 Jul 18 13:08:11.393917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1510/2899] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:11.628818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] validate_networks() for None {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:08:12.272366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:12.275450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:12.310398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:12.314141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:12.316888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:12.319770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:12.701088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:12.735612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8cebf305-956a-4f16-a455-3e2a7186067f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1507 microversion: 2.1 time: 0.477031 Jul 18 13:08:12.744051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1511/2900] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:12 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:13.771745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:13.776047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:13.815968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:13.817409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:13.819346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:13.821234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:14.348925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:08:14.350588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:08:14.352641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:08:14.353650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:08:14.355012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:08:14.374569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:14.375544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:14.413618 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e12beae5-ae9f-4128-be4b-b7744eadf03c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1465 microversion: 2.1 time: 0.652721 Jul 18 13:08:14.415231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:14.415937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:14.418460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:14.419290 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1512/2901] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:13 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1465 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:14.419481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:14.521910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:08:14.540378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Getting quotas for user 87071b7ce4994dabbf3234f2d60da8e8 and project 79e08cee89424fc3bcc56357db5fdb7f. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:08:14.558483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-188bccec-31fa-46f3-bc8b-cca9dfb5c422 req-15d4dcd7-26c7-4878-8ca1-a1594b0bd685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609fd767-a1e1-4348-bce9-97ad87b2aae6", "name": "network-vif-deleted", "tag": "c64f7552-bcde-488d-b0a6-c03c07352b31"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:14.599948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-188bccec-31fa-46f3-bc8b-cca9dfb5c422 req-15d4dcd7-26c7-4878-8ca1-a1594b0bd685 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:14.600406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-188bccec-31fa-46f3-bc8b-cca9dfb5c422 req-15d4dcd7-26c7-4878-8ca1-a1594b0bd685 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:14.623972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:08:14.638574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:08:14.652518 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-188bccec-31fa-46f3-bc8b-cca9dfb5c422 req-15d4dcd7-26c7-4878-8ca1-a1594b0bd685 service nova] Creating event network-vif-deleted:c64f7552-bcde-488d-b0a6-c03c07352b31 for instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 on n-h2-850003-3 Jul 18 13:08:14.682504 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-188bccec-31fa-46f3-bc8b-cca9dfb5c422 req-15d4dcd7-26c7-4878-8ca1-a1594b0bd685 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125914 Jul 18 13:08:14.689793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1513/2902] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:08:14.864274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6764dd4-5a2b-4d94-8e6f-59882f330e91 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553047 Jul 18 13:08:14.874962 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1390/2903] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:08:14.888044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c2049b4b-e704-43b1-afc2-de4fa88422cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:14.890503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c2049b4b-e704-43b1-afc2-de4fa88422cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:15.219431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c2049b4b-e704-43b1-afc2-de4fa88422cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:15.251569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c2049b4b-e704-43b1-afc2-de4fa88422cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1212 microversion: 2.1 time: 0.371024 Jul 18 13:08:15.262887 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1514/2904] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:14 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1212 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:15.447903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:15.448782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:15.490943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:15.491673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:15.499536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:15.500071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:15.730100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:15.753076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:15.756913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'fault' on Instance uuid 609fd767-a1e1-4348-bce9-97ad87b2aae6 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:08:16.018487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:16.033599 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c5683f0-8984-4eda-a31a-55f6eea38e1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 200 len: 1305 microversion: 2.1 time: 0.589705 Jul 18 13:08:16.035125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1391/2905] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:15 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 1305 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:16.289781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:16.291541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:16.327182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:16.328099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:16.329435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:16.332369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:16.774738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:16.809124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-099d3929-974a-491b-b155-6f8c00551251 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1216 microversion: 2.1 time: 0.523113 Jul 18 13:08:16.811490 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1515/2906] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:16 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1216 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:17.062742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:17.073684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:17.128084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:17.149992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:17.161295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:17.163154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:17.225520 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 HTTP/1.1 Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:08:17.231047 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:08:17.233257 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '609fd767-a1e1-4348-bce9-97ad87b2aae6'} Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:08:17.235062 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:08:17.240265 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:08:17.244231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:08:17.244231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a888ac76-8412-4cfa-bd49-a2a569e31231 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 404 len: 111 microversion: 2.1 time: 0.189541 Jul 18 13:08:17.244231 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1392/2907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:17 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:08:17.754835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-753866819", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:17.840562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:17.842878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:17.922874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:17.923576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:17.924455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:17.924918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:17.988706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:08:18.465954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:18.481746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2382a2ee-b7bd-45f6-b905-05c336773b29 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1272 microversion: 2.1 time: 0.650171 Jul 18 13:08:18.497676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1393/2908] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:17 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1272 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:18.809016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2003932986", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:18.982497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:08:23.174903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:08:23.176652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:08:23.177843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:08:23.179004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:08:23.181908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:08:23.222592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.227718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.230114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.231895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.266776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:08:23.277873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:08:23.302814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:08:23.309722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:08:23.577384 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a4b894f4-8df3-499e-8ee9-91f429d8fd30 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.831712 Jul 18 13:08:23.578502 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1516/2909] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:08:23.621766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:23.622829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:23.633842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:08:23.637680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:08:23.640675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:08:23.642446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:08:23.644645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:08:23.686638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.688031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.691958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.696557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.697366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.698183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.714941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:23.715848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:23.857151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:08:23.897093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:08:23.996156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:08:24.015949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:08:24.214635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:24.256909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dcfd32ec-747a-4164-9ca1-42bc93f1869a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1270 microversion: 2.1 time: 0.671545 Jul 18 13:08:24.260734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1517/2910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:23 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1270 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:24.299102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-796e3cfd-402c-470b-a17f-d65e334aee51 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:24.300368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-796e3cfd-402c-470b-a17f-d65e334aee51 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:24.381806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8889f4d9-3e89-4905-b177-ed98f852461c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.883127 Jul 18 13:08:24.401539 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1394/2911] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 5903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:08:24.420152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1fd48011-eb61-41ce-bd90-ee9224dead37 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:24.421266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1fd48011-eb61-41ce-bd90-ee9224dead37 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:25.018859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1fd48011-eb61-41ce-bd90-ee9224dead37 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:25.048866 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1fd48011-eb61-41ce-bd90-ee9224dead37 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1193 microversion: 2.1 time: 0.645037 Jul 18 13:08:25.052602 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1395/2912] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:24 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1193 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:25.295031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:25.297651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:25.360610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:25.361837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:25.364225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:25.366320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:25.997199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-796e3cfd-402c-470b-a17f-d65e334aee51 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:26.040216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-796e3cfd-402c-470b-a17f-d65e334aee51 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1214 microversion: 2.1 time: 1.776151 Jul 18 13:08:26.043135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1518/2913] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:24 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1214 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:26.081611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00d6ae99-5096-4b31-b3a6-c2512eb8e832 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:26.082785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00d6ae99-5096-4b31-b3a6-c2512eb8e832 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:26.421845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00d6ae99-5096-4b31-b3a6-c2512eb8e832 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:26.487185 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00d6ae99-5096-4b31-b3a6-c2512eb8e832 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1193 microversion: 2.1 time: 0.411602 Jul 18 13:08:26.515480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1519/2914] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:26 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1193 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:27.063289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:27.064250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:27.142067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:27.143477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:27.152914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:27.154067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:27.533817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:27.583743 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a407451-c1b7-4e32-905b-ac0578c707d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 2.295965 Jul 18 13:08:27.592673 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1396/2915] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:25 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:27.628041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:27.635514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:27.686656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:27.690083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:27.716210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:27.722292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:27.782301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:27.821593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b2732800-05e6-4dd9-995a-1608a14f8dea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1266 microversion: 2.1 time: 0.764007 Jul 18 13:08:27.833466 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1520/2916] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:27 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1266 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:28.175014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:28.227934 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-720eb1a2-44cb-41f8-99d7-b2f509250c34 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1245 microversion: 2.1 time: 0.630502 Jul 18 13:08:28.231821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1397/2917] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:27 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1245 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:28.646476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:28.649290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:28.726475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:28.726475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:28.751026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:28.752084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:28.848338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:28.862208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:28.920193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:28.923996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:28.930950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:28.933984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:29.662766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:29.684826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88b601d7-c239-484f-b5b5-2c6bdcc281b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1272 microversion: 2.1 time: 0.845001 Jul 18 13:08:29.687273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1398/2918] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:28 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1272 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:29.707332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:29.709878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:29.733158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:29.735055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:29.740684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:29.741602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:30.079484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:30.112037 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0541b7ba-8dd9-437d-9866-17a703ae7b04 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 1.496835 Jul 18 13:08:30.136253 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1521/2919] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:28 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:30.303068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:30.329540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dce9ab9c-9460-4584-bac3-11d955281bde tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1251 microversion: 2.1 time: 0.629528 Jul 18 13:08:30.338567 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1399/2920] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:29 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1251 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:30.719935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:30.723887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:30.755757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:30.778695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:30.784431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:30.786101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:30.786991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:30.819205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:30.821483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:30.837790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:30.838936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:30.841023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:30.842051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:31.863759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:31.870869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:31.899679 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71715154-6955-40fa-85b5-01b5f6fe49c0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.090312 Jul 18 13:08:31.902533 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b7de9943-88f6-42b9-ae69-35c1b2d424f8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 1.191625 Jul 18 13:08:31.903721 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1400/2921] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:30 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:31.926189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1522/2922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:30 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:31.954961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:31.956206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:31.960485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d0179118-b24d-4f71-9d23-1bb20b590739 req-77027405-5b0b-4492-959d-8e3cb86a367c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:32.013710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.015683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d0179118-b24d-4f71-9d23-1bb20b590739 req-77027405-5b0b-4492-959d-8e3cb86a367c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.016899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d0179118-b24d-4f71-9d23-1bb20b590739 req-77027405-5b0b-4492-959d-8e3cb86a367c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.018354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.021134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.022759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.062673 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d0179118-b24d-4f71-9d23-1bb20b590739 req-77027405-5b0b-4492-959d-8e3cb86a367c service nova] Creating event network-changed:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:08:32.105718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d0179118-b24d-4f71-9d23-1bb20b590739 req-77027405-5b0b-4492-959d-8e3cb86a367c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164179 Jul 18 13:08:32.107177 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1523/2923] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:32.125613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:32.127079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:32.149383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.152094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.154507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.155685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.395885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:32.412890 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15e96ac9-cbf9-477d-95ce-bd522b2ebb01 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1251 microversion: 2.1 time: 0.303092 Jul 18 13:08:32.415369 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1524/2924] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:32 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1251 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:32.936351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:32.937901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:32.958040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.959551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:32.962019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:32.963186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:33.245246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:33.352547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:33.383285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88e33dbd-c3f6-45c4-90e4-a817a150c32f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 1.474837 Jul 18 13:08:33.395230 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1401/2925] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:31 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:33.406130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:33.407323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:33.439693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:33.444996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:33.448230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:33.448230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:33.744737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:33.756297 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68dd2c3e-6472-40ab-a93a-4b952c49d285 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.825439 Jul 18 13:08:33.774224 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1525/2926] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:32 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:33.782662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:33.786865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:33.790310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:33.806757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:33.807264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:33.808633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:33.809277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:34.909627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:34.931588 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62555f21-9e6e-4f9b-8a74-d0822d6f0a28 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 1.534292 Jul 18 13:08:34.934194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1402/2927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:33 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:34.944810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1718299454"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:34.955312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:34.983635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:34.985741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:34.988142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:34.989262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:35.054946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:35.835357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:35.891096 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-85ee21b4-f29d-4ab8-808c-6a7084018be6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 2.108764 Jul 18 13:08:35.895681 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1526/2928] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:33 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:35.907814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:35.909616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:35.925437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:35.927037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:35.928972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:35.930988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:36.095239 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20e22bce-14ad-469e-ba85-b79384c924ed tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 1.158308 Jul 18 13:08:36.097652 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1403/2929] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:08:34 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 13:08:36.116657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-180b0372-ae29-40ed-9398-b0eec43afd55 req-33270ff8-0f74-4912-aea1-c1594c33c1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-unplugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:36.141053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-180b0372-ae29-40ed-9398-b0eec43afd55 req-33270ff8-0f74-4912-aea1-c1594c33c1e3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:36.142306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-180b0372-ae29-40ed-9398-b0eec43afd55 req-33270ff8-0f74-4912-aea1-c1594c33c1e3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:36.178245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-180b0372-ae29-40ed-9398-b0eec43afd55 req-33270ff8-0f74-4912-aea1-c1594c33c1e3 service nova] Creating event network-vif-unplugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:08:36.196029 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-180b0372-ae29-40ed-9398-b0eec43afd55 req-33270ff8-0f74-4912-aea1-c1594c33c1e3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094904 Jul 18 13:08:36.198872 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1404/2930] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:36.211188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:36.213905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:36.241313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:36.243665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:36.246585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:36.249595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:36.475308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:36.941353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:36.986389 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb86ef6e-e082-4544-9455-f9ef16ab0dc3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 1.086853 Jul 18 13:08:36.988530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1527/2931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:35 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:37.013818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3b4e92e7-d173-4609-b9fb-c2df60e64618 req-0ac36eb8-e16f-4127-98bd-d1f57c38925b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e940b5-37ea-4069-906b-3da8c53739cc", "tag": "5af9a826-94bc-46b2-a0a3-c8cfeb52c716"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:37.060149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3b4e92e7-d173-4609-b9fb-c2df60e64618 req-0ac36eb8-e16f-4127-98bd-d1f57c38925b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:37.064802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3b4e92e7-d173-4609-b9fb-c2df60e64618 req-0ac36eb8-e16f-4127-98bd-d1f57c38925b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:37.134966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3b4e92e7-d173-4609-b9fb-c2df60e64618 req-0ac36eb8-e16f-4127-98bd-d1f57c38925b service nova] Creating event network-changed:5af9a826-94bc-46b2-a0a3-c8cfeb52c716 for instance 13e940b5-37ea-4069-906b-3da8c53739cc on n-h1-850003-3 Jul 18 13:08:37.162924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3b4e92e7-d173-4609-b9fb-c2df60e64618 req-0ac36eb8-e16f-4127-98bd-d1f57c38925b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169181 Jul 18 13:08:37.169614 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1528/2932] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:37.180348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:37.183359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:37.201272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:37.202007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:37.203034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:37.203732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:37.428939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:37.465909 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e6711bc1-7d00-427a-94ff-290b7083aa85 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 1.261340 Jul 18 13:08:37.469713 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1405/2933] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:36 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:38.020925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:38.023142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:38.044113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:38.044940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:38.046956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:38.051853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:38.854025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:38.923734 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffe5fa1e-6cbe-43a4-9a83-932e9cb950b2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 0.909625 Jul 18 13:08:38.929088 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1406/2934] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:38 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:38.958459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e698ff1b-6d8e-43b9-9c28-d36232f45671 req-b7ac67b2-1535-4ed5-8a10-9a6b59afc7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf2bf7f-1966-4058-9947-e59f2a8548a7", "tag": "ee5263b1-437d-4d6d-8e95-2a285d027cfa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:38.984946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e698ff1b-6d8e-43b9-9c28-d36232f45671 req-b7ac67b2-1535-4ed5-8a10-9a6b59afc7ef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:38.986277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e698ff1b-6d8e-43b9-9c28-d36232f45671 req-b7ac67b2-1535-4ed5-8a10-9a6b59afc7ef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:39.033138 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e698ff1b-6d8e-43b9-9c28-d36232f45671 req-b7ac67b2-1535-4ed5-8a10-9a6b59afc7ef service nova] Creating event network-changed:ee5263b1-437d-4d6d-8e95-2a285d027cfa for instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 on n-h1-850003-3 Jul 18 13:08:39.033885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:39.049884 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e698ff1b-6d8e-43b9-9c28-d36232f45671 req-b7ac67b2-1535-4ed5-8a10-9a6b59afc7ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115463 Jul 18 13:08:39.054741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1407/2935] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:39.057210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=93 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:39.082755 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb284628-2224-4593-8209-a9a4a510626a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 1.910423 Jul 18 13:08:39.086491 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1529/2936] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:37 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:39.093001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:39.093748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:39.102230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:39.103049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:39.104742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:39.105853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:39.111081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:39.798358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:39.825245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-06ce5296-d0a9-46c5-98d7-9690d4f2e1ab tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 0.764487 Jul 18 13:08:39.851809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1408/2937] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:39 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:39.968790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:39.970573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:40.029609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.030540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:40.032204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.039485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:40.131568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:40.142466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:40.173966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.174828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:40.177387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.178667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:40.524315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:40.544670 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aaf2f781-e197-4c66-8655-57128b8e82ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 0.432311 Jul 18 13:08:40.547054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1409/2938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:40 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:40.874287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:40.875500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:40.886099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.887030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:40.888946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:40.889726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:41.355623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:41.409676 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d7f4a1d-56ad-48ab-b9bf-e9bda637c604 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 0.536999 Jul 18 13:08:41.412665 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1410/2939] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:40 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:41.588937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:41.603374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:41.629455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:41.630649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:41.632983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:41.634230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:42.025466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:42.051292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70aa2d60-6635-4587-9062-000ed9f30cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 2.091767 Jul 18 13:08:42.068286 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1530/2940] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:39 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:42.089044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:42.107689 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5dd72832-fd6b-4e1f-a9d9-79f6b927796a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 0.530106 Jul 18 13:08:42.109702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1411/2941] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:41 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:42.442607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:42.443906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:42.464014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:42.464864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:42.467061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:42.468448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:43.087819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:43.089759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:43.128997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:43.134943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:43.136606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:43.137282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:43.488797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:43.508996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-353c2338-a1a9-4e3d-ac31-43f29c6d165e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 0.428747 Jul 18 13:08:43.525078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1412/2942] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:43 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:43.530969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:43.531931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:43.541790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:43.543192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:43.546414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:43.547499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:44.004692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:44.049335 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a83e733a-46fa-416f-8520-89d24e0c5abe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 0.520296 Jul 18 13:08:44.056218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1413/2943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:43 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:44.090022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-606a4065-8055-4b61-9c39-12525c9f0be6 req-fa089fdc-2ef0-4e91-ac1c-966edc445ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-plugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:44.129130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-606a4065-8055-4b61-9c39-12525c9f0be6 req-fa089fdc-2ef0-4e91-ac1c-966edc445ebd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:44.129870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-606a4065-8055-4b61-9c39-12525c9f0be6 req-fa089fdc-2ef0-4e91-ac1c-966edc445ebd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:44.193296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-606a4065-8055-4b61-9c39-12525c9f0be6 req-fa089fdc-2ef0-4e91-ac1c-966edc445ebd service nova] Creating event network-vif-plugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:08:44.215526 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-606a4065-8055-4b61-9c39-12525c9f0be6 req-fa089fdc-2ef0-4e91-ac1c-966edc445ebd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134048 Jul 18 13:08:44.222378 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1414/2944] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:44.443650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:44.490860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fdd87874-c7a9-4d26-8c31-0d89635a7883 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 2.058609 Jul 18 13:08:44.500539 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1531/2945] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:42 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:44.540997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:44.553725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:44.580731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:44.595257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:44.597433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:44.600592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:44.602691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:45.085301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:45.091200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:45.126573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:45.127563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:45.130952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:45.132886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:45.193433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:45.217957 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ab1d7b6-e48a-4850-b17a-1381302f09e5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 0.688146 Jul 18 13:08:45.257072 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1415/2946] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:44 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:45.537558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:45.543134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:45.574609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:45.575446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:45.581750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:45.582796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.591787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:46.624738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:46.635225 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-801bc59c-cec5-42af-bc98-e9058f36a0f1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 1.106795 Jul 18 13:08:46.645797 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1416/2947] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:45 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:46.649783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d47a769-be2c-4d44-8bec-9ceb4ba44884 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 1.579839 Jul 18 13:08:46.656793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1532/2948] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:45 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:46.673546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:46.674503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9bd9a3f4-f18d-4034-8208-6478716d8125 req-ddad4a67-a882-40a7-af60-df1fc32ee521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-plugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:46.678365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:46.695506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9bd9a3f4-f18d-4034-8208-6478716d8125 req-ddad4a67-a882-40a7-af60-df1fc32ee521 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:46.696318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9bd9a3f4-f18d-4034-8208-6478716d8125 req-ddad4a67-a882-40a7-af60-df1fc32ee521 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.708042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:46.709803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.712392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:46.714750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.742868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9bd9a3f4-f18d-4034-8208-6478716d8125 req-ddad4a67-a882-40a7-af60-df1fc32ee521 service nova] Creating event network-vif-plugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:08:46.771427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9bd9a3f4-f18d-4034-8208-6478716d8125 req-ddad4a67-a882-40a7-af60-df1fc32ee521 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122846 Jul 18 13:08:46.789696 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1417/2949] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:46.821894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:46.837048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:46.844292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Searching by: {'deleted': False, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:08:46.869441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:46.870639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.876231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:46.879472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:46.973395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:08:47.171411 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6864110f-bbd3-4022-bc89-b8d580a2e2c1 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.378713 Jul 18 13:08:47.189877 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1418/2950] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:08:46 2022] GET /compute/v2.1/servers => generated 340 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:47.223633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:47.232544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:47.248132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Searching by: {'deleted': False, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:08:47.260033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:47.271550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:47.274112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:47.275937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:47.421113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:08:47.589497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:47.620082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:47.628383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:48.741456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8f0f141-47f0-4b93-97be-31ac7e37428d tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.539006 Jul 18 13:08:48.742654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1419/2951] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:08:47 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:08:48.770596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:48.772506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:48.795352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:48.824571 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b682d914-4c3d-48be-a4c1-8d0b1d36444a tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1312 microversion: 2.1 time: 2.165290 Jul 18 13:08:48.825442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:48.826341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:48.827897 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1533/2952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:46 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1312 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:48.838880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:48.838880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:48.883103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:48.889554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:48.935652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:48.937208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:48.943232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:48.949916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:49.333156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:49.349797 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98caaf58-c851-4a8e-a85b-8b1eb8cd1724 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 0.604998 Jul 18 13:08:49.352273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1420/2953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:48 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:49.365358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94d7a961-ba7a-43e9-a560-b693b70fbc4a tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:49.386338 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94d7a961-ba7a-43e9-a560-b693b70fbc4a tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031294 Jul 18 13:08:49.388741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1421/2954] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:08:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:49.487164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f059076e-f06b-400e-9ea7-4ec5bcc1b41c req-bf54be91-14e0-4a68-a8a9-bdb81e933a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf2bf7f-1966-4058-9947-e59f2a8548a7", "name": "network-vif-plugged", "status": "completed", "tag": "ee5263b1-437d-4d6d-8e95-2a285d027cfa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:49.522895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f059076e-f06b-400e-9ea7-4ec5bcc1b41c req-bf54be91-14e0-4a68-a8a9-bdb81e933a1e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:49.529221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f059076e-f06b-400e-9ea7-4ec5bcc1b41c req-bf54be91-14e0-4a68-a8a9-bdb81e933a1e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:49.575623 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f059076e-f06b-400e-9ea7-4ec5bcc1b41c req-bf54be91-14e0-4a68-a8a9-bdb81e933a1e service nova] Creating event network-vif-plugged:ee5263b1-437d-4d6d-8e95-2a285d027cfa for instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 on n-h1-850003-3 Jul 18 13:08:49.584553 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f059076e-f06b-400e-9ea7-4ec5bcc1b41c req-bf54be91-14e0-4a68-a8a9-bdb81e933a1e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103846 Jul 18 13:08:49.586450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1422/2955] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:49.863191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:49.872323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:49.901881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:49.902997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:49.904656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:49.905600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.036696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:08:50.299493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83da1f55-7a25-4e3e-84fe-fe63ba1b6395 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "DELETE /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 204 len: 0 microversion: 2.1 time: 0.444899 Jul 18 13:08:50.301052 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1423/2956] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:08:49 2022] DELETE /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:08:50.313224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:50.314842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:50.325122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.326307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.327591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.329278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.598605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:50.638560 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-965c7364-6f53-4794-9e5d-4900d1cb3410 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1293 microversion: 2.1 time: 1.785474 Jul 18 13:08:50.641722 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1534/2957] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:48 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1293 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:50.658034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:50.661979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:50.673169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.674112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.675261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.675997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.825358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:50.854208 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ba28e52-f752-4294-9c1f-18af843f8544 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1462 microversion: 2.1 time: 0.549597 Jul 18 13:08:50.868865 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1424/2958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:50 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1462 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:50.883716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:50.886777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:50.957031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.957982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:50.959801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:50.983137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:51.004281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:51.675905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:51.709585 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bdb6f40-3a9a-4528-b9fb-f9a6ae45b502 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 0.835834 Jul 18 13:08:51.711877 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1425/2959] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:50 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:52.030998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:52.062081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59b1bc6b-c6fa-4ccf-874e-5f44bf4693c6 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1714 microversion: 2.1 time: 1.410870 Jul 18 13:08:52.063577 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1535/2960] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:50 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1714 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:52.076940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:52.087091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:52.113248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.114617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.116948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.123305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.428749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:52.430641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:52.449122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.450067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.451744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.452718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.673352 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a2b7b992-a8c5-4008-9a98-91dfc6e8dd00 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1613 microversion: 2.1 time: 0.955970 Jul 18 13:08:52.685449 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1426/2961] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:51 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1613 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:52.690639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-414434cc-4d33-4572-bab2-5a84e665e5da req-c84141ea-d83b-4429-b178-736daccb57c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e940b5-37ea-4069-906b-3da8c53739cc", "name": "network-vif-plugged", "status": "completed", "tag": "5af9a826-94bc-46b2-a0a3-c8cfeb52c716"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:52.713785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-414434cc-4d33-4572-bab2-5a84e665e5da req-c84141ea-d83b-4429-b178-736daccb57c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.716328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-414434cc-4d33-4572-bab2-5a84e665e5da req-c84141ea-d83b-4429-b178-736daccb57c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.747081 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-414434cc-4d33-4572-bab2-5a84e665e5da req-c84141ea-d83b-4429-b178-736daccb57c3 service nova] Creating event network-vif-plugged:5af9a826-94bc-46b2-a0a3-c8cfeb52c716 for instance 13e940b5-37ea-4069-906b-3da8c53739cc on n-h1-850003-3 Jul 18 13:08:52.758809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-414434cc-4d33-4572-bab2-5a84e665e5da req-c84141ea-d83b-4429-b178-736daccb57c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071632 Jul 18 13:08:52.767548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1427/2962] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:08:52.776898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:52.778467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:52.796817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.797887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.801163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:52.801926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:52.887922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '79372472644947c4a87cc680d2997ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452f22ec646d4724bca1c9b9e8fe38c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:52.893987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] flavor_id is None. Assuming migration. {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 13:08:52.894972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:08:53.828905 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4bf38b0a-50d5-4a6d-bcda-3e78928b13b3 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1/action" status: 202 len: 0 microversion: 2.1 time: 1.058023 Jul 18 13:08:53.836458 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1428/2963] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:08:52 2022] POST /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1/action => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:08:53.857564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:53.859539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:53.899009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:53.901696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:53.907541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:53.909637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:53.976811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:53.990200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e81f2ba8-b650-4151-b0c9-3767ef079901 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1475 microversion: 2.1 time: 1.925169 Jul 18 13:08:54.000429 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1536/2964] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:52 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1475 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:54.005412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:54.006032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:54.035187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:54.036049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:54.037471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:54.038272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:54.812733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:54.864435 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09e3d175-6906-4e7c-9b45-e4f5aa76a08b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1714 microversion: 2.1 time: 0.862118 Jul 18 13:08:54.871530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1537/2965] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:54 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1714 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:54.897042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:54.906560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:54.963075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:54.981548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:54.982978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:54.983712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:55.386446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:55.404772 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-837424e4-be99-4b1a-936e-76cc9017db04 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1314 microversion: 2.1 time: 1.565317 Jul 18 13:08:55.418108 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1429/2966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:53 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1314 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:55.439451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-726311298", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:08:55.701936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:08:55.948805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:55.989879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1702615d-bd62-49c3-83ac-0f14b9074964 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 1.113781 Jul 18 13:08:55.991976 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1538/2967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:54 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:55.999026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:55.999908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:56.008117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:56.008840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:56.010259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:56.010878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:56.623748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:56.693427 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a4fbdcd8-899e-4380-82b5-0dbed7dfd16b tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1647 microversion: 2.1 time: 0.699634 Jul 18 13:08:56.703986 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1539/2968] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:55 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1647 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:56.757737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:56.765123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:56.816219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:56.821665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:56.823449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:56.824282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:57.347825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:57.574933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:08:57.628409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:57.642183 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e9c69f4-2424-49a0-ae73-02736dadb021 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1500 microversion: 2.1 time: 0.934899 Jul 18 13:08:57.647543 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1540/2969] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:56 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1500 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:57.685366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:57.688508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:57.729639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:57.732602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:57.740587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:57.757886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:58.809143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:58.911047 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ca042db-77f4-4e4f-864a-6c0143c3a3b8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 1.226487 Jul 18 13:08:58.914593 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1541/2970] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:57 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:58.941463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:58.956267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:59.005161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:59.014252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:59.024598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:59.036156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:59.866617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:08:59.899859 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a35cd528-bafe-4de8-a639-cc5f39b0d702 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1647 microversion: 2.1 time: 0.983252 Jul 18 13:08:59.927576 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1542/2971] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:58 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1647 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:08:59.941919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:08:59.943534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:08:59.974275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:59.975982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:08:59.979973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:08:59.987889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:00.796985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:00.845997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9084295-d19d-4235-83de-2aa496a23fb3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 0.917324 Jul 18 13:09:00.858787 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1543/2972] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:08:59 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:00.959607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:00.961391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:00.978945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=44 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:00.987769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:00.988583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:00.999589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:01.010279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:01.270349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:01.289270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52212693-4852-469f-9123-a1708eb86b75 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1647 microversion: 2.1 time: 0.340334 Jul 18 13:09:01.290629 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1544/2973] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:00 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1647 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:01.670912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:09:01.673626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:09:01.674736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:09:01.675362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:09:01.675975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:09:01.736259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:01.741440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:01.743011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:01.751968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:01.894654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:01.900289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:01.963216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:01.972585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:01.987691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:01.998377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:02.061906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:09:02.123634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:09:02.210943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:09:02.241829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:09:02.607355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b99544f4-2c7f-4302-aa34-07c29eab1b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.168149 Jul 18 13:09:02.613410 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1430/2974] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 7194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:09:02.671490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:02.676497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:02.711729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:02.712383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:02.721165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:02.721753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:02.912632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:02.943665 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1492edb-a277-4d7e-905a-939d6cae1946 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 1.053075 Jul 18 13:09:02.947443 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1545/2975] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:01 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:09:02.969737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:02.975658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0da1640e-6fb0-42af-8c0e-65e97dd4e25c req-7da07f13-774e-40d0-abb3-a8581061bfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94670aef-bd37-4a58-94a0-72df215cd4c2", "name": "network-vif-deleted", "tag": "eef70485-4df8-49a4-a9d6-fab142d0da32"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:02.976901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:02.977902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lazy-loading 'fault' on Instance uuid 94670aef-bd37-4a58-94a0-72df215cd4c2 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:09:03.012227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0da1640e-6fb0-42af-8c0e-65e97dd4e25c req-7da07f13-774e-40d0-abb3-a8581061bfa2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:03.015727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0da1640e-6fb0-42af-8c0e-65e97dd4e25c req-7da07f13-774e-40d0-abb3-a8581061bfa2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:03.114087 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0da1640e-6fb0-42af-8c0e-65e97dd4e25c req-7da07f13-774e-40d0-abb3-a8581061bfa2 service nova] Creating event network-vif-deleted:eef70485-4df8-49a4-a9d6-fab142d0da32 for instance 94670aef-bd37-4a58-94a0-72df215cd4c2 on n-h2-850003-3 Jul 18 13:09:03.184178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0da1640e-6fb0-42af-8c0e-65e97dd4e25c req-7da07f13-774e-40d0-abb3-a8581061bfa2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211063 Jul 18 13:09:03.185320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1546/2976] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:03.250769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:03.251370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:03.451939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:09:04.933489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.scheduler.client.report [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Deleted allocations for instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 Jul 18 13:09:04.962557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Instance Mapping does not exist while attempting local delete cleanup. Jul 18 13:09:04.964310 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b81cebc-488f-437c-8465-84578c4ae41d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8" status: 204 len: 0 microversion: 2.1 time: 1.762018 Jul 18 13:09:04.965347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1547/2977] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:09:03 2022] DELETE /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 => generated 0 bytes in 1771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:09:05.004067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61d49aa2-065f-4ae3-b7c6-6cb8e18f094e"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:05.007569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:05.054762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:05.059169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:05.070251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:05.073551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:05.159632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:05.175869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87a5208d191416395d977d5efb1c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875bdc8865da4f55a4d0deaf2e2fbfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:05.216223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e27ff85-936f-4929-95db-6a1f9cb1d17e tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 200 len: 1367 microversion: 2.1 time: 2.595174 Jul 18 13:09:05.238263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1431/2978] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:02 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 1367 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:05.275820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:05.278602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:05.300301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:05.323255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:05.324148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:05.330574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:06.116510 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52664743-cad5-4418-b8d7-e57d8611920a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125037 Jul 18 13:09:06.130920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1548/2979] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:09:04 2022] POST /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc/os-volume_attachments => generated 194 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:06.183391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:06.183673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:06.207679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 HTTP/1.1 Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:09:06.210048 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:09:06.212903 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0bd55f08-0e1a-4848-af85-e1371d5891c8'} Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:09:06.213855 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:09:06.215363 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.221320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:09:06.228324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0aa21e28-f3f5-43d7-950f-32c11fcfe8bd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8" status: 404 len: 111 microversion: 2.1 time: 0.090815 Jul 18 13:09:06.229683 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1549/2980] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:06 2022] GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:09:06.263140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:06.264091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] [instance: 94670aef-bd37-4a58-94a0-72df215cd4c2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:06.314461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:06.314918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:06.315940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:06.317967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:06.369383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] HTTP exception thrown: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Request method failure captured: Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 HTTP/1.1 Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VrrJJ_qzmc2NrDAjV1t3SkEQjS4isLgoscw6n1SY8PtMlMabAec98tmUamIs7Eq79ac450r0AGLbXtvDVAeGSkI1uH4oaBPCjZm8oymbf5zc3u6q7XRkG06Ujp1bbD6ckJAN2txLl5TmABHAfIUWUcLK7XlxW6BuP-PkwztnuM2Pto Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 875bdc8865da4f55a4d0deaf2e2fbfab Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestManualDisk-1916595498 Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:09:06.380296 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/875bdc8865da4f55a4d0deaf2e2fbfab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/875bdc8865da4f55a4d0deaf2e2fbfab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_875bdc8865da4f55a4d0deaf2e2fbfab", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/875bdc8865da4f55a4d0deaf2e2fbfab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestManualDisk-1916595498 Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 875bdc8865da4f55a4d0deaf2e2fbfab Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestManualDisk-1916595498 Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestManualDisk-1916595498-project Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: f87a5208d191416395d977d5efb1c8b2 Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestManualDisk-1916595498-project Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. Jul 18 13:09:06.383465 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '94670aef-bd37-4a58-94a0-72df215cd4c2'} Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:09:06.384959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. Jul 18 13:09:06.388927 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:09:06.403720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Returning 404 to user: Instance 94670aef-bd37-4a58-94a0-72df215cd4c2 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:09:06.403720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc524b14-cd89-435c-817b-96435aaddf94 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2" status: 404 len: 111 microversion: 2.1 time: 0.134473 Jul 18 13:09:06.403720 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1550/2981] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:06 2022] GET /compute/v2.1/servers/94670aef-bd37-4a58-94a0-72df215cd4c2 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:09:06.411735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ba2ddc1-b624-4129-b662-c155c5594663 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] Calling method '.version_select at 0x7f96e40d4dc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:06.517835 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ba2ddc1-b624-4129-b662-c155c5594663 tempest-ServersTestManualDisk-1916595498 tempest-ServersTestManualDisk-1916595498-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747094484" status: 202 len: 0 microversion: 2.1 time: 0.118289 Jul 18 13:09:06.525714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1551/2982] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747094484 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:09:06.864950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1087472547", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:07.114599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:09:07.260495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:07.289191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a77514de-da77-4825-bdfd-92b5928de5cb tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 2.040093 Jul 18 13:09:07.290456 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1432/2983] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:05 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:08.323158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:08.326299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:08.358371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:08.361484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:08.364563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:08.367928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:10.129763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:10.167759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c51a72f-9f2c-498a-987c-7bea0cea34a2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1471 microversion: 2.1 time: 1.850768 Jul 18 13:09:10.168779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1433/2984] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:08 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1471 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:11.203415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:11.213551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:11.297451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:11.298531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:11.313470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:11.316393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:11.956508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:12.143458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:13.837299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:13.860681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56bece3c-689d-43c8-a194-469e36000cb2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 2.667022 Jul 18 13:09:13.861819 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1434/2985] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:11 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:13.943221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:13.975495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:09:13.976229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:09:13.977767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:09:13.978894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:09:13.980174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:09:14.089395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:14.097423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:14.101379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:14.103526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:14.217126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:09:14.251984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:09:14.304010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:09:14.312114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:09:14.449312 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8fd996ab-d84e-40c0-ac12-00af27e8aaa0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.592001 Jul 18 13:09:14.464308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b695c133-68be-4256-967a-b5ed099e26fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:14.465184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b695c133-68be-4256-967a-b5ed099e26fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:14.469851 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1552/2986] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 7613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:09:14.912901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:14.919105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:14.993000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b695c133-68be-4256-967a-b5ed099e26fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:14.997382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:15.000844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:15.002569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:15.011352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:15.025248 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b695c133-68be-4256-967a-b5ed099e26fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1221 microversion: 2.1 time: 0.557211 Jul 18 13:09:15.025957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1435/2987] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:14 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1221 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:09:16.059410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:16.060621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:16.098379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:16.145407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:16.147299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:16.160256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:16.161629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:16.734570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:16.759941 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d70583bd-992e-4441-9ba9-617a5abef905 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 1.862276 Jul 18 13:09:16.762535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1553/2988] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:14 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:09:17.520421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:17.569684 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-badc59b8-6b72-49ea-82b0-508eeded48e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1225 microversion: 2.1 time: 1.514026 Jul 18 13:09:17.574433 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1436/2989] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:16 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1225 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:09:17.819669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:17.820793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:17.898717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:17.942014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:17.944425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:17.945426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:18.669161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:18.670048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:18.772121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:18.782071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:18.797665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:18.805193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:20.477150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:20.514377 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a5a7b57-8e5d-42f0-bc41-a83a52c01795 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 2.702338 Jul 18 13:09:20.534303 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1554/2990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:17 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:21.250598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:21.277401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:21.325771 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92219b8e-3408-4700-b15b-c40e01fe43ee tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1279 microversion: 2.1 time: 2.713382 Jul 18 13:09:21.328118 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1437/2991] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:18 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1279 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:21.547714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:21.551688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:21.575663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:21.583949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:21.593969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:21.595476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:22.356806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:22.367569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:22.469495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:22.469818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:22.483269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:22.484348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:23.145346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:23.185995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b135c8b-3861-4fcb-ad90-6e73e27ec057 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1279 microversion: 2.1 time: 0.842953 Jul 18 13:09:23.186760 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1438/2992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:22 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1279 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:24.166059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:24.214937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:24.220189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:24.256828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:24.259882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:24.267590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:24.271786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:24.279853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:24.388493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:24.417910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd6101ef-f5a1-4452-b6fc-6ee1f4f8e0f4 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 2.878049 Jul 18 13:09:24.431818 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1555/2993] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:21 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 2893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:25.020155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:25.493478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:25.497631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:25.547815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:25.548346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:25.549196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:25.549772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:26.909449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:26.934366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-194b3d35-4d9c-41a1-a082-e399ef6ee049 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 2.728162 Jul 18 13:09:26.960273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1439/2994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:24 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:26.989488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:26.993677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:27.015234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:27.027204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:27.028600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:27.030443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:28.024937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:28.104476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95a520b9-37b0-452f-b40c-37c39422cb5f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 2.625022 Jul 18 13:09:28.106634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1556/2995] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:25 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:09:28.187765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:28.189389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:28.218674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:28.224090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:28.225461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:28.230543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:28.232243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:28.251100 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c1ce663-da2d-465f-8437-163a64566a5d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.289237 Jul 18 13:09:28.251728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1440/2996] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:26 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:28.284093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1121146090"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:28.285747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:28.301345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:28.303987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:28.305760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:28.308551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:29.957246 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70a3297c-162d-447b-a089-e906e5186298 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 1.672820 Jul 18 13:09:29.971611 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1441/2997] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:09:28 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 18 13:09:29.985031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:29.987682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:30.002445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:30.003762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:30.006000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:30.008056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:30.227003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:30.249757 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72ac3877-c912-419a-88ee-47d2273fc877 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 2.133694 Jul 18 13:09:30.276135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1557/2998] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:28 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:30.322996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:30.325160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:30.359221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:30.360478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:30.362206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:30.363258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:30.818413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:30.849163 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d281ba6-331f-4cf5-82b9-672692c25aea tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.555061 Jul 18 13:09:30.850968 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1558/2999] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:30 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:30.959702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1c1952fb-357b-4150-88a8-162cd87fbd62 req-6dbe05a6-d5e1-4027-9e47-3abb32b3b0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-unplugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:30.992971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1c1952fb-357b-4150-88a8-162cd87fbd62 req-6dbe05a6-d5e1-4027-9e47-3abb32b3b0ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:30.995262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1c1952fb-357b-4150-88a8-162cd87fbd62 req-6dbe05a6-d5e1-4027-9e47-3abb32b3b0ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:31.027405 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1c1952fb-357b-4150-88a8-162cd87fbd62 req-6dbe05a6-d5e1-4027-9e47-3abb32b3b0ff service nova] Creating event network-vif-unplugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:09:31.039119 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1c1952fb-357b-4150-88a8-162cd87fbd62 req-6dbe05a6-d5e1-4027-9e47-3abb32b3b0ff service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087367 Jul 18 13:09:31.040531 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1559/3000] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:09:31.300455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:31.307143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:31.327978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:31.333054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:31.334250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:31.335718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:31.337611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:31.582437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:31.592869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9ff6d62-0e9f-4329-a065-0bdced5a1d1b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 1.618832 Jul 18 13:09:31.593488 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1442/3001] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:29 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:31.877567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:31.878792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:31.911396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:31.911396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:31.911396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:31.912011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:31.916105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:31.948027 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b306be4-1b91-4d53-9b2d-617e0c6ff6a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 0.655138 Jul 18 13:09:31.959528 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1560/3002] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:31 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:32.633815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ea4fa6d9-7afb-4b35-9e0a-baa601dc2e66 req-d4e0fdf1-794f-4693-b0ab-c6ce741f774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37a04c3-a79c-4b3a-b264-5d127a7f720f", "tag": "6e6f4338-158d-4bbe-b04f-a6ab86d0d20f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:32.680849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ea4fa6d9-7afb-4b35-9e0a-baa601dc2e66 req-d4e0fdf1-794f-4693-b0ab-c6ce741f774a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:32.685717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ea4fa6d9-7afb-4b35-9e0a-baa601dc2e66 req-d4e0fdf1-794f-4693-b0ab-c6ce741f774a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:32.788339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ea4fa6d9-7afb-4b35-9e0a-baa601dc2e66 req-d4e0fdf1-794f-4693-b0ab-c6ce741f774a service nova] Creating event network-changed:6e6f4338-158d-4bbe-b04f-a6ab86d0d20f for instance e37a04c3-a79c-4b3a-b264-5d127a7f720f on n-h2-850003-3 Jul 18 13:09:32.810637 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ea4fa6d9-7afb-4b35-9e0a-baa601dc2e66 req-d4e0fdf1-794f-4693-b0ab-c6ce741f774a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187683 Jul 18 13:09:32.815347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1561/3003] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:32.869793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:32.870925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:32.903926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:32.908724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:32.916368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:32.919800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:33.837174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:33.876578 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d240d74f-58d9-4cd3-b75f-263bfad81dc3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 2.006411 Jul 18 13:09:33.882086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1443/3004] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:31 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:33.908769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:33.910617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:33.940426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:33.941677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:33.943993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:33.950301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:34.135038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:34.166812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b56ece9-8a85-48ac-8076-e98bd1169f58 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1476 microversion: 2.1 time: 1.349406 Jul 18 13:09:34.167907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1562/3005] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:32 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1476 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:34.405671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:34.406382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:34.420684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:34.422095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:34.425661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:34.428533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:34.521507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:09:34.945812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0512a5e1-dd55-46a2-afba-ee43fd901960 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 204 len: 0 microversion: 2.1 time: 0.552539 Jul 18 13:09:34.947452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1563/3006] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:09:34 2022] DELETE /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:09:34.958050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:34.963759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:34.973350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:34.987681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:34.988340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:34.993488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:34.996765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:35.009927 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eed6dfc6-4d30-4ead-86c2-3613c09685ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 1.125394 Jul 18 13:09:35.018340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1444/3007] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:33 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:35.033590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:35.040660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:35.065768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:35.068747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:35.073712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:35.078643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:36.154599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:36.178481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38ce4a8c-0fb7-47ac-89ad-c0f534215311 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1552 microversion: 2.1 time: 1.148991 Jul 18 13:09:36.195189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1445/3008] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:35 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1552 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:36.216148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:36.218859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:36.251561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:36.252313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:36.257298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:36.258169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:37.332998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:37.356555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:37.372748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70f5d5fb-d6e3-4656-9391-1307511e3c1a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1684 microversion: 2.1 time: 2.422960 Jul 18 13:09:37.391323 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1564/3009] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:34 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1684 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:37.409613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:37.413371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:37.435311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:37.436595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:37.438526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:37.439644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:38.278895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:38.294882 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c48aa376-bae5-4edd-a3a8-b3c13c74ea0d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1475 microversion: 2.1 time: 2.097703 Jul 18 13:09:38.301345 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1446/3010] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:36 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1475 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:38.323540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:38.346686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:38.351993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:38.391774 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] Creating event network-vif-unplugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h1-850003-3 Jul 18 13:09:38.412422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:09:38.500337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ed51420a-a2b9-4084-987b-a5f75e654a79 req-52635b23-5905-4a0f-9a73-31e6359e76ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194760 Jul 18 13:09:38.501317 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1447/3011] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:38.529423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:38.539551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:38.589610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:38.598851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:38.605579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:38.606361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:38.771706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:38.819219 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b14ecc9-a722-4dac-a4a7-934a405198c5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 1.426161 Jul 18 13:09:38.822381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1565/3012] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:37 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:38.834523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:38.838879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:38.864000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:38.864957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:38.869567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:38.870272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:40.337591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:40.387276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f50a4c3-b192-401b-be14-cc1c6696cd04 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.561812 Jul 18 13:09:40.391650 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1566/3013] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:38 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:40.423025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:40.426249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:40.455453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:40.456246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:40.463019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:40.464270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:41.168817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:41.259804 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-86c567fb-8a8e-4487-a386-187f0f795f6b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1552 microversion: 2.1 time: 2.738832 Jul 18 13:09:41.288695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1448/3014] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:38 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1552 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:41.322766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:41.323898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:41.432973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:41.433765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.063s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:41.470192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:41.470703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:41.946984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:41.963161 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7503afaa-dc9b-491c-990b-f1a91c77592e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1475 microversion: 2.1 time: 1.568325 Jul 18 13:09:41.979736 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1567/3015] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:40 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1475 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:41.998389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:42.057949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:42.058963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:42.133869 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] Creating event network-changed:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h1-850003-3 Jul 18 13:09:42.146628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:09:42.226813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:42.252559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-817d13ab-58df-4a12-a32c-7f9308c5f42b req-59a82dbd-65dc-47d3-86ca-35b52f878779 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270602 Jul 18 13:09:42.253556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1568/3016] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:42.263238 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0dce49c9-18c0-444f-812c-b4055c431927 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 0.964710 Jul 18 13:09:42.284077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1449/3017] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:41 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:42.304765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:42.305965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:42.325911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:42.329628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:42.355575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:42.359372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:42.366337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:42.367132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:42.369391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:42.374481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:42.391229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:42.393577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:43.354187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:43.389795 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fce00a10-42ba-4d99-84bc-e5d7fd512b14 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1510 microversion: 2.1 time: 1.100529 Jul 18 13:09:43.406267 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1450/3018] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:42 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1510 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:43.412266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:43.412955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:43.460224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:43.460687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:43.461592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:43.462037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:44.017208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:44.043682 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a306daf-6f48-4e23-aa76-c030fc42d623 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.775361 Jul 18 13:09:44.044293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1569/3019] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:42 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:44.087498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-13b8a38e-bd7a-4126-b34b-aa6e8db48b67 req-199c09bf-c792-4ed2-abab-6f3a79164917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-plugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:44.115940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-13b8a38e-bd7a-4126-b34b-aa6e8db48b67 req-199c09bf-c792-4ed2-abab-6f3a79164917 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:44.139698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-13b8a38e-bd7a-4126-b34b-aa6e8db48b67 req-199c09bf-c792-4ed2-abab-6f3a79164917 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:44.187211 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-13b8a38e-bd7a-4126-b34b-aa6e8db48b67 req-199c09bf-c792-4ed2-abab-6f3a79164917 service nova] Creating event network-vif-plugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:09:44.202750 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-13b8a38e-bd7a-4126-b34b-aa6e8db48b67 req-199c09bf-c792-4ed2-abab-6f3a79164917 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152926 Jul 18 13:09:44.203907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1570/3020] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:44.209641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0cabccf7-281a-4756-8f8b-f4c7f566542f req-0ac07e37-9774-4efa-b559-1a34a26b0945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e940b5-37ea-4069-906b-3da8c53739cc", "name": "network-vif-deleted", "tag": "5af9a826-94bc-46b2-a0a3-c8cfeb52c716"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:44.241673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0cabccf7-281a-4756-8f8b-f4c7f566542f req-0ac07e37-9774-4efa-b559-1a34a26b0945 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:44.241673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0cabccf7-281a-4756-8f8b-f4c7f566542f req-0ac07e37-9774-4efa-b559-1a34a26b0945 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:44.268688 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0cabccf7-281a-4756-8f8b-f4c7f566542f req-0ac07e37-9774-4efa-b559-1a34a26b0945 service nova] Creating event network-vif-deleted:5af9a826-94bc-46b2-a0a3-c8cfeb52c716 for instance 13e940b5-37ea-4069-906b-3da8c53739cc on n-h1-850003-3 Jul 18 13:09:44.275983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0cabccf7-281a-4756-8f8b-f4c7f566542f req-0ac07e37-9774-4efa-b559-1a34a26b0945 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070480 Jul 18 13:09:44.283318 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1571/3021] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:44.292392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:44.297031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:44.316428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:44.317034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:44.318035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:44.318909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:44.838546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:44.881678 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b8b7ffb-8607-4d41-98cd-63b5dcbaf666 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1475 microversion: 2.1 time: 1.473760 Jul 18 13:09:44.898197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1451/3022] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:43 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1475 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:44.939490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:44.951179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:45.029577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:45.033303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:45.039947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:45.075116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:45.231625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:45.283183 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-723eecf2-9c9f-4a66-82b5-5efb37bc5680 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 0.997908 Jul 18 13:09:45.291055 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1572/3023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:44 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:45.329388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:45.354712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:45.391268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:45.392100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:45.393524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:45.433318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:45.680936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:45.730984 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22a511a0-88f7-42b8-99af-a37c6a12e284 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 0.840513 Jul 18 13:09:45.745070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1452/3024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:44 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:45.922803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:45.923933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:45.987239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:45.998866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:46.004982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:46.013662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:46.133630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:46.607039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:46.653473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba8d78e2-e2d4-46df-8624-d4aa60d2ac1c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.338330 Jul 18 13:09:46.673892 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1573/3025] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:45 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:46.700320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:46.701896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:46.725462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:46.726285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:46.727779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:46.728548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:47.783776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:47.825723 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-803c29f7-4b30-4f0a-987f-26fc773b8764 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1473 microversion: 2.1 time: 1.911513 Jul 18 13:09:47.841237 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1453/3026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:45 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1473 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:47.905813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:47.909252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:47.932891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:09:47.940159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:47.959669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:47.963780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:47.973160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:48.679248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:48.719484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e42f7e1a-509a-49fd-9fed-4a5603981780 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 0.874777 Jul 18 13:09:48.755629 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1454/3027] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:47 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:48.788586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:48.790997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:48.848015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:48.849468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:48.859748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:48.861005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:50.568934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:50.600012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca2b8d91-81c0-4d19-be85-aad757008226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.842759 Jul 18 13:09:50.618685 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1455/3028] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:48 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:50.640530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:50.646940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:50.674666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:50.681789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:50.692212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:50.693161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:51.257055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:51.274750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-31021e61-a056-4392-9d32-ce31a966abe9 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1470 microversion: 2.1 time: 0.658367 Jul 18 13:09:51.281793 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1456/3029] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:50 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1470 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:51.307652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-96f2e48c-bed6-4417-a12c-d6fcadc43320 req-8f2c1eca-5bcb-4802-91f1-c9ec5c66fc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a04c3-a79c-4b3a-b264-5d127a7f720f", "name": "network-vif-plugged", "status": "completed", "tag": "6e6f4338-158d-4bbe-b04f-a6ab86d0d20f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:51.337601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-96f2e48c-bed6-4417-a12c-d6fcadc43320 req-8f2c1eca-5bcb-4802-91f1-c9ec5c66fc91 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:51.350861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-96f2e48c-bed6-4417-a12c-d6fcadc43320 req-8f2c1eca-5bcb-4802-91f1-c9ec5c66fc91 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:51.404097 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-96f2e48c-bed6-4417-a12c-d6fcadc43320 req-8f2c1eca-5bcb-4802-91f1-c9ec5c66fc91 service nova] Creating event network-vif-plugged:6e6f4338-158d-4bbe-b04f-a6ab86d0d20f for instance e37a04c3-a79c-4b3a-b264-5d127a7f720f on n-h2-850003-3 Jul 18 13:09:51.442448 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-96f2e48c-bed6-4417-a12c-d6fcadc43320 req-8f2c1eca-5bcb-4802-91f1-c9ec5c66fc91 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157365 Jul 18 13:09:51.444702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1457/3030] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:09:51.462614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:51.471756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:51.498986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:51.502062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:51.507399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:51.514794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:51.926647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:51.969942 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e2187d3-ffe7-4a18-bd50-4d9912a637c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 5.293605 Jul 18 13:09:51.975192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1574/3031] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:46 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 5300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:52.014417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:09:52.015650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:52.059999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.061000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:52.070992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.071944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:52.441560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:52.486850 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-189ff61e-6116-4ece-8bb2-651085ce8363 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 1.039670 Jul 18 13:09:52.520674 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1458/3032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:51 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:52.548022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:52.549831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:52.564052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.565272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:52.568100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.569591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:52.793906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0df1be94-ecd7-4b0d-aa70-a2914723686b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "POST /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.816410 Jul 18 13:09:52.795982 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1575/3033] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:09:51 2022] POST /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:09:52.816618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:52.819456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:52.832511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.834862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:52.836827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:52.838010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:53.996127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:54.038093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3546072e-0e16-477a-8c5e-ea8a1f403df1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.490747 Jul 18 13:09:54.052216 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1459/3034] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:52 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:54.052216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:54.052216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:54.107260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:54.117094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:54.123945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:54.127120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:54.522765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:54.584126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5a8e43c-327c-4d39-9a5c-8b693516b49f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 1.780671 Jul 18 13:09:54.592062 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1576/3035] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:52 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:54.609849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:54.611076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:54.682263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:54.682672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:54.688098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:54.701025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:56.040449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:56.113021 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15dea923-5c92-4a33-8a59-32a12c898750 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 1.514812 Jul 18 13:09:56.138240 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1577/3036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:54 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:56.171232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:56.175158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:56.227185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:56.229629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:56.229908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:56.230704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:56.595117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:56.648950 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3967ec7b-10b0-4a27-9056-8c5c440e6cce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1321 microversion: 2.1 time: 2.606936 Jul 18 13:09:56.649969 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1460/3037] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:54 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1321 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:56.690615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:56.693006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:56.736559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:56.737694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:56.739531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:56.743233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:57.608072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:57.669132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28b314b9-50c0-42b7-8c01-134b6527ca2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.542249 Jul 18 13:09:57.722755 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1578/3038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:56 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:57.784201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:57.785700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:57.893063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:57.894812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:57.897204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:57.901350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:58.203676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:58.275622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-03f97400-4e5b-4f22-9210-70c65bbf43d3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 1.618301 Jul 18 13:09:58.285069 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1461/3039] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:56 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:58.319152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:58.320306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:58.480652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:58.511699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:58.513240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:58.514051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:59.691493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:09:59.728769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe42c705-a262-4117-adc3-973b8f7bd2aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1503 microversion: 2.1 time: 1.423928 Jul 18 13:09:59.733465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1462/3040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:58 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1503 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:09:59.755864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:09:59.764504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:09:59.792186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:59.795175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:59.801505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:09:59.805618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:09:59.968194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:00.047606 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c483e8e-081e-4825-83a9-c4c5ea5c6ba1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 2.322278 Jul 18 13:10:00.061167 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1579/3041] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:57 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:00.099411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:00.103611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:00.139094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:00.139642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:00.140497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:00.140945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:00.907322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:00.969040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9cb95569-4d2c-475d-9803-fafbe9ecfe92 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.232492 Jul 18 13:10:00.981179 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1463/3042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:09:59 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:01.016454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:01.018130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:01.061175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:01.062654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:01.064756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:01.072735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:01.371795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:01.393723 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fcaee3f7-1893-4abd-b463-62efdf6d9e2c tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 1.325016 Jul 18 13:10:01.407807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1580/3043] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:00 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:01.414619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-plugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:01.433586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:01.439315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:01.496646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:01.502391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] Creating event network-vif-plugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h1-850003-3 Jul 18 13:10:01.552014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:10:01.585195 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1142e2fb-719a-4232-b457-6efbee44407c req-31772121-3355-4f55-b9b6-3f7eb7092000 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175522 Jul 18 13:10:01.603575 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1581/3044] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:01.640441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:01.644223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:01.673587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:01.678446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:01.679770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:01.681483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:01.682297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:01.962205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:02.004903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5f834ae-2a15-4512-b96b-d743733e6ab0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1345 microversion: 2.1 time: 0.398209 Jul 18 13:10:02.006217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1582/3045] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:01 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1345 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:02.033831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:02.043508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:02.091703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:02.096782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:02.098639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:02.106736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:02.508633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:02.519598 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b44f8919-b9a1-40ef-9fcb-940e829ebddf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 0.507242 Jul 18 13:10:02.533905 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1583/3046] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:02 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:02.540043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:02.541186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:02.551927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:02.555098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:02.556789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:02.570210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.028047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:03.070318 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f61b66f-4a9e-42d6-8c78-54f73eb72ee2 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 0.534055 Jul 18 13:10:03.074722 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1584/3047] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:02 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:03.098430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:03.103331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:03.132295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.135887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.141424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.143185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.338674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.339701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.345543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'fault' on Instance uuid 13e940b5-37ea-4069-906b-3da8c53739cc {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:10:03.399408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:03.469731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12985fb8-38f0-471c-b38c-6dc5570aaeb7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1503 microversion: 2.1 time: 2.480954 Jul 18 13:10:03.472841 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1464/3048] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:00 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1503 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:03.506345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:03.509527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:03.528468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.532101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.535169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.537669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.561620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:03.578877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:10:03.608581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f818f4b-fad0-439a-b0b8-012b8ad2aa40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 200 len: 1350 microversion: 2.1 time: 0.534059 Jul 18 13:10:03.626748 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1585/3049] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:03 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 1350 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:03.666702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:03.668336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:03.709920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.723736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.725703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.728322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.806532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ebd5808-91e3-4d9f-b7a8-532dd06c11ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 204 len: 0 microversion: 2.1 time: 0.304843 Jul 18 13:10:03.812785 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1465/3050] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:10:03 2022] DELETE /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:10:03.847763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:03.852064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:03.884867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.887132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:03.912000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:03.913880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:04.383170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:04.384970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:04.398344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-907d05cc-b4cc-4ec0-8fce-0a49b8ccbed4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1509 microversion: 2.1 time: 0.579617 Jul 18 13:10:04.404717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1466/3051] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:03 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:04.413986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1197f6b1-0484-4566-9669-354b12782d47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 0.779083 Jul 18 13:10:04.415996 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1586/3052] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:03 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:04.436028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:04.436882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:04.459489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:04.459489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:04.459489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:04.459489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:04.667324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:04.687775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:04.716500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:04.716500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:04.716500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:04.717045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:04.796138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc HTTP/1.1 Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:04.799982 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:04.802706 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '13e940b5-37ea-4069-906b-3da8c53739cc'} Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:04.804145 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:04.806743 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:04.811139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:04.813130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21d08c93-7173-4bdd-b682-a58f601742f4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 404 len: 111 microversion: 2.1 time: 0.153635 Jul 18 13:10:04.825343 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1587/3053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:04 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:10:04.965305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:04.992017 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00f269ab-cd5a-4e56-afb2-91e62e8320b6 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 0.582280 Jul 18 13:10:05.001399 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1467/3054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:04 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:05.174691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:05.191353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:05.233820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.234522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:05.236052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.236885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:05.289736 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc/os-volume_attachments HTTP/1.1 Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:05.292694 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:05.295223 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '13e940b5-37ea-4069-906b-3da8c53739cc'} Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:05.296542 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:10:05.300292 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:05.304957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:05.304957 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9d74e95-0fe6-4ac1-8f1e-e40e427bcaa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.129406 Jul 18 13:10:05.304957 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1588/3055] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:10:05 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc/os-volume_attachments => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:10:05.445131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:05.451527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:05.452539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:05.461021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:05.486847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.497605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.499047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:05.500912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.505443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:05.505962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:05.508006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:05.527461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:06.319371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:06.349756 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28e622ed-bc88-421b-adbd-796716ad1e6b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1509 microversion: 2.1 time: 0.910999 Jul 18 13:10:06.356688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1589/3056] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:05 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1509 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:06.377070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1413702594", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:06.529843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:06.560567 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8da8bec-30a3-4b88-bca2-b66c1649ec7f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.123626 Jul 18 13:10:06.573073 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1468/3057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:05 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:06.588562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:06.589945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:06.610842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:06.611611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:06.613012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:06.619571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:06.636917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:08.923687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:08.940450 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81c32cd2-a7ec-45b5-9b55-46bbb5701bfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 2.375530 Jul 18 13:10:08.958674 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1469/3058] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:06 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:08.964346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:08.970971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:08.992752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:08.994530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:08.996398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:09.014085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:09.485264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:09.498731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b035d696-901c-4601-ba9f-58682b50d306 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 200 len: 1467 microversion: 2.1 time: 0.538494 Jul 18 13:10:09.504654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1470/3059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:08 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 1467 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:09.510702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:09.518386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:09.555163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:09.560781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:09.567890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:09.571945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:10.246530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:10:11.005116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:11.020804 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e73631a-8df9-43cb-8829-82f5e61c1c58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1679 microversion: 2.1 time: 1.514460 Jul 18 13:10:11.032472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1471/3060] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:09 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1679 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:11.525585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0bffdc32-64e0-41dc-8a47-5a0b86363a1c req-f5ca2a89-7552-4f25-917b-856e93be0e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a04c3-a79c-4b3a-b264-5d127a7f720f", "name": "network-vif-deleted", "tag": "6e6f4338-158d-4bbe-b04f-a6ab86d0d20f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:11.549699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0bffdc32-64e0-41dc-8a47-5a0b86363a1c req-f5ca2a89-7552-4f25-917b-856e93be0e0d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:11.555405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0bffdc32-64e0-41dc-8a47-5a0b86363a1c req-f5ca2a89-7552-4f25-917b-856e93be0e0d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:11.595679 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0bffdc32-64e0-41dc-8a47-5a0b86363a1c req-f5ca2a89-7552-4f25-917b-856e93be0e0d service nova] Creating event network-vif-deleted:6e6f4338-158d-4bbe-b04f-a6ab86d0d20f for instance e37a04c3-a79c-4b3a-b264-5d127a7f720f on n-h2-850003-3 Jul 18 13:10:11.608292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0bffdc32-64e0-41dc-8a47-5a0b86363a1c req-f5ca2a89-7552-4f25-917b-856e93be0e0d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573876 Jul 18 13:10:11.608845 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1472/3061] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:11.617448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:11.619067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:11.649573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:11.650550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:11.659953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:11.661389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:12.495320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:12.514985 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c93c19e4-4576-4eac-9458-9019c784399d tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 0.904735 Jul 18 13:10:12.525690 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1473/3062] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:11 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:12.838531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:10:12.839358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:10:12.839765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:10:12.840396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:10:12.840972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:10:12.871663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:12.873431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:12.878643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:12.879521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:12.932043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:12.961008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:12.985398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:10:12.990482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:10:13.028940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc02cea4-6b3e-4893-aaec-17d83ef8005d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Action: 'create', calling method: .version_select at 0x7f96d7a4dd30>, body: {"keypair": {"name": "tempest-keypair-1762915781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhXV9suVc7jFlZkw0cc1569UPX7CmDM3CL60l8OEztE8VkPba2NRydOiT81ikUl91AezxFcU5SPY7hNuT/mbL3xL9IsuC3tMicPUaBgg3gfvi+St4AsJGWDO2ao1XjPVA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:13.083362 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0d6aaf3-e175-4fe0-a29a-068d17e4e054 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.723463 Jul 18 13:10:13.092120 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1590/3063] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 6735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:10:13.098442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:13.099465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:13.101501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bc02cea4-6b3e-4893-aaec-17d83ef8005d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Getting quotas for project 89651644ce0c4de1b9f1c1e7c6bdd030. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:13.111451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.112409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:13.114181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.115039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:13.123508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bc02cea4-6b3e-4893-aaec-17d83ef8005d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Getting quotas for user 6d0fc95c467b49b9b18423663272bec9 and project 89651644ce0c4de1b9f1c1e7c6bdd030. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:13.139497 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f HTTP/1.1 Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:13.141894 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:10:13.143651 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e37a04c3-a79c-4b3a-b264-5d127a7f720f'} Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:13.145745 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:10:13.147900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:13.151526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:13.152815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0d9d1b9-870b-4995-bcc1-4b871b34efa2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 404 len: 111 microversion: 2.1 time: 0.059268 Jul 18 13:10:13.153567 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1591/3064] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:13 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:10:13.173741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:13.175141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:13.190505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.191133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:13.192244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.192690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:13.248302 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc02cea4-6b3e-4893-aaec-17d83ef8005d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.720001 Jul 18 13:10:13.249625 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1474/3065] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:10:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:13.262863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30c1f2a4-afe4-4a0c-9514-29ddee3b61e3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:13.263848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30c1f2a4-afe4-4a0c-9514-29ddee3b61e3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:13.483999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30c1f2a4-afe4-4a0c-9514-29ddee3b61e3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:13.496090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30c1f2a4-afe4-4a0c-9514-29ddee3b61e3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360" status: 200 len: 1215 microversion: 2.1 time: 0.242060 Jul 18 13:10:13.499324 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1475/3066] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:13 2022] GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:13.505248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-921d003a-6970-4fd8-a4d3-7aa9239dd4a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: .version_select at 0x7f96d7af89d0>, body: {"keypair": {"name": "tempest-key-278065705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwrOHYel1OdnuA6K7pEUjqjCF1P9jDl6OxNZG3rQnt6hFLHP0ASLdGQrh4B1fsYuOoiEssQj2UTqWOyR1nXOMGyJrUkfu5eDiHN5LaYaC5qiMq9IgDKOgY9reeztqmvWg=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:13.579243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-921d003a-6970-4fd8-a4d3-7aa9239dd4a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:13.611302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-921d003a-6970-4fd8-a4d3-7aa9239dd4a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:13.672525 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-921d003a-6970-4fd8-a4d3-7aa9239dd4a2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.171605 Jul 18 13:10:13.673160 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1476/3067] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:10:13 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:13.682712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:13.683230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:13.718063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:10:13.852072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:13.861246 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf759cdb-c4e1-4a50-9bec-1915afe8fced tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.696557 Jul 18 13:10:13.878388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1592/3068] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:13.890214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:13.891598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:13.917746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.918304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:13.921320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:13.921892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:14.445197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:14.457810 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a59c9b32-3011-43ef-83ae-1a6216d65cc0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1469 microversion: 2.1 time: 0.577555 Jul 18 13:10:14.458472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1593/3069] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:13 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1469 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:14.481240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba46fee2-9d8a-4bad-bb13-eac285b9e5d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '.version_select at 0x7f96e99be0d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:14.484308 n-d-850003-3 devstack@n-api.service[131366]: WARNING oslo_db.sqlalchemy.utils [None req-ba46fee2-9d8a-4bad-bb13-eac285b9e5d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 13:10:14.489382 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.scheduler.client.report [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Deleted allocations for instance 140b8010-cc11-41c8-bfda-cc62dd83f360 Jul 18 13:10:14.498759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Instance Mapping does not exist while attempting local delete cleanup. Jul 18 13:10:14.499368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba46fee2-9d8a-4bad-bb13-eac285b9e5d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.033260 Jul 18 13:10:14.503589 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1594/3070] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:10:14 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:14.510117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}, {"name": "network-changed", "server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:14.520042 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9f75255-6c15-4be9-b748-14e4c463b9be tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360" status: 204 len: 0 microversion: 2.1 time: 0.843421 Jul 18 13:10:14.523070 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1477/3071] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:10:13 2022] DELETE /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:10:14.544578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:14.545587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:14.559248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:14.560006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:14.571892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:14.572433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:14.582563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:14.601053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Creating event network-vif-unplugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:10:14.604107 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Creating event network-changed:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:10:14.604471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:14.624838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:10:14.682689 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ab1b71b7-909b-4ee6-a0a5-4d38331269ce req-c4e737d7-1ca4-471d-ae58-722a30068a23 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.175669 Jul 18 13:10:14.684092 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1595/3072] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:14.699679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:14.708681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:14.721028 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 HTTP/1.1 Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:14.724434 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:10:14.726567 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '140b8010-cc11-41c8-bfda-cc62dd83f360'} Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:14.727931 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:10:14.730409 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:14.733829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:14.735030 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-417542bc-cbe7-4b0a-b771-f75a1b77abb3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360" status: 404 len: 111 microversion: 2.1 time: 0.046190 Jul 18 13:10:14.736134 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1596/3073] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:14 2022] GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:10:14.853502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1216013300", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:15.031914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:10:15.827377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:15.860224 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22764a65-9bf3-496e-becb-1f277ab132cf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.333142 Jul 18 13:10:15.865947 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1478/3074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:14 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:15.887076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2025072255", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-key-278065705", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:18.217305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:10:18.218190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:10:18.219247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:10:18.220138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:10:18.220837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:10:18.282083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:18.286221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:18.293830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:18.295492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:18.408260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:18.429632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:18.542591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:10:18.553397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:10:18.717038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2655bc79-e2e3-488c-919f-0c342c7c33f2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.868095 Jul 18 13:10:18.720205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1597/3075] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:10:18.732768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:18.733765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:18.765249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:18.767425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:18.770058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:18.770921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:19.528515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:10:20.213041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:20.232217 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a27772a-4e91-4fc8-b3db-164516fdda8f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1462 microversion: 2.1 time: 1.510022 Jul 18 13:10:20.235640 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1598/3076] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:18 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1462 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:20.245441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7c9cbbb7-185d-41b4-875b-1894569a3cab req-a25d251c-401c-4f3f-9699-43bb1366c3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-unplugged", "status": "completed", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:20.324142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7c9cbbb7-185d-41b4-875b-1894569a3cab req-a25d251c-401c-4f3f-9699-43bb1366c3c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:20.325131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7c9cbbb7-185d-41b4-875b-1894569a3cab req-a25d251c-401c-4f3f-9699-43bb1366c3c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:20.356539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7c9cbbb7-185d-41b4-875b-1894569a3cab req-a25d251c-401c-4f3f-9699-43bb1366c3c6 service nova] Creating event network-vif-unplugged:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:10:20.395537 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7c9cbbb7-185d-41b4-875b-1894569a3cab req-a25d251c-401c-4f3f-9699-43bb1366c3c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153227 Jul 18 13:10:20.398541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1599/3077] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:20.413648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:20.417972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:20.442999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:20.456402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:20.458317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:20.461586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:20.873831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:21.264182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:21.289626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8992a679-903c-4d22-8f68-95daa3dcc90b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1219 microversion: 2.1 time: 0.885724 Jul 18 13:10:21.291052 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1600/3078] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:20 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1219 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:21.299038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:21.303663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:21.322419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:21.323233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:21.324529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:21.325212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.057543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:10:22.058271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:10:22.058658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:10:22.059110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:10:22.059528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:10:22.119176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.129144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.133871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.140131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.221411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:22.232777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:22.284761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:10:22.292405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:10:22.352358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:22.379488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fabbdbd5-6fb3-44b1-94cc-f15da82aab34 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.080976 Jul 18 13:10:22.402614 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1601/3079] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:21 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:22.413750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68fcb247-f1a8-4b27-8048-3a0603ec4baa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.545675 Jul 18 13:10:22.422059 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1479/3080] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 6555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:10:22.433430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:22.434056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:22.440679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:22.445952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:22.452488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.455202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.456607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.460530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.479519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.480947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.486633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.487640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.854435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:22.866725 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3a8d5f1-f380-48d8-a377-121868349557 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1273 microversion: 2.1 time: 0.443408 Jul 18 13:10:22.878388 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1480/3081] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:22 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1273 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:22.886490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:22.887106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:22.915818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.916423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:22.919580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:22.920169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:23.198684 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c552c06-0a67-4c16-884a-f5541cb5edd2 tempest-MigrationsAdminTest-12801773 tempest-MigrationsAdminTest-12801773-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1613 microversion: 2.1 time: 0.785447 Jul 18 13:10:23.201588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1602/3082] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:22 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1613 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:23.228510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e3ed038-f605-46a6-a62f-aae3487bef31 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:23.233018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e3ed038-f605-46a6-a62f-aae3487bef31 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:23.755855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e3ed038-f605-46a6-a62f-aae3487bef31 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:23.788343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e3ed038-f605-46a6-a62f-aae3487bef31 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1228 microversion: 2.1 time: 0.570818 Jul 18 13:10:23.798396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1603/3083] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:23 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1228 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:23.811613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:23.812649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:23.836605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:23.837653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:23.842230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:23.847631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:23.919711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:10:23.967806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:24.183756 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-566c2ef1-12ae-4838-856e-09b5f92bfc53 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "DELETE /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 204 len: 0 microversion: 2.1 time: 0.375588 Jul 18 13:10:24.189467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1604/3084] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:10:23 2022] DELETE /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:10:24.216970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1959179607", "imageRef": "82e03cf1-343a-46e7-8af1-510b0329c237", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9f375923-b2c1-4aca-8241-c76984eab0a4"}], "security_groups": [{"name": "tempest-securitygroup--802898028"}], "key_name": "tempest-keypair-1762915781", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:24.366666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:24.407300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25692a87-b42b-468a-95cd-dde1e3e974ac tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.526731 Jul 18 13:10:24.412054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1481/3085] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:22 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:24.426724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:24.428831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:24.469818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:24.470564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:24.475453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:24.486851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:24.699279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:24.722854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52295496-07e9-43d6-8b2c-dbf3b05b7617 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1273 microversion: 2.1 time: 0.309123 Jul 18 13:10:24.739504 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1482/3086] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:24 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:24.755840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:24.756759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:24.784511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:24.785654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:24.788875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:24.789696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:25.267422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:25.303441 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8da99e66-9e4f-4ec6-874c-97139ac89ca1 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1468 microversion: 2.1 time: 0.558480 Jul 18 13:10:25.307749 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1483/3087] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:24 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1468 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:25.327604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:25.335325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:25.358906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:25.367812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:25.369335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:25.370118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:25.503634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] validate_networks() for [('9f375923-b2c1-4aca-8241-c76984eab0a4', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:10:26.723779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:26.741071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da8746d4-c82e-43eb-a346-6e078355029e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.429446 Jul 18 13:10:26.742659 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1484/3088] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:25 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:26.754203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:26.755829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:26.773313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:26.779115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:26.783289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:26.784308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:27.055866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:27.082738 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d004063-7b64-4e50-89a3-318646199fc7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1286 microversion: 2.1 time: 0.337181 Jul 18 13:10:27.083799 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1485/3089] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:26 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1286 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:27.111205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:27.113687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:27.127967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:27.135934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:27.139466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:27.141765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:27.759588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:27.773988 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c24a8c3-a251-4961-9132-5f9084769929 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 0.673943 Jul 18 13:10:27.775023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1486/3090] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:27 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:27.791113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:27.792049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:27.805178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:27.806166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:27.807146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:27.807698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:28.344062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:28.355434 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3bf72d9d-5b75-40fa-93f5-98e4fc677275 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1468 microversion: 2.1 time: 0.569154 Jul 18 13:10:28.359531 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1487/3091] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:27 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1468 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:28.372657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:28.376072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:28.383981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:28.401703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:28.412393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:28.424208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:28.428208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:28.687979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b172237-2fa8-4681-9bb2-bfaf2b4fa987 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.325138 Jul 18 13:10:28.691194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1488/3092] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:10:28 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:10:28.717521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3044c7f5-9a00-4e52-9ef2-41631ba19c0f req-f4559304-24c4-4b7a-b701-eb93a8f81e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-plugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:28.746753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3044c7f5-9a00-4e52-9ef2-41631ba19c0f req-f4559304-24c4-4b7a-b701-eb93a8f81e42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:28.747331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3044c7f5-9a00-4e52-9ef2-41631ba19c0f req-f4559304-24c4-4b7a-b701-eb93a8f81e42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:28.785925 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3044c7f5-9a00-4e52-9ef2-41631ba19c0f req-f4559304-24c4-4b7a-b701-eb93a8f81e42 service nova] Creating event network-vif-plugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:10:28.806537 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3044c7f5-9a00-4e52-9ef2-41631ba19c0f req-f4559304-24c4-4b7a-b701-eb93a8f81e42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092922 Jul 18 13:10:28.812506 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1489/3093] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:28.831390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:28.831686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:28.855583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:28.859364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:28.864998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:28.869652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:29.468078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:29.478940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:29.528045 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d88cd95-56a1-45d6-a64c-767e91053c77 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1286 microversion: 2.1 time: 0.707741 Jul 18 13:10:29.540923 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1490/3094] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:28 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1286 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:29.556521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:29.557870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:29.593386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:29.595090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:29.599561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:29.600738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.022852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:10:30.023653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:10:30.024537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:10:30.025630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:10:30.027318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:10:30.075555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.076808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.078902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.080032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.124062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Getting quotas for project 89651644ce0c4de1b9f1c1e7c6bdd030. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:30.144621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Getting quotas for user 6d0fc95c467b49b9b18423663272bec9 and project 89651644ce0c4de1b9f1c1e7c6bdd030. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:30.198211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:10:30.209479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e03cf1-343a-46e7-8af1-510b0329c237',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:10:30.260099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:30.362228 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17ca63b4-0918-40a9-adc5-748ba004440d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 6.162911 Jul 18 13:10:30.375391 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1605/3095] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:10:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 6185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:10:30.408060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:30.430711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:30.449761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.452635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.453808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.454832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.553820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:30.571801 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8831c506-2958-4c03-8cb6-bed8e3287d00 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1668 microversion: 2.1 time: 1.029134 Jul 18 13:10:30.574953 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1491/3096] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:29 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1668 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:30.588096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:30.591094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:30.607678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.609340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.611544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.612002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.713218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.713573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.714042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lazy-loading 'fault' on Instance uuid 516a6053-053c-48e4-87cd-dc98c6d58dc1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:10:30.855905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:30.868087 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a52d4d0-1c00-4dd8-8449-fe727164fcee tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 200 len: 1302 microversion: 2.1 time: 0.291879 Jul 18 13:10:30.875568 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1492/3097] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:30 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 1302 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:30.889619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-80497f80-a1db-4f9a-ba7f-e04113bd24bf req-f76519a3-add9-4e44-9c1c-eb0fe22cc5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-deleted", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:30.909413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-80497f80-a1db-4f9a-ba7f-e04113bd24bf req-f76519a3-add9-4e44-9c1c-eb0fe22cc5ad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:30.910435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-80497f80-a1db-4f9a-ba7f-e04113bd24bf req-f76519a3-add9-4e44-9c1c-eb0fe22cc5ad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:30.945455 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-80497f80-a1db-4f9a-ba7f-e04113bd24bf req-f76519a3-add9-4e44-9c1c-eb0fe22cc5ad service nova] Creating event network-vif-deleted:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:10:30.962528 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-80497f80-a1db-4f9a-ba7f-e04113bd24bf req-f76519a3-add9-4e44-9c1c-eb0fe22cc5ad service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084697 Jul 18 13:10:30.964288 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1493/3098] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:30.979402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68cf8b6f-0ed9-4516-88d9-8b1fa59ac146 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:30.980276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-68cf8b6f-0ed9-4516-88d9-8b1fa59ac146 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:31.103467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-68cf8b6f-0ed9-4516-88d9-8b1fa59ac146 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:31.117715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68cf8b6f-0ed9-4516-88d9-8b1fa59ac146 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1246 microversion: 2.1 time: 0.151102 Jul 18 13:10:31.121338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1494/3099] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:30 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:31.141591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:31.150733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:31.172730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:31.178256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:31.179542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:31.181534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:31.829638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:31.851178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87762e8a-9005-4cf7-8fa9-2e5eeccc464d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 1.468072 Jul 18 13:10:31.864616 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1606/3100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:30 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:31.876007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:31.884042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a78f9655-76e6-4a20-9257-16aa6cfbeb5d req-fff521e9-8b1a-40eb-97cb-85810df00416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516a6053-053c-48e4-87cd-dc98c6d58dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc84dbb7-67ef-4fa8-bafe-265a0b267fac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:31.891785 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f11a0b2-97a5-4374-9244-f59b9ea0e6a6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 0.766945 Jul 18 13:10:31.894628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1495/3101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:31 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:31.911628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:31.916438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:31.918480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a78f9655-76e6-4a20-9257-16aa6cfbeb5d req-fff521e9-8b1a-40eb-97cb-85810df00416 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:31.918934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a78f9655-76e6-4a20-9257-16aa6cfbeb5d req-fff521e9-8b1a-40eb-97cb-85810df00416 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:31.942381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a78f9655-76e6-4a20-9257-16aa6cfbeb5d req-fff521e9-8b1a-40eb-97cb-85810df00416 service nova] Creating event network-vif-unplugged:cc84dbb7-67ef-4fa8-bafe-265a0b267fac for instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 on n-h2-850003-3 Jul 18 13:10:31.948518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:31.949632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:31.955499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:31.957131 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a78f9655-76e6-4a20-9257-16aa6cfbeb5d req-fff521e9-8b1a-40eb-97cb-85810df00416 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090212 Jul 18 13:10:31.960705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:31.969881 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1607/3102] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:31.989295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:31.990457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 516a6053-053c-48e4-87cd-dc98c6d58dc1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.004081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.004851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.010187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.011376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.047691 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] HTTP exception thrown: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Request method failure captured: Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 HTTP/1.1 Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vn0jfmuwrzoFrSWnmtpghTxSC4OFCzT3Y-Anx7jvjSWTI55r_-Fu2wnUSh7Pxjw3FA7_UYKndEbC8_wEpIwA5pa_qrvQs_nEZ80hMtyPwRk8hweJVOzsGHELvWlckO_N48lw5SbKag53HIMx3UyAmAaeJ5gNDiqYMf4umQZXR5TRaY Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:32.049453 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79e08cee89424fc3bcc56357db5fdb7f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 87071b7ce4994dabbf3234f2d60da8e8 Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. Jul 18 13:10:32.051211 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '516a6053-053c-48e4-87cd-dc98c6d58dc1'} Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:32.052038 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. Jul 18 13:10:32.053512 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:32.056125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Returning 404 to user: Instance 516a6053-053c-48e4-87cd-dc98c6d58dc1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:32.056125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f598efd-e191-4693-bbe8-5b9098f9fe3e tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1" status: 404 len: 111 microversion: 2.1 time: 0.084390 Jul 18 13:10:32.061388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1608/3103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:31 2022] GET /compute/v2.1/servers/516a6053-053c-48e4-87cd-dc98c6d58dc1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:10:32.071770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:32.072297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.080226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.080682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.082056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.082583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.143888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:10:32.183043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:32.335665 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f682410-92b5-450e-b407-67ed3854f013 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 204 len: 0 microversion: 2.1 time: 0.272507 Jul 18 13:10:32.337020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1609/3104] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:10:32 2022] DELETE /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:10:32.350876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:32.353457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.372195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.374468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.376712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.380151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.509991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:32.526708 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74eebd51-788c-4345-902c-da768e21b81a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1668 microversion: 2.1 time: 0.630532 Jul 18 13:10:32.528077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1496/3105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:31 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1668 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:32.539301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:32.542376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.566138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.568181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.579274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.580443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.814968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:32.825129 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-974f1f07-db1a-4d02-8ead-6ba21e19eb58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1242 microversion: 2.1 time: 0.485737 Jul 18 13:10:32.835634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1610/3106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:32 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1242 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:32.873082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:32.874228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.888860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.889503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.893493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.894676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.904221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:32.915911 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f868925-754e-424e-841a-4bc94f1aacfd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1533 microversion: 2.1 time: 0.385940 Jul 18 13:10:32.932167 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1497/3107] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:32 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1533 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:32.941873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:32.942921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:32.955875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.957394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:32.958953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:32.960411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:33.215308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:33.238028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2fe77f2-f7ba-4d69-a694-470e50095f2b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 0.300033 Jul 18 13:10:33.259647 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1498/3108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:32 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:33.287448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-edbe24cf-234a-4e51-ac9b-9d8becc8c519 req-f7c5dee2-1ede-4ec6-836c-d788a660e6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c22e2d-fc6e-47af-a9d4-02372306adad", "tag": "a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:33.308588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-edbe24cf-234a-4e51-ac9b-9d8becc8c519 req-f7c5dee2-1ede-4ec6-836c-d788a660e6b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:33.317202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-edbe24cf-234a-4e51-ac9b-9d8becc8c519 req-f7c5dee2-1ede-4ec6-836c-d788a660e6b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:33.344657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-edbe24cf-234a-4e51-ac9b-9d8becc8c519 req-f7c5dee2-1ede-4ec6-836c-d788a660e6b2 service nova] Creating event network-changed:a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb for instance 40c22e2d-fc6e-47af-a9d4-02372306adad on n-h2-850003-3 Jul 18 13:10:33.352591 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-edbe24cf-234a-4e51-ac9b-9d8becc8c519 req-f7c5dee2-1ede-4ec6-836c-d788a660e6b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087933 Jul 18 13:10:33.353896 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1499/3109] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:33.577247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:33.584254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:33.611858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:33.613887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:33.615887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:33.617142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.036181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:34.051372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fffb9206-9716-4d4e-8053-a24e8df86a23 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.485749 Jul 18 13:10:34.052049 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1500/3110] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:33 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:34.065033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:34.073386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:34.110870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.113080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.114918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.121723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.284968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:34.286708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:34.323354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f09e213c-0ea3-425b-bd20-d4f3bd7fd583 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 1.451676 Jul 18 13:10:34.330071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f96fc59-17eb-45c5-aac7-a0cfcfed4044 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1298 microversion: 2.1 time: 0.268954 Jul 18 13:10:34.330658 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1611/3111] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:32 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:34.346500 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1501/3112] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:34 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1298 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:34.354857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:34.362256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:34.364286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:34.366013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:34.377521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.379297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.381661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.383012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.392837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.393829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.395647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.396251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.607505 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-678ebdcf-fbd9-4ae9-8a15-67a8001637b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 200 len: 324 microversion: 2.1 time: 0.257100 Jul 18 13:10:34.609077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1502/3113] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:10:34 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:34.650067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:34.651916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:34.682347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.683316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:34.686286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:34.687961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:35.456550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:35.472233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16d36b22-1fd4-420b-98b3-ab0b92a7dfbf tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1533 microversion: 2.1 time: 1.138697 Jul 18 13:10:35.499422 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1612/3114] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:34 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1533 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:35.510468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:35.511695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:35.526213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:35.527451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:35.529296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:35.530750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:36.641647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:36.663351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a569892-a80a-437f-8cbb-2e77750cf830 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.161906 Jul 18 13:10:36.687328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1613/3115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:35 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:36.703555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:36.707769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:36.728854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:36.731664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:36.734325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:36.743691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:37.319142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:37.360783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f829df81-7c58-4f5d-9035-aa46227f1fbc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 2.749317 Jul 18 13:10:37.365394 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1503/3116] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:34 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:37.382744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:37.388716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:37.417524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:37.419345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:37.429791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:37.433729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:37.817359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:37.842294 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a064682-a12d-4be7-8dd0-411bc3943e23 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1304 microversion: 2.1 time: 0.471607 Jul 18 13:10:37.845435 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1504/3117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:37 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1304 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:37.854170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:37.854816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:37.871590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:37.872257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:37.873284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:37.873881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:38.356772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:38.375955 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8455611b-368a-47af-9b8a-256c965c6ba5 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 200 len: 1491 microversion: 2.1 time: 0.529327 Jul 18 13:10:38.393372 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1505/3118] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:37 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 1491 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:38.417516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:38.419533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:38.455527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:38.456561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:38.457395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:38.460905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:38.870689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:38.886702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4255a29c-2ea0-4300-9c91-9b0dd419d21f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 2.189750 Jul 18 13:10:38.893064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1614/3119] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:36 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:38.919560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2d6317e1-e915-47e9-b5f5-03c8632586aa req-cc0445e0-4abf-4453-bc4c-29a0b70d058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b78d57-1a15-4070-b759-0d65d34955ba", "name": "network-vif-deleted", "tag": "261f6d3d-4b6a-446d-8b0f-15c6779aa25a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:38.968575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d6317e1-e915-47e9-b5f5-03c8632586aa req-cc0445e0-4abf-4453-bc4c-29a0b70d058e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:38.972838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d6317e1-e915-47e9-b5f5-03c8632586aa req-cc0445e0-4abf-4453-bc4c-29a0b70d058e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:39.018660 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2d6317e1-e915-47e9-b5f5-03c8632586aa req-cc0445e0-4abf-4453-bc4c-29a0b70d058e service nova] Creating event network-vif-deleted:261f6d3d-4b6a-446d-8b0f-15c6779aa25a for instance c3b78d57-1a15-4070-b759-0d65d34955ba on n-h1-850003-3 Jul 18 13:10:39.035827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2d6317e1-e915-47e9-b5f5-03c8632586aa req-cc0445e0-4abf-4453-bc4c-29a0b70d058e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138139 Jul 18 13:10:39.040085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1615/3120] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:39.059235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:39.074500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:39.108350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:39.118977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:39.121259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:39.123663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.105379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:40.180428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=20 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:40.347449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:40.367079 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-328e6508-634e-4e2d-83f1-dfe56bdd75ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.971327 Jul 18 13:10:40.379147 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1506/3121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:38 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:40.400674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:40.410619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:40.436995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.441898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.451568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.453023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.494790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:40.535301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae53958b-bc16-4408-a08c-4c2385a1c91c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 1.492480 Jul 18 13:10:40.536747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1616/3122] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:39 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:40.548156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e9045627-696d-445f-b817-09e218756bcf req-4cd5a65c-a64d-48bf-ab47-829726d264c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9a19ee-dc03-42bf-abda-d65e840199a9", "tag": "f69acce5-059c-423e-92ad-68ee87b177a3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:40.592365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e9045627-696d-445f-b817-09e218756bcf req-4cd5a65c-a64d-48bf-ab47-829726d264c9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.593926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e9045627-696d-445f-b817-09e218756bcf req-4cd5a65c-a64d-48bf-ab47-829726d264c9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.663895 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e9045627-696d-445f-b817-09e218756bcf req-4cd5a65c-a64d-48bf-ab47-829726d264c9 service nova] Creating event network-changed:f69acce5-059c-423e-92ad-68ee87b177a3 for instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 on n-h1-850003-3 Jul 18 13:10:40.695154 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e9045627-696d-445f-b817-09e218756bcf req-4cd5a65c-a64d-48bf-ab47-829726d264c9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155892 Jul 18 13:10:40.709358 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1617/3123] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:40.728347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:40.734419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: c3b78d57-1a15-4070-b759-0d65d34955ba] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:40.764103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.769744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.774351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.775097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.851468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] HTTP exception thrown: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Request method failure captured: Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba HTTP/1.1 Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vn0jfmuwrzoFrSWnmtpghTxSC4OFCzT3Y-Anx7jvjSWTI55r_-Fu2wnUSh7Pxjw3FA7_UYKndEbC8_wEpIwA5pa_qrvQs_nEZ80hMtyPwRk8hweJVOzsGHELvWlckO_N48lw5SbKag53HIMx3UyAmAaeJ5gNDiqYMf4umQZXR5TRaY Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:10:40.854859 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79e08cee89424fc3bcc56357db5fdb7f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 87071b7ce4994dabbf3234f2d60da8e8 Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. Jul 18 13:10:40.857271 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c3b78d57-1a15-4070-b759-0d65d34955ba'} Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:10:40.858059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. Jul 18 13:10:40.859487 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:10:40.863602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Returning 404 to user: Instance c3b78d57-1a15-4070-b759-0d65d34955ba could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:10:40.876391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ea21ead-c488-404f-a5d6-87e872e43fbd tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba" status: 404 len: 111 microversion: 2.1 time: 0.162776 Jul 18 13:10:40.887470 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1618/3124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:40 2022] GET /compute/v2.1/servers/c3b78d57-1a15-4070-b759-0d65d34955ba => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:10:40.908023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:40.912729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:40.936536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.939180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:40.943131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:40.945814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:41.110201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=20 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:41.498821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:41.509774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4413b83-5ec7-43c3-be44-0fa52024c8c4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 0.620402 Jul 18 13:10:41.516719 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1619/3125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:40 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:41.548529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:41.578643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:41.600203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:41.601750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:41.604129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:41.605445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:41.767592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:41.793432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-901a3d52-5444-436f-b8ec-23e614548eeb tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1304 microversion: 2.1 time: 1.412652 Jul 18 13:10:41.796159 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1507/3126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:40 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1304 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:41.803456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba2c1ef0-a29a-4422-a243-8ed8dc749d17 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '.version_select at 0x7f96d7ab29d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:41.867729 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba2c1ef0-a29a-4422-a243-8ed8dc749d17 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539742680" status: 202 len: 0 microversion: 2.1 time: 0.068877 Jul 18 13:10:41.870764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1508/3127] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:10:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539742680 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:10:41.897408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:41.901071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:41.935617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:41.942048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:41.944235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:41.946678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.101339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:42.133515 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd6308a3-a6c7-49d6-83b4-4a74d80b0129 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.594346 Jul 18 13:10:42.134630 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1620/3128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:41 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:42.162194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:42.167560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:42.200908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.202649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.208827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.209909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.654054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:42.701929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74782df1-7efe-4d4b-9f7a-427d70077b80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 0.823787 Jul 18 13:10:42.708795 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1509/3129] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:41 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:42.739455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:42.741146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:42.781910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.786439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.793531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.795322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.796515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:42.821716 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef7ca7d0-df70-4df0-b400-0023ee76e67f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.668957 Jul 18 13:10:42.827748 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1621/3130] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:42 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:42.863619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:42.865081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:42.907341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.912042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:42.921844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:42.926369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:43.025176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:43.186784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:43.240708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ae1d9a9-73ed-451c-9e5e-14f3e1d1374b tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1304 microversion: 2.1 time: 0.407153 Jul 18 13:10:43.254753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1622/3131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:42 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1304 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:43.319317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1606867176", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "609839e4-f25f-4b03-a576-8c39127f230c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:43.462129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] validate_networks() for [('609839e4-f25f-4b03-a576-8c39127f230c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:10:46.292305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:46.298934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:46.357421 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1d00d48-9644-4f74-9b9f-e77831b56e3c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 3.646479 Jul 18 13:10:46.371679 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1510/3132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:42 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 3662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:46.401320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c30a66f1-c5ff-457f-b248-57ffcbe80083 req-c112109c-a382-49a7-9357-dd8c79fa6afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c22e2d-fc6e-47af-a9d4-02372306adad", "name": "network-vif-plugged", "status": "completed", "tag": "a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:46.473505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c30a66f1-c5ff-457f-b248-57ffcbe80083 req-c112109c-a382-49a7-9357-dd8c79fa6afd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:46.474664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c30a66f1-c5ff-457f-b248-57ffcbe80083 req-c112109c-a382-49a7-9357-dd8c79fa6afd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:46.527404 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c30a66f1-c5ff-457f-b248-57ffcbe80083 req-c112109c-a382-49a7-9357-dd8c79fa6afd service nova] Creating event network-vif-plugged:a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb for instance 40c22e2d-fc6e-47af-a9d4-02372306adad on n-h2-850003-3 Jul 18 13:10:46.542644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c30a66f1-c5ff-457f-b248-57ffcbe80083 req-c112109c-a382-49a7-9357-dd8c79fa6afd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168648 Jul 18 13:10:46.556775 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1511/3133] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:46.567405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:46.570920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:46.589213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:46.590777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:46.598812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:46.599551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.009933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:49.040983 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8b67b76e-7cb6-4bee-84ff-0d1f96dcbf2e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 2.477561 Jul 18 13:10:49.043778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1512/3134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:46 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:49.056147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:49.057966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:49.089736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.090515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.091813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.092471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.379302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:10:49.381020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:10:49.382420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:10:49.383480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:10:49.384482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:10:49.466457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.467426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.473817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.474687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.624860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:10:49.643017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:10:49.675680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:10:49.686062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:10:49.877843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69d6702f-f45c-42f8-8942-37974784dceb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.565831 Jul 18 13:10:49.880252 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1623/3135] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 6570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:10:49.892099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:49.896272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:49.913290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.913868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:49.915146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:49.915828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.036045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:51.051774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f60205d5-427d-4719-9080-8584c7501301 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 1.169037 Jul 18 13:10:51.072812 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1624/3136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:49 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:51.086259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b5f3f938-239a-4d4e-9111-f5f8183641e5 req-752b6b51-e4b9-45c2-b8d1-ca85c13a3590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9a19ee-dc03-42bf-abda-d65e840199a9", "name": "network-vif-plugged", "status": "completed", "tag": "f69acce5-059c-423e-92ad-68ee87b177a3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:51.141667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b5f3f938-239a-4d4e-9111-f5f8183641e5 req-752b6b51-e4b9-45c2-b8d1-ca85c13a3590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.142459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b5f3f938-239a-4d4e-9111-f5f8183641e5 req-752b6b51-e4b9-45c2-b8d1-ca85c13a3590 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.197911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b5f3f938-239a-4d4e-9111-f5f8183641e5 req-752b6b51-e4b9-45c2-b8d1-ca85c13a3590 service nova] Creating event network-vif-plugged:f69acce5-059c-423e-92ad-68ee87b177a3 for instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 on n-h1-850003-3 Jul 18 13:10:51.209233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b5f3f938-239a-4d4e-9111-f5f8183641e5 req-752b6b51-e4b9-45c2-b8d1-ca85c13a3590 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148218 Jul 18 13:10:51.210644 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1625/3137] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:51.233085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:51.234681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:51.255641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.259046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.260805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.269493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.447840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:51.475142 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c27c073-303c-4725-b514-80fefebb9850 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 2.428613 Jul 18 13:10:51.476656 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1513/3138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:49 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 2432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:51.482165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:51.483105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:51.496100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:51.505206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.505968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.507165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.507893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.508016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:51.591399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dd70f68-2a1d-4515-9105-331be4160604 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1219 microversion: 2.1 time: 0.373426 Jul 18 13:10:51.595124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1626/3139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:51 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1219 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:51.608173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:10:51.618567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:51.622811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:51.653379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.656015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.659179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:51.659654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:51.961481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-844efa66-cc01-4ae9-9a0b-3d46745308a7 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "DELETE /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 204 len: 0 microversion: 2.1 time: 0.479574 Jul 18 13:10:51.964822 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1514/3140] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:10:51 2022] DELETE /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:10:51.993224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:52.007853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:52.019389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.025108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:52.026888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.039251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:52.212755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:52.253574 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-472b0a7f-698b-4ff7-b06b-cd6b57a378d9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 0.648276 Jul 18 13:10:52.273985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1627/3141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:51 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:52.291957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:52.294901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:52.322414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.333952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:52.336168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.338700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:52.884486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:52.911089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-029bb965-3c1b-4510-b54e-3a00ad4133a3 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1468 microversion: 2.1 time: 0.937761 Jul 18 13:10:52.920212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1515/3142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:51 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1468 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:52.938503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:52.941095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:52.980931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.983058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:52.988841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:52.993955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:53.116205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:53.142604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82c37dc3-a409-40d7-99c2-1a9bf637c5f6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1315 microversion: 2.1 time: 0.865821 Jul 18 13:10:53.145841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1628/3143] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:52 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:53.165936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:53.167584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:53.182403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:53.183684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:53.185528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:53.186693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:53.424992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:53.443285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f59a637c-4223-49c4-bbd1-eb4c53c9de65 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1267 microversion: 2.1 time: 0.291450 Jul 18 13:10:53.444900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1629/3144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:53 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:53.459382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:53.460217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:53.487270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:53.488324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:53.489940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:53.491199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:53.996414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:54.058225 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa9715d8-878f-4d0d-9c52-c91c64cbabd5 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 1.123598 Jul 18 13:10:54.062676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1516/3145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:52 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:54.136954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:54.141645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:54.199779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:54.209242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:54.215005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:54.223140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:54.826689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:54.866447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-466fda6a-e7af-4ef3-8fbb-901c49e073e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1328 microversion: 2.1 time: 1.419576 Jul 18 13:10:54.867468 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1630/3146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:53 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1328 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:54.903781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:54.904960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:54.954096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:54.955174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:54.966516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:54.975468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:55.089563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:55.135824 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f23ad18-5782-41c0-ae51-b4af479b41d8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1468 microversion: 2.1 time: 1.037370 Jul 18 13:10:55.143663 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1517/3147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:54 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1468 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:55.180764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:55.183643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:55.216042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:55.220686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:55.225797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:55.227823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:55.484900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:55.501122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8fb53604-4c68-460d-962a-1b066985e8e0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1267 microversion: 2.1 time: 0.355484 Jul 18 13:10:55.503181 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1518/3148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:55 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1267 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:55.516902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b489b62d-334d-470a-9529-aefe01337d09 req-722521e5-509c-4be7-8d93-59d8ccd8723b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cab126c-3f1e-415d-bf7d-1d106cb34bbe", "tag": "02590902-2d3d-4bcb-9349-2e19ac73f4ee"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:55.560498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b489b62d-334d-470a-9529-aefe01337d09 req-722521e5-509c-4be7-8d93-59d8ccd8723b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:55.562970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b489b62d-334d-470a-9529-aefe01337d09 req-722521e5-509c-4be7-8d93-59d8ccd8723b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:55.615688 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b489b62d-334d-470a-9529-aefe01337d09 req-722521e5-509c-4be7-8d93-59d8ccd8723b service nova] Creating event network-changed:02590902-2d3d-4bcb-9349-2e19ac73f4ee for instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe on n-h2-850003-3 Jul 18 13:10:55.645555 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b489b62d-334d-470a-9529-aefe01337d09 req-722521e5-509c-4be7-8d93-59d8ccd8723b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138093 Jul 18 13:10:55.646908 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1519/3149] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:55.658210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:55.662466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:55.693252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:55.693252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:55.693252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:55.693252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:56.139295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:56.169624 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-372de2eb-7b47-4977-af20-458357bf19c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1501 microversion: 2.1 time: 1.300291 Jul 18 13:10:56.171470 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1631/3150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:54 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1501 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:56.191233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:56.201831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:56.243645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:56.245204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:56.248756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:56.249974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:57.032022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:57.061971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7bcc18b-f81a-4690-b905-4a5875e6d6aa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1509 microversion: 2.1 time: 0.879368 Jul 18 13:10:57.088209 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1632/3151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:56 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1509 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:57.115130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:57.117693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:57.164311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:57.181653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:57.195713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:57.202781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:57.998684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:58.011453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:58.070482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a70d6fb-6177-46df-b2bf-067e85c6657f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 2.418451 Jul 18 13:10:58.071714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1520/3152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:55 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:58.072340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74ebc13a-7039-4c09-a3c1-26c21478531f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 200 len: 1468 microversion: 2.1 time: 0.960423 Jul 18 13:10:58.086198 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1633/3153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:57 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 1468 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:58.088732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:58.089885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:58.103456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:58.105757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:58.137885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.146585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.150413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.152356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.153379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.157001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.165572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.167128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.588253 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e228ad28-bca6-4d56-ad53-60cc9dc47419 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad/action" status: 202 len: 0 microversion: 2.1 time: 0.492629 Jul 18 13:10:58.596352 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1521/3154] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:10:58 2022] POST /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:10:58.642914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:58.659299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:58.669601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:58.701739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.707334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.718376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f746b98-0ca7-4dff-a699-437742e24e42 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1273 microversion: 2.1 time: 0.638168 Jul 18 13:10:58.720311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.722012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.726841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1634/3155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:58 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1273 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:58.757610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-bb77aa5c-9990-47f2-919f-b00e82b98963 req-c582716f-3676-49ff-8b0a-d83bf288c473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cac83b-60b4-410e-8563-6e05d5cbec79", "name": "network-vif-deleted", "tag": "d39a2b67-7b84-47ba-b019-dcd98f99711f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:10:58.815808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bb77aa5c-9990-47f2-919f-b00e82b98963 req-c582716f-3676-49ff-8b0a-d83bf288c473 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.818060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bb77aa5c-9990-47f2-919f-b00e82b98963 req-c582716f-3676-49ff-8b0a-d83bf288c473 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.895680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-bb77aa5c-9990-47f2-919f-b00e82b98963 req-c582716f-3676-49ff-8b0a-d83bf288c473 service nova] Creating event network-vif-deleted:d39a2b67-7b84-47ba-b019-dcd98f99711f for instance 68cac83b-60b4-410e-8563-6e05d5cbec79 on n-h1-850003-3 Jul 18 13:10:58.917935 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-bb77aa5c-9990-47f2-919f-b00e82b98963 req-c582716f-3676-49ff-8b0a-d83bf288c473 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184580 Jul 18 13:10:58.921714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1635/3156] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:10:58.955595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:58.957101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:58.979851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.980488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:58.990031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:58.998770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:59.578443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:59.662518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:10:59.670546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:10:59.697355 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db09870f-0c4b-496e-b1cf-fa748d9c26ea tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1506 microversion: 2.1 time: 0.760646 Jul 18 13:10:59.698085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1636/3157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:58 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:10:59.720365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:10:59.725761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:10:59.761416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:59.762825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:10:59.767406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:10:59.773324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:00.231503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:00.317972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-328336d3-5103-4a57-bac1-0ed07d3c94e6 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 0.617977 Jul 18 13:11:00.344985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1637/3158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:59 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:00.370261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:00.371230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 68cac83b-60b4-410e-8563-6e05d5cbec79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:00.421222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:00.422226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:00.423392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:00.425088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:00.446282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] HTTP exception thrown: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Request method failure captured: Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 HTTP/1.1 Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vn0jfmuwrzoFrSWnmtpghTxSC4OFCzT3Y-Anx7jvjSWTI55r_-Fu2wnUSh7Pxjw3FA7_UYKndEbC8_wEpIwA5pa_qrvQs_nEZ80hMtyPwRk8hweJVOzsGHELvWlckO_N48lw5SbKag53HIMx3UyAmAaeJ5gNDiqYMf4umQZXR5TRaY Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:11:00.448484 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79e08cee89424fc3bcc56357db5fdb7f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 87071b7ce4994dabbf3234f2d60da8e8 Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. Jul 18 13:11:00.450012 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '68cac83b-60b4-410e-8563-6e05d5cbec79'} Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:11:00.450867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. Jul 18 13:11:00.453760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:00.459254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Returning 404 to user: Instance 68cac83b-60b4-410e-8563-6e05d5cbec79 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:11:00.460635 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4fbf84dc-a372-4fa6-8a43-027c3bab88ef tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79" status: 404 len: 111 microversion: 2.1 time: 0.123132 Jul 18 13:11:00.461886 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1638/3159] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:00 2022] GET /compute/v2.1/servers/68cac83b-60b4-410e-8563-6e05d5cbec79 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:11:00.798070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:00.800251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:00.803234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:00.850925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:00.852060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:00.856434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:00.857426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:01.042340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:01.053540 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b030bb25-b727-40ba-a564-8db91fea3d4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1273 microversion: 2.1 time: 0.589942 Jul 18 13:11:01.064249 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1639/3160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:00 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:01.071356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:01.072362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:01.080683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:01.081412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:01.082074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:01.083191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:01.124508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:11:01.194929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:01.292492 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33e94400-4c2c-4305-a602-cddc1fe29cf0 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "DELETE /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 204 len: 0 microversion: 2.1 time: 0.225208 Jul 18 13:11:01.297608 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1640/3161] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:11:01 2022] DELETE /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:11:01.319747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:01.326912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:01.347314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:01.348156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:01.354205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:01.355027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:01.977393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:02.021315 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f64d099b-d506-4d04-b071-cf66c0c7958c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1486 microversion: 2.1 time: 0.721759 Jul 18 13:11:02.052879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1641/3162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:01 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1486 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:02.092178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:02.097091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:02.125619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:02.126818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:02.133561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:02.135184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:02.727957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:02.807800 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-522dca9d-5965-4094-a330-209cb948ef20 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1509 microversion: 2.1 time: 4.202169 Jul 18 13:11:02.834580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1522/3163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:10:58 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1509 bytes in 4238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:02.879539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:02.880720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:02.925266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:02.925896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:02.927899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:02.927899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:03.091395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:03.111308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f988842-ea24-4784-a91c-e27314c84173 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1468 microversion: 2.1 time: 1.050641 Jul 18 13:11:03.115673 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1642/3164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:02 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1468 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:03.128015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:03.128953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:03.140638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:03.141378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:03.142472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:03.144097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:03.274788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:11:03.522983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-984cc63e-94f5-4fa4-9b0a-f9266c99171f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 204 len: 0 microversion: 2.1 time: 0.396113 Jul 18 13:11:03.529448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1643/3165] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:11:03 2022] DELETE /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:11:03.551005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:03.553179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:03.564086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:03.564888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:03.566436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:03.567279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:03.954580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:04.005126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aea5bb7e-b7ee-4ffd-8cda-08d5e82f568a tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 1.167220 Jul 18 13:11:04.006211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1523/3166] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:02 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:04.034380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:04.041048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:04.069866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.071115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:04.078996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.079576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:04.245994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:11:04.455766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:04.590587 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0f9fe18-c098-4f9b-a271-bf8d11a01b10 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 204 len: 0 microversion: 2.1 time: 0.582062 Jul 18 13:11:04.604976 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1524/3167] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:11:04 2022] DELETE /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:11:04.630855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:04.634675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:04.663404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.664598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:04.666117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.676895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:04.877100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:04.906768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8dfd9d7-ce4f-4573-9b7c-27ae23401ebe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 1.371669 Jul 18 13:11:04.907874 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1644/3168] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:03 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:04.930484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:04.932330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:04.960634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.963110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:04.964992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:04.966227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:05.276048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:05.306376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-822d5594-d464-491d-a007-c288f27f749f tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1426 microversion: 2.1 time: 0.395596 Jul 18 13:11:05.309874 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1645/3169] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:04 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1426 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:05.336703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:05.338590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:05.358518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:05.371419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:05.373340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:05.374556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:05.714705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:05.736010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23c68cce-0417-4e2e-8ab1-4144fc175bf3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1492 microversion: 2.1 time: 1.128077 Jul 18 13:11:05.750193 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1525/3170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:04 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1492 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:05.761895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3990f136-f127-4efa-9c82-11bfe9bf9966 req-76e5da5f-0de7-48bc-9659-9b3ea450d066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151b6010-7f23-4448-9249-c1124c76aed7", "name": "network-vif-deleted", "tag": "feb673fe-7688-4ae0-af22-37bc5293c34e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:05.817807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3990f136-f127-4efa-9c82-11bfe9bf9966 req-76e5da5f-0de7-48bc-9659-9b3ea450d066 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:05.818664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3990f136-f127-4efa-9c82-11bfe9bf9966 req-76e5da5f-0de7-48bc-9659-9b3ea450d066 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:05.862204 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3990f136-f127-4efa-9c82-11bfe9bf9966 req-76e5da5f-0de7-48bc-9659-9b3ea450d066 service nova] Creating event network-vif-deleted:feb673fe-7688-4ae0-af22-37bc5293c34e for instance 151b6010-7f23-4448-9249-c1124c76aed7 on n-h1-850003-3 Jul 18 13:11:05.881102 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3990f136-f127-4efa-9c82-11bfe9bf9966 req-76e5da5f-0de7-48bc-9659-9b3ea450d066 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138887 Jul 18 13:11:05.891814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1526/3171] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:05.912165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:05.921394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:05.954731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:05.957777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:05.961828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:05.965299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.028666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:06.051285 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f0b30d2-5d0f-4e89-8410-3739dc6274d6 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1515 microversion: 2.1 time: 0.726450 Jul 18 13:11:06.060681 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1646/3172] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:05 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1515 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:06.073167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:06.079427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:06.102323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:06.104445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.108755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:06.109643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.638672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:06.692162 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4996ffea-a8c7-45c0-8e12-2a6c399d3e40 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 0.628943 Jul 18 13:11:06.693930 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1647/3173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:06 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:06.714491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:06.716649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:06.740368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:06.741240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.743890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:06.749624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.877885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:06.887041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:06.888670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lazy-loading 'fault' on Instance uuid 151b6010-7f23-4448-9249-c1124c76aed7 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:11:07.132696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:07.194830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5317b484-cae6-49ff-ad79-06f3c6701a06 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 1.295299 Jul 18 13:11:07.195967 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1527/3174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:05 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:07.216575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:07.218529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:07.233080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:07.234959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:07.236625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:07.237724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:07.248110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87071b7ce4994dabbf3234f2d60da8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e08cee89424fc3bcc56357db5fdb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:07.271778 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-737a218f-cffc-41bd-8584-ba0b4e502ca8 tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 200 len: 1302 microversion: 2.1 time: 0.575775 Jul 18 13:11:07.275280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1648/3175] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:06 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 1302 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:07.296899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:07.301818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:07.334108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:07.337618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:07.345057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:07.350079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.019908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:08.049098 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e8b2952c-b4c8-4f12-a74e-afc75d9022fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1515 microversion: 2.1 time: 0.771578 Jul 18 13:11:08.050378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1649/3176] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:07 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1515 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:08.058929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:08.060107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:08.082802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.083549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.086082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.088277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.373821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:08.406012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dbfa38c0-bf57-4126-9be5-02c1f057550b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1492 microversion: 2.1 time: 1.208093 Jul 18 13:11:08.411398 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1528/3177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:07 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1492 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:08.433636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:08.434189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:08.435985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:08.444454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.445358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.446986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.447770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.459583 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7de9f25-977b-47d0-a328-81071d859f75 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 0.404634 Jul 18 13:11:08.461336 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1650/3178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:08 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:08.472967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:08.484422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] [instance: 151b6010-7f23-4448-9249-c1124c76aed7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:08.513560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.520089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.523643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.531101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.586045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] HTTP exception thrown: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Request method failure captured: Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 HTTP/1.1 Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vn0jfmuwrzoFrSWnmtpghTxSC4OFCzT3Y-Anx7jvjSWTI55r_-Fu2wnUSh7Pxjw3FA7_UYKndEbC8_wEpIwA5pa_qrvQs_nEZ80hMtyPwRk8hweJVOzsGHELvWlckO_N48lw5SbKag53HIMx3UyAmAaeJ5gNDiqYMf4umQZXR5TRaY Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:11:08.596535 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79e08cee89424fc3bcc56357db5fdb7f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79e08cee89424fc3bcc56357db5fdb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 79e08cee89424fc3bcc56357db5fdb7f Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-MigrationsAdminTest-2068125500 Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 87071b7ce4994dabbf3234f2d60da8e8 Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-MigrationsAdminTest-2068125500-project Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. Jul 18 13:11:08.599355 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '151b6010-7f23-4448-9249-c1124c76aed7'} Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:11:08.601084 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. Jul 18 13:11:08.603713 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:11:08.610761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] Returning 404 to user: Instance 151b6010-7f23-4448-9249-c1124c76aed7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:11:08.617305 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d93d1b5-1373-4994-a536-44c5dd911e2b tempest-MigrationsAdminTest-2068125500 tempest-MigrationsAdminTest-2068125500-project] 10.222.0.88 "GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7" status: 404 len: 111 microversion: 2.1 time: 0.152515 Jul 18 13:11:08.619201 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1651/3179] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:08 2022] GET /compute/v2.1/servers/151b6010-7f23-4448-9249-c1124c76aed7 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:11:08.645005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3d6220b2-860d-4890-a90f-a9fb5621ce8f req-65804b70-a63f-499c-ae03-befa7cf671fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9a19ee-dc03-42bf-abda-d65e840199a9", "name": "network-vif-deleted", "tag": "f69acce5-059c-423e-92ad-68ee87b177a3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:08.681060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3d6220b2-860d-4890-a90f-a9fb5621ce8f req-65804b70-a63f-499c-ae03-befa7cf671fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:08.682023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3d6220b2-860d-4890-a90f-a9fb5621ce8f req-65804b70-a63f-499c-ae03-befa7cf671fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:08.739174 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3d6220b2-860d-4890-a90f-a9fb5621ce8f req-65804b70-a63f-499c-ae03-befa7cf671fd service nova] Creating event network-vif-deleted:f69acce5-059c-423e-92ad-68ee87b177a3 for instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 on n-h1-850003-3 Jul 18 13:11:08.755611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3d6220b2-860d-4890-a90f-a9fb5621ce8f req-65804b70-a63f-499c-ae03-befa7cf671fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133972 Jul 18 13:11:08.758861 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1652/3180] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:09.224700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4d88f3e7-7174-4ffb-b9bc-0caaa69c9450 req-aa8cd0f9-7b4c-43ec-a45e-bcf2dc8959cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cab126c-3f1e-415d-bf7d-1d106cb34bbe", "name": "network-vif-plugged", "status": "completed", "tag": "02590902-2d3d-4bcb-9349-2e19ac73f4ee"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:09.287980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4d88f3e7-7174-4ffb-b9bc-0caaa69c9450 req-aa8cd0f9-7b4c-43ec-a45e-bcf2dc8959cd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.288962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4d88f3e7-7174-4ffb-b9bc-0caaa69c9450 req-aa8cd0f9-7b4c-43ec-a45e-bcf2dc8959cd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:09.353609 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4d88f3e7-7174-4ffb-b9bc-0caaa69c9450 req-aa8cd0f9-7b4c-43ec-a45e-bcf2dc8959cd service nova] Creating event network-vif-plugged:02590902-2d3d-4bcb-9349-2e19ac73f4ee for instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe on n-h2-850003-3 Jul 18 13:11:09.387117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4d88f3e7-7174-4ffb-b9bc-0caaa69c9450 req-aa8cd0f9-7b4c-43ec-a45e-bcf2dc8959cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425046 Jul 18 13:11:09.389672 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1653/3181] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:11:09.406430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:09.407530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:09.416775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.417632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:09.418722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.419377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:09.509087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.511617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:09.514617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lazy-loading 'fault' on Instance uuid 4c9a19ee-dc03-42bf-abda-d65e840199a9 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:11:09.705061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:09.735191 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5237366c-0355-43e7-a676-6941b9e4dbad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 200 len: 1318 microversion: 2.1 time: 0.337062 Jul 18 13:11:09.738347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1654/3182] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:09 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:09.760275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:09.761866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:09.773493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.775092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:09.776449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:09.777266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:10.289152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:10.305477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-799300b5-5ae5-4136-be6f-9d7d2a869377 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1492 microversion: 2.1 time: 0.564171 Jul 18 13:11:10.306572 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1655/3183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:09 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1492 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:10.330299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:10.332315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:10.347449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:10.349842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:10.351844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:10.354246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:10.401140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:10.556498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:10.572896 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b74f2023-ddf1-4141-903e-5bab54f11830 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 2.156010 Jul 18 13:11:10.575176 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1529/3184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:08 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:10.736789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:10.762803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:10.763886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ba636ce-a32d-4f22-bd45-fc6487943391 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 0.455797 Jul 18 13:11:10.765306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:10.766320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1656/3185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:10 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:10.793977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:10.796969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:10.801156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:10.804194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:10.890670 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 HTTP/1.1 Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:11:10.896227 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:11:10.898979 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '4c9a19ee-dc03-42bf-abda-d65e840199a9'} Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:11:10.901069 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:11:10.904818 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:10.910653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:11:10.916053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34bcccd9-0b02-4955-9598-cdac7b6a2e54 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 404 len: 111 microversion: 2.1 time: 0.157750 Jul 18 13:11:10.918614 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1530/3186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:10 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:11:10.930083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97c02c4e-5d51-43b0-9fd5-c9cbbd3dc025 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '.version_select at 0x7f96e4662c10>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:10.979121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97c02c4e-5d51-43b0-9fd5-c9cbbd3dc025 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-key-278065705" status: 202 len: 0 microversion: 2.1 time: 0.055500 Jul 18 13:11:10.980072 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1657/3187] 10.222.0.88 () {58 vars in 1205 bytes} [Mon Jul 18 13:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-278065705 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:11:11.215640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-12c072ec-6a8c-44f2-8b22-da8f573b1db8 req-c9772b2f-92b1-4900-baa3-16cf7ae764b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21787a3c-9911-451e-bcae-c07aff3b5b9a", "tag": "dfb531cb-fbc8-4aa0-bdbf-482f29506871"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:11.244514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-12c072ec-6a8c-44f2-8b22-da8f573b1db8 req-c9772b2f-92b1-4900-baa3-16cf7ae764b5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.249800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-709291493", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:11.251685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-12c072ec-6a8c-44f2-8b22-da8f573b1db8 req-c9772b2f-92b1-4900-baa3-16cf7ae764b5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:11.289004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-12c072ec-6a8c-44f2-8b22-da8f573b1db8 req-c9772b2f-92b1-4900-baa3-16cf7ae764b5 service nova] Creating event network-changed:dfb531cb-fbc8-4aa0-bdbf-482f29506871 for instance 21787a3c-9911-451e-bcae-c07aff3b5b9a on n-h1-850003-3 Jul 18 13:11:11.311544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-12c072ec-6a8c-44f2-8b22-da8f573b1db8 req-c9772b2f-92b1-4900-baa3-16cf7ae764b5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100717 Jul 18 13:11:11.313667 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1531/3188] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:11:11.332353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:11.333499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:11.348761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.354509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:11.356161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.358951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:11.428126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:11:11.718911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:11.739739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d81e054c-6004-4b64-a28e-1e3d09cb0715 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1450 microversion: 2.1 time: 0.411900 Jul 18 13:11:11.747085 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1532/3189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:11 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1450 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:11.766490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f995e3eb-236b-4451-915e-898419732e22 req-c2c76abb-f7ae-493e-902a-b877795b16c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c22e2d-fc6e-47af-a9d4-02372306adad", "name": "network-vif-unplugged", "status": "completed", "tag": "a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:11.787360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f995e3eb-236b-4451-915e-898419732e22 req-c2c76abb-f7ae-493e-902a-b877795b16c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.788422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f995e3eb-236b-4451-915e-898419732e22 req-c2c76abb-f7ae-493e-902a-b877795b16c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:11.817585 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f995e3eb-236b-4451-915e-898419732e22 req-c2c76abb-f7ae-493e-902a-b877795b16c2 service nova] Creating event network-vif-unplugged:a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb for instance 40c22e2d-fc6e-47af-a9d4-02372306adad on n-h2-850003-3 Jul 18 13:11:11.826363 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f995e3eb-236b-4451-915e-898419732e22 req-c2c76abb-f7ae-493e-902a-b877795b16c2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064893 Jul 18 13:11:11.827913 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1533/3190] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:11.837845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:11.839590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:11.864814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.865781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:11.867363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:11.868608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:12.833010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:12.868444 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd45ef85-bef8-4080-86ea-f7c65b6acd58 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1371 microversion: 2.1 time: 1.034725 Jul 18 13:11:12.869358 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1534/3191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:11 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1371 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:12.900013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:12.906407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:12.953839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:12.956177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:12.958845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:12.962750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:13.663376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:11:13.665138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:11:13.666910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:11:13.667979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:11:13.668987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:11:13.734362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:13.735564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:13.741486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:13.742816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:13.815901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:11:13.834940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:11:13.883945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:11:13.898926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:13.899862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:11:13.954311 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15567ee2-8eef-4167-abe2-189a22a2ad8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 1.067746 Jul 18 13:11:13.979986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1535/3192] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:12 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:14.041686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:14.046745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:14.077593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42afe52e-c201-4a31-b8b8-f735912c09e7 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.834298 Jul 18 13:11:14.088662 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1658/3193] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:11:14.094624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2dd7521d-4442-4d77-85f3-05e51e334faf req-33302477-0622-4cdc-9cdb-841e165a3246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c22e2d-fc6e-47af-a9d4-02372306adad", "name": "network-vif-deleted", "tag": "a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:14.115242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2dd7521d-4442-4d77-85f3-05e51e334faf req-33302477-0622-4cdc-9cdb-841e165a3246 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.116357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2dd7521d-4442-4d77-85f3-05e51e334faf req-33302477-0622-4cdc-9cdb-841e165a3246 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.128850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.129210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.141387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.141876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.164200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2dd7521d-4442-4d77-85f3-05e51e334faf req-33302477-0622-4cdc-9cdb-841e165a3246 service nova] Creating event network-vif-deleted:a3cbf8e9-2fa2-4dde-8f6d-c1315f764beb for instance 40c22e2d-fc6e-47af-a9d4-02372306adad on n-h2-850003-3 Jul 18 13:11:14.177669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2dd7521d-4442-4d77-85f3-05e51e334faf req-33302477-0622-4cdc-9cdb-841e165a3246 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094092 Jul 18 13:11:14.179736 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1659/3194] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:14.199391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:14.202386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:14.217555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.219229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.221647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.223200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.304941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:14.305414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:14.309732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'fault' on Instance uuid 40c22e2d-fc6e-47af-a9d4-02372306adad {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:11:14.465083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:14.495546 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3406c1b2-a446-4c5a-adfa-5a18ec98e467 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 200 len: 1305 microversion: 2.1 time: 0.510211 Jul 18 13:11:14.496167 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1536/3195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:13 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 1305 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:14.516112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-86ede633-60b8-40c0-af44-1d726b44a3b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:14.524092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-86ede633-60b8-40c0-af44-1d726b44a3b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:14.718884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-86ede633-60b8-40c0-af44-1d726b44a3b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:14.760709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-86ede633-60b8-40c0-af44-1d726b44a3b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1208 microversion: 2.1 time: 0.262624 Jul 18 13:11:14.763570 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1537/3196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:14 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1208 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:14.990603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:14.996319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:15.002041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:15.019864 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51254c1b-9842-41c1-afc3-5fed9172f705 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1557 microversion: 2.1 time: 0.833389 Jul 18 13:11:15.020561 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1660/3197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:14 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1557 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:15.039471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:15.040287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:15.047240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.048184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:15.049212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.049900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:15.057970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.058656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:15.079194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.083784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:15.608617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:15.638603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c7fc9d42-e0eb-4e9f-824a-dc88ca00580b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 0.656374 Jul 18 13:11:15.639680 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1538/3198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:14 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:15.671080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:15.676286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:15.707065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.712528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:15.714737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:15.717476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:16.434592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d30cfa00-c47f-41f5-9bc0-bab0180e210f tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.398658 Jul 18 13:11:16.448154 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1661/3199] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:11:15 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-interface => generated 284 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:11:16.480477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:16.486818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:16.545486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:16.546528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:16.558090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:16.559105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:16.758312 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad HTTP/1.1 Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:11:16.765803 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:11:16.767518 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '40c22e2d-fc6e-47af-a9d4-02372306adad'} Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:11:16.768469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:11:16.770037 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:16.776199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:11:16.776199 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b7a2e25-7f09-4929-8501-661e597a2525 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 404 len: 111 microversion: 2.1 time: 1.115028 Jul 18 13:11:16.779978 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1539/3200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:15 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 111 bytes in 1125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:11:16.803756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:16.806916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:16.840879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:16.841735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:16.848630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:16.851253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:17.129794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:17.181328 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1cd6cb9-fb32-470c-9b8a-3ed7ce1d747b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1204 microversion: 2.1 time: 0.730792 Jul 18 13:11:17.229378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1662/3201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:16 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1204 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:17.242946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-444819178", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:17.343280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:17.379193 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de864962-e2a7-4765-9a27-816afc77236a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 0.592158 Jul 18 13:11:17.420904 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1540/3202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:16 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:17.440331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:11:18.248075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:18.249363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:18.296701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:18.301549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:18.308141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:18.315546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:19.360540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:19.385442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea5b8b72-8769-4f65-88e6-10383fd43474 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1266 microversion: 2.1 time: 1.163563 Jul 18 13:11:19.386101 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1541/3203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:18 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1266 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:19.425982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:19.434019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:19.515512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:19.516343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:19.526904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:19.529421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:21.192962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:11:21.194658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:11:21.195816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:11:21.197079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:11:21.198998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:11:21.236296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:21.250784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:21.252388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:21.252966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:21.316824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:11:21.341664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:11:21.375149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:11:21.385477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:11:21.540415 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb9a199d-f5a4-4f68-96d6-7b548675c88b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.308800 Jul 18 13:11:21.549035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1663/3204] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:11:21.579654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:21.631153 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8838241a-76e8-4ea9-9728-36497da82392 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 2.225598 Jul 18 13:11:21.633071 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1542/3205] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:19 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:21.677513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:21.684158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:21.723952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:21.725475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:21.729743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:21.735035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:22.079946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a27ebed5-955b-4259-bede-02d80744c100 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96e99be700>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:22.366000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a27ebed5-955b-4259-bede-02d80744c100 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb" status: 200 len: 371 microversion: 2.1 time: 0.814036 Jul 18 13:11:22.374274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1664/3206] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:11:21 2022] GET /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb => generated 371 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:22.400952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7596f0a2-8f3a-4b6a-a05e-845be9010be7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:22.402212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7596f0a2-8f3a-4b6a-a05e-845be9010be7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:22.412071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:22.582094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7596f0a2-8f3a-4b6a-a05e-845be9010be7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:22.615903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7596f0a2-8f3a-4b6a-a05e-845be9010be7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1214 microversion: 2.1 time: 0.239266 Jul 18 13:11:22.621474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1665/3207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:22 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:22.636264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Action: 'update', calling method: .version_select at 0x7f96e99898b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:22.935013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:22.943732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:22.955615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:22.961602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:23.264965 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ecf33537-f401-4d0b-9dba-19fd61fc8a3e tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb" status: 200 len: 328 microversion: 2.1 time: 0.641005 Jul 18 13:11:23.268947 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1666/3208] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 13:11:22 2022] PUT /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb => generated 328 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:23.276029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:23.277079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:23.314834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:23.320354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:23.325734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:23.327681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:23.521013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:23.562532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a377523-bdd3-41a3-9b34-425427123fa4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 1.914610 Jul 18 13:11:23.563766 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1543/3209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:21 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:23.593187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa9d3b8e-ecba-4222-8058-36d0fccbcac2 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:23.636965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:23.645175 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa9d3b8e-ecba-4222-8058-36d0fccbcac2 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb" status: 202 len: 0 microversion: 2.1 time: 0.068151 Jul 18 13:11:23.653015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1544/3210] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:11:23 2022] DELETE /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:11:23.944076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-53ecdc90-83c2-4090-97bf-0ea15b95e3ca req-f3273997-99c3-408e-9bca-f8919387ef84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cab126c-3f1e-415d-bf7d-1d106cb34bbe", "tag": "02590902-2d3d-4bcb-9349-2e19ac73f4ee"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:24.009356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-53ecdc90-83c2-4090-97bf-0ea15b95e3ca req-f3273997-99c3-408e-9bca-f8919387ef84 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:24.015942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-53ecdc90-83c2-4090-97bf-0ea15b95e3ca req-f3273997-99c3-408e-9bca-f8919387ef84 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:24.077749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-53ecdc90-83c2-4090-97bf-0ea15b95e3ca req-f3273997-99c3-408e-9bca-f8919387ef84 service nova] Creating event network-changed:02590902-2d3d-4bcb-9349-2e19ac73f4ee for instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe on n-h2-850003-3 Jul 18 13:11:24.104328 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-53ecdc90-83c2-4090-97bf-0ea15b95e3ca req-f3273997-99c3-408e-9bca-f8919387ef84 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448005 Jul 18 13:11:24.106329 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1545/3211] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:24.118773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:24.121049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:24.131176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:24.132203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:24.133454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:24.134416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:24.257252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:24.295692 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4b0cf5f6-9a1d-417d-98e9-c2265de2c3a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 1.003787 Jul 18 13:11:24.298447 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1667/3212] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:23 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:24.327382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5282d91-647a-4ac8-8a79-c748092512c1 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96e5266670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:24.651489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5282d91-647a-4ac8-8a79-c748092512c1 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb" status: 200 len: 371 microversion: 2.1 time: 0.348419 Jul 18 13:11:24.664280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1668/3213] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:11:24 2022] GET /compute/v2.1/os-quota-sets/cb722312f28c45ffbbc9186d83dff2bb => generated 371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:24.691770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:24.694169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:24.716626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:24.718109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:24.720554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:24.722176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:24.736514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:25.333330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:25.340095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:25.417734 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a61139b-c105-4a90-9eb6-f54c011249c3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1266 microversion: 2.1 time: 1.308176 Jul 18 13:11:25.425639 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1546/3214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:24 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1266 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:25.447939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c0be88be-c169-4697-b900-cdf338d057cf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96e4b6d8b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:26.189830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c0be88be-c169-4697-b900-cdf338d057cf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.759660 Jul 18 13:11:26.192632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1547/3215] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:11:25 2022] GET /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3/defaults => generated 371 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:26.211021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:26.212374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:26.249976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:26.253470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:26.255716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:26.259652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:26.702081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:26.737027 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-310fbe89-3748-4f0a-892e-791f8b644023 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 2.067913 Jul 18 13:11:26.738557 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1669/3216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:24 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:26.767586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:26.769163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:26.782828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:26.784026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:26.786041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:26.788432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:27.183315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:27.231446 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-237ab994-7ae3-4886-9095-bbcee69c4d53 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1272 microversion: 2.1 time: 0.477822 Jul 18 13:11:27.232586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1670/3217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:26 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1272 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:27.259253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3f8845d5-db07-4659-adb1-f4a939d014a8 req-6ab6255e-f940-430e-b7b4-92eab366bf38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21787a3c-9911-451e-bcae-c07aff3b5b9a", "name": "network-vif-plugged", "status": "completed", "tag": "dfb531cb-fbc8-4aa0-bdbf-482f29506871"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:27.294654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f8845d5-db07-4659-adb1-f4a939d014a8 req-6ab6255e-f940-430e-b7b4-92eab366bf38 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:27.307068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f8845d5-db07-4659-adb1-f4a939d014a8 req-6ab6255e-f940-430e-b7b4-92eab366bf38 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:27.353749 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3f8845d5-db07-4659-adb1-f4a939d014a8 req-6ab6255e-f940-430e-b7b4-92eab366bf38 service nova] Creating event network-vif-plugged:dfb531cb-fbc8-4aa0-bdbf-482f29506871 for instance 21787a3c-9911-451e-bcae-c07aff3b5b9a on n-h1-850003-3 Jul 18 13:11:27.367390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3f8845d5-db07-4659-adb1-f4a939d014a8 req-6ab6255e-f940-430e-b7b4-92eab366bf38 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130849 Jul 18 13:11:27.372133 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1671/3218] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:27.402604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4499f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:28.169146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.171203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.180024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.183351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.364963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df00cf54-28a3-41bf-8ee8-1b4cc8aa19fe tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991" status: 200 len: 328 microversion: 2.1 time: 0.985763 Jul 18 13:11:28.378103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1672/3219] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 13:11:27 2022] PUT /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991 => generated 328 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:28.391321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:28.394110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:28.409669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.411232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.413624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.414725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.563568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:28.625315 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92a419d7-052a-4b94-8091-426f3fee106a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 2.429299 Jul 18 13:11:28.642198 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1548/3220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:26 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:28.644028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:28.660284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:28.680595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.681972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.684092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:28.685262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:28.987671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:29.015724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4555b63c-0ea3-4a33-ac3d-4683a9c039af tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1272 microversion: 2.1 time: 0.384413 Jul 18 13:11:29.022587 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1549/3221] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:28 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:29.060867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96d7abf550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:29.337445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:29.338047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:29.350241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:29.352901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:29.457987 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8636dd78-a82a-4431-9ef4-78e923bf3aac tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991/detail" status: 200 len: 916 microversion: 2.1 time: 0.432534 Jul 18 13:11:29.459372 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1550/3222] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:11:29 2022] GET /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991/detail => generated 916 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:29.539939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f5dd36b-4292-408d-b497-086e4d15b0f0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Action: 'create', calling method: .version_select at 0x7f96e47264c0>, body: {"keypair": {"name": "tempest-keypair-514235463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSco9UvrCYUjHzLjTAlNDcTlIQaUvM/FubNeBOiI9i68H6IRt5G+Sabfm36vyUun3HHeFNCN6df/VTY7//y957aOCn6SNFSkrIvRNaxYxkBGbSDrqPmuccL9BTYGR3iRQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:29.543861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:29.585543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad7205ae-8265-4f73-9d40-3a4593bb4657 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 1.204447 Jul 18 13:11:29.596254 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1673/3223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:28 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:29.620337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2f5dd36b-4292-408d-b497-086e4d15b0f0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Getting quotas for project f9554635c7e94296bd6d3069eaf2e2fa. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:11:29.646185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2f5dd36b-4292-408d-b497-086e4d15b0f0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Getting quotas for user 67ff01c9115c4931812cb211af0e9515 and project f9554635c7e94296bd6d3069eaf2e2fa. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:11:29.775344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f5dd36b-4292-408d-b497-086e4d15b0f0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.246069 Jul 18 13:11:29.783797 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1551/3224] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 13:11:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 13:11:29.792933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:29.794469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:29.826575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:29.827337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:29.828841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:29.829635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:30.056072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:30.057653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:30.099211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:30.099963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:30.101480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:30.112334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:30.892116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:30.906938 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec86c2aa-ef26-43f6-8dcd-3a4d0173085c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1315 microversion: 2.1 time: 1.121423 Jul 18 13:11:30.907674 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1674/3225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:29 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:30.927141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4499af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:31.164362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.174702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.176684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.178541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.259731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:31.317088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b6b0d86f-b2fe-46aa-98c6-87cd32f9f12f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 1.259832 Jul 18 13:11:31.321990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1552/3226] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:30 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:31.360791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c67d712f-4dbf-49e8-998d-2257da6425d7 req-6bd4f1b3-6cd6-478e-ad03-dfc1c38dcf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf0feda-7b55-4304-998b-2b0c22b96e7a", "tag": "67610709-0332-4c04-997d-1cebab98c7f3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:31.400857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c67d712f-4dbf-49e8-998d-2257da6425d7 req-6bd4f1b3-6cd6-478e-ad03-dfc1c38dcf30 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.406771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c67d712f-4dbf-49e8-998d-2257da6425d7 req-6bd4f1b3-6cd6-478e-ad03-dfc1c38dcf30 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.408097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.409458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.413923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.420596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.470598 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c67d712f-4dbf-49e8-998d-2257da6425d7 req-6bd4f1b3-6cd6-478e-ad03-dfc1c38dcf30 service nova] Creating event network-changed:67610709-0332-4c04-997d-1cebab98c7f3 for instance caf0feda-7b55-4304-998b-2b0c22b96e7a on n-h2-850003-3 Jul 18 13:11:31.491534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c67d712f-4dbf-49e8-998d-2257da6425d7 req-6bd4f1b3-6cd6-478e-ad03-dfc1c38dcf30 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158172 Jul 18 13:11:31.495861 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1553/3227] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:31.540866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:31.545730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:31.576188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.577179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.582841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:31.584108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:31.729167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a482275a-0dfd-45aa-8771-22112f59b3f4 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991?user_id=33168c05ff684248bb8713ecf281fbd3" status: 200 len: 328 microversion: 2.1 time: 0.809815 Jul 18 13:11:31.733604 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1675/3228] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:11:30 2022] PUT /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991?user_id=33168c05ff684248bb8713ecf281fbd3 => generated 328 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:31.770520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-707473f2-51d8-4077-baae-8aac37e7dab5 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96e40855e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:32.037491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-707473f2-51d8-4077-baae-8aac37e7dab5 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991?user_id=33168c05ff684248bb8713ecf281fbd3" status: 200 len: 370 microversion: 2.1 time: 0.292928 Jul 18 13:11:32.050448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1676/3229] 10.222.0.88 () {58 vars in 1322 bytes} [Mon Jul 18 13:11:31 2022] GET /compute/v2.1/os-quota-sets/474089c9283b41e2a6947da34c7b7991?user_id=33168c05ff684248bb8713ecf281fbd3 => generated 370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:11:32.062631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:32.064753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:32.078612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:32.081163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:32.082997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:32.083934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:32.694882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:32.727699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:32.731262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b1d4a34-f286-4813-8291-c43e8e971072 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 1.221748 Jul 18 13:11:32.735421 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1554/3230] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:31 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:32.755882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:32.759023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:32.779806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac34e45e-f405-48e8-8f64-a0e28b5624e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1502 microversion: 2.1 time: 0.704830 Jul 18 13:11:32.785660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1677/3231] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:32 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1502 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:32.804147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:32.804944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:32.821224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:32.822273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:32.836344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e37352c1-b633-4cc0-9692-c6a6a12e1c11 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:32.871725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e37352c1-b633-4cc0-9692-c6a6a12e1c11 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:32.873454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e37352c1-b633-4cc0-9692-c6a6a12e1c11 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:33.005701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e37352c1-b633-4cc0-9692-c6a6a12e1c11 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:11:33.179660 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e37352c1-b633-4cc0-9692-c6a6a12e1c11 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.364153 Jul 18 13:11:33.198713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1678/3232] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:11:32 2022] POST /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:11:33.212425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df1988b1-9ff1-4c32-8b90-42cf9a1ae414 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Calling method '.version_select at 0x7f96e4c9df70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:33.656680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:33.666405 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc6dc0e7-789d-4b8c-bdf5-4fd122be9001 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 0.928770 Jul 18 13:11:33.667331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1555/3233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:32 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:33.673593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:33.674513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:33.683098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:33.683865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:33.685015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:33.685715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:33.894765 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df1988b1-9ff1-4c32-8b90-42cf9a1ae414 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.688313 Jul 18 13:11:33.897183 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1679/3234] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:11:33 2022] GET /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3/defaults => generated 371 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:33.910815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:33.913570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:33.935309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:33.936186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:33.937727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:33.938806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:34.252676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:34.267610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d79b312d-d234-4de1-a2ab-978f6c7f5954 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.597314 Jul 18 13:11:34.269184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1556/3235] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:33 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:34.284802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b8951f22-30d7-4876-870d-61d3d94e8341 req-3db40668-a359-4c5c-b741-041c1b688b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1a786c-31fc-49b4-8953-726d14fad26e", "tag": "9eaa9d78-ff87-45cc-afc7-5487e05134e4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:34.300243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b8951f22-30d7-4876-870d-61d3d94e8341 req-3db40668-a359-4c5c-b741-041c1b688b17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:34.301388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b8951f22-30d7-4876-870d-61d3d94e8341 req-3db40668-a359-4c5c-b741-041c1b688b17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:34.325898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b8951f22-30d7-4876-870d-61d3d94e8341 req-3db40668-a359-4c5c-b741-041c1b688b17 service nova] Creating event network-changed:9eaa9d78-ff87-45cc-afc7-5487e05134e4 for instance 1e1a786c-31fc-49b4-8953-726d14fad26e on n-h1-850003-3 Jul 18 13:11:34.337223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b8951f22-30d7-4876-870d-61d3d94e8341 req-3db40668-a359-4c5c-b741-041c1b688b17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065558 Jul 18 13:11:34.339051 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1557/3236] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:34.355037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Action: 'update', calling method: .version_select at 0x7f96e4889a60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:34.575422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:34.576777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:34.580311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:34.581883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:34.910015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:34.931131 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d32e723-4a59-42c8-a970-2ead625414f5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 1.030468 Jul 18 13:11:34.933718 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1680/3237] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:33 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:34.942708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:34.943889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:34.959072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:34.959976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:34.961229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:34.962096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:35.039961 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ab163d8-fe56-4cfc-a12e-f5d799da6817 tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3" status: 200 len: 329 microversion: 2.1 time: 0.698791 Jul 18 13:11:35.041197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1558/3238] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 18 13:11:34 2022] PUT /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3 => generated 329 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:35.060271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Action: 'update', calling method: .version_select at 0x7f96e469ddc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:35.278217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:35.279228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:35.284577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:35.286278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:35.572445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=78,nova_api:INSERT=18,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:36.172120 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b345c6f5-2b55-4057-b1e9-cc3e0f9e9aaf tempest-QuotasAdminTestJSON-1932135512 tempest-QuotasAdminTestJSON-1932135512-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3" status: 200 len: 329 microversion: 2.1 time: 1.120367 Jul 18 13:11:36.173124 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1559/3239] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 18 13:11:35 2022] PUT /compute/v2.1/os-quota-sets/731c6f1893fa4be894bd92a9c403e5e3 => generated 329 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:36.187753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:36.189175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:36.209772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:36.210434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:36.211684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:36.212275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:36.427605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:36.475896 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1475ef8-9e50-400b-a802-b1a568b73f81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 1.539699 Jul 18 13:11:36.476948 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1681/3240] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:34 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:36.486442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:36.493528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:36.518029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:36.519883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:36.521542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:36.523011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:36.544826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:36.566302 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a611b5ec-ad1f-431c-86b2-106c14c2470b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.390809 Jul 18 13:11:36.578428 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1560/3241] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:36 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:37.080064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:37.091796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:37.107215 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5265fd8-f829-436f-9ab2-77b00d414426 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.625905 Jul 18 13:11:37.108659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1682/3242] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:36 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:37.504890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:37.505511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:37.524594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:37.525048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:37.526439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:37.526891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:37.598866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:37.599798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:37.630400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:37.631063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:37.632204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:37.642857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:38.024310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:38.044726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19b63905-9b1c-4efa-aeaa-73aa9f41ac41 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 0.543834 Jul 18 13:11:38.061338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1561/3243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:37 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:38.141512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:38.146091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:38.200142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:38.200981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:38.202535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:38.203348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:38.310697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:38.322459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4cdc053e-39a4-4f62-a8e7-42b2ab33a640 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.728614 Jul 18 13:11:38.323994 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1683/3244] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:37 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:38.389698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1322216455", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ad4090bf-fd12-4605-bb41-8c371c0349c4"}, {"port": "bc1a8ecc-ef83-425e-a737-4418cb999916", "tag": "port-1"}, {"port": "c95f6557-6819-48b1-8ad3-47bdaf47eaac", "tag": "port-2"}, {"uuid": "4c6a1f35-7b13-44dd-8bc3-1a1e5b7f8df9", "tag": "net-1"}, {"uuid": "4c6a1f35-7b13-44dd-8bc3-1a1e5b7f8df9"}, {"uuid": "67f30ce9-ab2f-4319-b1eb-584ae24a3879", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "67f30ce9-ab2f-4319-b1eb-584ae24a3879", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1d2e563d-2e8c-4304-b2a9-eb0289a3059c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b79b12f9-a281-4951-8b00-ddae9006379f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "922c3233-8885-4ab3-b51f-46f1baadd043", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--905609510"}], "key_name": "tempest-keypair-514235463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:38.755986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] validate_networks() for [('ad4090bf-fd12-4605-bb41-8c371c0349c4', None, None, None, None, None), (None, None, 'bc1a8ecc-ef83-425e-a737-4418cb999916', None, None, None), (None, None, 'c95f6557-6819-48b1-8ad3-47bdaf47eaac', None, None, None), ('4c6a1f35-7b13-44dd-8bc3-1a1e5b7f8df9', None, None, None, None, None), ('4c6a1f35-7b13-44dd-8bc3-1a1e5b7f8df9', None, None, None, None, None), ('67f30ce9-ab2f-4319-b1eb-584ae24a3879', '10.2.2.100', None, None, None, None), ('67f30ce9-ab2f-4319-b1eb-584ae24a3879', '10.2.2.200', None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:11:39.062807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:39.080626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e1bdd82f-6a64-4138-9545-2903ef3e8bb8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.955453 Jul 18 13:11:39.084857 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1562/3245] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:38 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:39.094483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:39.098675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:39.115373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:39.116218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:39.118025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:39.123369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:39.712486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:39.752160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-007c6f29-06c8-4ca8-b2cf-d2d4d1f346a4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 0.665349 Jul 18 13:11:39.754928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1563/3246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:39 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:39.770839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:39.772572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:39.811828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:39.817455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:39.825459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:39.826646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:40.407911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:40.450073 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c45fa20-6372-489e-b34a-a29a1a5e7e31 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.690857 Jul 18 13:11:40.463861 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1564/3247] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:39 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:40.477100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:40.479025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:40.500228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:40.502691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:40.505655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:40.507825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:41.125239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:41.142206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-daeceb0d-5f52-4e8a-8142-716036662592 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.675292 Jul 18 13:11:41.144223 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1565/3248] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:40 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:41.160589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:41.161823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:41.190066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:41.191220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:41.192832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:41.198360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:41.473617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:41.494053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=13 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:41.498662 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-21406a9b-4a42-48bc-976a-7856a6d9de73 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 0.351167 Jul 18 13:11:41.519191 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1566/3249] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:41 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:41.537579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:41.541335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:41.570783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:41.572014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:41.573692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:41.578489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:42.031543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=50 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:42.180588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:42.206971 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bd7c77f-17a7-4f3f-b96d-13a8d999e116 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.685516 Jul 18 13:11:42.208056 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1567/3250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:41 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:42.224538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:42.225204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:42.258722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:42.259274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:42.260128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:42.260569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:42.737128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:42.741604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:42.767019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de22d57b-af63-467a-8d55-2603d6b83eba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.551733 Jul 18 13:11:42.768482 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1568/3251] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:42 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:42.786596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:42.787989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:42.816625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:42.817689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:42.818818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:42.819929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:43.768929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:43.784478 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cdd31571-0aa2-4f61-a281-1e5383383763 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 1.010747 Jul 18 13:11:43.799657 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1569/3252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:42 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:43.815962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d5fcd1a1-9016-4caf-80fd-8288cdcf467b req-95e1c962-81ea-4c26-b0a3-e048e565fe0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a786c-31fc-49b4-8953-726d14fad26e", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa9d78-ff87-45cc-afc7-5487e05134e4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:43.844539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d5fcd1a1-9016-4caf-80fd-8288cdcf467b req-95e1c962-81ea-4c26-b0a3-e048e565fe0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:43.846055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d5fcd1a1-9016-4caf-80fd-8288cdcf467b req-95e1c962-81ea-4c26-b0a3-e048e565fe0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:43.891428 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d5fcd1a1-9016-4caf-80fd-8288cdcf467b req-95e1c962-81ea-4c26-b0a3-e048e565fe0a service nova] Creating event network-vif-plugged:9eaa9d78-ff87-45cc-afc7-5487e05134e4 for instance 1e1a786c-31fc-49b4-8953-726d14fad26e on n-h1-850003-3 Jul 18 13:11:43.916034 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d5fcd1a1-9016-4caf-80fd-8288cdcf467b req-95e1c962-81ea-4c26-b0a3-e048e565fe0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114047 Jul 18 13:11:43.918916 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1570/3253] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:43.940695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:43.948112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:43.966059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:43.967485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:43.970998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:43.973200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:44.590939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:44.617807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b778732d-b95d-4cdc-a2a3-4de2122febeb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.691358 Jul 18 13:11:44.625800 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1571/3254] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:43 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:44.650039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:44.652109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:44.683212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:44.683974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:44.686106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:44.687188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:45.349878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:45.451487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:45.477001 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a7bcabb-27dc-4e91-8c74-1a91929dc8fc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.848522 Jul 18 13:11:45.496471 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1572/3255] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:44 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:45.522316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:45.523488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:45.551739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:45.554010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:45.555806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:45.557383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:45.772751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:11:45.773841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:11:45.775090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:11:45.776444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:11:45.778187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:11:45.799343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:45.800726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:45.803999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:45.806875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:45.853472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Getting quotas for project f9554635c7e94296bd6d3069eaf2e2fa. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:11:45.865833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:45.869539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Getting quotas for user 67ff01c9115c4931812cb211af0e9515 and project f9554635c7e94296bd6d3069eaf2e2fa. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:11:46.119871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:46.140305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=74 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:46.169808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3368e9a8-2a1f-4b47-8970-63e2be0f714c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1314 microversion: 2.1 time: 0.671316 Jul 18 13:11:46.172031 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1573/3256] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:45 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:46.195639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:46.199697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:46.229160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.230906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.239768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.241054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.379175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:11:46.382342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1d2e563d-2e8c-4304-b2a9-eb0289a3059c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b79b12f9-a281-4951-8b00-ddae9006379f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='922c3233-8885-4ab3-b51f-46f1baadd043',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:11:46.627590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:46.645378 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d90e0bf9-25f1-456a-b012-d90bf38c27f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.457401 Jul 18 13:11:46.646950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1574/3257] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:46 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:46.881017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:46.883075 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:46.883075 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:11:46.885036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.885960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.887081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.887588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.912574 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c240854c-56fc-46f9-b790-a27b231c4c0d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.530465 Jul 18 13:11:46.915891 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1684/3258] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 18 13:11:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 8535 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 13:11:46.943921 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fff33589-38ff-4de9-a596-43bf948f349a tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.295353 Jul 18 13:11:46.944616 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1575/3259] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:11:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:46.946521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ac765e5a-5bec-4306-aade-cd6f143be800 req-256c598d-f0d7-4a9c-a395-e742cf505c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf0feda-7b55-4304-998b-2b0c22b96e7a", "name": "network-vif-plugged", "status": "completed", "tag": "67610709-0332-4c04-997d-1cebab98c7f3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:46.950204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:46.951055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:46.959116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.959680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ac765e5a-5bec-4306-aade-cd6f143be800 req-256c598d-f0d7-4a9c-a395-e742cf505c4b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.960112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.960254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ac765e5a-5bec-4306-aade-cd6f143be800 req-256c598d-f0d7-4a9c-a395-e742cf505c4b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.961324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:46.962109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:46.977333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ac765e5a-5bec-4306-aade-cd6f143be800 req-256c598d-f0d7-4a9c-a395-e742cf505c4b service nova] Creating event network-vif-plugged:67610709-0332-4c04-997d-1cebab98c7f3 for instance caf0feda-7b55-4304-998b-2b0c22b96e7a on n-h2-850003-3 Jul 18 13:11:46.985555 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ac765e5a-5bec-4306-aade-cd6f143be800 req-256c598d-f0d7-4a9c-a395-e742cf505c4b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067362 Jul 18 13:11:46.988811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1685/3260] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:47.012298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:47.013679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:47.105739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:47.123444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:47.128257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:47.130985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd89e994-2dbb-44a2-8448-4cc919c7ba5a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1285 microversion: 2.32 time: 0.139684 Jul 18 13:11:47.133622 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1686/3261] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:46 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:47.145754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:47.149250 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:47.149250 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:11:47.152481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.153677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.161430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.161430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.220451 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e9a032e-c524-4b22-805d-114d24884f2f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082991 Jul 18 13:11:47.222374 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1687/3262] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 13:11:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:47.239529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:47.241103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:47.254380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.255450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.257543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.259158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.561724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:47.581710 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26252908-56c3-4825-8dce-d1af4fb2b4ca tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1500 microversion: 2.1 time: 0.357138 Jul 18 13:11:47.600878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:47.609317 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1688/3263] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:47 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:47.619549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:47.619832 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85c96ff7-eda9-48cb-a43d-b6188d5e3e57 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.673218 Jul 18 13:11:47.621099 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1576/3264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:46 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:47.627166 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:47.627166 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:11:47.631721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:47.632368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.633237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:47.635311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.637849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.641431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.660760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.662699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.668076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.669422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.712250 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e0c3a9b-352b-4931-8806-a8d76ed0320f tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.100290 Jul 18 13:11:47.713163 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1689/3265] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:11:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:47.731099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:47.733227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'flavor' on Instance uuid 1e1a786c-31fc-49b4-8953-726d14fad26e {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:11:47.738039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:47.749150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.749979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:47.751435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:47.752186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.120243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:48.145471 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-662f363b-54c5-47d6-ba5f-542877507c7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.429747 Jul 18 13:11:48.147055 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1690/3266] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:47 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:48.167517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:48.171068 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:48.171068 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:11:48.174437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.175869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.177883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.179454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.233493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0edcada0-05c0-433e-a5b9-b99500b51641 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-850003-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.081929 Jul 18 13:11:48.237019 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1691/3267] 10.222.0.88 () {58 vars in 1193 bytes} [Mon Jul 18 13:11:48 2022] GET /compute/v2.1/os-services?host=n-d-850003-3&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:11:48.257148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:48.259058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:48.407279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:48.444971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:48.449031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:48.452125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-619ff1c4-6dd9-49b4-b2b8-baf36b341242 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1285 microversion: 2.32 time: 0.211130 Jul 18 13:11:48.467477 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1692/3268] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:48 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:48.488196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:48.505800 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:48.505800 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:11:48.507468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76e86e7a-3d44-461b-9f9c-d82e6b63eadd tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e/action" status: 202 len: 0 microversion: 2.1 time: 0.870165 Jul 18 13:11:48.508800 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1577/3269] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:11:47 2022] POST /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:11:48.516384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.518581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.527108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.529133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.555585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:48.560751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:48.607475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.608670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.619183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.620159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.653581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a2b7a4f-ad71-4507-8321-768efabd801d tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.183982 Jul 18 13:11:48.663506 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1693/3270] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:11:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:48.670369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:48.671410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:48.684475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.685590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:48.686938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:48.688284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.021612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.043403 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be109124-cb97-40b8-99e8-7089b9e13460 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 0.524632 Jul 18 13:11:49.044941 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1578/3271] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:48 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:49.057732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:49.061800 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:49.061800 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:11:49.066093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.067341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.069373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.070683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.135049 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-441ae00d-a019-4408-a9b2-ebd0f90a4bc2 tempest-ServicesAdminNegativeTestJSON-1748674028 tempest-ServicesAdminNegativeTestJSON-1748674028-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.088009 Jul 18 13:11:49.136588 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1579/3272] 10.222.0.88 () {58 vars in 1197 bytes} [Mon Jul 18 13:11:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:11:49.294677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.314999 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0438d0a9-579f-484b-9b6e-1b0686a09c7f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1308 microversion: 2.1 time: 0.649058 Jul 18 13:11:49.316498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1694/3273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:48 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:49.337783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:49.340012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:49.361633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.363047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.368521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.369949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.480944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6913d2b-837a-4323-831c-b95d22f5e8bc tempest-ServicesAdminNegativeTestJSON-290763256 tempest-ServicesAdminNegativeTestJSON-290763256-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:49.484187 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:11:49.484187 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:11:49.488445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6913d2b-837a-4323-831c-b95d22f5e8bc tempest-ServicesAdminNegativeTestJSON-290763256 tempest-ServicesAdminNegativeTestJSON-290763256-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'df06d8a9963b4abcaed5a622552e77ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a608e4dc3fee411b8cc907728db8f2c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6913d2b-837a-4323-831c-b95d22f5e8bc tempest-ServicesAdminNegativeTestJSON-290763256 tempest-ServicesAdminNegativeTestJSON-290763256-project] Request method failure captured: Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VwPF7vrkhpVjKOUlol2LLi23JZltnUdi9xh07CZMwo0KHk_t4vBUtenfs8XuaANziKJ4GOm_GaxVmNT5a7Q1FJkNQ_JEaKTUxSKkX1gD7nJf8KPGuEcSxnF8Fv_CQIAInFnyCBNUTcvQjTl4PifUnHK4NPEBKUVq_oJPZ0YbFfZrrQ Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a608e4dc3fee411b8cc907728db8f2c3 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-290763256 Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:11:49.493725 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a608e4dc3fee411b8cc907728db8f2c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a608e4dc3fee411b8cc907728db8f2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a608e4dc3fee411b8cc907728db8f2c3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a608e4dc3fee411b8cc907728db8f2c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-290763256 Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a608e4dc3fee411b8cc907728db8f2c3 Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-290763256 Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServicesAdminNegativeTestJSON-290763256-project Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: df06d8a9963b4abcaed5a622552e77ba Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-290763256-project Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 13:11:49.496849 n-d-850003-3 devstack@n-api.service[131367]: action_args: {} Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 13:11:49.500052 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 13:11:49.504397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:11:49.510370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6913d2b-837a-4323-831c-b95d22f5e8bc tempest-ServicesAdminNegativeTestJSON-290763256 tempest-ServicesAdminNegativeTestJSON-290763256-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:11:49.512372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6913d2b-837a-4323-831c-b95d22f5e8bc tempest-ServicesAdminNegativeTestJSON-290763256 tempest-ServicesAdminNegativeTestJSON-290763256-project] 10.222.0.88 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.362815 Jul 18 13:11:49.514207 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1580/3274] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:11:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 366 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:11:49.529929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:49.531234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:49.550513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.551663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.554860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:49.556407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:49.853031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.875579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.880216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:49.883185 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f78f99b9-3a57-4879-ba9c-cfa232a90d24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1575 microversion: 2.32 time: 0.366667 Jul 18 13:11:49.884486 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1581/3275] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:49 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1575 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:50.097542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:50.100243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:50.123669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.124310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:50.125836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.126701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:50.234090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:50.254894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-471b38d0-e503-4480-b7c4-1ccc93cecc66 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.936203 Jul 18 13:11:50.256256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1695/3276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:49 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:50.349576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:50.351859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:50.405270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.406875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:50.408739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.409938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:50.506933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:50.528702 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f8aac33-6fdf-40ab-a345-1015da23f120 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 0.454731 Jul 18 13:11:50.549130 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1582/3277] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:50 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:50.901363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:50.915648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:50.916521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:50.935734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=12,nova_api:INSERT=11 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:50.938819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5eabedcc-2466-4012-b492-d199b3010a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1489 microversion: 2.1 time: 0.598964 Jul 18 13:11:50.940167 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1696/3278] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:50 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1489 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:50.947723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.950577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:50.952980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:50.954233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:51.192003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-709291493", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:11:51.198419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:51.227775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:51.232155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:51.236158 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b72e5bad-9fce-43c4-a448-ea8aab3972d5 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1593 microversion: 2.32 time: 0.323502 Jul 18 13:11:51.238251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1583/3279] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:50 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1593 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:11:51.296737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:51.301394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:51.317006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:51.317838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:51.319344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:51.331362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:51.378049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:11:51.989424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:52.022247 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba71595d-e4e3-42c1-8c1b-a058dffb7f02 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 0.742383 Jul 18 13:11:52.028862 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1584/3280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:51 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:11:52.046659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:52.048554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:52.078886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:52.079626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:52.085263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:52.086107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.168430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:11:53.169267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:11:53.170106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:11:53.170884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:11:53.171608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:11:53.209175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.209943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.212441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.213206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.284058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:11:53.294514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:11:53.320976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:53.334641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:11:53.335355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a70a817-4ac4-4f67-9895-c9b77cfb2baf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 1.304084 Jul 18 13:11:53.348453 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1585/3281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:52 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:53.351902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:11:53.379008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:53.392530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:53.466783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.507422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.518519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.521949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.642556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:53.688673 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91266a4a-0e1c-4908-8120-e533a9b1e38c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.505799 Jul 18 13:11:53.690956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1697/3282] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:11:53.702911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:53.721643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:53.793502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.794742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:53.796905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:53.799469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:54.142408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:54.185680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:54.207419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:54.209630 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f48260d-fac9-4495-ae4c-e01004a9d78d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1660 microversion: 2.32 time: 0.859061 Jul 18 13:11:54.233514 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1586/3283] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:53 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1660 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:54.255187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30f618d8-4bd3-413a-909e-06a23eb9ebfc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:54.256471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30f618d8-4bd3-413a-909e-06a23eb9ebfc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:54.528196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30f618d8-4bd3-413a-909e-06a23eb9ebfc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:54.555976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30f618d8-4bd3-413a-909e-06a23eb9ebfc tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1208 microversion: 2.1 time: 0.319735 Jul 18 13:11:54.558104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1587/3284] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:54 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1208 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:54.579893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:54.582204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:54.598387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:54.599327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:54.603799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:54.604864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:54.748673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:54.800894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45f458ea-f4b5-4cf9-9d45-6917d663e6fe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 1.106306 Jul 18 13:11:54.809299 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1698/3285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:53 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:55.073139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:55.098904 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d595892d-ce33-4692-9f1a-46b7f8ff5a82 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 0.536995 Jul 18 13:11:55.099949 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1588/3286] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:54 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:55.269610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:55.275188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:55.300856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:55.305892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:55.309880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:55.313398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:55.622535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:55.623911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:55.655685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:55.657212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:55.668289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:55.670946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:55.911713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:55.950085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eab4ba9b-e17d-4b59-8f23-56d59a60b2eb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1260 microversion: 2.1 time: 0.362184 Jul 18 13:11:55.974939 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1589/3287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:55 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1260 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:55.995202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:55.998006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:56.020307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:56.023276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:56.024384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:56.030954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:56.108099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:56.155158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:56.167155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:56.174206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c2e3822-1acb-45d7-88fc-78739b492dca tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1660 microversion: 2.32 time: 0.907284 Jul 18 13:11:56.178923 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1699/3288] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:55 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1660 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:56.202897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:56.204704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:56.233399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:56.243992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:56.262135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:56.262135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:57.008571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:57.035805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aebf777c-3b2d-4dba-bcca-bc4e46546d67 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1512 microversion: 2.1 time: 1.058484 Jul 18 13:11:57.042100 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1590/3289] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:55 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1512 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:57.060500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:57.062730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:57.106541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:57.107922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:57.110379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:57.120409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:57.437146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:57.475843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e39dc64-d936-4a47-b2d8-717f13ab543a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1266 microversion: 2.1 time: 0.421254 Jul 18 13:11:57.477494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1591/3290] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:57 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1266 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:57.500620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:57.503515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:57.535106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:57.536282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:57.543998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:57.545715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:58.293873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:58.316450 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1c2901b-c411-48e1-8232-91dbd12267b3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 2.135197 Jul 18 13:11:58.330817 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1700/3291] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:56 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:11:58.884274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Calling method '.version_select at 0x7f96e45d9040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:58.927000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:58.938684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:58.939813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:58.940494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:59.046805 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c38d7f1-5d83-4927-9198-df5b1af18b24 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] 10.222.0.88 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.713494 Jul 18 13:11:59.065970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1701/3292] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jul 18 13:11:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:11:59.088053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:59.089404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:11:59.107122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:59.140040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:59.149042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:59.151084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:59.157738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:59.306921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:59.334922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:59.340788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:59.346089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37460cdb-e898-4dfb-9121-fd73fc937c92 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1660 microversion: 2.32 time: 1.862354 Jul 18 13:11:59.358413 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1592/3293] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:11:57 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1660 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:11:59.366203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:11:59.366203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:11:59.384152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:59.385157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:59.387237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:11:59.388516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:11:59.928788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:11:59.973886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4cba2c7d-6332-40cb-9daf-8586f47254b7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1489 microversion: 2.1 time: 0.905345 Jul 18 13:11:59.978573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1702/3294] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:59 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1489 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:00.003296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-842562955", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:00.267512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:12:00.457462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:00.502859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d74e18a2-5870-4e51-a2bf-3359dec9d3d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 1.142073 Jul 18 13:12:00.510175 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1593/3295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:11:59 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:00.528989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:00.536696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:00.551509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:00.555236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:00.574941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:00.576679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:01.796024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:01.862474 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-01829f86-66fd-4ebb-b944-4f7601df94f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 1.317341 Jul 18 13:12:01.870517 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1594/3296] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:00 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:01.905233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:01.919903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:02.006687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.016868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:02.030640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.032311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:02.261080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Getting quotas for project 9ba7d935ee1842a5b09a7ec89a82a6f7. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:12:02.276223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f55d01d7-ff2d-4099-a77f-5e5d6b19bc89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 200 len: 173 microversion: 2.1 time: 0.402816 Jul 18 13:12:02.285969 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1595/3297] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:12:01 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 173 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:02.287655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Getting quotas for user ca643d993d124931ace4845debe2b125 and project 9ba7d935ee1842a5b09a7ec89a82a6f7. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:12:02.305803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:02.308886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:02.341310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.342049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:02.346596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.350904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:02.353746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Request method failure captured: Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 1751 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VwdJm9Sg_QDNWyaC2DSu_B_KIkBM34rdTPXJ5h3o-LZCKxeZSq-HlwgzIDXLrMjyoiAi4QVEtAkQ-WC9dHYoS1p8TWYJ3RT_6uAB8jx-do2Cqq22Yb6yCq6FEzsBlKzEzlz3kN3D2RVWk760y1ceguP-s8JLS8eja7KXm11kZdz4_I Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9ba7d935ee1842a5b09a7ec89a82a6f7 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-500026059 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9ba7d935ee1842a5b09a7ec89a82a6f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9ba7d935ee1842a5b09a7ec89a82a6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9ba7d935ee1842a5b09a7ec89a82a6f7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9ba7d935ee1842a5b09a7ec89a82a6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-500026059 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9ba7d935ee1842a5b09a7ec89a82a6f7 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-500026059 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-500026059-project Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ca643d993d124931ace4845debe2b125 Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-500026059-project Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-842562955", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:12:02.365643 n-d-850003-3 devstack@n-api.service[131366]: exception: Maximum number of metadata items exceeds 128 Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-842562955', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:12:02.368838 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 18 13:12:02.375208 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:12:02.382073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:12:02.382073 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8f34c9d-75d1-4a55-93b7-85bddbdc5389 tempest-AbsoluteLimitsNegativeTestJSON-500026059 tempest-AbsoluteLimitsNegativeTestJSON-500026059-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.399932 Jul 18 13:12:02.385409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1703/3298] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 18 13:11:59 2022] POST /compute/v2.1/servers => generated 87 bytes in 2406 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:12:02.431908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:02.433729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:02.461852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.465751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:02.472000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:02.475668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:03.058046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:03.122705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:03.141582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:03.144575 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49913e2d-046f-4c80-9f0c-009c161d7b83 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1706 microversion: 2.32 time: 0.856118 Jul 18 13:12:03.145936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1596/3299] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:02 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1706 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:03.164493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:03.165699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:03.175144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:03.206554 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b65b390c-b692-43fb-8248-8212690dd5cb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 0.818779 Jul 18 13:12:03.209498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:03.214393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:03.214864 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1704/3300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:02 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:03.216818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:03.226208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:03.242318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:03.248014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:03.286181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:03.291409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:03.293718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:03.298779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:04.548406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:04.930697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:04.964933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aadf823b-45dd-47e2-adf6-c19f933bfcd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.816645 Jul 18 13:12:04.967928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1597/3301] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:03 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:04.985960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:04.992016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:05.022811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:05.027799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:05.041074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:05.042376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:05.251683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:05.298254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38fee283-8f9e-46e5-b687-4f3770d388de tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 2.073856 Jul 18 13:12:05.299772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1705/3302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:03 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:05.358135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:05.361013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:05.415025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:05.422225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:05.424033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:05.426944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:06.137387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:06.200871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:06.204379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:06.206841 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0021969-ad30-4d01-81f5-d3b0a28449ce tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1752 microversion: 2.32 time: 1.234921 Jul 18 13:12:06.228436 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1598/3303] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:04 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1752 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:06.240241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:06.242639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:06.255115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:06.256282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:06.258121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:06.259223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:06.676815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:06.715303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d3e819d-7b57-4056-8b3a-18f3e1caf0b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 1.376131 Jul 18 13:12:06.717807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1706/3304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:05 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:06.742566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:06.744434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:06.764322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:06.768942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:06.772650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:06.781987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.004014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:08.025488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cfb73f4c-08eb-40ad-9179-ea801452c517 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.795090 Jul 18 13:12:08.028063 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1599/3305] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:06 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:08.045677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:08.052115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:08.079741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:08.080662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.081955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:08.083649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.157267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:08.180936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:08.188967 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-48ccf252-b762-461e-8c00-c6fb68f8bb5d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 1.464038 Jul 18 13:12:08.206189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1707/3306] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:06 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:08.216192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-46765979-4ca0-4b18-b589-9898ae626e4c req-32026625-6517-4772-8208-ad64e1fad9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1ad742-1f92-4ba5-a85a-820555bfe979", "tag": "441d6bf6-fac9-44a2-872f-78e1a2c9355e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:08.244901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46765979-4ca0-4b18-b589-9898ae626e4c req-32026625-6517-4772-8208-ad64e1fad9df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:08.248174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46765979-4ca0-4b18-b589-9898ae626e4c req-32026625-6517-4772-8208-ad64e1fad9df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.288341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-46765979-4ca0-4b18-b589-9898ae626e4c req-32026625-6517-4772-8208-ad64e1fad9df service nova] Creating event network-changed:441d6bf6-fac9-44a2-872f-78e1a2c9355e for instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 on n-h2-850003-3 Jul 18 13:12:08.313526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-46765979-4ca0-4b18-b589-9898ae626e4c req-32026625-6517-4772-8208-ad64e1fad9df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111597 Jul 18 13:12:08.320316 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1708/3307] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:08.338912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:08.340514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:08.364976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:08.366621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.367791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:08.368554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:08.985861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:09.434878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:09.475653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:09.482084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:09.489350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-979cab4b-8a72-4bda-850c-a097c0b21855 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1752 microversion: 2.32 time: 1.456167 Jul 18 13:12:09.499764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1600/3308] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:08 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1752 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:09.521191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:09.524172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:09.550648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:09.563304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:09.565055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:09.566079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:09.665149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:09.693356 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2975c373-38ff-4b71-841c-3202ea995a06 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 1.370049 Jul 18 13:12:09.699896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1709/3309] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:08 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:09.735424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:09.740130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:09.764217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:09.765604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:09.775498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:09.776336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:11.079397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:11.103951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c62989b9-3667-4f54-8993-1cc0df4669ad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.600700 Jul 18 13:12:11.126008 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1601/3310] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:09 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:11.129082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:11.132210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:11.145166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:11.146226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:11.147849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:11.148831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:11.448273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:11.471128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8ec82c9-97c2-4059-9494-b542c152c6a7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 1.758794 Jul 18 13:12:11.486185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1710/3311] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:09 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:11.486185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:11.486926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:11.505893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:11.518668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:11.519942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:11.534850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:11.536246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:12.149520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:12.209441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:12.212673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:12.214127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5df25bdf-a77e-49d3-aa8f-16e37738e349 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1798 microversion: 2.32 time: 1.099664 Jul 18 13:12:12.234294 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1602/3312] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:11 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1798 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:12.234294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:12.234294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:12.235315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:12.235509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:12.235509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:12.235509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:12.235509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:12.244477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40126ce7-d8f2-49ed-b7d8-8e3e8125d60f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 0.771085 Jul 18 13:12:12.266929 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1711/3313] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:11 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:12.511025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:12.514811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:12.521175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=22 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:12.546927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:12.547645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:12.550005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:12.550825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:13.039112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:13.102580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36a5f920-2596-4a97-98b4-02a1b09d0e46 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.869701 Jul 18 13:12:13.111270 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1603/3314] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:12 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:13.147265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-787f96fc-2ef8-4aca-b6eb-0b02ca3cfd40 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Action: 'create', calling method: .version_select at 0x7f96e41d3a60>, body: {"keypair": {"name": "tempest-keypair-2027042077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+r2NSDLelUBGqXNrpmynoSd+7PO7b6XA432XxI9DSKRPfeEPkcGkl5wXZ/R6wahiFSapk/X7N/KKbYcHl4+nQJH/f/65piqePUBIrvDf6t/I89YpNRN8M9G1Ri8RtX3w=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:13.209928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-787f96fc-2ef8-4aca-b6eb-0b02ca3cfd40 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Getting quotas for project 29b2c2c435e344ce916120d2372fde2a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:12:13.230198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-787f96fc-2ef8-4aca-b6eb-0b02ca3cfd40 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Getting quotas for user fa4ecc5b14c041808dd284e49ba361d6 and project 29b2c2c435e344ce916120d2372fde2a. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:12:13.238692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:13.272663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd9989a2-951e-4006-a6af-9363f72efe7e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 0.772416 Jul 18 13:12:13.295197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1712/3315] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:12 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:13.319447 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-787f96fc-2ef8-4aca-b6eb-0b02ca3cfd40 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.202248 Jul 18 13:12:13.321375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:13.322723 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1604/3316] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 13:12:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 13:12:13.332405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:13.337951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:13.348408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:13.351403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:13.352303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:13.354359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:13.355626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:13.389590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:13.402014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:13.405405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:13.406883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:13.464278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:13.864933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:13.899443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:13.908668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:13.911767 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6c35becc-2ce6-4962-b4e7-302e4426d98c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1798 microversion: 2.32 time: 0.613788 Jul 18 13:12:13.919911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1713/3317] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:13 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1798 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:13.940077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1646350833", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "609839e4-f25f-4b03-a576-8c39127f230c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:14.142735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] validate_networks() for [('609839e4-f25f-4b03-a576-8c39127f230c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:12:14.581260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:14.597839 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3682956b-96ea-4236-bd17-c594de70d3bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 1.272396 Jul 18 13:12:14.620001 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1605/3318] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:13 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:14.628360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:14.629582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:14.659068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:14.664720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:14.668769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:14.677234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:15.429686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:15.469636 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce82cb20-731f-4e45-a9c6-eb47ffc9a07b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1506 microversion: 2.1 time: 0.843933 Jul 18 13:12:15.495395 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1606/3319] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:14 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1506 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:15.516850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:15.518019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:15.544846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:15.545608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:15.552363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:15.553393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:16.298625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:16.334114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:16.340918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:16.342320 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32959972-d482-4330-82ce-a775846debae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1844 microversion: 2.32 time: 0.845306 Jul 18 13:12:16.347236 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1607/3320] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:15 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1844 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:16.354525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:16.355149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:16.388709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:16.390361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:16.391891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:16.399813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:16.698625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:12:16.699416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:12:16.702418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:12:16.702617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:12:16.705666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:12:16.757562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:16.758442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:16.760050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:16.768054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:16.878027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:12:16.893769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:12:16.939536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:12:16.945368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:12:17.114645 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-303d9442-ec82-4e23-a716-84c68f4f354a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.191607 Jul 18 13:12:17.125598 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1714/3321] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:12:17.135120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:17.148323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:17.172799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:17.174499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:17.185782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:17.206998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:17.212134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:17.255490 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ca95abd-d06c-4d42-8a5f-c65a2fc54fc9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 0.906200 Jul 18 13:12:17.258375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1608/3322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:16 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:17.294028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8b4f07f-b5af-4af8-bdd3-8672b8228897 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:17.324114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c8b4f07f-b5af-4af8-bdd3-8672b8228897 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:18.126464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:18.141397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c270adc3-17d5-48ec-9682-23f444c0bc57 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1527 microversion: 2.1 time: 1.013488 Jul 18 13:12:18.165745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1715/3323] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:17 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1527 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:18.171577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:18.173081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:18.186259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:18.188344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:18.192984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:18.194140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:19.495383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c8b4f07f-b5af-4af8-bdd3-8672b8228897 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:19.528166 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8b4f07f-b5af-4af8-bdd3-8672b8228897 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1215 microversion: 2.1 time: 2.236674 Jul 18 13:12:19.530086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1609/3324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:17 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1215 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:19.545626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:19.551668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:19.589654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:19.591120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:19.597400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:19.598276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:19.600794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:19.641481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:19.646690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:19.649146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4c1de58-e240-40cf-99b0-9e40a0c2d59e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1844 microversion: 2.32 time: 1.481645 Jul 18 13:12:19.660591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1716/3325] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:18 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1844 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:19.709753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:19.719010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:19.748983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:19.761552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:19.766432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:19.771743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:21.274566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:21.290394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a05fc4d-b6b7-4143-aec2-469fede998b8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1527 microversion: 2.1 time: 1.626714 Jul 18 13:12:21.310801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1717/3326] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:19 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1527 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:21.321486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-470645dd-bd39-4c99-a399-721b422498c5 req-616bd8cb-cf12-47bb-972c-45817f79591b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "1971fd4f-36e3-45e1-9819-2469791698ad"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:21.353357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-470645dd-bd39-4c99-a399-721b422498c5 req-616bd8cb-cf12-47bb-972c-45817f79591b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:21.354118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-470645dd-bd39-4c99-a399-721b422498c5 req-616bd8cb-cf12-47bb-972c-45817f79591b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:21.393080 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-470645dd-bd39-4c99-a399-721b422498c5 req-616bd8cb-cf12-47bb-972c-45817f79591b service nova] Creating event network-changed:1971fd4f-36e3-45e1-9819-2469791698ad for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:12:21.419083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-470645dd-bd39-4c99-a399-721b422498c5 req-616bd8cb-cf12-47bb-972c-45817f79591b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101754 Jul 18 13:12:21.423175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1718/3327] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:21.439207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0a1a918-0848-48af-a59e-6c688ce456a4"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:21.465171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:21.488455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:21.489132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:21.491361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:21.491984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:22.576146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b80650c2-a3f4-4622-be35-933423a035ca tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "POST /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.149486 Jul 18 13:12:22.579864 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1719/3328] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:12:21 2022] POST /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments => generated 194 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:22.666907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:22.676769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:22.730846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:22.734184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:22.739621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:22.742982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:23.081412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:23.117301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43068324-c5fb-449c-9ee6-01218684893c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1273 microversion: 2.1 time: 0.535078 Jul 18 13:12:23.139173 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1720/3329] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:22 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1273 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:23.177605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:23.179594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:23.225382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:23.226462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:23.228191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:23.238749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.061392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:24.078872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:24.092420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:24.101173 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-89282ad0-088d-40d9-bc12-3caf66c9a41e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1844 microversion: 2.32 time: 0.959260 Jul 18 13:12:24.114804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1721/3330] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:23 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1844 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:24.123836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:24.131454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7a1d0215-93c7-4e5d-a77a-f1b45426d751 req-e5b599f5-54b9-46e3-86e2-0186ab1fe761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a786c-31fc-49b4-8953-726d14fad26e", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa9d78-ff87-45cc-afc7-5487e05134e4"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:24.151232 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d0963f4-66a5-429c-9aff-b2d5ebd73320 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 4.615805 Jul 18 13:12:24.156222 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1610/3331] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:19 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 4624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:24.169142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:24.173667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:24.192944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:24.203168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:24.203515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7a1d0215-93c7-4e5d-a77a-f1b45426d751 req-e5b599f5-54b9-46e3-86e2-0186ab1fe761 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:24.204832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.205417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7a1d0215-93c7-4e5d-a77a-f1b45426d751 req-e5b599f5-54b9-46e3-86e2-0186ab1fe761 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.215341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:24.221974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.240270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7a1d0215-93c7-4e5d-a77a-f1b45426d751 req-e5b599f5-54b9-46e3-86e2-0186ab1fe761 service nova] Creating event network-vif-plugged:9eaa9d78-ff87-45cc-afc7-5487e05134e4 for instance 1e1a786c-31fc-49b4-8953-726d14fad26e on n-h1-850003-3 Jul 18 13:12:24.262042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7a1d0215-93c7-4e5d-a77a-f1b45426d751 req-e5b599f5-54b9-46e3-86e2-0186ab1fe761 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140472 Jul 18 13:12:24.277391 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1722/3332] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:24.305655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:24.321905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:24.368248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:24.379568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.383004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:24.383792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:24.932042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:24.965242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-817d25e8-9787-40ee-a3ea-12815c33a350 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1273 microversion: 2.1 time: 0.683156 Jul 18 13:12:24.971278 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1723/3333] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:24 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1273 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:25.159747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:25.163629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:25.186728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:25.187596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:25.188625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:25.190736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:25.959231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:25.979386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:25.985125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:25.986521 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60c08fe0-ffa6-4b38-851b-9d0ddbb3bf0c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1865 microversion: 2.32 time: 0.841207 Jul 18 13:12:25.988637 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1724/3334] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:25 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1865 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:25.994737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:25.995656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:26.025024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:26.025999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:26.027109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:26.027809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:26.477898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:26.501110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:26.531320 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c77d6565-0a1c-4aad-a7b0-a67c6e4c063f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 0.537104 Jul 18 13:12:26.538555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1725/3335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:25 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:26.569485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:26.571668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:26.594270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:26.595101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:26.596667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:26.597387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:26.731758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:26.767484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb3ea409-ad57-420c-bc03-1fb5db8fab4c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1273 microversion: 2.1 time: 0.223211 Jul 18 13:12:26.786448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1726/3336] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:26 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:26.794004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2668a1d1-2f00-4737-ac0e-7e4c598f0a06 req-da8714b1-c6c6-443f-baca-5209d7ac4251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1ad742-1f92-4ba5-a85a-820555bfe979", "name": "network-vif-plugged", "status": "completed", "tag": "441d6bf6-fac9-44a2-872f-78e1a2c9355e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:26.831544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2668a1d1-2f00-4737-ac0e-7e4c598f0a06 req-da8714b1-c6c6-443f-baca-5209d7ac4251 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:26.832156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2668a1d1-2f00-4737-ac0e-7e4c598f0a06 req-da8714b1-c6c6-443f-baca-5209d7ac4251 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:26.835282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:26.893750 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2668a1d1-2f00-4737-ac0e-7e4c598f0a06 req-da8714b1-c6c6-443f-baca-5209d7ac4251 service nova] Creating event network-vif-plugged:441d6bf6-fac9-44a2-872f-78e1a2c9355e for instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 on n-h2-850003-3 Jul 18 13:12:26.920418 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2668a1d1-2f00-4737-ac0e-7e4c598f0a06 req-da8714b1-c6c6-443f-baca-5209d7ac4251 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128290 Jul 18 13:12:26.921781 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1727/3337] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:27.068610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:27.073091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:27.117098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:27.119362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:27.119844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:27.120760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:27.121201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:28.588896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:28.612099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:28.616145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:28.619585 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d14d028-9c26-4bb0-b85b-5908418bef4a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1865 microversion: 2.32 time: 1.559672 Jul 18 13:12:28.621703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1728/3338] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:27 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1865 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:28.631381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:28.632938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:28.646751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:28.649072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:28.651147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:28.652436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:28.841588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:28.884340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60c73500-57cf-4140-b22b-85b09840dfb7 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 4.722934 Jul 18 13:12:28.886226 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1611/3339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:24 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 4729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:28.902615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:28.908310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:28.929321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:28.930386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:28.937559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:28.938669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:29.349374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:29.356073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:29.379096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-328e1122-ca12-4ef7-a94f-66466fb2c192 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1273 microversion: 2.1 time: 0.489258 Jul 18 13:12:29.438542 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f42793b-0290-4da0-9d36-c4e4a9a13768 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1308 microversion: 2.1 time: 0.776837 Jul 18 13:12:29.438542 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1729/3340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:28 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:29.442186 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1612/3341] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:28 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1273 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:29.664918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:29.669853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:29.693938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:29.695285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:29.696910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:29.701349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:29.919844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:29.923132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:29.952815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:29.957737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:29.958969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:29.962240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:29.964086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:31.931307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:31.968634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:31.977279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:31.986062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f391c9b-d402-43ea-86e8-1a7859fcb12e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1865 microversion: 2.32 time: 2.337586 Jul 18 13:12:31.988884 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1730/3342] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:29 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1865 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:32.032789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:32.034505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:32.049307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.050533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.053856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.055083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.527652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:32.543969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:32.555109 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d752a382-9a3e-4f32-bfde-aece4ba564f5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 2.642075 Jul 18 13:12:32.564822 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1613/3343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:29 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 2649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:12:32.571270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6dca25bd-bd31-49ba-a49f-195bfd97641e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1489 microversion: 2.1 time: 0.579615 Jul 18 13:12:32.579727 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1731/3344] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:31 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1489 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:32.585972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:32.591256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:32.605282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fca0df97-41ce-492f-9b8b-aeff3b97b2bf req-928c30ac-01d6-4ba5-98c3-5e0427356426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "bc1a8ecc-ef83-425e-a737-4418cb999916"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:32.615173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.616399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.622177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.623338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.638079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fca0df97-41ce-492f-9b8b-aeff3b97b2bf req-928c30ac-01d6-4ba5-98c3-5e0427356426 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.647045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fca0df97-41ce-492f-9b8b-aeff3b97b2bf req-928c30ac-01d6-4ba5-98c3-5e0427356426 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.685473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fca0df97-41ce-492f-9b8b-aeff3b97b2bf req-928c30ac-01d6-4ba5-98c3-5e0427356426 service nova] Creating event network-changed:bc1a8ecc-ef83-425e-a737-4418cb999916 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:12:32.713658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fca0df97-41ce-492f-9b8b-aeff3b97b2bf req-928c30ac-01d6-4ba5-98c3-5e0427356426 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129925 Jul 18 13:12:32.715777 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1732/3345] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:32.730023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:32.741486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:32.790061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.792174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:32.794020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:32.794598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:33.741950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:33.766120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4c76f3f-66f5-4774-bdb5-0cf5da6a4869 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1489 microversion: 2.1 time: 1.043564 Jul 18 13:12:33.772182 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1733/3346] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:32 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1489 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:33.794719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:33.805151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:33.832768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:33.836285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:33.844686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:33.846536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:34.774550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:34.815779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:34.822076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:34.826768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-122d44ef-a7fb-4714-98c9-2441dce1e0ba tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1865 microversion: 2.32 time: 1.051977 Jul 18 13:12:34.843217 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1734/3347] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:33 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1865 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:34.864940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:34.867603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:34.886375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:34.888456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:34.891083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:34.892482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:35.747559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:35.766561 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9638b72c-e612-42cd-be84-4083d1954d2c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1315 microversion: 2.1 time: 3.199291 Jul 18 13:12:35.782569 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1614/3348] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:32 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1315 bytes in 3217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:35.808625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:35.814237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:35.884645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:35.885806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:35.892671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:35.893450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:35.956920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:35.978817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef99b0d1-c5a2-4446-9a00-6f75ca544d66 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 1.131839 Jul 18 13:12:36.029956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1735/3349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:34 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:36.040332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-768494957", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0ffafd84-0d01-4d6b-aa80-3832700dfcbc"}, {"port": "17ab78fd-5a1c-41fd-b464-c43918fe755f", "tag": "port-1"}, {"port": "2658726f-8f22-4a68-949c-9c30639612d1", "tag": "port-2"}, {"uuid": "9d90aac8-e6f0-41c4-ae7c-d5ce7735c500", "tag": "net-1"}, {"uuid": "9d90aac8-e6f0-41c4-ae7c-d5ce7735c500"}, {"uuid": "1e8843b6-35a8-47f0-bee4-43baef3418a9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1e8843b6-35a8-47f0-bee4-43baef3418a9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c78814d1-c768-4b49-a3da-9e5bd7132f05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "420e76ed-ff4d-4988-aa15-90e3b3fc6769", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a7c6509a-aab6-4d22-ab57-c10860346af4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1857605757"}], "key_name": "tempest-keypair-2027042077", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:36.684425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] validate_networks() for [('0ffafd84-0d01-4d6b-aa80-3832700dfcbc', None, None, None, None, None), (None, None, '17ab78fd-5a1c-41fd-b464-c43918fe755f', None, None, None), (None, None, '2658726f-8f22-4a68-949c-9c30639612d1', None, None, None), ('9d90aac8-e6f0-41c4-ae7c-d5ce7735c500', None, None, None, None, None), ('9d90aac8-e6f0-41c4-ae7c-d5ce7735c500', None, None, None, None, None), ('1e8843b6-35a8-47f0-bee4-43baef3418a9', '10.2.2.100', None, None, None, None), ('1e8843b6-35a8-47f0-bee4-43baef3418a9', '10.2.2.200', None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:12:36.869441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:36.894442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b9c86fa-7f76-4f5c-ace3-1d8783b40ce9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1489 microversion: 2.1 time: 1.101776 Jul 18 13:12:36.919723 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1615/3350] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:35 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1489 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:36.934908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:36.936066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:36.961317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:36.961930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:36.966375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:36.969048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:38.017447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:38.072198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:38.082609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:38.089093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-848e1786-2f0f-407d-9faf-7a376c086dbb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1886 microversion: 2.32 time: 1.166734 Jul 18 13:12:38.102527 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1616/3351] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:36 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1886 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:38.132086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:38.135866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:38.171243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:38.174715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:38.179003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:38.181317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:39.334687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:39.380092 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6caa968-d31f-4523-bc9b-ecfe975e412f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1315 microversion: 2.1 time: 1.256413 Jul 18 13:12:39.406673 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1617/3352] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:38 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1315 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:39.427391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:39.429206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:39.441819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:39.443206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:39.445582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:39.446614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:39.557553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:12:39.808691 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ec93e9a-6c9f-4ffd-b334-3f8e283d044e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 204 len: 0 microversion: 2.1 time: 0.386364 Jul 18 13:12:39.812472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1618/3353] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:12:39 2022] DELETE /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:12:39.833925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:39.837643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:39.870616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:39.874269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:39.876325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:39.877601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:40.970204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:41.012523 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-95521e8e-a845-45e4-b76b-c3a5eb96b163 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 1.197293 Jul 18 13:12:41.014781 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1619/3354] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:39 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:41.026847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6f2d0e09-5c31-480b-852d-3efa55b64864 req-0f71da92-d5a1-4024-9c56-98d5db0b43a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1212db38-4f34-4a1b-aa7d-27e1f3e8eab9", "tag": "c236389b-1572-429b-945e-9b33f5609779"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:41.048922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6f2d0e09-5c31-480b-852d-3efa55b64864 req-0f71da92-d5a1-4024-9c56-98d5db0b43a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:41.050199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6f2d0e09-5c31-480b-852d-3efa55b64864 req-0f71da92-d5a1-4024-9c56-98d5db0b43a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:41.080724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6f2d0e09-5c31-480b-852d-3efa55b64864 req-0f71da92-d5a1-4024-9c56-98d5db0b43a7 service nova] Creating event network-changed:c236389b-1572-429b-945e-9b33f5609779 for instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 on n-h2-850003-3 Jul 18 13:12:41.092088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6f2d0e09-5c31-480b-852d-3efa55b64864 req-0f71da92-d5a1-4024-9c56-98d5db0b43a7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074410 Jul 18 13:12:41.095876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1620/3355] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:41.117420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:41.119975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:41.145815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:41.146758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:41.148180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:41.149477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:43.909841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:43.916485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:43.957776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:43.960452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:43.966917 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62a34984-c74a-4d27-9c30-e7c9f82b96c7 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1886 microversion: 2.32 time: 2.868121 Jul 18 13:12:43.968971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1621/3356] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:41 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1886 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:43.986648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:43.993809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:44.032417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:44.037037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:44.042867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:44.044428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:44.970214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:45.011196 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bee2bfe4-b5ad-4db9-ad1d-dfd097526642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 200 len: 1453 microversion: 2.1 time: 1.023834 Jul 18 13:12:45.012441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1622/3357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:43 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 1453 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:45.070107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:45.071384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:45.112109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:45.112905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:45.114434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:45.115215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:45.976768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=53 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:49.426937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:49.468384 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e2e20c6-6a5e-4298-bf23-647153d66d95 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1315 microversion: 2.1 time: 4.437867 Jul 18 13:12:49.469852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1623/3358] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:45 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1315 bytes in 4457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:49.496497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:49.501300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:49.542201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:49.542201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:49.543015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:49.543735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:50.394930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:51.312306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:51.336820 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-812d8c39-58d9-4326-83c0-d1ea27192b99 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 1.863597 Jul 18 13:12:51.347995 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1624/3359] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:49 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:51.394005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3ff20017-6da2-4532-9782-0a1184d1673e req-1dc30429-0ef7-43a9-b7a9-537952137418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "c95f6557-6819-48b1-8ad3-47bdaf47eaac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:51.428226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3ff20017-6da2-4532-9782-0a1184d1673e req-1dc30429-0ef7-43a9-b7a9-537952137418 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:51.430716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3ff20017-6da2-4532-9782-0a1184d1673e req-1dc30429-0ef7-43a9-b7a9-537952137418 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:51.478444 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3ff20017-6da2-4532-9782-0a1184d1673e req-1dc30429-0ef7-43a9-b7a9-537952137418 service nova] Creating event network-changed:c95f6557-6819-48b1-8ad3-47bdaf47eaac for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:12:51.507999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3ff20017-6da2-4532-9782-0a1184d1673e req-1dc30429-0ef7-43a9-b7a9-537952137418 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155251 Jul 18 13:12:51.510113 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1625/3360] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:51.529390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:51.536727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:51.572428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:51.573560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:51.575360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:51.583178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:51.691104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:12:51.692515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:12:51.693464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:12:51.694308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:12:51.695098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:12:51.720543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:51.721496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:51.722583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:51.731060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:51.788138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Getting quotas for project 29b2c2c435e344ce916120d2372fde2a. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:12:51.807932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Getting quotas for user fa4ecc5b14c041808dd284e49ba361d6 and project 29b2c2c435e344ce916120d2372fde2a. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:12:52.454765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:12:52.459087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c78814d1-c768-4b49-a3da-9e5bd7132f05',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='420e76ed-ff4d-4988-aa15-90e3b3fc6769',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7c6509a-aab6-4d22-ab57-c10860346af4',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:12:52.972814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:53.003951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:53.028416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:53.031112 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-332ee200-e073-4cc8-bb4e-b54be1242b89 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.518406 Jul 18 13:12:53.047488 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1626/3361] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:51 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:53.071057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:53.072758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:53.089663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.092203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:53.095212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.096605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:53.140952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 HTTP/1.1 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6b1ad742-1f92-4ba5-a85a-820555bfe979'} Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:12:53.145294 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:12:53.163460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:12:53.166791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:12:53.169482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b0fae69-c86d-48a3-a1f3-61d2aee5166e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 404 len: 111 microversion: 2.1 time: 0.114348 Jul 18 13:12:53.172746 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1627/3362] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:53 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:12:53.188133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:53.190266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:53.207283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.209267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:53.211229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.213059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:53.858250 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee47350b-8fb0-4acd-8698-3a3e3985383f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 17.822304 Jul 18 13:12:53.867825 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1736/3363] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 18 13:12:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 17836 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:12:53.898770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:53.904912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:53.945975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.948485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:53.967837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:53.972590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:54.934069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:54.955067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ce0b7fe-2bb3-4636-8fdd-783b2e59ad2d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 1.079466 Jul 18 13:12:54.957609 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1737/3364] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:53 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:54.970239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:54.971150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:54.991100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:54.991915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:54.993080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:54.994786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:55.106263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:55.138401 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bcbbad16-49bf-4a57-a008-6067aa64c941 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1315 microversion: 2.1 time: 1.954659 Jul 18 13:12:55.140562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1628/3365] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:53 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1315 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:55.157842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:12:55.163658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1ad742-1f92-4ba5-a85a-820555bfe979", "name": "network-vif-deleted", "tag": "441d6bf6-fac9-44a2-872f-78e1a2c9355e"}, {"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "7f349224-d4c9-4f4a-a01b-62ec8d49e2e1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:55.210667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:12:55.216371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:55.218196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:55.307585 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] Creating event network-vif-deleted:441d6bf6-fac9-44a2-872f-78e1a2c9355e for instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 on n-h2-850003-3 Jul 18 13:12:55.312228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] Creating event network-changed:7f349224-d4c9-4f4a-a01b-62ec8d49e2e1 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:12:55.365685 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8a9986fe-f153-47b2-be3d-d73e70b337c3 req-4f89cdab-a4d7-453d-9a5c-1f04963d462a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.222023 Jul 18 13:12:55.384159 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1629/3366] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:55.417510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:55.425221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:55.570711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bafd29d-e445-4d66-9d59-ebe0a930fd6a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 204 len: 0 microversion: 2.1 time: 0.611198 Jul 18 13:12:55.571315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1738/3367] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:12:54 2022] DELETE /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:12:55.588911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c5aa84bf-ff0f-41b2-b11c-e107ddd38bc1 req-cf70fe5d-6b39-43b0-ae72-481edf2d666f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1212db38-4f34-4a1b-aa7d-27e1f3e8eab9", "name": "network-vif-plugged", "status": "completed", "tag": "c236389b-1572-429b-945e-9b33f5609779"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:12:55.625669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c5aa84bf-ff0f-41b2-b11c-e107ddd38bc1 req-cf70fe5d-6b39-43b0-ae72-481edf2d666f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:55.626657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c5aa84bf-ff0f-41b2-b11c-e107ddd38bc1 req-cf70fe5d-6b39-43b0-ae72-481edf2d666f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:55.667038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c5aa84bf-ff0f-41b2-b11c-e107ddd38bc1 req-cf70fe5d-6b39-43b0-ae72-481edf2d666f service nova] Creating event network-vif-plugged:c236389b-1572-429b-945e-9b33f5609779 for instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 on n-h2-850003-3 Jul 18 13:12:55.693086 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c5aa84bf-ff0f-41b2-b11c-e107ddd38bc1 req-cf70fe5d-6b39-43b0-ae72-481edf2d666f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119586 Jul 18 13:12:55.698411 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1739/3368] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:12:55.722820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:55.724925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:55.751264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:55.757321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:55.765532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:55.767266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.024370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.045215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.048025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.050641 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-14fc6c4d-d12b-4259-b5cd-f42259646c9f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1285 microversion: 2.42 time: 0.664032 Jul 18 13:12:56.056924 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1630/3369] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:55 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1285 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:56.064623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:56.065267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:56.088836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.089595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.091256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.092223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.510996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.550940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.565326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.570678 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff294ddb-a42f-47e0-9b3d-4368666a5e27 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.869478 Jul 18 13:12:56.576520 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1740/3370] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:55 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:56.593471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:56.597105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:56.622303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.624855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.629986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.631946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.718631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:56.745484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7317fbf5-0628-452f-a26a-a58eed3861a1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1495 microversion: 2.1 time: 0.683413 Jul 18 13:12:56.746866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1631/3371] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:56 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1495 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:56.754578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:56.759425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:56.780722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.786936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:56.803119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:56.804067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:57.221896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:57.265229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c0086aa5-f4f9-42ba-abe9-8b44dcd7c155 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 0.681721 Jul 18 13:12:57.313442 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1741/3372] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:56 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:12:57.340743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:57.359738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:57.406924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:57.413101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:57.415166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:57.416649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:57.980095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:58.027201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:58.050085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:58.060997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1255586-7de9-413d-b3af-eb471c4c5d99 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1575 microversion: 2.42 time: 0.744142 Jul 18 13:12:58.063022 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1742/3373] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:57 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1575 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:58.081613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:58.097723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:58.153337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:58.163980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:58.167042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:58.185159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:59.861000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:59.879716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:59.884679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:12:59.891391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-109fd544-68ba-4e9f-8599-5b8f974c40ae tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.826466 Jul 18 13:12:59.892018 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1743/3374] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:12:58 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:12:59.922222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:12:59.922222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:12:59.930284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:59.932614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:12:59.933475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:12:59.937188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:00.592307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:00.654499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:00.678097 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1d134eb-19e0-4d80-8c77-74c7db0f9a2c tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1495 microversion: 2.1 time: 0.784937 Jul 18 13:13:00.678444 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49fc24d3-5060-4950-8da0-bda1b7343678 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1315 microversion: 2.1 time: 3.928888 Jul 18 13:13:00.698185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1744/3375] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:59 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1495 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:00.698946 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1632/3376] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:12:56 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1315 bytes in 3942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:00.699135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:00.699135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:00.708307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d67f1389-f93f-4a70-900c-44b02aae30a4 req-2c2eb41e-f7d0-434c-a196-561a9fb6e25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "a5655267-e11d-4f82-8970-49c5b34333be"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:00.746627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d67f1389-f93f-4a70-900c-44b02aae30a4 req-2c2eb41e-f7d0-434c-a196-561a9fb6e25e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:00.746954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:00.747153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d67f1389-f93f-4a70-900c-44b02aae30a4 req-2c2eb41e-f7d0-434c-a196-561a9fb6e25e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:00.747333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:00.747997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:00.748452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:00.790925 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d67f1389-f93f-4a70-900c-44b02aae30a4 req-2c2eb41e-f7d0-434c-a196-561a9fb6e25e service nova] Creating event network-changed:a5655267-e11d-4f82-8970-49c5b34333be for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:13:00.812845 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d67f1389-f93f-4a70-900c-44b02aae30a4 req-2c2eb41e-f7d0-434c-a196-561a9fb6e25e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119445 Jul 18 13:13:00.825971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1633/3377] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:00.892554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:00.898699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:00.951655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:00.957526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:00.963815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:00.969727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:01.446598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:01.504042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:01.523521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:01.528419 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85b8f92f-f7e0-4403-b4b0-9a0e23be2b36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1593 microversion: 2.42 time: 0.692873 Jul 18 13:13:01.531175 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1634/3378] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:00 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1593 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:01.574201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:01.582394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:01.620898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:01.627879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:01.629939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:01.636189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:01.772312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:01.820171 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8acde6b-7b2d-4fe4-9375-f08fd43078aa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261669 Jul 18 13:13:01.822574 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1635/3379] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:13:01 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:01.834676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:01.840097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:01.846975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:01.869118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:01.869914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:01.880991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:01.881722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:02.120372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:02.168086 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ea94f06-1ced-4894-a857-867e9a3b757e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1522 microversion: 2.1 time: 1.475991 Jul 18 13:13:02.169920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1745/3380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:00 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1522 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:02.357671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1894373181", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a033b52b-1498-49d7-ba23-1daf19aff968"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:02.560227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] validate_networks() for [('a033b52b-1498-49d7-ba23-1daf19aff968', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:13:03.125726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:03.199769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:03.203944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:03.212854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-194cf4c7-fbcd-463a-a2f7-bf619b87de1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.381164 Jul 18 13:13:03.214937 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1636/3381] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:01 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:03.226988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a7b6c52f-2c71-4f41-bf45-9338c20c1709 req-bba826f4-f010-4353-a598-e7009a30e003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf0feda-7b55-4304-998b-2b0c22b96e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "67610709-0332-4c04-997d-1cebab98c7f3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:03.246301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a7b6c52f-2c71-4f41-bf45-9338c20c1709 req-bba826f4-f010-4353-a598-e7009a30e003 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:03.248189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a7b6c52f-2c71-4f41-bf45-9338c20c1709 req-bba826f4-f010-4353-a598-e7009a30e003 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:03.298944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a7b6c52f-2c71-4f41-bf45-9338c20c1709 req-bba826f4-f010-4353-a598-e7009a30e003 service nova] Creating event network-vif-unplugged:67610709-0332-4c04-997d-1cebab98c7f3 for instance caf0feda-7b55-4304-998b-2b0c22b96e7a on n-h2-850003-3 Jul 18 13:13:03.314466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a7b6c52f-2c71-4f41-bf45-9338c20c1709 req-bba826f4-f010-4353-a598-e7009a30e003 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096195 Jul 18 13:13:03.322247 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1637/3382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:03.340982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:03.343400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:03.360451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:03.361618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:03.364270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:03.366527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:04.361931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:04.379645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-edd8c255-975b-4b67-939a-a67e31d8d224 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 200 len: 1495 microversion: 2.1 time: 1.055000 Jul 18 13:13:04.380287 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1638/3383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:03 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 1495 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:04.397758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:04.398865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:04.420268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:04.421013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:04.426234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:04.427254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:05.769829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:05.804039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb1cde19-de5a-4d15-8901-30f2f4431720 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1502 microversion: 2.1 time: 1.412924 Jul 18 13:13:05.805337 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1639/3384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:04 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1502 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:05.845206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:05.850414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:05.865272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:05.866738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:05.868529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:05.869696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:06.033322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:06.189928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lazy-loading 'services' on Instance uuid 7cab126c-3f1e-415d-bf7d-1d106cb34bbe {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:13:06.453073 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0571c2f9-df05-4f24-bc66-4dd8d1aa9a1d tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments/e0a1a918-0848-48af-a59e-6c688ce456a4" status: 202 len: 0 microversion: 2.1 time: 0.630788 Jul 18 13:13:06.460894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1640/3385] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:13:05 2022] DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments/e0a1a918-0848-48af-a59e-6c688ce456a4 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:06.473535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:06.474297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:06.489186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:06.489576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:06.490409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:06.490857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.221773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:13:07.223631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:13:07.225396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:13:07.226960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:13:07.228088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:13:07.267461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.268850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.270900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.272043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.293552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:07.329925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Getting quotas for project 8d2b92ce2ef44d4ab4943bffab5568f2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:13:07.342512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Getting quotas for user 20db5561236e4a26a87d4050bb6d4da1 and project 8d2b92ce2ef44d4ab4943bffab5568f2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:13:07.360798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:07.376671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:07.383954 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c6abbf6-7278-442f-8e7c-18a62a3cd337 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1661 microversion: 2.42 time: 0.917312 Jul 18 13:13:07.399038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1641/3386] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:06 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1661 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:07.402662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Going to run 2 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:13:07.405583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 0c158f2e-de61-4600-ab0c-431fb62ad5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:07.427797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:07.437499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:07.448549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=0c158f2e-de61-4600-ab0c-431fb62ad5f8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:07.470846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.473666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.478515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.479915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.491482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:07.655391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3707aee-556d-473a-8fd5-04e0b251e507 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.481058 Jul 18 13:13:07.671225 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1746/3387] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 5500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:13:07.702173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:07.703961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:07.735844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.738874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:07.740748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:07.748187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.394826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:08.443648 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7eaffb2d-8ed5-4b88-bfc9-20a869c4afe6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1504 microversion: 2.1 time: 1.048171 Jul 18 13:13:08.455775 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1642/3388] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:07 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1504 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:08.478017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7b85f856-1923-4100-b51b-a7a02f3a4ffb req-b2848c54-173a-414d-b5a7-f421d49ddc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "d9b46508-549b-4942-a526-4ee162fb2863"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:08.496002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7b85f856-1923-4100-b51b-a7a02f3a4ffb req-b2848c54-173a-414d-b5a7-f421d49ddc28 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:08.497937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7b85f856-1923-4100-b51b-a7a02f3a4ffb req-b2848c54-173a-414d-b5a7-f421d49ddc28 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.555427 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7b85f856-1923-4100-b51b-a7a02f3a4ffb req-b2848c54-173a-414d-b5a7-f421d49ddc28 service nova] Creating event network-changed:d9b46508-549b-4942-a526-4ee162fb2863 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:13:08.571327 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7b85f856-1923-4100-b51b-a7a02f3a4ffb req-b2848c54-173a-414d-b5a7-f421d49ddc28 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112071 Jul 18 13:13:08.573709 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1643/3389] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:08.586897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:08.588655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:08.609864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:08.611543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.615418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:08.616879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.691952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a HTTP/1.1 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'caf0feda-7b55-4304-998b-2b0c22b96e7a'} Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:08.700820 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:13:08.708110 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:08.710530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:13:08.720076 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-87429edc-9b30-4a20-b8fd-adae616f2afa tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 404 len: 111 microversion: 2.1 time: 0.135329 Jul 18 13:13:08.721218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1644/3390] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:08 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:13:08.742111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:08.747020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:08.767095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:08.768138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.773594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:08.774845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:08.945090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d082f088-735b-43a7-99e7-78d437483e1e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action" status: 200 len: 14 microversion: 2.1 time: 0.221079 Jul 18 13:13:08.949888 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1645/3391] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:08 2022] POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:08.959765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:08.967096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:08.968113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Searching by: {'deleted': False, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:13:09.003921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:09.005590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:09.007800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:09.008970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:09.111861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:13:09.201555 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a48447d5-08e7-441d-aba3-ab223a973769 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.248038 Jul 18 13:13:09.215129 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1646/3392] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:13:08 2022] GET /compute/v2.1/servers => generated 677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:09.229903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6ed8054e-0f6c-4287-90ae-c2a431270640 req-bd2af4a5-101f-49e9-982c-b8ecef914738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a786c-31fc-49b4-8953-726d14fad26e", "name": "network-vif-unplugged", "status": "completed", "tag": "9eaa9d78-ff87-45cc-afc7-5487e05134e4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:09.270057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6ed8054e-0f6c-4287-90ae-c2a431270640 req-bd2af4a5-101f-49e9-982c-b8ecef914738 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:09.271276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6ed8054e-0f6c-4287-90ae-c2a431270640 req-bd2af4a5-101f-49e9-982c-b8ecef914738 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:09.339254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:09.369964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_external_events [req-6ed8054e-0f6c-4287-90ae-c2a431270640 req-bd2af4a5-101f-49e9-982c-b8ecef914738 service nova] Unable to find a host for instance 1e1a786c-31fc-49b4-8953-726d14fad26e. Dropping event network-vif-unplugged {{(pid=131367) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 13:13:09.379861 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6ed8054e-0f6c-4287-90ae-c2a431270640 req-bd2af4a5-101f-49e9-982c-b8ecef914738 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.159640 Jul 18 13:13:09.389108 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1647/3393] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 171 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 13:13:09.396562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:09.404256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:09.407676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:09.410206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76a0ef6e-e834-401d-8a7a-341f9134f5d0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.736685 Jul 18 13:13:09.411044 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1747/3394] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:07 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:09.419198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:09.443551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:09.444190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:09.446818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-161019507", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:09.447658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:09.448611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:09.634471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:13:10.472470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:10.492500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:10.499067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:10.501274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b6fce079-a11e-4ba6-a2ea-38da2259dbd4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1708 microversion: 2.42 time: 1.108833 Jul 18 13:13:10.517733 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1648/3395] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:09 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1708 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:10.519201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:10.522738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:10.543681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:10.545657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:10.547456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:10.548408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:10.722509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:10.742316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39f5bc29-2b33-4af6-8f82-12f0107117de tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1272 microversion: 2.1 time: 0.234168 Jul 18 13:13:10.763529 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1649/3396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:10 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:10.780790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:10.785488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:10.811131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:10.812227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:10.815839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:10.816930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:11.337217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:11.367818 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08166144-9887-41f8-b925-01b1f5861edb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 200 len: 1447 microversion: 2.1 time: 0.601601 Jul 18 13:13:11.371764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1650/3397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:10 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 1447 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:11.394480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:11.407288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:11.439442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:11.444491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:11.446264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:11.450075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:11.635372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9e8b149-38fc-4374-8b1c-cbf720923869 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action" status: 200 len: 14 microversion: 2.1 time: 0.253311 Jul 18 13:13:11.640712 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1651/3398] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:11 2022] POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:11.679808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:11.693504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:11.718058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:11.719519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:11.721122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:11.722024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.104129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:13:12.109830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:13:12.111260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:13:12.115194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:13:12.121598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:13:12.167582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:12.168758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.174814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:12.176016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.235764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:13:12.249382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:13:12.287953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:13:12.292609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:12.425746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f0775a1c-58a2-480b-9883-059cf5b95e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.001179 Jul 18 13:13:12.438862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1748/3399] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:13:12.451748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf0feda-7b55-4304-998b-2b0c22b96e7a", "name": "network-vif-deleted", "tag": "67610709-0332-4c04-997d-1cebab98c7f3"}, {"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "5783181c-6d5c-4774-acf0-5a3a9820e65a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:12.472268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:12.473315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.555535 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] Creating event network-vif-deleted:67610709-0332-4c04-997d-1cebab98c7f3 for instance caf0feda-7b55-4304-998b-2b0c22b96e7a on n-h2-850003-3 Jul 18 13:13:12.562308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] Creating event network-changed:5783181c-6d5c-4774-acf0-5a3a9820e65a for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:13:12.593322 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c8407e3d-4ce4-4931-8742-50953c61cd99 req-280117ef-cf26-4ad9-9447-48cdee5b393e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.151871 Jul 18 13:13:12.594845 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1749/3400] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:12.614349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:12.615587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:12.641525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:12.645243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.646950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:12.647896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:12.769224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:13:12.785784 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Working on deleting snapshot d40f34fd-8097-4893-add8-8406710234ce from shelved instance... Jul 18 13:13:13.879293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:13.906415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:13.911331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:13.917301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2040d6e-6b05-4c87-a79a-1370836f324b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 2.277174 Jul 18 13:13:13.918335 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1652/3401] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:11 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:13.937152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:13.940390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:13.977260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:13.978851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:13.988387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:13.989433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:14.302448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Doing local delete in cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131366) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 13:13:14.304116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:14.304882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:14.305674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 13:13:14.343656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] deallocate_for_instance() {{(pid=131366) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 13:13:15.635071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:15.669195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:15.680864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:15.683853 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5b9f4f05-bbff-4d4a-b3b4-eeb5e69b9cdf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1755 microversion: 2.42 time: 1.761219 Jul 18 13:13:15.698980 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1653/3402] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:13 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1755 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:15.713766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:15.715003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:15.727198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:15.728550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:15.730415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:15.731599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:15.952977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:15.976770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e7cc040-8d2a-4572-b0ff-63b7fce4e3ce tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1278 microversion: 2.1 time: 0.274700 Jul 18 13:13:15.979229 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1654/3403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:15 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1278 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:15.988589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:15.989581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:16.005116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.006097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:16.007872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.008527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:16.252166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:16.275316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48065af3-2463-4711-be49-bfd7c1467a69 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1266 microversion: 2.1 time: 0.293774 Jul 18 13:13:16.279183 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1655/3404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:15 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:16.289201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:16.291021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:16.313617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.317272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:16.319479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.323144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:16.399553 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db146fe2-c0ed-4d5c-bb09-614b600edb69 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action" status: 200 len: 14 microversion: 2.1 time: 0.117071 Jul 18 13:13:16.402243 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1656/3405] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:16 2022] POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:16.411020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:16.412280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:16.422449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.423244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:16.424533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:16.425373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:17.422590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:17.460984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:17.464084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:17.466657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4556bb92-65bb-4876-9b74-0e8e793b3104 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.059919 Jul 18 13:13:17.468302 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1657/3406] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:16 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:17.482571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:17.483692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:17.506394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:17.506863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:17.507699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:17.508148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:17.899410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:17.929570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Updating instance_info_cache with network_info: [] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:13:18.371165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:18.406769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:18.413306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:18.420741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b7badae6-e648-4c25-8525-7a5abbc527be tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1802 microversion: 2.42 time: 0.947503 Jul 18 13:13:18.423954 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1658/3407] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:17 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1802 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:18.438832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:18.444836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:18.451668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bca07648-ac87-40bf-830b-87c096479db5 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 204 len: 0 microversion: 2.1 time: 5.852536 Jul 18 13:13:18.453335 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1750/3408] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:13:12 2022] DELETE /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 0 bytes in 5858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:13:18.470319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.472933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:18.476608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.477376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:18.604656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:18.606043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:18.617523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.618589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:18.620117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.621108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:18.949405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:18.968425 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abceba27-7b83-4dcb-b6be-1c6eaf7fe2ca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1266 microversion: 2.1 time: 0.512442 Jul 18 13:13:18.970491 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1751/3409] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:18 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1266 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:18.979215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:18.983768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:18.994618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.995815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:18.997774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:18.998986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:19.043083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:19.078049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-814310ca-2425-44ae-8168-87561d9f39d2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action" status: 200 len: 14 microversion: 2.1 time: 0.104087 Jul 18 13:13:19.080666 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1752/3410] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:18 2022] POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:19.095116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-40a5c9a7-0757-4bf5-a10e-0e9978b42fea req-b36d5747-723b-4458-bcec-6920be43f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a786c-31fc-49b4-8953-726d14fad26e", "name": "network-vif-deleted", "tag": "9eaa9d78-ff87-45cc-afc7-5487e05134e4"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:19.114972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40a5c9a7-0757-4bf5-a10e-0e9978b42fea req-b36d5747-723b-4458-bcec-6920be43f1ed service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:19.115594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40a5c9a7-0757-4bf5-a10e-0e9978b42fea req-b36d5747-723b-4458-bcec-6920be43f1ed service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:19.142664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.server_external_events [req-40a5c9a7-0757-4bf5-a10e-0e9978b42fea req-b36d5747-723b-4458-bcec-6920be43f1ed service nova] Unable to find a host for instance 1e1a786c-31fc-49b4-8953-726d14fad26e. Dropping event network-vif-deleted {{(pid=131366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 13:13:19.144474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-40a5c9a7-0757-4bf5-a10e-0e9978b42fea req-b36d5747-723b-4458-bcec-6920be43f1ed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061513 Jul 18 13:13:19.145856 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1753/3411] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 13:13:19.160087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:19.162203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:19.177404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:19.179003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:19.182830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:19.184443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:19.224033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e HTTP/1.1 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1e1a786c-31fc-49b4-8953-726d14fad26e'} Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:19.228344 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:13:19.241293 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:19.243340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:13:19.244234 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a48aec6-9132-4138-a25b-3647294b7e5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 404 len: 111 microversion: 2.1 time: 0.096420 Jul 18 13:13:19.245649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1754/3412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:19 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:13:19.257486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:19.270539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:19.282960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:19.283440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:19.284575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:19.285040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:20.423596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:20.455214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:20.459144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:20.460998 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40151287-3b74-479b-a4b7-313e40c27995 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.210420 Jul 18 13:13:20.463573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1755/3413] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:19 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:20.472893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1147511464", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:20.491021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:20.609642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:13:20.791623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:20.814966 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dbf7b807-dcbd-42d1-aaa6-a5c6d800902a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 2.386823 Jul 18 13:13:20.817618 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1659/3414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:18 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:20.831560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:20.834684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:20.853419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:20.856929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:20.860895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:20.864039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:22.211159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:22.266529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:22.277893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:22.293084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:22.299862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:22.303177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58fe5112-604d-463e-b31f-fd1c445aed87 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1802 microversion: 2.42 time: 1.482986 Jul 18 13:13:22.307709 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1660/3415] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:20 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1802 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:22.325692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:22.329664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:22.343253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:22.344484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:22.348650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:22.352579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:22.392692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:22.415588 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45cb921c-4415-4d82-b1fa-8256f521e1ac tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104205 Jul 18 13:13:22.426010 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1661/3416] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:13:22 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:22.437590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:22.438621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:22.448295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:22.449425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:22.451307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:22.452190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.219824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:13:23.220642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:13:23.221355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:13:23.222071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:13:23.222904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:13:23.244558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:23.257142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.257946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.259797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.260561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.269424 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b18b22f5-299d-423c-88e7-9d62f8984651 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 0.840796 Jul 18 13:13:23.271469 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1662/3417] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:22 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:23.283278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:23.285267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:23.295970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.297286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.299026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.300089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.353972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:13:23.378417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:13:23.398738 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb2ade46-d249-4318-91a7-2a9e77080b5f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action" status: 200 len: 16397 microversion: 2.1 time: 0.125332 Jul 18 13:13:23.399633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1663/3418] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:23 2022] POST /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9/action => generated 16397 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:13:23.414255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:23.415961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:23.428601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.429801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.431586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.432704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.435643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:13:23.440449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:23.601150 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73e210c1-2a3d-45f9-91b7-7a3bd0946526 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.135201 Jul 18 13:13:23.603035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1756/3419] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:13:23.613798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:23.615452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:23.633500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.639087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:23.640998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:23.643429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:24.873610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:24.895719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45f85289-df50-4665-b4b5-2a3f124590ec tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 1.289455 Jul 18 13:13:24.908566 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1757/3420] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:23 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:24.924729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:24.927790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:24.942964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:24.943801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:24.945319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:24.946646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:25.026783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56ffce4e-d673-4b00-9210-e2efa2fcf892 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106403 Jul 18 13:13:25.027860 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1758/3421] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:13:24 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:13:25.041818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:25.043020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:25.081598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:25.082453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:25.083917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:25.084690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:25.969497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:25.976221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.024378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.033826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.037839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.041814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.046519 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-570b8016-13a2-4640-8625-a2e623d52f64 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 2.638760 Jul 18 13:13:26.048552 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df433e0a-b4bb-4d7b-988c-b3bdddac3324 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1849 microversion: 2.42 time: 1.018288 Jul 18 13:13:26.071757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1759/3422] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:25 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1849 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:26.074840 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1664/3423] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:23 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 2668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:26.084175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:26.092457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:26.093582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:26.095042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:26.114189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=74 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:26.117552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.121545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.123767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:26.127181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:26.127949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.129678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.130969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:26.137732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:26.522205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:26.546378 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9a9c23b-1bd1-4faf-99d8-b29227368127 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1275 microversion: 2.1 time: 0.469176 Jul 18 13:13:26.547905 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1665/3424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:26 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1275 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:26.557614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:26.562003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:26.576902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.578004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:26.580177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:26.581968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.436111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:27.456397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7f7db69-27ea-4a08-830c-c3dadac55157 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.382190 Jul 18 13:13:27.475742 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1760/3425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:26 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:27.498913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3209ad51-0498-43ff-98af-f4faf7cd9273 req-227da14d-51cd-4577-8c36-bbc21288c90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88fceed9-6790-4556-afdc-53d03577924b", "tag": "86600ffd-699a-4061-9add-a7c2adeae1dc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:27.516540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3209ad51-0498-43ff-98af-f4faf7cd9273 req-227da14d-51cd-4577-8c36-bbc21288c90f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.517257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3209ad51-0498-43ff-98af-f4faf7cd9273 req-227da14d-51cd-4577-8c36-bbc21288c90f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.535531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3209ad51-0498-43ff-98af-f4faf7cd9273 req-227da14d-51cd-4577-8c36-bbc21288c90f service nova] Creating event network-changed:86600ffd-699a-4061-9add-a7c2adeae1dc for instance 88fceed9-6790-4556-afdc-53d03577924b on n-h1-850003-3 Jul 18 13:13:27.543815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3209ad51-0498-43ff-98af-f4faf7cd9273 req-227da14d-51cd-4577-8c36-bbc21288c90f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065070 Jul 18 13:13:27.544996 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1761/3426] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:27.551759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:27.552415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:27.559944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.560829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.561915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.562681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.620220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:27.632307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:13:27.642205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23835385-4f06-49c3-814a-74ab7513d795 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 1.092159 Jul 18 13:13:27.653354 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1666/3427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:26 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:27.669597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:27.670798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:27.698328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.699225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.701672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.704943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.840941 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec0499f0-8172-486d-8f54-cbac1f9468b4 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 204 len: 0 microversion: 2.1 time: 0.292807 Jul 18 13:13:27.847775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1762/3428] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:13:27 2022] DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:13:27.855497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fe4deca9-7d87-4e16-88fa-25278381e4d7 req-b8abb512-f399-4b9c-a79f-cf7d7be0e1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c158f2e-de61-4600-ab0c-431fb62ad5f8", "tag": "a09060db-b243-4064-843b-51ff8af62eca"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:27.876480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fe4deca9-7d87-4e16-88fa-25278381e4d7 req-b8abb512-f399-4b9c-a79f-cf7d7be0e1ba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.877555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fe4deca9-7d87-4e16-88fa-25278381e4d7 req-b8abb512-f399-4b9c-a79f-cf7d7be0e1ba service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.907224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fe4deca9-7d87-4e16-88fa-25278381e4d7 req-b8abb512-f399-4b9c-a79f-cf7d7be0e1ba service nova] Creating event network-changed:a09060db-b243-4064-843b-51ff8af62eca for instance 0c158f2e-de61-4600-ab0c-431fb62ad5f8 on n-h2-850003-3 Jul 18 13:13:27.915080 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fe4deca9-7d87-4e16-88fa-25278381e4d7 req-b8abb512-f399-4b9c-a79f-cf7d7be0e1ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068392 Jul 18 13:13:27.916274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1763/3429] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:27.923362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:27.925100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:27.939730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.940998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.942571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:27.943826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:27.984746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:UPDATE=16,nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:28.218930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:28.244837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf189cb1-6056-4c4e-b886-b83eedf352c7 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 0.589450 Jul 18 13:13:28.249917 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1667/3430] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:27 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:28.269320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:28.272898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:28.296639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:28.299292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:28.300862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:28.302908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:28.896716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:28.930400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:28.935628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:28.938718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d6d5ca5-becc-4d2b-88fc-e7027feffd35 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1849 microversion: 2.42 time: 1.019923 Jul 18 13:13:28.954272 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1764/3431] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:27 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1849 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:28.954272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:28.954272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:28.975264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:28.976110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:28.977779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:28.980140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.015483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.048768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.075055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.081017 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f550110-e0cb-495e-a7a6-b548b13f694f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.826724 Jul 18 13:13:29.100581 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1668/3432] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:28 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:29.118393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:29.122850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:29.156538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.160106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.165886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.170412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.347053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.363626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e753370c-533b-4b41-a781-bd69b0413a1a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1273 microversion: 2.1 time: 0.261625 Jul 18 13:13:29.364722 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1669/3433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:29 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:29.384016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:29.387388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:29.400481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.401537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.403594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.404796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.716712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.733316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b0ad8296-40a6-487f-93e3-8f883527cae3 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1681 microversion: 2.1 time: 0.366704 Jul 18 13:13:29.735363 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1670/3434] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:29 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:29.745086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:29.747206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:29.764501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.765419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.767063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.767982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.915248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:29.958452 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dde794cf-0ed0-4489-bc04-5117e1c7074d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.016006 Jul 18 13:13:29.963080 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1765/3435] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:28 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:29.974274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:29.976298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:29.990772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.992101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:29.998077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:29.999595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:30.549769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:30.569356 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b25028c6-fa68-4fd7-ac6c-34b79615c7dd tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 0.829840 Jul 18 13:13:30.571645 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1671/3436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:29 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:30.584168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-78cc8f33-7162-4f93-ba48-4565059768bd req-1b69247b-dfe5-45ec-8163-a0a155bcb39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "e55910a4-60fb-4c9c-9429-97cd52f7ff56"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:30.625661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-78cc8f33-7162-4f93-ba48-4565059768bd req-1b69247b-dfe5-45ec-8163-a0a155bcb39f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:30.631955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-78cc8f33-7162-4f93-ba48-4565059768bd req-1b69247b-dfe5-45ec-8163-a0a155bcb39f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:30.664796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-78cc8f33-7162-4f93-ba48-4565059768bd req-1b69247b-dfe5-45ec-8163-a0a155bcb39f service nova] Creating event network-changed:e55910a4-60fb-4c9c-9429-97cd52f7ff56 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:30.690350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-78cc8f33-7162-4f93-ba48-4565059768bd req-1b69247b-dfe5-45ec-8163-a0a155bcb39f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115749 Jul 18 13:13:30.691754 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1672/3437] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:30.711179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:30.713895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:30.734222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:30.735697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:30.737464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:30.738596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:31.428398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:31.468180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:31.471364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:31.472969 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1cb5e1b5-f1f0-4998-a752-440732cdda6e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1849 microversion: 2.42 time: 0.779190 Jul 18 13:13:31.474131 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1673/3438] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:30 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1849 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:31.511274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:31.513033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:31.527610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:31.528458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:31.529966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:31.530798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:31.533761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:31.571523 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63d1a605-7b7e-42e1-b6cd-e39e8f465394 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 1.605079 Jul 18 13:13:31.575778 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1766/3439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:29 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:31.593269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:31.601500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:31.624698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:31.629859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:31.639316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:31.640834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:33.298626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:33.412869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:33.623400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:33.639843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a6c4890-8447-4717-b8b6-a76084248278 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 2.136112 Jul 18 13:13:33.640450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1674/3440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:31 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:33.664204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3184d658-3d95-4974-ba83-968fc5b183d7 req-c9496950-eaa3-4e6c-a306-7c9835ccdbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa368980-0fa6-4f71-8864-55ba6965b76a", "tag": "2ea500f4-27a0-42d2-ac83-da85f44531a6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:33.690292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3184d658-3d95-4974-ba83-968fc5b183d7 req-c9496950-eaa3-4e6c-a306-7c9835ccdbc8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:33.691064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3184d658-3d95-4974-ba83-968fc5b183d7 req-c9496950-eaa3-4e6c-a306-7c9835ccdbc8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:33.731677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3184d658-3d95-4974-ba83-968fc5b183d7 req-c9496950-eaa3-4e6c-a306-7c9835ccdbc8 service nova] Creating event network-changed:2ea500f4-27a0-42d2-ac83-da85f44531a6 for instance fa368980-0fa6-4f71-8864-55ba6965b76a on n-h2-850003-3 Jul 18 13:13:33.762591 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3184d658-3d95-4974-ba83-968fc5b183d7 req-c9496950-eaa3-4e6c-a306-7c9835ccdbc8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120485 Jul 18 13:13:33.763534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1675/3441] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:33.797258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:33.798685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:33.817319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:33.818183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:33.832098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:33.832912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:33.861869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:33.913819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:33.916180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:33.917808 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eccb74bf-4938-4bd2-97a0-f04c76fcaece tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 2.340164 Jul 18 13:13:33.946270 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1767/3442] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:31 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:33.946270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:33.946270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:33.964597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:33.965613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:33.966706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:33.967639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:35.129532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:35.179578 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4cc27b1c-9e4b-4970-b624-4b107d8dddc1 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1681 microversion: 2.1 time: 1.242182 Jul 18 13:13:35.194573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1768/3443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:33 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1681 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:35.217307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:35.218011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:35.248369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:35.249184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:35.253962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:35.257796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:35.323969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:35.354776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ace4b03-9923-4a13-99b0-b703c0fbb30a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 1.573929 Jul 18 13:13:35.366187 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1676/3444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:33 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:35.376467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:35.388246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:35.409446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:35.410852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:35.413684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:35.414899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:36.320699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:36.337666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd2afb9f-d7bb-40b6-b7f7-dec717cc88db tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 1.137912 Jul 18 13:13:36.339045 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1769/3445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:35 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:36.353555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:36.354939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:36.367103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:36.368099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:36.370737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:36.372172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:36.884377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:36.898120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dae105e0-e828-4106-9cf1-01e4e8c2ef1f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 0.556556 Jul 18 13:13:36.910189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1770/3446] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:36 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:36.914634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d303e64e-d09a-4ac9-b88b-79604d746109 req-fb01f7e7-782c-4f7c-8af1-878199e0e962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cab126c-3f1e-415d-bf7d-1d106cb34bbe", "name": "network-vif-unplugged", "status": "completed", "tag": "02590902-2d3d-4bcb-9349-2e19ac73f4ee"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:36.932596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d303e64e-d09a-4ac9-b88b-79604d746109 req-fb01f7e7-782c-4f7c-8af1-878199e0e962 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:36.933418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d303e64e-d09a-4ac9-b88b-79604d746109 req-fb01f7e7-782c-4f7c-8af1-878199e0e962 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:36.979565 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d303e64e-d09a-4ac9-b88b-79604d746109 req-fb01f7e7-782c-4f7c-8af1-878199e0e962 service nova] Creating event network-vif-unplugged:02590902-2d3d-4bcb-9349-2e19ac73f4ee for instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe on n-h2-850003-3 Jul 18 13:13:36.994035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:37.022899 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d303e64e-d09a-4ac9-b88b-79604d746109 req-fb01f7e7-782c-4f7c-8af1-878199e0e962 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115033 Jul 18 13:13:37.051663 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1771/3447] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:37.067842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:37.073007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:37.075320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:37.077938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a06c94f-cea8-42a3-87b4-52a29129d640 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1849 microversion: 2.42 time: 1.717273 Jul 18 13:13:37.094199 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1677/3448] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:35 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1849 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:37.095710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:37.101673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:37.101673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:37.129057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:37.130166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:37.131970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:37.138096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:37.149672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:37.150510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:37.151909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:37.152730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:38.274221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:38.319393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:38.327793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:38.331775 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10d26ad7-fd74-4422-a247-5a8e2f416b2d tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.246995 Jul 18 13:13:38.336833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1678/3449] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:37 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:38.348228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:38.350570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:38.368386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:38.369625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:38.371940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:38.373096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:38.475456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:38.491860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9a9d48a-a0f7-4af1-b528-c45fbe638a89 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.437768 Jul 18 13:13:38.493274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1772/3450] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:37 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:38.525298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:38.526980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:38.539793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:38.541111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:38.543502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:38.544749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:39.070175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:39.095288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:39.111388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05d0e09a-82e9-44b5-baff-5ea1776d3505 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1614 microversion: 2.1 time: 0.771624 Jul 18 13:13:39.114666 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1679/3451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:38 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1614 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:39.140619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-92075d23-93d7-4679-8101-572df72488b5 req-2ea278ee-cfb5-4b02-84ee-38a2672b542c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc73bb6f-593b-47db-83ab-a46d14657248", "tag": "ab2ff59f-f7dd-4415-b3e2-0831b29b241d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:39.174402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92075d23-93d7-4679-8101-572df72488b5 req-2ea278ee-cfb5-4b02-84ee-38a2672b542c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:39.174864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92075d23-93d7-4679-8101-572df72488b5 req-2ea278ee-cfb5-4b02-84ee-38a2672b542c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:39.291928 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-92075d23-93d7-4679-8101-572df72488b5 req-2ea278ee-cfb5-4b02-84ee-38a2672b542c service nova] Creating event network-changed:ab2ff59f-f7dd-4415-b3e2-0831b29b241d for instance bc73bb6f-593b-47db-83ab-a46d14657248 on n-h2-850003-3 Jul 18 13:13:39.312024 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-92075d23-93d7-4679-8101-572df72488b5 req-2ea278ee-cfb5-4b02-84ee-38a2672b542c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194764 Jul 18 13:13:39.313391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1680/3452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:39.323413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:39.325754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:39.336769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:39.337965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:39.339789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:39.341627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:39.965735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:39.985095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15ff7403-ffd9-4f45-b5e6-6d458019338b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 0.669251 Jul 18 13:13:39.986064 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1681/3453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:39 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:39.999345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:40.000716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:40.018862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.019434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.020343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.020801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.301538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:40.326445 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39273bf9-5d34-43a1-8269-7530531eb11f tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 1.817294 Jul 18 13:13:40.337339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1773/3454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:38 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:40.354407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:40.355762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:40.380424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.381749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.384056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.385140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.394668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:40.408157 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1de36e4b-9190-4e64-8ba6-c985ed3aa037 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 0.420783 Jul 18 13:13:40.415907 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1682/3455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:39 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:40.438501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:40.439460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:40.464364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.464618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.470422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.472549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.598615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Locking {{(pid=131367) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 18 13:13:40.840005 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b38ffc7-a870-453c-8a98-a0f5cf67a26a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.418479 Jul 18 13:13:40.845133 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1683/3456] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:40 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:40.890939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c158f2e-de61-4600-ab0c-431fb62ad5f8", "name": "network-vif-plugged", "status": "completed", "tag": "a09060db-b243-4064-843b-51ff8af62eca"}, {"server_uuid": "88fceed9-6790-4556-afdc-53d03577924b", "name": "network-vif-plugged", "status": "completed", "tag": "86600ffd-699a-4061-9add-a7c2adeae1dc"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:40.943916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:40.945462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:40.978071 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] Creating event network-vif-plugged:a09060db-b243-4064-843b-51ff8af62eca for instance 0c158f2e-de61-4600-ab0c-431fb62ad5f8 on n-h2-850003-3 Jul 18 13:13:40.979068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] Creating event network-vif-plugged:86600ffd-699a-4061-9add-a7c2adeae1dc for instance 88fceed9-6790-4556-afdc-53d03577924b on n-h1-850003-3 Jul 18 13:13:41.027922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b1b51953-e830-4d15-9522-9acb239b628c req-5ddc59dc-a189-4c67-a7e1-020e1395ab06 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.179999 Jul 18 13:13:41.048495 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1684/3457] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:41.113481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:41.122802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:41.170294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.174394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.176123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.177214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.384953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:41.424442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:41.434002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:41.438610 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c28b0a9f-2a18-41f7-98f8-186e47e488e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1891 microversion: 2.42 time: 1.099282 Jul 18 13:13:41.443632 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1774/3458] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:40 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1891 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:41.467685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e3243cd4-9062-4a6f-8df8-cc64c42e9867 req-32e1c638-400c-4db8-8167-60202b5f9311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cab126c-3f1e-415d-bf7d-1d106cb34bbe", "name": "network-vif-deleted", "tag": "02590902-2d3d-4bcb-9349-2e19ac73f4ee"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:41.504700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e3243cd4-9062-4a6f-8df8-cc64c42e9867 req-32e1c638-400c-4db8-8167-60202b5f9311 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.508907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e3243cd4-9062-4a6f-8df8-cc64c42e9867 req-32e1c638-400c-4db8-8167-60202b5f9311 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.557761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e3243cd4-9062-4a6f-8df8-cc64c42e9867 req-32e1c638-400c-4db8-8167-60202b5f9311 service nova] Creating event network-vif-deleted:02590902-2d3d-4bcb-9349-2e19ac73f4ee for instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe on n-h2-850003-3 Jul 18 13:13:41.589748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e3243cd4-9062-4a6f-8df8-cc64c42e9867 req-32e1c638-400c-4db8-8167-60202b5f9311 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137577 Jul 18 13:13:41.596003 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1775/3459] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:41.621172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:41.622579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:41.643111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.644330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.646505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.648329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.719908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.721412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.722684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lazy-loading 'fault' on Instance uuid 7cab126c-3f1e-415d-bf7d-1d106cb34bbe {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:13:41.847455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0fc95c467b49b9b18423663272bec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89651644ce0c4de1b9f1c1e7c6bdd030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:41.867130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-173e6077-9367-4cb4-892a-b7258aeb46fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 200 len: 1332 microversion: 2.1 time: 0.268891 Jul 18 13:13:41.870741 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1776/3460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:41 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 1332 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:41.888617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:41.893632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:41.920018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.921589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:41.927663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:41.932123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:42.414193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:42.434061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:42.436380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:42.446682 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64dc805a-526f-4caf-8797-3d332e949092 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.394403 Jul 18 13:13:42.448008 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1685/3461] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:41 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:42.462949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:42.469453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:42.488840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:42.490711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:42.492777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:42.506970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:42.844917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:42.869754 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f13dbb4-f783-4015-ab8c-839ce62e6966 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1308 microversion: 2.1 time: 0.419574 Jul 18 13:13:42.873858 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1686/3462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:42 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:42.888603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:42.889863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:42.910881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:42.911370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:42.912964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:42.913796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:43.290882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:43.304498 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c54a671b-ffb1-41ed-9815-b82a3147a688 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 0.428740 Jul 18 13:13:43.319849 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1687/3463] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:42 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:43.328503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:43.329343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:43.339224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:43.340534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:43.341442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:43.341901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:43.429917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:43.452115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63eac88c-485a-4bb8-870e-29d77617802c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.573447 Jul 18 13:13:43.454370 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1777/3464] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:41 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:43.461829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "17ab78fd-5a1c-41fd-b464-c43918fe755f"}, {"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "2658726f-8f22-4a68-949c-9c30639612d1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:43.492125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:43.498244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:43.549602 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] Creating event network-changed:17ab78fd-5a1c-41fd-b464-c43918fe755f for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:43.550702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] Creating event network-changed:2658726f-8f22-4a68-949c-9c30639612d1 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:43.562503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-054ed307-0d52-495c-8060-24300c490727 req-34a85271-f4f7-4c48-94a0-a7e20916e33f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105883 Jul 18 13:13:43.569972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1778/3465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:43.584003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:43.585015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:43.615056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:43.615614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:43.616497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:43.616952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.004471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:44.027889 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-790d04fd-96a5-4473-9674-f60229c4ed82 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 0.705895 Jul 18 13:13:44.047079 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1688/3466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:43 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:44.075763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:44.077872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:44.119427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.122918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.129929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.131204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.189078 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] HTTP exception thrown: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Request method failure captured: Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe HTTP/1.1 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtMbm-1bwbd5GsmhmeiKHh3Ngt8XP5UfgJVtQJqa68dSQWOkiq7zQcaTwj_J5CemoMGQLXVCl7bxes4cMtAizeKcpzbnKdrX9gCprLFtrEIJu1o9M2Z9_pfVnpAPwb7CoLM2hox6erqore8Ezcd_WkZJuyzugXvi3co2CmwHsYCvHE Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_89651644ce0c4de1b9f1c1e7c6bdd030", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6d0fc95c467b49b9b18423663272bec9 Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7cab126c-3f1e-415d-bf7d-1d106cb34bbe'} Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:44.199446 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:13:44.210478 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.220712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Returning 404 to user: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:13:44.222627 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb77770d-cf6d-4860-8e52-7e81eef079fa tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 404 len: 111 microversion: 2.1 time: 0.173057 Jul 18 13:13:44.229347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1689/3467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:44 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:13:44.238798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:44.240325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:44.252983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.254355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.256275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.257388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.445367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:44.496136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:44.508066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:44.522976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dae60f15-3e6f-43f6-982d-d3e5ec272a97 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1891 microversion: 2.42 time: 0.943587 Jul 18 13:13:44.540476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1779/3468] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:43 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1891 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:44.567402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:44.593775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.596044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.709835 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action HTTP/1.1 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 15 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: {"os-stop": {}} Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '2f3b2ac7-9dfd-4893-9af0-4d2760a36550', 'body': {'os-stop': {}}} Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked Jul 18 13:13:44.716310 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:13:44.726141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 409 to user: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 is locked {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:13:44.731262 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2644fb97-5155-43ea-9b06-87c3609cc33c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 409 len: 107 microversion: 2.1 time: 0.186170 Jul 18 13:13:44.740234 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1780/3469] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:44 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 107 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:13:44.761149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-991bc457-d4cf-4a90-859b-12869eb4d34d req-feb93213-2d4c-46d8-859f-8d8cebcd40b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa368980-0fa6-4f71-8864-55ba6965b76a", "name": "network-vif-plugged", "status": "completed", "tag": "2ea500f4-27a0-42d2-ac83-da85f44531a6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:44.802341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-991bc457-d4cf-4a90-859b-12869eb4d34d req-feb93213-2d4c-46d8-859f-8d8cebcd40b4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.807955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-991bc457-d4cf-4a90-859b-12869eb4d34d req-feb93213-2d4c-46d8-859f-8d8cebcd40b4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.860797 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-991bc457-d4cf-4a90-859b-12869eb4d34d req-feb93213-2d4c-46d8-859f-8d8cebcd40b4 service nova] Creating event network-vif-plugged:2ea500f4-27a0-42d2-ac83-da85f44531a6 for instance fa368980-0fa6-4f71-8864-55ba6965b76a on n-h2-850003-3 Jul 18 13:13:44.884956 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-991bc457-d4cf-4a90-859b-12869eb4d34d req-feb93213-2d4c-46d8-859f-8d8cebcd40b4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141337 Jul 18 13:13:44.892773 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1781/3470] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:44.912580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:44.913738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:44.923914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.924385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:44.925297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:44.925657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:45.456835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:45.481833 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b18854c8-d3d1-44f9-9822-fe2e4ff54f80 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1489 microversion: 2.1 time: 0.587044 Jul 18 13:13:45.489065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:45.495301 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1782/3471] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:44 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1489 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:45.516414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-092800f7-b11c-4d2d-a98f-cebcabcef094 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '.version_select at 0x7f96e9b06940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:45.520408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:45.538527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:45.540935 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81f47aec-c81f-4064-8638-6b7e8bc5451a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.308837 Jul 18 13:13:45.541985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1690/3472] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:44 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:45.569114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-092800f7-b11c-4d2d-a98f-cebcabcef094 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762915781" status: 202 len: 0 microversion: 2.1 time: 0.069511 Jul 18 13:13:45.576454 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1783/3473] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762915781 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:45.584303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:45.585970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:45.599868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:45.600740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:45.602355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:45.603162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:45.609151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:45.610983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:45.640716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:45.647770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:45.653256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:45.654630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:45.751990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:45.825061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Unlocking {{(pid=131366) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 13:13:45.986762 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-132c5f6e-8e7e-4518-9c2b-72eac0a54bc1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.407444 Jul 18 13:13:45.988848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1784/3474] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:45 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:46.003830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:46.004819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:46.026434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.027975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.030550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.031279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.125025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:46.160881 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b79d8f7f-6f7e-4fa3-aafe-2f5568939b2e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 0.592962 Jul 18 13:13:46.162462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1691/3475] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:45 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:46.172243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:46.174977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:46.188276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.189319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.190985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.192459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.398936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-65eab5f1-4781-44e5-bec1-a15cba79d7ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "PUT /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1084 microversion: 2.1 time: 0.232787 Jul 18 13:13:46.401462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1692/3476] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:13:46 2022] PUT /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1084 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:46.419863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:46.421647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:46.438754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.442263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.452631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.454999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.769753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:46.794590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-643eac72-a351-47dd-a5a1-606a1882a05f tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1320 microversion: 2.1 time: 0.802847 Jul 18 13:13:46.806782 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1785/3477] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:45 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1320 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:46.826070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fd631bfe-753f-4d20-9179-da4ba64cd4ad req-893a2739-bfd3-4026-a55c-27c3686032a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "c9972e1f-8e69-4009-8b8b-ac6965438f43"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:46.868894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fd631bfe-753f-4d20-9179-da4ba64cd4ad req-893a2739-bfd3-4026-a55c-27c3686032a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:46.874771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fd631bfe-753f-4d20-9179-da4ba64cd4ad req-893a2739-bfd3-4026-a55c-27c3686032a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:46.928831 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fd631bfe-753f-4d20-9179-da4ba64cd4ad req-893a2739-bfd3-4026-a55c-27c3686032a4 service nova] Creating event network-changed:c9972e1f-8e69-4009-8b8b-ac6965438f43 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:46.953933 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fd631bfe-753f-4d20-9179-da4ba64cd4ad req-893a2739-bfd3-4026-a55c-27c3686032a4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144262 Jul 18 13:13:46.957739 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1786/3478] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:46.979577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f35a3d6b-629a-4478-b8ca-6f76a397d7e1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:47.007256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35a3d6b-629a-4478-b8ca-6f76a397d7e1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:47.011012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f35a3d6b-629a-4478-b8ca-6f76a397d7e1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:47.112944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f35a3d6b-629a-4478-b8ca-6f76a397d7e1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:13:47.347281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:47.357476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f35a3d6b-629a-4478-b8ca-6f76a397d7e1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.394446 Jul 18 13:13:47.360396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1787/3479] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:46 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:47.377314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:47.379086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:47.383693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:47.386652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:47.391368 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-087f0c43-bada-43a0-9ea0-62baf886ffc8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1891 microversion: 2.42 time: 0.986747 Jul 18 13:13:47.392158 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1693/3480] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:46 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1891 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:47.407413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:47.408091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:47.408933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:47.410197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:47.411681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:47.412385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:47.434855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:47.435699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:47.439879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:47.439879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:48.061456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:48.086937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75a9385f-3ea8-4122-9557-22aaa9985fc3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1510 microversion: 2.1 time: 0.723321 Jul 18 13:13:48.099966 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1788/3481] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:47 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1510 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:48.118244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:48.119377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:48.144924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:48.146029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:48.147686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:48.148874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:48.641923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:48.681305 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69351019-954a-403d-bbce-fb688f1e6e3a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 0.576988 Jul 18 13:13:48.685711 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1789/3482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:48 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:48.709037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:48.716442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:48.735646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:48.736469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:48.737924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:48.738735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.045136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.079846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.086593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.090274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a03ddf4b-b1ae-4da6-844a-2a44b7789239 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.695687 Jul 18 13:13:49.092391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1694/3483] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:47 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:49.101446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d0c3d40c-c2ec-4256-bc73-59df24896e81 req-ccbe1ec4-c5eb-4b7b-aca9-75fb91b1fc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc73bb6f-593b-47db-83ab-a46d14657248", "name": "network-vif-plugged", "status": "completed", "tag": "ab2ff59f-f7dd-4415-b3e2-0831b29b241d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:49.125587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d0c3d40c-c2ec-4256-bc73-59df24896e81 req-ccbe1ec4-c5eb-4b7b-aca9-75fb91b1fc9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.126831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d0c3d40c-c2ec-4256-bc73-59df24896e81 req-ccbe1ec4-c5eb-4b7b-aca9-75fb91b1fc9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.139303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:49.175814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d0c3d40c-c2ec-4256-bc73-59df24896e81 req-ccbe1ec4-c5eb-4b7b-aca9-75fb91b1fc9e service nova] Creating event network-vif-plugged:ab2ff59f-f7dd-4415-b3e2-0831b29b241d for instance bc73bb6f-593b-47db-83ab-a46d14657248 on n-h2-850003-3 Jul 18 13:13:49.208715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d0c3d40c-c2ec-4256-bc73-59df24896e81 req-ccbe1ec4-c5eb-4b7b-aca9-75fb91b1fc9e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109697 Jul 18 13:13:49.210676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1695/3484] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:49.227933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:49.230196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:49.243539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.244909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.246571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.247449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.395584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.425112 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69b4e2a7-8364-4c96-8444-bb87d8e80587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.737553 Jul 18 13:13:49.428471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1790/3485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:48 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:49.445040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:49.449801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:49.470551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.471715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.473391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.474493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.859383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.875084 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad060915-bc95-452e-a12e-af39870aa2e1 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 200 len: 1505 microversion: 2.1 time: 0.661700 Jul 18 13:13:49.876473 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1696/3486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:49 2022] GET /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:49.908206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:49.921823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:49.927052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:49.941827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7c83649-e110-49b5-b5f1-d54de36592a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1510 microversion: 2.1 time: 0.510915 Jul 18 13:13:49.943519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1791/3487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:49 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:49.950295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.952145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.954945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.957364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:49.962534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9ab32330-7215-4251-b0b6-a6c2744afe9d req-cec3c352-4570-49fa-9dd6-41cbbf35ff86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "89a431b7-da19-47fb-9aae-199f2600baf7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:49.991737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9ab32330-7215-4251-b0b6-a6c2744afe9d req-cec3c352-4570-49fa-9dd6-41cbbf35ff86 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:49.992564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9ab32330-7215-4251-b0b6-a6c2744afe9d req-cec3c352-4570-49fa-9dd6-41cbbf35ff86 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.017896 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9ab32330-7215-4251-b0b6-a6c2744afe9d req-cec3c352-4570-49fa-9dd6-41cbbf35ff86 service nova] Creating event network-changed:89a431b7-da19-47fb-9aae-199f2600baf7 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:50.030091 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9ab32330-7215-4251-b0b6-a6c2744afe9d req-cec3c352-4570-49fa-9dd6-41cbbf35ff86 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084128 Jul 18 13:13:50.032421 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1792/3488] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:50.043163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:50.046331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:50.059149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.060316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.062008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.063164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.565258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:50.582579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:50.585868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:50.588336 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db44ae76-8829-4f19-ab7b-208677cb0c68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.709205 Jul 18 13:13:50.590245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1697/3489] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:49 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:50.603021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:50.604240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 0c158f2e-de61-4600-ab0c-431fb62ad5f8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:50.619661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.629248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.629248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.629248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.675719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:50.702177 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-023b3a4a-d822-44ed-ac8c-3fd576d9ca0d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1315 microversion: 2.1 time: 0.665902 Jul 18 13:13:50.703775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1793/3490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:50 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:50.735241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:50.737770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:50.748980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:50.752808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.753639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.755180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:50.755955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:50.829232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:13:51.021356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:51.051467 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51338347-b68a-498c-9c6a-983eef708bca tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 204 len: 0 microversion: 2.1 time: 0.344859 Jul 18 13:13:51.053016 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1794/3491] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:13:50 2022] DELETE /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:13:51.061747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69b2ea01-08bd-4e92-a23d-a10848d636a4 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/0c158f2e-de61-4600-ab0c-431fb62ad5f8" status: 200 len: 1505 microversion: 2.1 time: 0.468718 Jul 18 13:13:51.077075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:51.079878 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1698/3492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:50 2022] GET /compute/v2.1/servers/0c158f2e-de61-4600-ab0c-431fb62ad5f8 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:51.080348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:51.095154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.096025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.097065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.097598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.104799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:51.106196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:51.130596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.131496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.133090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.133739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.515435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:51.533930 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-387b291e-2f18-4e77-9704-65f294281bba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.451259 Jul 18 13:13:51.535827 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1699/3493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:51 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:51.546581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:51.548156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:51.561549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.567292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.568743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.569462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.908157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:51.931847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:51.935683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:51.937385 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1411b88c-3d9e-403e-ab6f-edde8873f4f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.881944 Jul 18 13:13:51.938910 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1795/3494] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:51 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:51.952986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:51.954273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 0c158f2e-de61-4600-ab0c-431fb62ad5f8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:51.973995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.976788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:51.978992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:51.981049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.014834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:52.053118 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-323ec5db-4d23-40a1-bb19-a53cf48a8493 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1516 microversion: 2.1 time: 0.508902 Jul 18 13:13:52.055666 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1700/3495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:51 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1516 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:52.080800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 0c158f2e-de61-4600-ab0c-431fb62ad5f8] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:13:52.090979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:52.092814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:52.129909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.131231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.135463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.140036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.248471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=90,nova_cell1:UPDATE=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:52.468820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be14a79a-b655-4feb-8c37-05864983fd25 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0c158f2e-de61-4600-ab0c-431fb62ad5f8" status: 204 len: 0 microversion: 2.1 time: 0.527141 Jul 18 13:13:52.470178 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1796/3496] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:13:51 2022] DELETE /compute/v2.1/servers/0c158f2e-de61-4600-ab0c-431fb62ad5f8 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:13:52.480882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:52.481886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:52.498773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.500293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.502064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.502934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.705085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:52.725886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:52.729708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:52.732704 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88616420-1a1a-42b2-8a64-0a378ee9e795 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.674633 Jul 18 13:13:52.733770 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1701/3497] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:52 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:52.744186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-de325d0f-103b-4993-ade1-e49f9c824e51 req-4d743251-23bd-4043-9afb-b1a9280b85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "8791c0a2-8139-4af5-9ac2-a0f217024850"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:52.763631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-de325d0f-103b-4993-ade1-e49f9c824e51 req-4d743251-23bd-4043-9afb-b1a9280b85b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.764470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-de325d0f-103b-4993-ade1-e49f9c824e51 req-4d743251-23bd-4043-9afb-b1a9280b85b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.796345 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-de325d0f-103b-4993-ade1-e49f9c824e51 req-4d743251-23bd-4043-9afb-b1a9280b85b1 service nova] Creating event network-changed:8791c0a2-8139-4af5-9ac2-a0f217024850 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:52.810633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-de325d0f-103b-4993-ade1-e49f9c824e51 req-4d743251-23bd-4043-9afb-b1a9280b85b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074353 Jul 18 13:13:52.812502 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1702/3498] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:52.823055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:52.827461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:52.843560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.844615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.846341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:52.847327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:52.934245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: fa368980-0fa6-4f71-8864-55ba6965b76a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:13:53.174999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a26f5471-8b81-4d3f-8cc1-5c2d9f5d9def tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a" status: 204 len: 0 microversion: 2.1 time: 0.356786 Jul 18 13:13:53.192963 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1703/3499] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:13:52 2022] DELETE /compute/v2.1/servers/fa368980-0fa6-4f71-8864-55ba6965b76a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:13:53.224600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:53.229484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:53.266835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:53.271542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:53.275689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:53.278027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:53.894601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:53.919076 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80a95b81-f780-420a-946e-f85c960af934 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.721289 Jul 18 13:13:53.920097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1704/3500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:53 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:53.950233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:53.951526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:53.963054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:53.964102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:53.965429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:53.967268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:53.968320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:53.998198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6cc5b353-fcba-42f5-b19d-0bfb66a21b81 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1501 microversion: 2.1 time: 1.526489 Jul 18 13:13:53.999347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1797/3501] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:52 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1501 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:54.021252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:54.024161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:54.056974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:54.065523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:54.065988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:54.068229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:54.975112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:54.976069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.000509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1347b01f-1554-42da-863a-914efff149b5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1516 microversion: 2.1 time: 0.999006 Jul 18 13:13:55.013273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.015998 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1798/3502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:53 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1516 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:55.024157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.027198 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5516d98e-4062-424e-87d9-a4e99da0152f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.090761 Jul 18 13:13:55.030241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-166224968", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a033b52b-1498-49d7-ba23-1daf19aff968"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:55.031759 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1705/3503] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:53 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:55.050656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:55.071632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:55.117370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:55.124415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:55.126201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:55.133646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:55.236079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] validate_networks() for [('a033b52b-1498-49d7-ba23-1daf19aff968', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:13:55.890483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.928772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.942802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:55.945438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-690e75fd-b0a2-4237-9fe4-d14eb36dbdcc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.911931 Jul 18 13:13:55.990878 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1706/3504] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:55 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:56.037281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6668f12f-1f46-432d-a294-e82fa5b5247c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:56.069477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6668f12f-1f46-432d-a294-e82fa5b5247c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:56.075372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6668f12f-1f46-432d-a294-e82fa5b5247c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:56.416034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6668f12f-1f46-432d-a294-e82fa5b5247c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Going to try to stop instance {{(pid=131367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:13:56.640958 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6668f12f-1f46-432d-a294-e82fa5b5247c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248/action" status: 202 len: 0 microversion: 2.1 time: 0.639980 Jul 18 13:13:56.642735 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1707/3505] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:13:55 2022] POST /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:13:56.657724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:56.668635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:56.701642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:56.715914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:56.717253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:56.720109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:56.722927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.426526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:57.459004 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4fd770f7-1423-4cf8-b01f-aee4fe03afcb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.813411 Jul 18 13:13:57.460097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1708/3506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:56 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:57.488939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:57.495889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:57.528878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:57.532402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.536687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:57.539591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.591769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:13:57.592626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:13:57.593553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:13:57.595170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:13:57.595970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:13:57.645686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:57.646705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.648325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:57.650534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:57.653224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.655173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lazy-loading 'fault' on Instance uuid 88fceed9-6790-4556-afdc-53d03577924b {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:13:57.655663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:57.752565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Getting quotas for project 8d2b92ce2ef44d4ab4943bffab5568f2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:13:57.784938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Getting quotas for user 20db5561236e4a26a87d4050bb6d4da1 and project 8d2b92ce2ef44d4ab4943bffab5568f2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:13:57.834418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Going to run 2 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:13:57.847570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:57.904626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:57.939418 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9f1f5ec-4eb1-4997-b60d-8a319aae49ae tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 200 len: 1319 microversion: 2.1 time: 0.474237 Jul 18 13:13:57.944929 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1709/3507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:57 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:57.969937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9c3e56f8-cb56-4112-9946-7f3659b7faa0 req-9afc8fcd-81c2-4f93-8136-9da20c1af9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "a55f2463-da87-436c-bdce-5622c0a24659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:13:57.970270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=01c83335-3dd0-4128-ae35-ef01ca25ac15,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:13:58.008346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c3e56f8-cb56-4112-9946-7f3659b7faa0 req-9afc8fcd-81c2-4f93-8136-9da20c1af9e0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:58.011393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c3e56f8-cb56-4112-9946-7f3659b7faa0 req-9afc8fcd-81c2-4f93-8136-9da20c1af9e0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:58.083279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:13:58.088087 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9c3e56f8-cb56-4112-9946-7f3659b7faa0 req-9afc8fcd-81c2-4f93-8136-9da20c1af9e0 service nova] Creating event network-changed:a55f2463-da87-436c-bdce-5622c0a24659 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:13:58.116447 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9c3e56f8-cb56-4112-9946-7f3659b7faa0 req-9afc8fcd-81c2-4f93-8136-9da20c1af9e0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168532 Jul 18 13:13:58.124087 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1710/3508] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:13:58.141744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:58.147365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:58.187749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:58.188738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:58.190402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:58.191360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:58.303469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c285c1ad-9058-4a4a-9911-d603057e530e tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.285582 Jul 18 13:13:58.321151 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1799/3509] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:13:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 3304 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 13:13:58.334547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:58.345086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:58.389811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:58.390717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:58.392246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:58.396490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:59.803922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:59.829263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:59.845929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:59.848626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:59.852482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd7739ad-1707-4936-93a9-607dbb8d0b1b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.725707 Jul 18 13:13:59.875940 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de07b239-ac2a-4d4e-ad79-08c72820f51a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 1.553167 Jul 18 13:13:59.880540 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1711/3510] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:58 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:13:59.895206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1800/3511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:13:58 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:13:59.901114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:59.907325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:13:59.909072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:13:59.916007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:13:59.918217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Searching by: {'deleted': False, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:13:59.947299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:59.948174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:59.951145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:59.952048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:59.957669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:59.958467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:13:59.960192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:13:59.962684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:00.098118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:14:00.218044 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b4bbc14-7b5a-4656-a234-d64de3f58665 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.321288 Jul 18 13:14:00.230139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1801/3512] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:13:59 2022] GET /compute/v2.1/servers => generated 1335 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:00.242464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:00.250975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:00.275214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:00.276054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:00.282186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:00.283028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.311034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:01.358425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:01.365170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:01.375817 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4be9b1f-9a9f-45e2-b3cf-11284bbee8c6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.489456 Jul 18 13:14:01.381727 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1712/3513] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:13:59 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:01.399263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:01.404829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:01.438296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:01.443884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.446360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:01.451410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.528385 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b HTTP/1.1 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '88fceed9-6790-4556-afdc-53d03577924b'} Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:01.538616 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:14:01.551159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:01.560357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:01.562674 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec972225-1563-412c-b1d8-a577ae3ef6af tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 404 len: 111 microversion: 2.1 time: 0.178256 Jul 18 13:14:01.576552 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1713/3514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:01 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:14:01.614299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:01.623559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:01.680530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:01.681757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.690783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:01.697240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.722585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:01.779663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95956ae5-ca73-45c0-838b-c22abb37ad56 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 1.546976 Jul 18 13:14:01.789913 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1802/3515] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:00 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:01.831288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-195fc825-bf1b-42bd-a10b-0b0b7b4ffc07 req-5b7ada46-888e-4593-9b2d-8907392e769a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fceed9-6790-4556-afdc-53d03577924b", "name": "network-vif-deleted", "tag": "86600ffd-699a-4061-9add-a7c2adeae1dc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:01.881207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-195fc825-bf1b-42bd-a10b-0b0b7b4ffc07 req-5b7ada46-888e-4593-9b2d-8907392e769a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:01.888357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-195fc825-bf1b-42bd-a10b-0b0b7b4ffc07 req-5b7ada46-888e-4593-9b2d-8907392e769a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:01.942377 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-195fc825-bf1b-42bd-a10b-0b0b7b4ffc07 req-5b7ada46-888e-4593-9b2d-8907392e769a service nova] Creating event network-vif-deleted:86600ffd-699a-4061-9add-a7c2adeae1dc for instance 88fceed9-6790-4556-afdc-53d03577924b on n-h1-850003-3 Jul 18 13:14:01.966819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-195fc825-bf1b-42bd-a10b-0b0b7b4ffc07 req-5b7ada46-888e-4593-9b2d-8907392e769a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174190 Jul 18 13:14:01.971314 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1803/3516] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:01.998191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:02.000143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:02.032429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:02.033371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:02.035142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:02.035984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:02.146919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:02.232096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3196d5d2-872d-45d4-856e-6f2520266cf3 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1221 microversion: 2.1 time: 0.645205 Jul 18 13:14:02.237320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1714/3517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:01 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1221 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:02.274565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:02.281336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:02.327209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:02.329429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:02.341729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:02.344851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:02.915671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:02.959343 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-903cc6f1-575e-4a09-8626-ab4e70d6820c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.713624 Jul 18 13:14:02.962778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1715/3518] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:02 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:03.031917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-50918e82-1a90-476c-9a91-dc8331a6454e req-b86d6929-72ad-45c5-990f-864fe8865e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c158f2e-de61-4600-ab0c-431fb62ad5f8", "name": "network-vif-deleted", "tag": "a09060db-b243-4064-843b-51ff8af62eca"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:03.064356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-50918e82-1a90-476c-9a91-dc8331a6454e req-b86d6929-72ad-45c5-990f-864fe8865e7a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:03.067142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-50918e82-1a90-476c-9a91-dc8331a6454e req-b86d6929-72ad-45c5-990f-864fe8865e7a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:03.119388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-50918e82-1a90-476c-9a91-dc8331a6454e req-b86d6929-72ad-45c5-990f-864fe8865e7a service nova] Creating event network-vif-deleted:a09060db-b243-4064-843b-51ff8af62eca for instance 0c158f2e-de61-4600-ab0c-431fb62ad5f8 on n-h2-850003-3 Jul 18 13:14:03.142945 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-50918e82-1a90-476c-9a91-dc8331a6454e req-b86d6929-72ad-45c5-990f-864fe8865e7a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168175 Jul 18 13:14:03.149660 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1716/3519] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:03.175285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:03.178547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:03.202193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:03.205265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:03.212502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:03.213742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:03.275907 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] HTTP exception thrown: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Request method failure captured: Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe HTTP/1.1 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtMbm-1bwbd5GsmhmeiKHh3Ngt8XP5UfgJVtQJqa68dSQWOkiq7zQcaTwj_J5CemoMGQLXVCl7bxes4cMtAizeKcpzbnKdrX9gCprLFtrEIJu1o9M2Z9_pfVnpAPwb7CoLM2hox6erqore8Ezcd_WkZJuyzugXvi3co2CmwHsYCvHE Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_89651644ce0c4de1b9f1c1e7c6bdd030", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6d0fc95c467b49b9b18423663272bec9 Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7cab126c-3f1e-415d-bf7d-1d106cb34bbe'} Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:03.280264 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:03.289263 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:03.296570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Returning 404 to user: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:03.301534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e5a48cab-722b-4133-8a03-475dfcba7261 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 404 len: 111 microversion: 2.1 time: 0.142828 Jul 18 13:14:03.303184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1717/3520] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:14:03 2022] DELETE /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:14:03.324373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1629240192", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e5781d37-5148-4dcb-ab66-3da676255956"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:03.499479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] validate_networks() for [('e5781d37-5148-4dcb-ab66-3da676255956', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:14:03.852535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:03.884843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:03.900048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:03.902253 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-162b9bce-06cb-4e3c-a025-fbe006c135f3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.923531 Jul 18 13:14:03.903534 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1804/3521] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:01 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:03.922709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:03.929153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:03.947015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:03.950119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:03.951295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:03.954813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.110830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:05.144566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:05.148136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:05.155144 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a4da4982-9be9-412d-b9ed-d2a6a25c8b88 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.247590 Jul 18 13:14:05.162863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1805/3522] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:03 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:05.177047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:05.178815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:05.194896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.196065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.197919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.199645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.653851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:14:05.654800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:14:05.656024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:14:05.657418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:14:05.658328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:14:05.676769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.677597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.679554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.680602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.718508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:14:05.730312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Getting quotas for user 6cec9b041a764a5e923aafd4d09610e1 and project 96f2324a4d464b5e8a757112f9e8322c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:14:05.760165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:14:05.765828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:14:05.788840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:05.807799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eeee4fd9-142f-4e93-85f2-1d108493f168 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1653 microversion: 2.1 time: 0.642542 Jul 18 13:14:05.809311 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1806/3523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:05 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1653 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:05.819406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:05.821098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:05.841019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.842356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.845218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.846817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.919920 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-966bc8c9-a104-434e-b80b-1fd40bc8cf38 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611976 Jul 18 13:14:05.921948 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1718/3524] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:14:05.932171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:05.934520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] [instance: 7cab126c-3f1e-415d-bf7d-1d106cb34bbe] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:05.948067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.949612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.951494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:05.952493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:05.984376 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] HTTP exception thrown: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Request method failure captured: Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe HTTP/1.1 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtMbm-1bwbd5GsmhmeiKHh3Ngt8XP5UfgJVtQJqa68dSQWOkiq7zQcaTwj_J5CemoMGQLXVCl7bxes4cMtAizeKcpzbnKdrX9gCprLFtrEIJu1o9M2Z9_pfVnpAPwb7CoLM2hox6erqore8Ezcd_WkZJuyzugXvi3co2CmwHsYCvHE Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_89651644ce0c4de1b9f1c1e7c6bdd030", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/89651644ce0c4de1b9f1c1e7c6bdd030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 89651644ce0c4de1b9f1c1e7c6bdd030 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-865403307 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6d0fc95c467b49b9b18423663272bec9 Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-865403307-project Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7cab126c-3f1e-415d-bf7d-1d106cb34bbe'} Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:05.987661 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. Jul 18 13:14:05.993990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:05.996611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] Returning 404 to user: Instance 7cab126c-3f1e-415d-bf7d-1d106cb34bbe could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:05.997940 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a16c2c9b-8337-423a-a77d-e615fb8e0c19 tempest-AttachSCSIVolumeTestJSON-865403307 tempest-AttachSCSIVolumeTestJSON-865403307-project] 10.222.0.88 "GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe" status: 404 len: 111 microversion: 2.1 time: 0.073797 Jul 18 13:14:05.999182 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1719/3525] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:05 2022] GET /compute/v2.1/servers/7cab126c-3f1e-415d-bf7d-1d106cb34bbe => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:14:06.017017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:06.021747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:06.043447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.045687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.047563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.048220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.525830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:06.554376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0bd657b8-3d5e-459f-905c-7f7d24556ef5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1275 microversion: 2.1 time: 0.741405 Jul 18 13:14:06.567467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1807/3526] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:05 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1275 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:06.579155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:06.581038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:06.601360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.603033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.609358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.610947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.624276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:06.647663 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79a27bc4-9256-47c1-a70b-17441c71617a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.646615 Jul 18 13:14:06.655405 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1720/3527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:05 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:06.676232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0cc7e891-1981-49b7-af06-7596662c7479 req-1bcea2af-ef4c-49ac-87b3-82473ff70373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa368980-0fa6-4f71-8864-55ba6965b76a", "name": "network-vif-deleted", "tag": "2ea500f4-27a0-42d2-ac83-da85f44531a6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:06.718612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0cc7e891-1981-49b7-af06-7596662c7479 req-1bcea2af-ef4c-49ac-87b3-82473ff70373 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.719929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0cc7e891-1981-49b7-af06-7596662c7479 req-1bcea2af-ef4c-49ac-87b3-82473ff70373 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.748195 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0cc7e891-1981-49b7-af06-7596662c7479 req-1bcea2af-ef4c-49ac-87b3-82473ff70373 service nova] Creating event network-vif-deleted:2ea500f4-27a0-42d2-ac83-da85f44531a6 for instance fa368980-0fa6-4f71-8864-55ba6965b76a on n-h2-850003-3 Jul 18 13:14:06.759379 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0cc7e891-1981-49b7-af06-7596662c7479 req-1bcea2af-ef4c-49ac-87b3-82473ff70373 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099954 Jul 18 13:14:06.761563 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1721/3528] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:06.777602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e7d849b-dcd5-4ceb-a601-7390efa3e4bd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:06.812714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7d849b-dcd5-4ceb-a601-7390efa3e4bd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:06.813778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7d849b-dcd5-4ceb-a601-7390efa3e4bd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:06.887489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e7d849b-dcd5-4ceb-a601-7390efa3e4bd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Going to try to start instance {{(pid=131367) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 13:14:07.008238 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e7d849b-dcd5-4ceb-a601-7390efa3e4bd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.241858 Jul 18 13:14:07.012793 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1722/3529] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:14:06 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:14:07.028801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:07.030870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:07.045532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.046630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:07.048679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.049637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:07.384138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:07.426503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b88cc1a8-349c-42a5-a320-6619cfcaf885 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1213 microversion: 2.1 time: 0.408493 Jul 18 13:14:07.447755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1723/3530] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:07 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1213 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:07.463936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:07.467263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:07.485636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.486864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:07.489237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.491089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:07.735280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:07.763250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:07.768232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:07.772946 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27ec0074-8acc-4df4-8e06-a440e3abcc10 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 1.202697 Jul 18 13:14:07.779125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1808/3531] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:06 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:07.794188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:07.796844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:07.803217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:07.824171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.826027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:07.833323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:07.834690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.488520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.498366 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-243f5c3f-d91b-4e27-ad60-1f35632e3179 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1662 microversion: 2.1 time: 0.717170 Jul 18 13:14:08.499294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1809/3532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:07 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1662 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:08.520044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:08.521109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:08.539357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.540207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.541677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.542537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.568966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.609211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.612773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.615216 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f976886-47b4-4c01-9874-175cdf2b1ab7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.173168 Jul 18 13:14:08.627483 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1724/3533] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:07 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:08.643416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:08.644731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:08.670792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.671790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.673316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.674166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.756534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.780670 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a22beeec-48de-4229-95ea-0d8be71b3fd2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1275 microversion: 2.1 time: 0.264485 Jul 18 13:14:08.795096 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1810/3534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:08 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:08.795096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:08.795096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:08.804944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.805680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.807216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:08.808101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:08.958846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:08.980097 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3deb53d-1e63-48e6-b1c1-80a8bc55bc52 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1267 microversion: 2.1 time: 0.195604 Jul 18 13:14:09.004904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1811/3535] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:08 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:09.017956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:09.019528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:09.032788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.033785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.035623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.036562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.454322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:09.467834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:09.470274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:09.472229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-042b4d05-2419-4c24-8213-b483c509ed0f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.464718 Jul 18 13:14:09.473114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1812/3536] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:09 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:09.532673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:09.533745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:09.547800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.548583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.549991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.551073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.579932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:09.592821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b7e043a8-85f9-4790-94e0-906e7451b928 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.972522 Jul 18 13:14:09.593989 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1725/3537] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:08 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:09.605744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:09.643854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:09.645081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:09.659746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.660680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.662304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:09.663216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:09.991138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:10.135742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:10.159911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1dc6871-d15b-4d8c-803c-627de91008e8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1662 microversion: 2.1 time: 0.631451 Jul 18 13:14:10.161917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1813/3538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:09 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1662 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:10.178536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:10.180438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:10.194727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:10.196154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:10.198325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:10.199031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:10.811612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:10.833851 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4c4d0c02-c72a-4385-ae5a-0d96b407d606 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.669622 Jul 18 13:14:10.841329 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1814/3539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:10 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:10.864938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:10.866347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:10.883850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:10.885594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:10.887443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:10.888660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.072498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.100435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.107610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.113636 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37270719-24f2-4040-880c-1e0771cdd633 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.478993 Jul 18 13:14:11.126897 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1726/3540] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:09 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:11.127319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.141884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:11.143451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:11.162322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.163172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.167497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.169858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.170875 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5de01e3-62c1-4398-9c8d-770c0509b8bf tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1267 microversion: 2.1 time: 0.327060 Jul 18 13:14:11.175267 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1815/3541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:10 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1267 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:11.225256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:11.239188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:11.265633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.269307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.270917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.271914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.750083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.783388 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-362b5a14-d6a6-4c68-a9e3-94eca83e0b80 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.602656 Jul 18 13:14:11.785399 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1816/3542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:11 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:11.795163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-604061b5-1bdd-4ce5-be1f-fa571a6063a4 req-f7544251-73da-42b8-bd41-5b0bf1a9cf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "1971fd4f-36e3-45e1-9819-2469791698ad"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:11.813087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-604061b5-1bdd-4ce5-be1f-fa571a6063a4 req-f7544251-73da-42b8-bd41-5b0bf1a9cf42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.814628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-604061b5-1bdd-4ce5-be1f-fa571a6063a4 req-f7544251-73da-42b8-bd41-5b0bf1a9cf42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.851549 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-604061b5-1bdd-4ce5-be1f-fa571a6063a4 req-f7544251-73da-42b8-bd41-5b0bf1a9cf42 service nova] Creating event network-vif-plugged:1971fd4f-36e3-45e1-9819-2469791698ad for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:11.891612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-604061b5-1bdd-4ce5-be1f-fa571a6063a4 req-f7544251-73da-42b8-bd41-5b0bf1a9cf42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101112 Jul 18 13:14:11.895507 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1817/3543] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:11.914990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:11.917247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:11.929410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.929957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.930802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:11.931258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:11.971579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:11.996906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:12.004331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:12.009099 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b3320255-a619-447a-a498-a8a46809c0c8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.888895 Jul 18 13:14:12.026414 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1727/3544] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:11 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:12.041382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-32ec8abc-0320-42c1-b021-832c5a2e1e32 req-69becd0b-6eea-4905-aa94-12c955c5e764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c83335-3dd0-4128-ae35-ef01ca25ac15", "tag": "84d40a39-6c15-4762-aae2-ec02feee759b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:12.083792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-32ec8abc-0320-42c1-b021-832c5a2e1e32 req-69becd0b-6eea-4905-aa94-12c955c5e764 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:12.086572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-32ec8abc-0320-42c1-b021-832c5a2e1e32 req-69becd0b-6eea-4905-aa94-12c955c5e764 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:12.106085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-32ec8abc-0320-42c1-b021-832c5a2e1e32 req-69becd0b-6eea-4905-aa94-12c955c5e764 service nova] Creating event network-changed:84d40a39-6c15-4762-aae2-ec02feee759b for instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 on n-h1-850003-3 Jul 18 13:14:12.115589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-32ec8abc-0320-42c1-b021-832c5a2e1e32 req-69becd0b-6eea-4905-aa94-12c955c5e764 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086079 Jul 18 13:14:12.117623 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1728/3545] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:12.128317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:12.129799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:12.143338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:12.143892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:12.146224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:12.146956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:12.757948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:12.799634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-22eb39a6-7e0b-4e9c-b163-cdd9a8f37b59 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1662 microversion: 2.1 time: 0.901426 Jul 18 13:14:12.801242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1818/3546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:11 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1662 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:12.849105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:12.856073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:12.882474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:12.884464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:12.890746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:12.892339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:13.044063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:13.107541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59e5dc22-e954-41db-96f3-9d0694293f3d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.987375 Jul 18 13:14:13.115952 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1729/3547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:12 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:13.131305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:13.132912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:13.159674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:13.161642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:13.164234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:13.165459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:14.106970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:14.128521 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a25d7da1-1f39-4195-9911-2b48e04d76b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 1.008430 Jul 18 13:14:14.128521 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1730/3548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:13 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:14.153817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:14.163309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:14.199149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:14.200889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:14.202372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:14.203330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:14.214204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:14.400446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:14.422492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:14.427318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:14.431963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75392cd6-5c23-4781-9e20-a49889ddb40a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.629059 Jul 18 13:14:14.451414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1819/3549] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:12 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:14.467837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:14.469447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:14.484386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:14.485924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:14.489405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:14.491396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.069464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.094660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.099553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.102799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17479878-abdf-4227-8e86-1ae25b5953d8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.649304 Jul 18 13:14:15.103664 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1820/3550] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:14 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:15.111808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:15.113359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:15.125567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.126791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.129718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.131270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.304540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.320097 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12d2627d-f223-4ea0-ad2c-990be296b703 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 1.190610 Jul 18 13:14:15.322544 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1731/3551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:14 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:15.334020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "a5655267-e11d-4f82-8970-49c5b34333be"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "d9b46508-549b-4942-a526-4ee162fb2863"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "c95f6557-6819-48b1-8ad3-47bdaf47eaac"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "5783181c-6d5c-4774-acf0-5a3a9820e65a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:15.353305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.354487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.378197 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Creating event network-vif-plugged:a5655267-e11d-4f82-8970-49c5b34333be for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:15.381363 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Creating event network-vif-plugged:d9b46508-549b-4942-a526-4ee162fb2863 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:15.382910 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Creating event network-vif-plugged:c95f6557-6819-48b1-8ad3-47bdaf47eaac for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:15.384277 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] Creating event network-vif-plugged:5783181c-6d5c-4774-acf0-5a3a9820e65a for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:15.396914 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-26a78466-4d6e-4fec-9a8d-5779557f3484 req-c05302e5-d614-4bab-b751-b722dd89cf0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.071025 Jul 18 13:14:15.398495 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1732/3552] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:15.413896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:15.415591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:15.430778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.432043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.434046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.434863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.503952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.514940 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37c94697-87ab-493b-af57-00859006b606 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.409662 Jul 18 13:14:15.515746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1821/3553] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:15 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:15.521881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:15.522653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:15.531512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.531976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.532779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.533227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.697001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:15.744240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:15.762612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:15.777368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33a7649b-360b-4f92-b70d-7095213ae4ba tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.259503 Jul 18 13:14:15.778980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1822/3554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:15 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:15.789636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:15.792718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:15.803913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.804731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:15.806239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:15.807029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.091763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:16.112201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:16.115405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:16.117737 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b434880f-ec17-4b83-b781-c55edaa5521c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.336971 Jul 18 13:14:16.119566 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1823/3555] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:15 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:16.128296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:16.130089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:16.140150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.140937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.142052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.142599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.369586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:16.387851 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad63aa59-ffdf-40a9-b53a-d91be683edde tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.265882 Jul 18 13:14:16.389084 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1824/3556] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:16 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:16.401839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:16.403451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:16.416203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.417789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.419292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.420101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.622769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:16.640185 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa61afcc-5072-496a-bc42-7ae2b0767d50 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 1.233915 Jul 18 13:14:16.644664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1733/3557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:15 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:16.655552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:16.657143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:16.672029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.673296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:16.675793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:16.677643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.319126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:17.352113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:17.368908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:17.377702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6076ab22-bca9-42c4-ad68-66505d150ccf tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.986051 Jul 18 13:14:17.386645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1825/3558] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:16 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:17.408600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:17.409580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:17.426941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:17.428691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.430464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.434405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.436493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.459276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-16345198-854a-4fda-91ee-449ec321a3a9 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.811055 Jul 18 13:14:17.459907 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1734/3559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:16 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:17.464935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-20827abc-ce92-4ea9-a5af-d79d11d85ac1 req-22bd90fa-935f-4a72-b132-4ea8c04e9ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b24e27e-828e-4933-a5fd-5bd5756146a2", "tag": "ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:17.485920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-20827abc-ce92-4ea9-a5af-d79d11d85ac1 req-22bd90fa-935f-4a72-b132-4ea8c04e9ca5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.486686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-20827abc-ce92-4ea9-a5af-d79d11d85ac1 req-22bd90fa-935f-4a72-b132-4ea8c04e9ca5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.511949 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-20827abc-ce92-4ea9-a5af-d79d11d85ac1 req-22bd90fa-935f-4a72-b132-4ea8c04e9ca5 service nova] Creating event network-changed:ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae for instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 on n-h1-850003-3 Jul 18 13:14:17.531625 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-20827abc-ce92-4ea9-a5af-d79d11d85ac1 req-22bd90fa-935f-4a72-b132-4ea8c04e9ca5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070110 Jul 18 13:14:17.532837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1735/3560] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:17.551800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:17.553037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:17.565731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.566498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.571841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.573507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.577958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Unlocking {{(pid=131366) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 13:14:17.728340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70761ef7-becf-4477-b782-345678b0fd6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.334067 Jul 18 13:14:17.738697 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1826/3561] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:14:17 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:14:17.750194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:17.750542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:17.767974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.768815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:17.770362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:17.771186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:18.237230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:18.247449 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc3e5f2a-7eec-4685-8a8c-c26857d17a81 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.712647 Jul 18 13:14:18.261905 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1736/3562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:17 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:18.269634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:18.270725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:18.280806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:18.282070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:18.283479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:18.284288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:18.565063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:18.601488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:18.605335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:18.612580 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cdf1e7f3-5609-47be-8973-aeccf8ffdc10 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.880845 Jul 18 13:14:18.621356 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1827/3563] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:17 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:18.652276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:18.653981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:18.666538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:18.667969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:18.669791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:18.671024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:18.720069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:19.021370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.035506 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80770bbe-3a96-4a9b-b0e8-02c28bee95d0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.771237 Jul 18 13:14:19.037161 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1737/3564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:18 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:19.047717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "7f349224-d4c9-4f4a-a01b-62ec8d49e2e1"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-plugged", "status": "completed", "tag": "bc1a8ecc-ef83-425e-a737-4418cb999916"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:19.067025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.068317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.089160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] Creating event network-vif-plugged:7f349224-d4c9-4f4a-a01b-62ec8d49e2e1 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:19.090096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] Creating event network-vif-plugged:bc1a8ecc-ef83-425e-a737-4418cb999916 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:19.107724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c0758807-6f23-47d2-8f30-330c82e26807 req-f1b66bd2-1449-4f5f-aaed-b7934d8b4214 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064004 Jul 18 13:14:19.111150 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1738/3565] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:19.124072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:19.125901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:19.135349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.136206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.137191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.137808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.261677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.281081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8715c650-6eae-4a4c-a0a7-8baa257b5176 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.656775 Jul 18 13:14:19.294873 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1828/3566] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:18 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:19.302119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:19.302920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:19.306781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:19.316473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.317211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.318029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.318537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.644472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.657164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-916b1383-3aba-45a9-8510-209fab2c1cde tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.359720 Jul 18 13:14:19.659227 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1829/3567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:19 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:19.667687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:19.668849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:19.690267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.690734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.708600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.711389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.713622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:19.715175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.715819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.716423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-320d717b-7b8a-4853-8d9b-85a43782c724 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.603479 Jul 18 13:14:19.729491 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1739/3568] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:19 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:19.735144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:19.736138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:19.752462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.753756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:19.757186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:19.758536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.138273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:20.149749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f16ae4e9-f81c-476a-baea-423a5c0bdd9a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.418398 Jul 18 13:14:20.150418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1740/3569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:19 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:20.164133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:20.170671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-07ced2db-10ac-446b-9cd4-72cbccc84040 req-da00e892-4449-4a12-95e2-b905c769b4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ef5ca5-ff80-4b66-bbec-3c889fa344d9", "tag": "8523752b-5806-4c66-843b-0f3bc34b8b77"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:20.202272 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ca5244a-bfb1-4766-9ef5-86eba6eb30a9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.540714 Jul 18 13:14:20.203810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1830/3570] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:19 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:20.210358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-07ced2db-10ac-446b-9cd4-72cbccc84040 req-da00e892-4449-4a12-95e2-b905c769b4ec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.211342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-07ced2db-10ac-446b-9cd4-72cbccc84040 req-da00e892-4449-4a12-95e2-b905c769b4ec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.216096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:20.217683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:20.225968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.226702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.230580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.232058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.282809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-07ced2db-10ac-446b-9cd4-72cbccc84040 req-da00e892-4449-4a12-95e2-b905c769b4ec service nova] Creating event network-changed:8523752b-5806-4c66-843b-0f3bc34b8b77 for instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 on n-h2-850003-3 Jul 18 13:14:20.293296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-07ced2db-10ac-446b-9cd4-72cbccc84040 req-da00e892-4449-4a12-95e2-b905c769b4ec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134732 Jul 18 13:14:20.295907 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1741/3571] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:20.305924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:20.307345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:20.319098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.320487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.322249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.323522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.840127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:20.862810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:20.867063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:20.870878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50a5b1df-9127-4cc5-9f8b-06446ef42dbe tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.664252 Jul 18 13:14:20.887237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1831/3572] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:20 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:20.904888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:20.906588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:20.924307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.926289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:20.931446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:20.933714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:21.059943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:21.086429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46359b7e-8fc7-4498-8a19-a7c73832519a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.788184 Jul 18 13:14:21.087612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1742/3573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:20 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:21.097095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:21.098064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:21.107976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:21.108788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:21.109831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:21.110316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:21.329652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:21.351263 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39c4f544-0563-4bc6-982d-fe18cd6f5f13 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.260673 Jul 18 13:14:21.372461 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1743/3574] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:21 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:21.382870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:21.384563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:21.397532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:21.398790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:21.400284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:21.401181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:21.993425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.014133 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69a1703f-9033-48bc-8e86-3bc1cbfcb850 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.124580 Jul 18 13:14:22.027034 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1832/3575] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:20 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:22.040054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:22.045606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:22.057115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.058003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.059041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.059667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.144512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.178351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.180949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.182677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9be07e8d-a5b2-41c7-a713-63d83bb28b2b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.807097 Jul 18 13:14:22.186380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1744/3576] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:21 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:22.202515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:22.203410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:22.216419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.217954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.220518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.222113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.377281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.389214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6780837-c68e-4602-8364-052e092b3c61 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.357609 Jul 18 13:14:22.399124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1833/3577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:22 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:22.399124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:22.399124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:22.407830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.409277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.412483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.415825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.587551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-754f6faa-be60-4b48-b86e-e0990f5c89b6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.195324 Jul 18 13:14:22.589972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1834/3578] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:14:22 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:14:22.599330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:22.600379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:22.611221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.612250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.615054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:22.616120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:22.933762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:22.952836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ac6c671-c160-4707-a336-3eab1de76da9 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.360254 Jul 18 13:14:22.977297 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1835/3579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:22 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:22.990592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:22.995168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:23.022434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.028809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.031498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.035214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.040203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.056215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.060374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.063276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca8bdf44-406a-464c-87a2-01b076ed8f79 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.874566 Jul 18 13:14:23.075841 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1745/3580] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:22 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:23.085423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:23.086723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:23.096246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.097224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.098665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.099395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.369704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.392508 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf02f447-7c8f-46d9-91c1-e02e87958f45 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.412081 Jul 18 13:14:23.393533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1836/3581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:22 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:23.406430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dba7b4a9-2467-40c2-ad63-1eb49e500153 req-8ecd5252-9774-4cce-ba52-962c56260eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c83335-3dd0-4128-ae35-ef01ca25ac15", "name": "network-vif-plugged", "status": "completed", "tag": "84d40a39-6c15-4762-aae2-ec02feee759b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:23.423068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dba7b4a9-2467-40c2-ad63-1eb49e500153 req-8ecd5252-9774-4cce-ba52-962c56260eef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.424327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dba7b4a9-2467-40c2-ad63-1eb49e500153 req-8ecd5252-9774-4cce-ba52-962c56260eef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.447308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dba7b4a9-2467-40c2-ad63-1eb49e500153 req-8ecd5252-9774-4cce-ba52-962c56260eef service nova] Creating event network-vif-plugged:84d40a39-6c15-4762-aae2-ec02feee759b for instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 on n-h1-850003-3 Jul 18 13:14:23.456984 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dba7b4a9-2467-40c2-ad63-1eb49e500153 req-8ecd5252-9774-4cce-ba52-962c56260eef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061736 Jul 18 13:14:23.457983 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1837/3582] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:23.466784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:23.467990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:23.477316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.479372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.480411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.481640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.786938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.813798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.815660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.816930 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-999d4b4d-cb5b-4d91-8c2b-537e1bbf1627 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1874 microversion: 2.32 time: 0.357203 Jul 18 13:14:23.830065 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1838/3583] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:23 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:23.835416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:23.836132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:23.844897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.845495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.845806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:23.846278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:23.985459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:23.995976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5799023f-7163-4811-b68b-3f40aaf47c88 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1651 microversion: 2.1 time: 0.918895 Jul 18 13:14:23.996590 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1746/3584] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:23 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1651 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:24.004684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:24.006291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:24.024867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.026662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.030184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.031395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.131696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:24.141069 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-448764bb-2e62-4d8e-a2d9-22f5a53c32c9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.310074 Jul 18 13:14:24.141663 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1839/3585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:23 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:24.147458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:24.148317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:24.156331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.156788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.157585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.158251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.257291 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa0000cb-678c-4e18-9c6c-f627874c76c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.113504 Jul 18 13:14:24.259717 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1840/3586] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:14:24 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:14:24.268230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:24.269624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:24.285418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.287072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.289135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.290482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.684334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:24.724061 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1924274d-bc74-4e63-891f-45ccca6c495b tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.721241 Jul 18 13:14:24.727266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1747/3587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:23 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:24.739001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:24.740463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:24.760001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.760786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:24.761761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:24.762906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.063561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.083382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.091418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.099997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3c0a414-1406-432e-8948-9789bd0565e4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.836226 Jul 18 13:14:25.111875 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1841/3588] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:24 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:25.120507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:25.127952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:25.142446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.143461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.145717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.148904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.187344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.205146 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f2564217-2f3d-4ea4-b369-8de15c274414 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.474950 Jul 18 13:14:25.215549 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1748/3589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:24 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:25.223662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:25.225854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:25.236697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.237169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.237980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.238648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.534366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.546942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.549256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.551469 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc951f76-43a1-48de-8c0d-5572f8c4dcc3 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2825 microversion: 2.32 time: 0.333967 Jul 18 13:14:25.552025 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1749/3590] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:25 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2825 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:25.557339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:25.558291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:25.566748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:25.569909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.570665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.571987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.572716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.598567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:25.704746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.719475 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac25e16b-eb6a-4033-8cdb-7160144c0fcb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.605694 Jul 18 13:14:25.721946 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1842/3591] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:25 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:25.730570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:25.731708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:25.739306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.740122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.741184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.742027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.841058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:25.849853 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d375ff91-6585-4717-a8bf-6882d8523608 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.296231 Jul 18 13:14:25.862261 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1750/3592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:25 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:25.862261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:25.862261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:25.871666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.872117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:25.872926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:25.873981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.104422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85406719-67aa-43f3-b5f9-40f0338201a9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.250472 Jul 18 13:14:26.105810 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1751/3593] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:14:25 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a/os-interface => generated 1829 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:26.115480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0e133f8f-38e8-4d85-b2ba-e7b981425b29 req-d30c2de8-680e-4f8e-974e-4c5fa3847d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ef5ca5-ff80-4b66-bbec-3c889fa344d9", "name": "network-vif-plugged", "status": "completed", "tag": "8523752b-5806-4c66-843b-0f3bc34b8b77"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:26.136400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0e133f8f-38e8-4d85-b2ba-e7b981425b29 req-d30c2de8-680e-4f8e-974e-4c5fa3847d36 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.137520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0e133f8f-38e8-4d85-b2ba-e7b981425b29 req-d30c2de8-680e-4f8e-974e-4c5fa3847d36 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.161593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0e133f8f-38e8-4d85-b2ba-e7b981425b29 req-d30c2de8-680e-4f8e-974e-4c5fa3847d36 service nova] Creating event network-vif-plugged:8523752b-5806-4c66-843b-0f3bc34b8b77 for instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 on n-h2-850003-3 Jul 18 13:14:26.170947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:26.172615 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0e133f8f-38e8-4d85-b2ba-e7b981425b29 req-d30c2de8-680e-4f8e-974e-4c5fa3847d36 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062976 Jul 18 13:14:26.180277 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1752/3594] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:26.190229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:26.194640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:26.196070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:26.198462 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c632d556-cb4b-4779-a746-43041b6115c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.473133 Jul 18 13:14:26.207908 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1843/3595] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:25 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:26.216385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.219312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.227880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.228388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.233687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:26.235120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:26.253395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.255581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.259188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.261400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.951207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:26.962487 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-733b7bcb-efe9-4a1b-8e50-b7e598b6a9b5 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.779023 Jul 18 13:14:26.965944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1753/3596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:26 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:26.974066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:26.975424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:26.989056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.989368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:26.989558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:26.991141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:26.992034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.009261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:27.012014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:27.014247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a76067e0-7f98-4050-aa8c-5975022d3b21 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.804362 Jul 18 13:14:27.015300 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1844/3597] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:26 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:27.024568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:27.026772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:27.038575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.039722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.041172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.042436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.400128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:27.462057 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c6bb79a-d694-4b47-9e4d-7c7f90acdbb6 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.444390 Jul 18 13:14:27.480235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1845/3598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:27 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:27.480235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:27.480235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:27.502603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.508493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.510765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.517367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.569390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:27.585281 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ff4c261-6fb9-4b51-a128-8171694da762 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.617683 Jul 18 13:14:27.599091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1754/3599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:26 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:27.604602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:27.605412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:27.627715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.628726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:27.631830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:27.633103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:28.128216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:28.153763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bf779f67-33a9-4aca-bb91-86134c467ea5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1309 microversion: 2.1 time: 0.687958 Jul 18 13:14:28.155798 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1846/3600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:27 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:28.167024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:28.168441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:28.186622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:28.187755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:28.189231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:28.190063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:28.245345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:28.258822 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47eae25b-7ad6-49c8-99e4-32801930964b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.658152 Jul 18 13:14:28.263765 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1755/3601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:27 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:28.268943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:28.270452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:28.282369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:28.283463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:28.285197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:28.286309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:28.934834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:28.959292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:28.965936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:28.965936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cbb15192-b031-45d3-a266-225214b11904 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.703265 Jul 18 13:14:28.965936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1756/3602] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:28 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:28.974638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8de4fb90-926e-4404-80c9-fff6b690cfca req-5e7fe68d-acc4-465e-8748-08321215d5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b24e27e-828e-4933-a5fd-5bd5756146a2", "name": "network-vif-plugged", "status": "completed", "tag": "ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:28.989932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8de4fb90-926e-4404-80c9-fff6b690cfca req-5e7fe68d-acc4-465e-8748-08321215d5df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:28.990555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8de4fb90-926e-4404-80c9-fff6b690cfca req-5e7fe68d-acc4-465e-8748-08321215d5df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.012355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:29.013992 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8de4fb90-926e-4404-80c9-fff6b690cfca req-5e7fe68d-acc4-465e-8748-08321215d5df service nova] Creating event network-vif-plugged:ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae for instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 on n-h1-850003-3 Jul 18 13:14:29.027914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3df67f1b-b5c8-4f88-ad9d-3235a5b8067c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.869248 Jul 18 13:14:29.042417 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8de4fb90-926e-4404-80c9-fff6b690cfca req-5e7fe68d-acc4-465e-8748-08321215d5df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065246 Jul 18 13:14:29.042417 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1757/3603] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:29.045751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:29.048298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:29.068963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.068963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.068963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.068963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.070748 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1847/3604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:28 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:29.086108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:29.089956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:29.108560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.109872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.111650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.113462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.492365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:29.522409 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b5486d1-3173-47fc-ab7f-840300f896a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.485429 Jul 18 13:14:29.524336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1758/3605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:29 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:29.536068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:29.537500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:29.546707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.547846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.549739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.551132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.717412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:29.752296 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e15ebfec-1e63-4508-a2e1-f0a4aea1001a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.679101 Jul 18 13:14:29.754269 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1848/3606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:29 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:29.770098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2b2b1c6d-7514-49f2-b1ed-d82969e10339 req-c787f777-05ab-4470-9665-b68c2ec66b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "tag": "1971fd4f-36e3-45e1-9819-2469791698ad"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:29.799316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b2b1c6d-7514-49f2-b1ed-d82969e10339 req-c787f777-05ab-4470-9665-b68c2ec66b1c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.800958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b2b1c6d-7514-49f2-b1ed-d82969e10339 req-c787f777-05ab-4470-9665-b68c2ec66b1c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.839257 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2b2b1c6d-7514-49f2-b1ed-d82969e10339 req-c787f777-05ab-4470-9665-b68c2ec66b1c service nova] Creating event network-changed:1971fd4f-36e3-45e1-9819-2469791698ad for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:14:29.851845 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2b2b1c6d-7514-49f2-b1ed-d82969e10339 req-c787f777-05ab-4470-9665-b68c2ec66b1c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094320 Jul 18 13:14:29.854002 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1849/3607] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:29.868235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:29.871446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:29.887771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:29.896488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.897153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.898737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.899768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.909432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c516b11-55b8-4ab4-8d96-09f2d483405d tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1490 microversion: 2.1 time: 0.381867 Jul 18 13:14:29.911276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1759/3608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:29 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1490 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:29.964537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1897724068"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:29.967123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:29.979716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.980494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:29.983410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:29.984651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.193947 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-246c130f-d39f-4760-ad9b-3b0a41e0a50e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "PUT /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1075 microversion: 2.1 time: 0.255957 Jul 18 13:14:30.195692 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1760/3609] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:14:29 2022] PUT /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1075 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:30.211816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:30.215741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:30.240931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.241770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.243278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.246357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.393924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:30.421299 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc215a53-07e9-4176-b9fa-49e75734866c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.557644 Jul 18 13:14:30.435290 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1850/3610] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:29 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:30.443805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:30.443805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:30.462044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.463479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.464121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.464870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.813925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:30.861785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:30.871897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:30.880580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c778fc1e-2423-425b-9303-066c453a38d0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.680762 Jul 18 13:14:30.884850 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1761/3611] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:30 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:30.908319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:30.912960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:30.945125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.946449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.949175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:30.951062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:30.961971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:30.994735 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d746f24-e565-4c7d-8159-076b4a160416 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.565685 Jul 18 13:14:31.001497 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1851/3612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:30 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:31.023565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:31.026057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:31.040674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.042214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:31.045399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.046967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:31.477801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:31.483198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:31.499039 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a76b9bc6-a743-495e-9304-33e34b3333bf tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.494283 Jul 18 13:14:31.502059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1852/3613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:31 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:31.508779 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93f10642-ec47-4132-adf8-3522e1f7771e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1501 microversion: 2.1 time: 0.621822 Jul 18 13:14:31.521605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1762/3614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:30 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1501 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:31.564740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:31.566041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:31.580299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.581584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:31.583183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.584915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:31.925837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:31.931519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:31.945657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.946407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:31.952221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:31.953614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.043110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:32.053607 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d0f4c1e-88ac-40e2-82ab-f766eda28b98 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1501 microversion: 2.1 time: 0.503587 Jul 18 13:14:32.054855 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1853/3615] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:31 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:32.064879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:32.066509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:32.079153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.080543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.082896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.084380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.390202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:32.404821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d691a32-c1fa-400c-aef0-7772f3f8ced2 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1317 microversion: 2.1 time: 0.347966 Jul 18 13:14:32.405937 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1854/3616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:32 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:32.413792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b5d1a4d-11d5-4deb-a917-90436a5128d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:32.436289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b5d1a4d-11d5-4deb-a917-90436a5128d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.437549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b5d1a4d-11d5-4deb-a917-90436a5128d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.519007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b5d1a4d-11d5-4deb-a917-90436a5128d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:14:32.558897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:32.597851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:32.600464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:32.609038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b5d1a4d-11d5-4deb-a917-90436a5128d0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "POST /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9/action" status: 202 len: 0 microversion: 2.1 time: 0.200586 Jul 18 13:14:32.610825 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1855/3617] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:14:32 2022] POST /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:14:32.615550 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0e45d90-e333-4e6e-a41d-4f3e55360418 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.702140 Jul 18 13:14:32.617007 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1763/3618] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:31 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:32.636279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:32.642327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:32.642982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:32.645619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:32.656975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.658900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.660148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.660451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.661280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.666212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:32.667981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:32.668957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:33.066732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:33.089997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27c81ae6-9507-4dce-8fa1-96c1ae0f9efe tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.476774 Jul 18 13:14:33.091626 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1856/3619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:32 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:33.176562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:33.202546 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb0443b4-c57c-44d1-8f90-76b2196a39e1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.583508 Jul 18 13:14:33.209105 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1764/3620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:32 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:33.435985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:33.436981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:33.454331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:33.456086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:33.457857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:33.458841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:33.651744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:33.653898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:33.695043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:33.695865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:33.697662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:33.698408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:33.919583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:33.952907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ca78812-ac64-4bb6-a92b-c3cd3b7996bb tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 200 len: 1503 microversion: 2.1 time: 0.523382 Jul 18 13:14:33.967665 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1857/3621] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:33 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:33.988937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:33.990599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:34.005670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.007009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.008950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.010046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.359726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:34.378083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c411d47c-10b4-40c8-bd82-8458ada18f4a tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 200 len: 1502 microversion: 2.1 time: 0.398662 Jul 18 13:14:34.383200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1858/3622] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:33 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:34.408436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:34.409096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:34.413763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:34.418870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.419624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.420862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.421948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.448686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:34.451086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:34.453126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2202a34-f1e7-49c5-8c54-152a6d72dab6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.808150 Jul 18 13:14:34.455102 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1765/3623] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:33 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:34.491290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:34.493470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:34.508956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.509607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.510772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.511987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.667975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:34.697517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3d1271f-2096-4421-b5c2-11707a9a5068 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.312517 Jul 18 13:14:34.699212 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1859/3624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:34 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:34.729055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:34.730444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:34.742313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.742940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.744397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.745154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.753610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:34.794328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:14:34.948886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f0a038a-86ac-48dc-ba28-407f591290b0 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "DELETE /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 204 len: 0 microversion: 2.1 time: 0.227494 Jul 18 13:14:34.953180 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1860/3625] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:14:34 2022] DELETE /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:14:34.973175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:34.974616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:34.988159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.989167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:34.990647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:34.991592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.052416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:14:35.166692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:35.187794 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-86645b02-0c59-443a-85cc-43df91568f43 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.730913 Jul 18 13:14:35.206744 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1766/3626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:34 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:35.303332 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-333aa7cb-79b4-4fc2-ba92-d523cd501a76 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 204 len: 0 microversion: 2.1 time: 0.342595 Jul 18 13:14:35.306075 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1861/3627] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:14:34 2022] DELETE /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:14:35.323923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:35.326011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:35.345200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.346392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.348123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.350527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.493551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:35.496507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:35.512109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.514497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.516736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.518349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.792374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:35.817484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0462281c-ef33-47ff-8864-2d61a94c363c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 200 len: 1508 microversion: 2.1 time: 0.504984 Jul 18 13:14:35.827511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1767/3628] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:35 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:35.849260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:35.850404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:35.873284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.874081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.875513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:35.884185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:35.902283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:36.035378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:36.052391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:36.056041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:36.060276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae10abb4-b5a8-4a0f-92be-f1d2ee29bfc2 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.575711 Jul 18 13:14:36.062340 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1862/3629] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:35 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:36.244703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:36.255489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:36.257231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:36.281638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56f620fe-5351-4bd5-a6bf-eb8d31234a06 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.445799 Jul 18 13:14:36.299956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:36.301070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:36.302501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:36.308773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:36.312496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1768/3630] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:35 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:36.761530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:36.784513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76a15829-9fcd-4324-a093-a9e7f549ef60 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.545182 Jul 18 13:14:36.806006 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1863/3631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:36 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:36.856939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:36.859969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:36.895804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:36.898135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:36.899646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:36.900561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.086966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:37.089869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:37.105549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.110463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.112722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.113927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.355396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:37.386799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9d7fe642-099d-4064-ac76-90635615ddab tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 200 len: 1508 microversion: 2.1 time: 0.532499 Jul 18 13:14:37.389003 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1769/3632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:36 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:37.408664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:37.409488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:37.430394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.432420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.436850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.437830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.675956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:37.696495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:37.701326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:37.704241 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0a44e4d-7dd3-45a3-b67e-4faf0edabc34 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.624272 Jul 18 13:14:37.705585 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1864/3633] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:37 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:37.819572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:37.820902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:37.833881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.834787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.836438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:37.837343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:37.870247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:37.887930 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e8b5563-813e-4855-b75e-b7e5bef1fafb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1511 microversion: 2.1 time: 0.494918 Jul 18 13:14:37.908104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1770/3634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:37 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:38.340956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:38.362795 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08183311-9576-4bbb-a84e-5dc2ade94c97 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.550715 Jul 18 13:14:38.366061 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1865/3635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:37 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:38.430454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:38.432644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:38.444330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:38.444796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:38.445989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:38.446709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:38.740822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:38.741775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:38.757876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:38.758778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:38.762199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:38.762872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:38.966454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:38.989220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46652d11-5c76-40b3-91e5-0655f4cba730 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 200 len: 1508 microversion: 2.1 time: 0.573738 Jul 18 13:14:38.990026 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1771/3636] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:38 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:39.011989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:39.012954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:39.022981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.023693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.024891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.026108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.384164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:39.414198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:39.420124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:39.421909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c241f39-fd09-4ea0-8cdc-08d17b1488ea tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.689094 Jul 18 13:14:39.436078 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1866/3637] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:38 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:39.449654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:39.451013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:39.461464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.462275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.464035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.464700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.545452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:39.570257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c7b10398-900b-40c6-a058-2506a4e1e7d2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1488 microversion: 2.1 time: 0.573231 Jul 18 13:14:39.571338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1772/3638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:38 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1488 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:39.599059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:39.600063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:39.625004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.625792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.627255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.628027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:39.722171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:14:39.887537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:39.926249 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f105aa1f-cdd6-44e6-ac01-4b5b1e3eb4d2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.487068 Jul 18 13:14:39.931694 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1867/3639] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:39 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:39.954037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-75729f4c-0c8a-4d50-8e68-73b77263d2d4 req-74da070b-c47c-457b-ac4e-c7c31866dc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c83335-3dd0-4128-ae35-ef01ca25ac15", "name": "network-vif-deleted", "tag": "84d40a39-6c15-4762-aae2-ec02feee759b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:39.986879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75729f4c-0c8a-4d50-8e68-73b77263d2d4 req-74da070b-c47c-457b-ac4e-c7c31866dc9d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:39.989020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75729f4c-0c8a-4d50-8e68-73b77263d2d4 req-74da070b-c47c-457b-ac4e-c7c31866dc9d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.018292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-75729f4c-0c8a-4d50-8e68-73b77263d2d4 req-74da070b-c47c-457b-ac4e-c7c31866dc9d service nova] Creating event network-vif-deleted:84d40a39-6c15-4762-aae2-ec02feee759b for instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 on n-h1-850003-3 Jul 18 13:14:40.028424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-75729f4c-0c8a-4d50-8e68-73b77263d2d4 req-74da070b-c47c-457b-ac4e-c7c31866dc9d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093205 Jul 18 13:14:40.035672 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1868/3640] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:40.046705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:40.048394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:40.062624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.063731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.065251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.066407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.101952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1efc88c-a3fc-49f7-a7d6-2302b91a06ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 204 len: 0 microversion: 2.1 time: 0.511178 Jul 18 13:14:40.111026 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1773/3641] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:14:39 2022] DELETE /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:14:40.166324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:40.169730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:40.185366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.186791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.188604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.190415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.198040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.198851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.199686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lazy-loading 'fault' on Instance uuid 01c83335-3dd0-4128-ae35-ef01ca25ac15 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:14:40.346714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20db5561236e4a26a87d4050bb6d4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b92ce2ef44d4ab4943bffab5568f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:40.373524 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f10a35c3-8652-4096-af11-5e816ea3390d tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 200 len: 1307 microversion: 2.1 time: 0.335256 Jul 18 13:14:40.377897 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1869/3642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:40 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:40.454273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:40.456605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:40.496901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.497897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.499461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.500337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.767040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:40.794671 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-275717b9-6cb4-4598-9265-b767de27696b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1494 microversion: 2.1 time: 0.673058 Jul 18 13:14:40.799702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1774/3643] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:40 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1494 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:40.810202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-58b654f9-9b8d-4203-965d-b9165e40984a req-fdcb22a6-3445-4d02-a302-0cb4c991d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b24e27e-828e-4933-a5fd-5bd5756146a2", "name": "network-vif-deleted", "tag": "ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:40.828606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-58b654f9-9b8d-4203-965d-b9165e40984a req-fdcb22a6-3445-4d02-a302-0cb4c991d8bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:40.830598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-58b654f9-9b8d-4203-965d-b9165e40984a req-fdcb22a6-3445-4d02-a302-0cb4c991d8bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:40.865713 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-58b654f9-9b8d-4203-965d-b9165e40984a req-fdcb22a6-3445-4d02-a302-0cb4c991d8bf service nova] Creating event network-vif-deleted:ad7d6f42-1ee2-487e-a80d-ef11b5b1a0ae for instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 on n-h1-850003-3 Jul 18 13:14:40.882330 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-58b654f9-9b8d-4203-965d-b9165e40984a req-fdcb22a6-3445-4d02-a302-0cb4c991d8bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078896 Jul 18 13:14:40.885735 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1775/3644] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:41.004290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.008351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:41.053287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.059562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.064470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.068577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.167113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:41.179958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:41.182132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:41.183684 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0209376f-f2b4-41e4-824b-f0e274215060 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.737015 Jul 18 13:14:41.184685 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1870/3645] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:40 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:41.510987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0288e07f-2e33-42fd-a260-b98c8fbc9577 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.540028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:41.551667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0288e07f-2e33-42fd-a260-b98c8fbc9577 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.343291 Jul 18 13:14:41.553263 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1871/3646] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:41.565668 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6dabc384-2cc1-499c-bd07-798e510f3feb tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.591777 Jul 18 13:14:41.581578 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1776/3647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:40 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:41.595111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.596663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 01c83335-3dd0-4128-ae35-ef01ca25ac15] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:41.605550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f7818f8-9e14-46cb-ba45-c8a655526151 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.632502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:41.648638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.649844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.663476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.664495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.690940 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f7818f8-9e14-46cb-ba45-c8a655526151 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.106332 Jul 18 13:14:41.703816 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1872/3648] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:41.710881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f24992d-a12d-444d-9805-ace99afd1509 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.724873 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f24992d-a12d-444d-9805-ace99afd1509 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019219 Jul 18 13:14:41.736385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1873/3649] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:41.738810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] HTTP exception thrown: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Request method failure captured: Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 HTTP/1.1 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VxcW11HKOBNF4WgQGES-Iy2G-5f79wfNwkdgiNysfOZsGCvsw9pseKvEfkmeMDPiYqKkJlYgwZWqowTnjhuQGkmJKLeQ4T1tse1fZIEPSfXzf7oAQ3PW1SA11I-yRdSItA1UU0i9M9CWW7tT7GJkBTFLr5LQuM0FZwpyxKR7i2wApA Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d2b92ce2ef44d4ab4943bffab5568f2 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d2b92ce2ef44d4ab4943bffab5568f2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d2b92ce2ef44d4ab4943bffab5568f2 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MultipleCreateTestJSON-443472631-project Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 20db5561236e4a26a87d4050bb6d4da1 Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MultipleCreateTestJSON-443472631-project Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '01c83335-3dd0-4128-ae35-ef01ca25ac15'} Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:41.741279 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. Jul 18 13:14:41.748481 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.749321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d26b1f0-6440-4b7b-8238-fbc1d30a8327 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.750679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Returning 404 to user: Instance 01c83335-3dd0-4128-ae35-ef01ca25ac15 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:41.751739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f0984ce-b4e0-427a-ad0f-f39a8ac78110 tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15" status: 404 len: 111 microversion: 2.1 time: 0.168901 Jul 18 13:14:41.752603 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1777/3650] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/servers/01c83335-3dd0-4128-ae35-ef01ca25ac15 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:14:41.761043 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d26b1f0-6440-4b7b-8238-fbc1d30a8327 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022012 Jul 18 13:14:41.761685 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1874/3651] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:41.773630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.775714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] [instance: 8b24e27e-828e-4933-a5fd-5bd5756146a2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:41.780012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b89511b-6077-444e-b9d2-460def8c620e tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.802838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.804020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.805911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.807337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.848593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] HTTP exception thrown: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Request method failure captured: Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 HTTP/1.1 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VxcW11HKOBNF4WgQGES-Iy2G-5f79wfNwkdgiNysfOZsGCvsw9pseKvEfkmeMDPiYqKkJlYgwZWqowTnjhuQGkmJKLeQ4T1tse1fZIEPSfXzf7oAQ3PW1SA11I-yRdSItA1UU0i9M9CWW7tT7GJkBTFLr5LQuM0FZwpyxKR7i2wApA Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8d2b92ce2ef44d4ab4943bffab5568f2 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8d2b92ce2ef44d4ab4943bffab5568f2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8d2b92ce2ef44d4ab4943bffab5568f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8d2b92ce2ef44d4ab4943bffab5568f2 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-MultipleCreateTestJSON-443472631 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-MultipleCreateTestJSON-443472631-project Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 20db5561236e4a26a87d4050bb6d4da1 Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-MultipleCreateTestJSON-443472631-project Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '8b24e27e-828e-4933-a5fd-5bd5756146a2'} Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:41.852771 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] Returning 404 to user: Instance 8b24e27e-828e-4933-a5fd-5bd5756146a2 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6dae76cd-bf8b-44c2-bde9-367377b8485c tempest-MultipleCreateTestJSON-443472631 tempest-MultipleCreateTestJSON-443472631-project] 10.222.0.88 "GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2" status: 404 len: 111 microversion: 2.1 time: 0.097352 Jul 18 13:14:41.866898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1778/3652] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/servers/8b24e27e-828e-4933-a5fd-5bd5756146a2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:14:41.869742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b89511b-6077-444e-b9d2-460def8c620e tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.090460 Jul 18 13:14:41.869942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.869942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:41.874315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1875/3653] 10.222.0.88 () {58 vars in 1164 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:41.880333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f2ae7157-a691-4565-8490-a4507424f310 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.886141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.887074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.888591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:41.889406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:41.902187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f2ae7157-a691-4565-8490-a4507424f310 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025850 Jul 18 13:14:41.903198 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1876/3654] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:41.922316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d91c5f9-4039-4209-951b-6275abbf9276 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:41.974124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d91c5f9-4039-4209-951b-6275abbf9276 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.059288 Jul 18 13:14:41.992332 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1877/3655] 10.222.0.88 () {58 vars in 1168 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:42.003130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29cf8b36-5c57-4648-afcd-adb643ec7642 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.040088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29cf8b36-5c57-4648-afcd-adb643ec7642 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.044471 Jul 18 13:14:42.042706 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1878/3656] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:42.065104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-297993bc-303c-4b5c-8aa4-75d835032391 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.088786 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-297993bc-303c-4b5c-8aa4-75d835032391 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034359 Jul 18 13:14:42.091355 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1879/3657] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:42.111342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8203e99-64d4-4f0d-b0e4-77829a705039 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.215493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8203e99-64d4-4f0d-b0e4-77829a705039 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.112529 Jul 18 13:14:42.217063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1880/3658] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 13:14:42 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:42.237460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.239209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:42.255642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:42.257001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:42.258908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:42.261582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:42.531852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:42.548515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc122001-7f36-49c3-a058-dde8a641b9d8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1494 microversion: 2.1 time: 0.688540 Jul 18 13:14:42.549603 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1779/3659] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:41 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1494 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:42.560167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d268b58-6304-4371-b269-f9f7b7a088f8 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.575626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d268b58-6304-4371-b269-f9f7b7a088f8 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023602 Jul 18 13:14:42.577569 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1780/3660] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:42.590545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:42.592040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:42.602221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:42.603812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:42.605264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:42.606415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:42.989689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:43.004094 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0531d27d-95cc-4757-9381-fbbde22cd9a8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.419415 Jul 18 13:14:43.015365 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1781/3661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:42 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:43.027599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f2af915e-ba1f-42b7-8274-dd4df14fc753 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.051037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:43.079309 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f2af915e-ba1f-42b7-8274-dd4df14fc753 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.061158 Jul 18 13:14:43.080819 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1782/3662] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:43.084930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:43.089409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:43.092256 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd50dddb-c40c-4bdc-ad44-a0b9ede477cf tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.873012 Jul 18 13:14:43.093978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1881/3663] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:42 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:43.113723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e53abe86-f1bf-4bf0-8a7b-5268aece2678 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.129644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e53abe86-f1bf-4bf0-8a7b-5268aece2678 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034559 Jul 18 13:14:43.130775 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1783/3664] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:43.152031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c37349de-2446-475b-b01b-644cb6ea4ae7 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.183073 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c37349de-2446-475b-b01b-644cb6ea4ae7 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.039839 Jul 18 13:14:43.185428 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1882/3665] 10.222.0.88 () {58 vars in 1147 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:43.210385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a40219df-125d-430c-823e-4b2f66277d36 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.237458 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a40219df-125d-430c-823e-4b2f66277d36 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.035721 Jul 18 13:14:43.239497 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1784/3666] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:43.257423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19e1478d-6945-4b9c-a8dc-d6c272839d6d tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.273640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19e1478d-6945-4b9c-a8dc-d6c272839d6d tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022586 Jul 18 13:14:43.275811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1883/3667] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:43.294292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca93ac4c-612e-4a19-9bf7-530870bd41f0 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.400520 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca93ac4c-612e-4a19-9bf7-530870bd41f0 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.113745 Jul 18 13:14:43.401607 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1785/3668] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:43.426279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16259afe-b841-496c-b0fa-0776ce9fd797 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.456240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6a1dad17-a085-4e4a-882f-0eb735d6a0ca req-37c2a0da-848d-4ef3-ab39-9b1457ccf14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc73bb6f-593b-47db-83ab-a46d14657248", "name": "network-vif-deleted", "tag": "ab2ff59f-f7dd-4415-b3e2-0831b29b241d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:43.481827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16259afe-b841-496c-b0fa-0776ce9fd797 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063536 Jul 18 13:14:43.484676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6a1dad17-a085-4e4a-882f-0eb735d6a0ca req-37c2a0da-848d-4ef3-ab39-9b1457ccf14c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:43.485570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6a1dad17-a085-4e4a-882f-0eb735d6a0ca req-37c2a0da-848d-4ef3-ab39-9b1457ccf14c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:43.492870 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1884/3669] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:43.520939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1d0a384-d9c2-4f4f-be8d-86a061c24be9 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.543511 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6a1dad17-a085-4e4a-882f-0eb735d6a0ca req-37c2a0da-848d-4ef3-ab39-9b1457ccf14c service nova] Creating event network-vif-deleted:ab2ff59f-f7dd-4415-b3e2-0831b29b241d for instance bc73bb6f-593b-47db-83ab-a46d14657248 on n-h2-850003-3 Jul 18 13:14:43.553868 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1d0a384-d9c2-4f4f-be8d-86a061c24be9 tempest-FlavorsV2TestJSON-1675547658 tempest-FlavorsV2TestJSON-1675547658-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039025 Jul 18 13:14:43.557110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1885/3670] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:43.560638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6a1dad17-a085-4e4a-882f-0eb735d6a0ca req-37c2a0da-848d-4ef3-ab39-9b1457ccf14c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117362 Jul 18 13:14:43.562983 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1786/3671] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:14:43.599868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:43.603263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:43.650435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:43.650944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:43.652886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:43.654974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:43.764760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:43.766070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:43.769476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'fault' on Instance uuid bc73bb6f-593b-47db-83ab-a46d14657248 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:14:43.956610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:43.981703 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8685d590-d074-40ca-8450-3922d460d940 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 200 len: 1305 microversion: 2.1 time: 0.406924 Jul 18 13:14:44.002315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1886/3672] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:43 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 1305 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:44.041277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:44.043064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:44.056187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:44.057846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:44.058801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:44.059615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:44.122275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:44.125808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:44.142633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:44.143886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:44.145229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:44.147352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:44.196741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:44.551107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:44.572468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e5a7bc4c-9ead-45ea-977c-5d228cf9da41 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.542327 Jul 18 13:14:44.575380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1787/3673] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:44 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:45.017883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:45.018898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:45.032869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:45.033948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:45.035541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:45.036576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:45.072300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 HTTP/1.1 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bc73bb6f-593b-47db-83ab-a46d14657248'} Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:14:45.076976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:14:45.091357 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:14:45.095820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:14:45.098872 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f3f3d464-5b92-4a57-b769-2a956f51fc1b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 404 len: 111 microversion: 2.1 time: 0.089207 Jul 18 13:14:45.100363 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1788/3674] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:45 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:14:45.332777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:45.351264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:45.354960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:45.357592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-18626cf6-09ab-496e-be16-2788b325be11 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.245091 Jul 18 13:14:45.362330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-359871275", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dfc9d32c-f020-4875-97fd-cdad9ee583e2"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:45.374446 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1887/3675] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:44 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:45.483584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] validate_networks() for [('dfc9d32c-f020-4875-97fd-cdad9ee583e2', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:14:45.609647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:45.612108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:45.633537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:45.633537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:45.639610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:45.641178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:46.347402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:46.370401 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40c3d1ef-95ce-459a-b95e-c352b2fdd992 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.771628 Jul 18 13:14:46.373107 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1888/3676] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:45 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:46.400211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:14:46.400947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:14:46.401394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:46.401816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:14:46.402500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:14:46.403039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:14:46.404103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:46.416331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:46.417601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:46.420001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:46.421960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:46.427030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:46.428437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:46.431995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:46.433559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:46.473041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:14:46.482183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Getting quotas for user ff30a9e281264cba8e23efe4476e58fd and project 9768e74ecd074a20b20301296b60f22e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:14:46.523544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:14:46.529297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:14:46.596282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:46.665204 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f37f0f57-0262-4260-8b98-210fd11d6aad tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308997 Jul 18 13:14:46.668960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1789/3677] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:14:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:14:46.694141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc33b5c1-d39c-4795-9f3a-949ee0e74330 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:46.696190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc33b5c1-d39c-4795-9f3a-949ee0e74330 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:46.844509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc33b5c1-d39c-4795-9f3a-949ee0e74330 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:46.862447 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc33b5c1-d39c-4795-9f3a-949ee0e74330 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1214 microversion: 2.1 time: 0.179572 Jul 18 13:14:46.865493 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1790/3678] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:46 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:47.001701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:47.026245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:47.029512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:47.037130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f735a45d-7446-441f-960b-1aebaaa434ed tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.646026 Jul 18 13:14:47.038009 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1889/3679] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:46 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:47.399539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:47.401888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:47.428225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:47.429011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:47.430130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:47.430768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:47.775340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:47.794664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12a608d7-6b93-4794-bec2-0d15682fdc35 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.400368 Jul 18 13:14:47.806847 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1791/3680] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:47 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:47.897164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:47.898264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:47.948820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:47.950448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:47.952352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:47.957108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:48.079640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:48.080779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:48.102112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:48.104565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:48.106309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:48.107053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:48.239616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:48.266031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a640a8c-834d-4e82-a117-0dc2f401f8d3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1218 microversion: 2.1 time: 0.372011 Jul 18 13:14:48.267304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1890/3681] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:47 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:48.684494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:48.711569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:48.714577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:48.716837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ccd3280-76e5-4272-896d-0f80d2568d72 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.646331 Jul 18 13:14:48.717807 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1792/3682] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:48 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:48.828762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:48.832000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:48.863204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:48.864356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:48.867289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:48.868496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:49.296063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:49.297660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:49.322855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:49.323978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:49.326926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:49.333240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:49.338897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:49.461296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:49.497004 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f492259c-8cce-4d35-a96c-ef3337969da9 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.656513 Jul 18 13:14:49.497841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1891/3683] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:48 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:49.549385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:49.570979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c32673f-822a-4d66-baba-780f92769fb2 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1284 microversion: 2.1 time: 0.283697 Jul 18 13:14:49.574188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1793/3684] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:49 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:49.753852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:49.755402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:49.772187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:49.773461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:49.776804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:49.779767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:50.252246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:50.282902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:50.290881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:50.293927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe4c5d03-5b32-4935-838d-7b73f820a046 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.551792 Jul 18 13:14:50.295848 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1892/3685] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:49 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:50.524987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:50.525882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:50.545729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:50.548596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:50.552699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:50.557110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:50.602406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:50.604735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:50.626606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:50.627511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:50.628683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:50.629367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:50.813358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:50.850936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6bc9b852-e2f4-48e2-aa09-8eb62cedaf47 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1272 microversion: 2.1 time: 0.252176 Jul 18 13:14:50.853622 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1893/3686] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:50 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:51.135791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:51.184432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-28010850-b103-4b41-821f-36334cc3bd23 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.666226 Jul 18 13:14:51.198189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1794/3687] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:50 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:51.333620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:51.334207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:51.343832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:51.344732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:51.345797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:51.346580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:51.622768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-cb9490d0-a486-41f3-92a0-8d172f800092 req-afccd160-a688-45ff-a0de-20080b18fe8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "a55f2463-da87-436c-bdce-5622c0a24659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:51.640880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cb9490d0-a486-41f3-92a0-8d172f800092 req-afccd160-a688-45ff-a0de-20080b18fe8a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:51.648031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cb9490d0-a486-41f3-92a0-8d172f800092 req-afccd160-a688-45ff-a0de-20080b18fe8a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:51.675870 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-cb9490d0-a486-41f3-92a0-8d172f800092 req-afccd160-a688-45ff-a0de-20080b18fe8a service nova] Creating event network-vif-plugged:a55f2463-da87-436c-bdce-5622c0a24659 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:51.682657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-cb9490d0-a486-41f3-92a0-8d172f800092 req-afccd160-a688-45ff-a0de-20080b18fe8a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066084 Jul 18 13:14:51.684458 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1795/3688] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:51.874472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:51.875582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:51.892207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:51.892768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:51.893625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:51.894070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:51.957616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:51.979589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:51.990173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:52.001681 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-072357db-0520-4b05-b3a2-486e2ecaa0fd tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.682144 Jul 18 13:14:52.024136 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1894/3689] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:51 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:52.224971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:52.228277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:52.246074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:52.247429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:52.249516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:52.251163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:52.652554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:52.664007 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99e6e5a8-25af-4e93-834c-bf4743d59ac5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.453190 Jul 18 13:14:52.665706 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1895/3690] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:52 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:53.029498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:53.032434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:53.033848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:53.039883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-269e28d2-0855-4324-901d-e5121ff6c2ba tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 1.171522 Jul 18 13:14:53.040973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1796/3691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:51 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:53.053982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:53.053982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:53.063414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:53.064010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:53.699627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:53.701244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:53.730348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:53.731436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:53.733091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:53.734866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:53.898130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:53.938809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:53.943998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:53.945859 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0956e61a-9834-48f3-a239-16758ac03fa9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.918093 Jul 18 13:14:53.962788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1896/3692] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:53 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:14:53.988019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "89a431b7-da19-47fb-9aae-199f2600baf7"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "e55910a4-60fb-4c9c-9429-97cd52f7ff56"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:54.008068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:54.008642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:54.055828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] Creating event network-vif-plugged:89a431b7-da19-47fb-9aae-199f2600baf7 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:54.057407 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] Creating event network-vif-plugged:e55910a4-60fb-4c9c-9429-97cd52f7ff56 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:54.069894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b44aa9c4-ddb2-4bde-aaa9-2e1b3b57d460 req-b939d9a4-c711-4baa-880b-cd88781edb1a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098263 Jul 18 13:14:54.071712 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1897/3693] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:54.079795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:54.087918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:54.105546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:54.106464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:54.107481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:54.108118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:54.506892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:54.533448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:54.547386 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6dc9b6e-ab5d-4001-8f7c-31901a3ac16c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.473681 Jul 18 13:14:54.563069 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1898/3694] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:54 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:54.611213 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c4bcda6-de21-4cd3-a07c-ec13c0aa86a5 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.911840 Jul 18 13:14:54.625143 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1797/3695] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:53 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:54.984407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:54.988446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:55.023252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.027384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:55.029253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.032501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:55.625228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:55.628407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:55.632689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:55.644965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:55.651705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:55.653195 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b6fbe47-9466-4473-a30b-a745bef58539 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.684733 Jul 18 13:14:55.657231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1899/3696] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:54 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:55.671671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:55.672665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:55.684247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.685685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:55.689345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.690069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:55.721815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.724183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:55.726404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:55.728266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:56.216795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:56.243522 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-47e4bfed-23f3-44f0-9e20-0ac675b8db17 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.581678 Jul 18 13:14:56.247937 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1900/3697] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:55 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:56.285419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "2658726f-8f22-4a68-949c-9c30639612d1"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "c9972e1f-8e69-4009-8b8b-ac6965438f43"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "17ab78fd-5a1c-41fd-b464-c43918fe755f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:56.301853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:56.302681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:56.356246 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Creating event network-vif-plugged:2658726f-8f22-4a68-949c-9c30639612d1 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:56.359854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Creating event network-vif-plugged:c9972e1f-8e69-4009-8b8b-ac6965438f43 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:56.361448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] Creating event network-vif-plugged:17ab78fd-5a1c-41fd-b464-c43918fe755f for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:56.378414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-76388b11-caa1-45b6-9387-8bbafb7f8960 req-2987beed-a53e-4375-87fc-004b2a6e24d6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.114165 Jul 18 13:14:56.381807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1901/3698] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:56.443122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:56.453917 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45713fc0-741f-4cd6-8755-aa121b7ca955 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.862621 Jul 18 13:14:56.455180 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1798/3699] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:55 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:56.710393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:56.713456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:56.715470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:56.733667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:56.734775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:56.736421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:56.738257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:56.854983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:57.199487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1429269270", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:57.287977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:57.345586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:57.366547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:57.384670 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-755b35f8-586a-426d-80ad-8c93c7614f03 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.698010 Jul 18 13:14:57.385292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1902/3700] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:56 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:57.419348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2d176212-c5bc-4937-b953-75228068f737 req-387608e4-4df9-41b4-b728-990111e0cbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d40fa9-9e2b-42f7-a330-74493547fe7e", "tag": "bf28fbe5-d50e-423e-9dbb-02e8b53f0b76"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:57.436549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d176212-c5bc-4937-b953-75228068f737 req-387608e4-4df9-41b4-b728-990111e0cbb2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.437362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d176212-c5bc-4937-b953-75228068f737 req-387608e4-4df9-41b4-b728-990111e0cbb2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.483815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2d176212-c5bc-4937-b953-75228068f737 req-387608e4-4df9-41b4-b728-990111e0cbb2 service nova] Creating event network-changed:bf28fbe5-d50e-423e-9dbb-02e8b53f0b76 for instance 45d40fa9-9e2b-42f7-a330-74493547fe7e on n-h2-850003-3 Jul 18 13:14:57.495362 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2d176212-c5bc-4937-b953-75228068f737 req-387608e4-4df9-41b4-b728-990111e0cbb2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083473 Jul 18 13:14:57.496009 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1903/3701] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:14:57.501687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:14:57.502863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:14:57.505917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:14:57.506749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:14:57.512950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:14:57.517800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:57.518546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:57.541383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.542354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.543448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.544289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.564841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.567795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.570908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.575025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.661636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Getting quotas for project f1978ec9af4449b4b2479925dc1eae7e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:14:57.672323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Getting quotas for user 477f5344069e424f9c0c9c7f71bc216d and project f1978ec9af4449b4b2479925dc1eae7e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:14:57.732367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:14:57.736325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:14:57.902562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:57.919680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e33ce59d-c3c7-4a6d-a379-f99d29cb10b0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.409476 Jul 18 13:14:57.921344 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1904/3702] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:57 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:57.923770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6c75c8f6-d3ad-4228-8f1e-25db3e435855 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.229277 Jul 18 13:14:57.928956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:57.932316 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1799/3703] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:14:57.932625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:57.941577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.943174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.944599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:57.945516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:57.957038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:57.958338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:58.238612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:58.255636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:58.276971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-47280947-832c-4c5d-94fc-38437e3ab4ef tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.353368 Jul 18 13:14:58.307425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1905/3704] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:57 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:14:58.310643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:58.313877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:58.319932 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b765367d-ecca-4ba3-a551-47c4fb9ec819 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1281 microversion: 2.47 time: 0.380701 Jul 18 13:14:58.325117 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1800/3705] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:57 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1281 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:14:58.419199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:58.419943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:58.423741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4ebb6d5a-78ba-4a39-a17e-41d3e71d2e8a req-83cda96f-e845-41c0-b5eb-a68d258139c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-plugged", "status": "completed", "tag": "8791c0a2-8139-4af5-9ac2-a0f217024850"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:14:58.442586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:58.443256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:58.444377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:58.445066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:58.467014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4ebb6d5a-78ba-4a39-a17e-41d3e71d2e8a req-83cda96f-e845-41c0-b5eb-a68d258139c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:58.470769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4ebb6d5a-78ba-4a39-a17e-41d3e71d2e8a req-83cda96f-e845-41c0-b5eb-a68d258139c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:58.478056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:14:58.529188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4ebb6d5a-78ba-4a39-a17e-41d3e71d2e8a req-83cda96f-e845-41c0-b5eb-a68d258139c3 service nova] Creating event network-vif-plugged:8791c0a2-8139-4af5-9ac2-a0f217024850 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:14:58.597799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4ebb6d5a-78ba-4a39-a17e-41d3e71d2e8a req-83cda96f-e845-41c0-b5eb-a68d258139c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171039 Jul 18 13:14:58.614060 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1906/3706] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:14:58.952809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:58.956454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:58.991387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:58.992774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:58.995689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:58.997005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:59.506548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:14:59.523966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c0e55c4-8550-4524-a75f-67a88d6dabed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.584342 Jul 18 13:14:59.526544 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1907/3707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:58 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:14:59.535746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:14:59.537721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:14:59.554429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:59.555110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:14:59.556352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:14:59.557043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:00.064249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.101289 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-587cc47e-ef3a-4580-938e-37cf9e97c60c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.572803 Jul 18 13:15:00.122269 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1908/3708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:14:59 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:00.136613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:00.138327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:00.159783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:00.161196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:00.163089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:00.164898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:00.255624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.314972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.318771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.321720 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79a86ef8-3645-4b9c-8f1f-199deabc8239 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 1.907779 Jul 18 13:15:00.334687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1801/3709] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:14:58 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:00.380108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.406381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.410398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.416151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3eddd7ec-20c8-43fe-b815-f364d1e4bdb7 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1333 microversion: 2.47 time: 0.289746 Jul 18 13:15:00.417835 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1909/3710] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:00 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:00.569682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:00.572310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:00.589399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:00.590502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:00.592485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:00.593226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:00.960077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:00.982570 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-294f17e5-c58a-4e96-b5ad-1b65ee58b177 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.436099 Jul 18 13:15:00.992988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1802/3711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:00 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:01.131230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:01.134307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:01.161180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.165882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.169613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.174328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.351308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:01.352157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:01.378133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.379801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.381538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.382484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.750264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:01.772528 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-54dbb91c-0f6c-4356-9b38-50341a53a2df tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.647701 Jul 18 13:15:01.778499 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1910/3712] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:01 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:01.800203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:01.804887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:01.830198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.831244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.837583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:01.846066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:01.899189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:01.926651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:01.935199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:01.937625 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b75c924d-a503-433f-8454-aa8977bc1ee0 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.590870 Jul 18 13:15:01.943126 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1803/3713] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:01 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:02.018721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:02.022681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:02.023689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:02.042307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:02.044407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:02.045254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:02.046711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:02.047522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:02.048181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:02.052632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-54e84d80-d5c9-4d5b-bf1d-5e3177bbe5dd tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1339 microversion: 2.47 time: 0.268404 Jul 18 13:15:02.054261 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1911/3714] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:01 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1339 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:02.518039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:02.542429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-116c7be8-0501-4198-87fc-2c63cdab83a0 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.534474 Jul 18 13:15:02.546945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1804/3715] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:02 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:02.812883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:02.819189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:02.844663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:02.847773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:02.849759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:02.853457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:02.974130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:02.975202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:02.997620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.000472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.006833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.010141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.560677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.596029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.601041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.607006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.608544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d8990c9-1ea7-4aa6-930a-e3210a19a451 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1879 microversion: 2.42 time: 0.640263 Jul 18 13:15:03.610403 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1805/3716] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:02 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1879 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:03.623623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:03.625161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:03.636862 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d00ca527-be50-4fb2-946d-7ede06e8834e tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.827973 Jul 18 13:15:03.643691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1912/3717] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:02 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:03.665299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.666425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.669154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.669571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:03.671088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.673967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:03.713249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.714652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.720468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:03.745670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:03.908095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.925496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.928133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:03.931275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8e6a389-42b4-42a3-8f1c-72e4196db4c8 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1339 microversion: 2.47 time: 0.318454 Jul 18 13:15:03.933039 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1806/3718] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:03 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:04.380200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:04.396909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82082cc0-7c0e-4302-9def-c9146a2fd3ed tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.750790 Jul 18 13:15:04.406344 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1913/3719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:03 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:04.661987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:04.668469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:04.679215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:04.680790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:04.690560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:04.694044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:04.698406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:04.703630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:04.715431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:04.716203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:04.721820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:04.726062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.282387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.325860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.329663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.334684 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0575228-7246-4063-9f68-5480b3674d1f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2835 microversion: 2.42 time: 0.688254 Jul 18 13:15:05.350381 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1807/3720] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:04 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2835 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:05.382002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:05.389183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:05.430875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.436728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.439910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.446794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.559240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.576463 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5af2d1a0-46b0-4dfd-82f0-50ef5023fb40 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.909033 Jul 18 13:15:05.578654 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1914/3721] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:04 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:05.609539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:05.611092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:05.633939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.636480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.641342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.647256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.716511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.773578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.784903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:05.787912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7f1753ff-610c-42da-9971-5a63e7ba98f1 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1339 microversion: 2.47 time: 0.424806 Jul 18 13:15:05.789484 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1808/3722] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:05 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1339 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:05.800427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:05.801976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:05.815506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.816831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:05.819705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:05.821389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:06.021499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-988acbc1-a532-41b7-bc11-71f88e7104b6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.441048 Jul 18 13:15:06.036700 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1915/3723] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:15:05 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35/os-interface => generated 1830 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:06.512547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:06.570517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9eadf289-1376-4823-8662-71dfba11a2ce tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.771805 Jul 18 13:15:06.578130 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1809/3724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:05 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:06.615973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:06.617523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:06.634354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:06.635897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:06.637728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:06.638962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:06.831138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:06.837904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:06.890792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:06.892202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:06.899391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:06.901097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:07.026106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:07.043233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dc54b167-98bc-4624-8ad9-63f23f68a3c1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.435336 Jul 18 13:15:07.044285 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1916/3725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:06 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:07.323942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:07.331723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1575813324", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:07.347601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:07.351791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:07.354003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17995ab1-8359-4971-bbc8-a49fd491a130 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1360 microversion: 2.47 time: 0.533032 Jul 18 13:15:07.372432 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1810/3726] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:06 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1360 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:07.380272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1493883346"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:07.383103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:07.395583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:07.396885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:07.400007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:07.401902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:07.535198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] validate_networks() for [('3878adc7-5dcd-4c1b-92c7-f58b49518f4c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:15:07.854058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:08.172312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:08.211167 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ceedbaf-1bb9-4b30-8a48-eabbc8c3465c tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "POST /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79/action" status: 202 len: 52 microversion: 2.47 time: 0.834573 Jul 18 13:15:08.231400 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1811/3727] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:15:07 2022] POST /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79/action => generated 52 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Jul 18 13:15:08.244209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:08.246337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:08.264745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.266793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.274728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.277547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.341966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:08.692812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:15:08.692812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:15:08.695259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:15:08.695259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:15:08.695592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:15:08.721433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.722589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.724258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.725194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.768026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Getting quotas for project e94ea9219ab648bfbea251e13bd8542c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:15:08.779570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:08.783944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Getting quotas for user 2a21754edbea4264894e37691956513c and project e94ea9219ab648bfbea251e13bd8542c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:15:08.826773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:15:08.831683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:15:08.847331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:08.863793 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1dfa4d35-b62e-4184-93a2-69b58b071cb3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.629086 Jul 18 13:15:08.870854 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1812/3728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:08 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:08.882684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:08.887972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:08.923593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.924780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.926300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:08.927182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:08.976210 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd8971e5-f6c7-4642-8f0b-d3f2e9d60156 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929371 Jul 18 13:15:08.989084 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1917/3729] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:15:08.990985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:08.992269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:09.015257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.016073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.017497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.018324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.119999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:15:09.339843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:09.382895 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-730ce0d2-86dd-4c3e-83dd-c7c8c111b0a1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.509210 Jul 18 13:15:09.389803 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1813/3730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:08 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:09.401919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8e1d2d05-38f4-4802-b3b4-b852e678b2c9 req-230e3393-8096-4813-a361-9adc69850f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d40fa9-9e2b-42f7-a330-74493547fe7e", "name": "network-vif-plugged", "status": "completed", "tag": "bf28fbe5-d50e-423e-9dbb-02e8b53f0b76"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:09.415536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca69c2b8-2b77-465c-8821-f90a7c264853 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 204 len: 0 microversion: 2.47 time: 0.429554 Jul 18 13:15:09.420432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1918/3731] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:15:08 2022] DELETE /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:15:09.442887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8e1d2d05-38f4-4802-b3b4-b852e678b2c9 req-230e3393-8096-4813-a361-9adc69850f5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.443805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8e1d2d05-38f4-4802-b3b4-b852e678b2c9 req-230e3393-8096-4813-a361-9adc69850f5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.445505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d3513b3-970b-4203-809b-32566f859a53 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:09.451633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d3513b3-970b-4203-809b-32566f859a53 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:09.519254 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8e1d2d05-38f4-4802-b3b4-b852e678b2c9 req-230e3393-8096-4813-a361-9adc69850f5d service nova] Creating event network-vif-plugged:bf28fbe5-d50e-423e-9dbb-02e8b53f0b76 for instance 45d40fa9-9e2b-42f7-a330-74493547fe7e on n-h2-850003-3 Jul 18 13:15:09.543731 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8e1d2d05-38f4-4802-b3b4-b852e678b2c9 req-230e3393-8096-4813-a361-9adc69850f5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148607 Jul 18 13:15:09.550257 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1814/3732] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:09.566850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e1be3a23-fb8b-4b4d-9442-bb0fb4bbb054 req-fc90b89c-b747-49ef-92fb-af6a702e917c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "tag": "e55910a4-60fb-4c9c-9429-97cd52f7ff56"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:09.608133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e1be3a23-fb8b-4b4d-9442-bb0fb4bbb054 req-fc90b89c-b747-49ef-92fb-af6a702e917c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.614225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e1be3a23-fb8b-4b4d-9442-bb0fb4bbb054 req-fc90b89c-b747-49ef-92fb-af6a702e917c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.645209 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e1be3a23-fb8b-4b4d-9442-bb0fb4bbb054 req-fc90b89c-b747-49ef-92fb-af6a702e917c service nova] Creating event network-changed:e55910a4-60fb-4c9c-9429-97cd52f7ff56 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:15:09.668159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d3513b3-970b-4203-809b-32566f859a53 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:09.691872 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e1be3a23-fb8b-4b4d-9442-bb0fb4bbb054 req-fc90b89c-b747-49ef-92fb-af6a702e917c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127291 Jul 18 13:15:09.693054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1815/3733] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:09.700016 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d3513b3-970b-4203-809b-32566f859a53 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1224 microversion: 2.1 time: 0.275388 Jul 18 13:15:09.704831 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1919/3734] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:09 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1224 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:09.710675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:09.712458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:09.732166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.733582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.735533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.737609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.932928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:09.952437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:09.980576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.982969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:09.991564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:09.994019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:10.181801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:10.205928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:10.210261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:10.213296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a705d76-b421-4358-9a40-edb2be949614 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1366 microversion: 2.47 time: 0.518497 Jul 18 13:15:10.215172 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1816/3735] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:09 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:10.440750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:10.449098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:10.481673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:10.482682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:10.487403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:10.495753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:10.721475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:10.795895 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-169c757b-e01f-45a7-a5df-2212329de4fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 0.888704 Jul 18 13:15:10.799584 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1920/3736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:09 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:10.833672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:10.837614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:10.860102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:10.861589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:10.864004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:10.865565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:10.947415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:10.992012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34072ebd-c41c-4fc4-8663-337c26b5bfd4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1314 microversion: 2.1 time: 0.577234 Jul 18 13:15:10.993991 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1817/3737] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:10 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:11.102675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:11.125291 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-429a356e-53db-49ab-aa1c-f2d1fa6feeeb tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1228 microversion: 2.1 time: 0.323027 Jul 18 13:15:11.127146 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1921/3738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:10 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1228 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:11.248527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:11.252296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:11.269542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.270859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.272653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.274352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.322468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:11.325172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:11.341052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.342264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.344060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.344880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.528597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:11.564636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:11.572678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:11.579834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0377ece5-c1f9-4e17-9178-b2afb450ec2d tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1366 microversion: 2.47 time: 0.338122 Jul 18 13:15:11.584857 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1818/3739] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:11 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:11.596918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:11.616083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d744c84-be3f-4307-9818-29a8d9c70dd2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.304457 Jul 18 13:15:11.623334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1922/3740] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:15:11 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:15:11.635496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:11.641040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:11.688213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.694126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.699985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.722644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.844141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:11.848895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:11.907505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.915354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:11.924115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:11.925609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:12.597633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:12.617981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80643013-2bb6-4258-9d99-fdca133a862a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1668 microversion: 2.1 time: 0.991909 Jul 18 13:15:12.618702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1819/3741] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:11 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1668 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:12.650557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:12.653690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:12.671956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:12.672445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:12.680833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:12.682261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:12.837031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:12.885657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b500a952-ac3d-457c-839c-36c8487cb2fe tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1511 microversion: 2.1 time: 1.059892 Jul 18 13:15:12.893948 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1923/3742] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:11 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1511 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:12.917016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:12.922712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:12.945492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:12.951151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:12.952374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:12.953211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.267215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:13.298904 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7d4ae65-a2aa-45c2-9677-6aa61035e816 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1276 microversion: 2.1 time: 0.402653 Jul 18 13:15:13.300660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1924/3743] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:12 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1276 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:13.330087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:13.331806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:13.346478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.347698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.349384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.352327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.358836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:13.393877 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb1a9abe-9587-4da6-b91b-e2afbf2739d4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1499 microversion: 2.1 time: 0.760651 Jul 18 13:15:13.400243 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1820/3744] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:12 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1499 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:13.425508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:13.427088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:13.453382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.457644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.459926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.460706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.462794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lazy-loading 'fault' on Instance uuid 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:15:13.464002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.466715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.571293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:13.584352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lazy-loading 'flavor' on Instance uuid 45d40fa9-9e2b-42f7-a330-74493547fe7e {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:15:13.600213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:13.606946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '477f5344069e424f9c0c9c7f71bc216d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1978ec9af4449b4b2479925dc1eae7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:13.610481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17802d85-4e30-4cb5-b740-5230b23255c6 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 200 len: 1371 microversion: 2.47 time: 0.293503 Jul 18 13:15:13.611990 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1925/3745] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:13 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:13.659715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:13.666379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:13.688623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.691161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.695271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.696958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.822421 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-536a2557-cc23-4343-b8bb-b21c4aa8b856 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "POST /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e/action" status: 202 len: 0 microversion: 2.1 time: 0.403319 Jul 18 13:15:13.825108 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1821/3746] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:15:13 2022] POST /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:15:13.842002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:13.843675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:13.855392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.856481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:13.857770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:13.858592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.184538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:14.238832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4dc515c2-91b9-4836-9206-22c940834f47 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1668 microversion: 2.1 time: 0.596538 Jul 18 13:15:14.240604 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1926/3747] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1668 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:14.259786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:14.280869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:14.308190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.319457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.324643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.327527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.739388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:14.749774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6abbfea-fd98-4ff1-987e-1724204d2e1f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1488 microversion: 2.1 time: 0.506682 Jul 18 13:15:14.751580 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1927/3748] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:14 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1488 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:14.762590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:14.763590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:14.777396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.778284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.779407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.780098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.797318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:14.824062 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6a1a351-f832-4e14-9927-ff2d394f4c5a tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1507 microversion: 2.1 time: 0.992492 Jul 18 13:15:14.828663 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1822/3749] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:13 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1507 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:14.844027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:14.845298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] [instance: 2d8f337e-bbf4-4f16-8afa-7b670bc36d79] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:14.854059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.854887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.856048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.856503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.875345 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] HTTP exception thrown: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Request method failure captured: Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 HTTP/1.1 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VzQ4MQTN1o5lMwzujCApAbn1-UeN8sCF3UTZlaP7rv_wEXLuPgs6vn2_1iLNuP7zKmIEYreRklH88cVs06xxXbinZcmVQKs4P8y2pp4EGzc1-mMIIL9d_cJBS-wYTpmSWN0IUsLewDqu2EYReQMmfdhhel1gAjujIV-TwlgqDFPo6o Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f1978ec9af4449b4b2479925dc1eae7e Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersAaction247Test-1657330525 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f1978ec9af4449b4b2479925dc1eae7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1978ec9af4449b4b2479925dc1eae7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f1978ec9af4449b4b2479925dc1eae7e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1978ec9af4449b4b2479925dc1eae7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersAaction247Test-1657330525 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f1978ec9af4449b4b2479925dc1eae7e Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersAaction247Test-1657330525 Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersAaction247Test-1657330525-project Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 477f5344069e424f9c0c9c7f71bc216d Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersAaction247Test-1657330525-project Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2d8f337e-bbf4-4f16-8afa-7b670bc36d79'} Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:14.885321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:14.893311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] Returning 404 to user: Instance 2d8f337e-bbf4-4f16-8afa-7b670bc36d79 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:14.895996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-895a45e5-c4a8-48e7-9bae-fbf82a36c553 tempest-ServersAaction247Test-1657330525 tempest-ServersAaction247Test-1657330525-project] 10.222.0.88 "GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79" status: 404 len: 111 microversion: 2.47 time: 0.065627 Jul 18 13:15:14.896931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1823/3750] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:14 2022] GET /compute/v2.1/servers/2d8f337e-bbf4-4f16-8afa-7b670bc36d79 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:15:14.903561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-519706973"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:14.906754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:14.917069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.918347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.919605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:14.920562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:14.942711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:14.958167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6bd866ed-d692-4573-b84d-cb0a445a78ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1282 microversion: 2.1 time: 0.205061 Jul 18 13:15:14.968864 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1928/3751] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:14 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:15.050388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7bec4c9-8a0d-41cb-8da0-978ed07c92c1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "PUT /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1060 microversion: 2.1 time: 0.151777 Jul 18 13:15:15.052946 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1824/3752] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:15:14 2022] PUT /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1060 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:15.078994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:15.084229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:15.143291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.146474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.150869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.166240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.288352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:15.290564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:15.309198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.310794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.315146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.315932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.497922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:15.510663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afce4836-b59d-4cc5-a3ea-5dc60037a1d4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1487 microversion: 2.1 time: 0.440642 Jul 18 13:15:15.520397 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1929/3753] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:15 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1487 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:15.554650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:15.555932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:15.568621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.577224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.580050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:15.582140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:15.996161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:16.009104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bda901bd-b8df-4087-9987-0ef0f0878b51 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1487 microversion: 2.1 time: 0.460617 Jul 18 13:15:16.009745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1930/3754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:15 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1487 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:16.033856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.040856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.057734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.061719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.063479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.064848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.100878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:16.192059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-732e3f22-9b46-4335-bf4d-5d3077371587 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1668 microversion: 2.1 time: 0.925689 Jul 18 13:15:16.192059 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1825/3755] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:15 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1668 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:16.205398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.207275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.234108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.235543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.237891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.241668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.431054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:16.452429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6311a04-1568-477e-bd54-9fa7ee9a627a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1282 microversion: 2.1 time: 0.258674 Jul 18 13:15:16.457161 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1826/3756] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:16 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:16.467247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.467592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.475295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:16.489773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-444c8565-ab74-4f50-8560-2ea2ad36d3e1 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1490 microversion: 2.1 time: 0.475328 Jul 18 13:15:16.490717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.491500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.494683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.496982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.504684 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1931/3757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:16 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1490 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:16.512309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:16.519773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.520372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.540181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.542141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.543762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.545069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.590492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:15:16.611305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:15:16.765718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:16.801726 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8655d97-e4e8-444c-bfe4-44a899727208 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 204 len: 0 microversion: 2.1 time: 0.342429 Jul 18 13:15:16.808825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1827/3758] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:16 2022] DELETE /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:15:16.816600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a5f7938-daaa-4d46-9558-d119800bc399 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 204 len: 0 microversion: 2.1 time: 0.309855 Jul 18 13:15:16.823065 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1932/3759] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:16 2022] DELETE /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:15:16.833144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.834959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.847619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:16.849841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:16.857658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.860541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.862563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.867616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.892586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.893741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:16.898796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:16.899979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:17.440267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:17.487143 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-312f1e3f-5346-42c5-be3f-46807500f285 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1496 microversion: 2.1 time: 0.660825 Jul 18 13:15:17.495985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1933/3760] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:16 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1496 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:17.512973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:17.518339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:17.553384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:17.554395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:17.555876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:17.558584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:17.603184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:17.621445 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5bda500-05fa-4a44-ae0f-47757e51ca65 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1493 microversion: 2.1 time: 0.802969 Jul 18 13:15:17.625116 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1828/3761] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:16 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1493 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:17.649446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:17.653283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:17.672688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:17.675965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:17.679386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:17.681981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:17.959145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:17.999225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-107e10a4-42ff-48d6-9588-524b939e6c49 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1673 microversion: 2.1 time: 0.495579 Jul 18 13:15:18.005384 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1934/3762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:17 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1673 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:18.042397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:18.065944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81d2a1d6-5fa6-4a33-9a37-0c900965333f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.435139 Jul 18 13:15:18.080004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1829/3763] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:17 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:18.522898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:18.525731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:18.542114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:18.543642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:18.545230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:18.546026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:18.660249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:18.662397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:18.681285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:18.683248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:18.685644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:18.687080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:18.747679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:18.844649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:18.857545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62d3efe9-7842-463b-9564-f3a75a26d37b tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1496 microversion: 2.1 time: 0.342510 Jul 18 13:15:18.858945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1935/3764] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:18 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1496 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:18.988467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:18.999464 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5f1cde8-79b4-465f-a9e6-53e67acc1820 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1493 microversion: 2.1 time: 0.346398 Jul 18 13:15:19.000906 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1830/3765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:18 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1493 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:19.026984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:19.028578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:19.037254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.038372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:19.041270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.042531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:19.093435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:19.095287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:19.111862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.113054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:19.114802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.115976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:19.377184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:19.391815 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1edbfb53-70fa-4b29-ad2a-40273c8c643b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.306717 Jul 18 13:15:19.393454 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1831/3766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:19 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:19.423414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:19.441371 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08b108ba-7cdd-4a16-9e7c-507cc6812dbf tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1673 microversion: 2.1 time: 0.419576 Jul 18 13:15:19.443279 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1936/3767] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:19 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1673 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:19.887360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:19.888250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:19.909585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.912892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:19.914693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:19.915645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.023385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:20.026003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:20.032292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:20.043238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.044243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.047364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.048940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.105178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:20.295180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:20.326968 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a234187-acaa-4393-86b2-13c05cb9a35b tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1493 microversion: 2.1 time: 0.300114 Jul 18 13:15:20.335200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:20.344876 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-44f31b10-1847-40d1-ae31-689594742b2c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1496 microversion: 2.1 time: 0.463677 Jul 18 13:15:20.345767 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1832/3768] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:19 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1496 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:20.348151 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1937/3769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:20 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:20.420693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:20.421806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:20.440027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.440840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.442333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.443361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.461762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:20.462430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:20.473941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.475881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:20.479288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:20.481498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:21.092595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:21.122881 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-341ba95c-b0f1-44fe-b12a-35cfdef5dd6f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.708684 Jul 18 13:15:21.134661 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1833/3770] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:20 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:21.870844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:21.875881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:21.912197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:21.916278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:21.919693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:21.926347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:22.300842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:22.318770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3571d672-3f3c-404c-abd8-ce59a14ab53f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1673 microversion: 2.1 time: 1.860878 Jul 18 13:15:22.332799 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1938/3771] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:20 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1673 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:22.344424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:22.348045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:22.366895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:22.368919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:22.376111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:22.376969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:23.061217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:23.136583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:23.148023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:23.159527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b283d4d5-ce67-4833-97d3-974e4c3fd93c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2944 microversion: 2.32 time: 1.813007 Jul 18 13:15:23.160633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1834/3772] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:21 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2944 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:15:23.174350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:23.181838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:23.215490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:23.217815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:23.219687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:23.223071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:23.276483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:23.303550 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21b3c936-fb9d-4a22-96a7-979e263cf928 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 200 len: 1493 microversion: 2.1 time: 0.966747 Jul 18 13:15:23.305102 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1939/3773] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:22 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 1493 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:23.322949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:23.323780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:23.360323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:23.365455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:23.378636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:23.379894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:24.427569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:24.447561 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6712c860-8d19-440b-b7dd-f4b17fe0bc6b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 1.139698 Jul 18 13:15:24.451811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1940/3774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:23 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:24.468920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:24.471247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:24.504616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:24.511655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:24.512960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:24.514984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:24.849766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:24.860256 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-282656c4-8528-441a-a475-4e61a4328aa8 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1496 microversion: 2.1 time: 1.697735 Jul 18 13:15:24.861248 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1835/3775] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:23 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1496 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:24.869424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:24.870915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:24.880322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:24.881121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:24.882173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:24.883649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.033380 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7eb293d9-4ccd-4bb5-bce7-1e4e5cedcb97 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.579704 Jul 18 13:15:25.035192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1941/3776] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:15:24 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a/os-interface => generated 1829 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:25.321404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-15876259-09c0-4217-b973-c178ff9290a0 req-0b0a5607-868f-473b-8675-0428b846fd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ef5ca5-ff80-4b66-bbec-3c889fa344d9", "name": "network-vif-deleted", "tag": "8523752b-5806-4c66-843b-0f3bc34b8b77"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:25.340728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-15876259-09c0-4217-b973-c178ff9290a0 req-0b0a5607-868f-473b-8675-0428b846fd92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.345360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-15876259-09c0-4217-b973-c178ff9290a0 req-0b0a5607-868f-473b-8675-0428b846fd92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.372819 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-15876259-09c0-4217-b973-c178ff9290a0 req-0b0a5607-868f-473b-8675-0428b846fd92 service nova] Creating event network-vif-deleted:8523752b-5806-4c66-843b-0f3bc34b8b77 for instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 on n-h2-850003-3 Jul 18 13:15:25.394351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-15876259-09c0-4217-b973-c178ff9290a0 req-0b0a5607-868f-473b-8675-0428b846fd92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345008 Jul 18 13:15:25.395642 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1942/3777] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:25.401905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:25.414030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:25.425682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.426430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.427319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.427935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.455189 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 HTTP/1.1 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '97ef5ca5-ff80-4b66-bbec-3c889fa344d9'} Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:25.459200 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:25.470059 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:25.473531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:25.482908 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5bbd1bf2-a706-4033-9612-e51987d88642 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 404 len: 111 microversion: 2.1 time: 0.080746 Jul 18 13:15:25.486005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1943/3778] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:25 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:25.504098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1a53cbc9-fbe9-41f7-a7be-c82496d57f00 req-bd2b36c1-db67-4b2c-80e3-e520b7929892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d40fa9-9e2b-42f7-a330-74493547fe7e", "name": "network-vif-unplugged", "status": "completed", "tag": "bf28fbe5-d50e-423e-9dbb-02e8b53f0b76"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:25.535049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1a53cbc9-fbe9-41f7-a7be-c82496d57f00 req-bd2b36c1-db67-4b2c-80e3-e520b7929892 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.536544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1a53cbc9-fbe9-41f7-a7be-c82496d57f00 req-bd2b36c1-db67-4b2c-80e3-e520b7929892 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.565717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1a53cbc9-fbe9-41f7-a7be-c82496d57f00 req-bd2b36c1-db67-4b2c-80e3-e520b7929892 service nova] Creating event network-vif-unplugged:bf28fbe5-d50e-423e-9dbb-02e8b53f0b76 for instance 45d40fa9-9e2b-42f7-a330-74493547fe7e on n-h2-850003-3 Jul 18 13:15:25.579113 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1a53cbc9-fbe9-41f7-a7be-c82496d57f00 req-bd2b36c1-db67-4b2c-80e3-e520b7929892 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090024 Jul 18 13:15:25.580307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1944/3779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:25.593308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:25.595596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:25.626794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.628492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:25.630289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:25.631810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:26.324102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:26.352968 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1cd85b5-7fc3-4cac-b7f7-75c15828930a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.489457 Jul 18 13:15:26.354490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1836/3780] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:24 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:26.386773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:26.387610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:26.412521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:26.423940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:26.430837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:26.434792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:26.539095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 HTTP/1.1 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '97ef5ca5-ff80-4b66-bbec-3c889fa344d9'} Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:26.553015 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:26.567177 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:26.574977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:26.584065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f65ab1b2-da49-47b8-8007-f46397f9a868 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 404 len: 111 microversion: 2.1 time: 0.220104 Jul 18 13:15:26.586290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1837/3781] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:26 2022] DELETE /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:26.622606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:26.624005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:26.682893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:26.686923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:26.694012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:26.695621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:26.927212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:26.989260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5241a03f-b527-47a3-970d-44a34408940b tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 1.406215 Jul 18 13:15:27.006205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1945/3782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:25 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:27.027606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d4f54408-f883-4286-8325-8feb7c2616d6 req-277c5415-09fe-4882-8872-e4153986f2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d40fa9-9e2b-42f7-a330-74493547fe7e", "name": "network-vif-deleted", "tag": "bf28fbe5-d50e-423e-9dbb-02e8b53f0b76"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:27.066461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff30a9e281264cba8e23efe4476e58fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768e74ecd074a20b20301296b60f22e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:27.086111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d4f54408-f883-4286-8325-8feb7c2616d6 req-277c5415-09fe-4882-8872-e4153986f2b9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.096372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17438ae4-2675-4337-9aef-66cede75f1da tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 200 len: 1290 microversion: 2.1 time: 0.507492 Jul 18 13:15:27.100370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d4f54408-f883-4286-8325-8feb7c2616d6 req-277c5415-09fe-4882-8872-e4153986f2b9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.112604 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1838/3783] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:26 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 1290 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:27.130697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:27.139652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 97ef5ca5-ff80-4b66-bbec-3c889fa344d9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:27.169603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d4f54408-f883-4286-8325-8feb7c2616d6 req-277c5415-09fe-4882-8872-e4153986f2b9 service nova] Creating event network-vif-deleted:bf28fbe5-d50e-423e-9dbb-02e8b53f0b76 for instance 45d40fa9-9e2b-42f7-a330-74493547fe7e on n-h2-850003-3 Jul 18 13:15:27.203120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d4f54408-f883-4286-8325-8feb7c2616d6 req-277c5415-09fe-4882-8872-e4153986f2b9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205561 Jul 18 13:15:27.209588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1946/3784] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:27.221076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.221774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.236698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.237559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.315918 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 HTTP/1.1 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '97ef5ca5-ff80-4b66-bbec-3c889fa344d9'} Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.320844 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 97ef5ca5-ff80-4b66-bbec-3c889fa344d9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92c72c73-e858-4a66-811c-5020c811a953 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9" status: 404 len: 111 microversion: 2.1 time: 0.211076 Jul 18 13:15:27.332396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1839/3785] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:27 2022] GET /compute/v2.1/servers/97ef5ca5-ff80-4b66-bbec-3c889fa344d9 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:27.358063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:27.359662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:27.401968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.404679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.425167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.485540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.555694 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b HTTP/1.1 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '88fceed9-6790-4556-afdc-53d03577924b'} Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:27.561772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.573101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.576235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:27.578446 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1f6325d-9d06-41bf-9e4c-5407b0fcc896 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 404 len: 111 microversion: 2.1 time: 0.241582 Jul 18 13:15:27.580649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1947/3786] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:27 2022] DELETE /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:27.597301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:27.599506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 88fceed9-6790-4556-afdc-53d03577924b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:27.650550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.651577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.653082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.654053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.700064 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b HTTP/1.1 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '88fceed9-6790-4556-afdc-53d03577924b'} Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.703879 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. Jul 18 13:15:27.713629 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.716366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 88fceed9-6790-4556-afdc-53d03577924b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:27.718318 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91245482-b9b3-45ee-8fd0-a2bdc54cd88e tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b" status: 404 len: 111 microversion: 2.1 time: 0.130469 Jul 18 13:15:27.724402 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1840/3787] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:27 2022] GET /compute/v2.1/servers/88fceed9-6790-4556-afdc-53d03577924b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:27.734034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:27.738716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:27.776726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.777630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.779055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.783379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.858003 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 HTTP/1.1 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '6b1ad742-1f92-4ba5-a85a-820555bfe979'} Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:27.870936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:27.881577 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:27.885674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:27.888622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dbcefc27-2c12-4d64-a1a2-5fca0715e996 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 404 len: 111 microversion: 2.1 time: 0.162472 Jul 18 13:15:27.895631 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1948/3788] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:27 2022] DELETE /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:27.914252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:27.920994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 6b1ad742-1f92-4ba5-a85a-820555bfe979] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:27.939607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0823e2fa-04d2-45e1-a679-2b0ac135481f req-b92cb36c-6392-4706-9fa9-bb79864c7329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:27.951950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.952821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.954326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.960498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:27.984453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0823e2fa-04d2-45e1-a679-2b0ac135481f req-b92cb36c-6392-4706-9fa9-bb79864c7329 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:27.987032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0823e2fa-04d2-45e1-a679-2b0ac135481f req-b92cb36c-6392-4706-9fa9-bb79864c7329 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.004438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 HTTP/1.1 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6b1ad742-1f92-4ba5-a85a-820555bfe979'} Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.007190 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. Jul 18 13:15:28.017650 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.023765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 6b1ad742-1f92-4ba5-a85a-820555bfe979 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.025697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96a8432b-e91e-42aa-ab07-7bd9be71c532 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979" status: 404 len: 111 microversion: 2.1 time: 0.121888 Jul 18 13:15:28.028159 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1841/3789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:27 2022] GET /compute/v2.1/servers/6b1ad742-1f92-4ba5-a85a-820555bfe979 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.032348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0823e2fa-04d2-45e1-a679-2b0ac135481f req-b92cb36c-6392-4706-9fa9-bb79864c7329 service nova] Creating event network-changed:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:15:28.036914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.038205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.043373 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0823e2fa-04d2-45e1-a679-2b0ac135481f req-b92cb36c-6392-4706-9fa9-bb79864c7329 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116324 Jul 18 13:15:28.045347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1949/3790] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:15:28.057701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.058288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.059192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.059731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.076414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.077361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.090431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.092483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.094123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.095296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.124317 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a HTTP/1.1 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'caf0feda-7b55-4304-998b-2b0c22b96e7a'} Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.128618 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.139046 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.141712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.142908 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dae40c91-b306-4482-8087-85742b25920a tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 404 len: 111 microversion: 2.1 time: 0.095031 Jul 18 13:15:28.143955 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1950/3791] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.150038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.151337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.161235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.162179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.164311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.165246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.196240 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e HTTP/1.1 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '45d40fa9-9e2b-42f7-a330-74493547fe7e'} Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.198710 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.207764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.211001 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee5e4e4d-1b43-4b32-9853-fb1c445d4e93 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 404 len: 111 microversion: 2.1 time: 0.065475 Jul 18 13:15:28.211936 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1951/3792] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.218040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.219059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: caf0feda-7b55-4304-998b-2b0c22b96e7a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.229483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.229932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.230888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.231922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.260545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a HTTP/1.1 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'caf0feda-7b55-4304-998b-2b0c22b96e7a'} Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.262674 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. Jul 18 13:15:28.269317 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.270831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance caf0feda-7b55-4304-998b-2b0c22b96e7a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.271884 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-312631af-37c0-4e74-b321-ce63d31eccf4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a" status: 404 len: 111 microversion: 2.1 time: 0.058902 Jul 18 13:15:28.273128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1952/3793] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/caf0feda-7b55-4304-998b-2b0c22b96e7a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.278074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.278920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.290546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.291596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.293698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.295203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.326295 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e HTTP/1.1 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '45d40fa9-9e2b-42f7-a330-74493547fe7e'} Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.329376 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e76fbec-0bec-43d8-82de-3237b932e926 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 404 len: 111 microversion: 2.1 time: 0.057921 Jul 18 13:15:28.335606 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1953/3794] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.344263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.345068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.358582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.360111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.362182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.363202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.397892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 HTTP/1.1 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4c9a19ee-dc03-42bf-abda-d65e840199a9'} Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.401639 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.410910 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.415664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.415664 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6a5c4b8-ff5c-4f91-aa61-fc95c734fdb1 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 404 len: 111 microversion: 2.1 time: 0.079388 Jul 18 13:15:28.416733 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1954/3795] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.427306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.428498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 45d40fa9-9e2b-42f7-a330-74493547fe7e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.437238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:28.446769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.447279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.448764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.449548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.480650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:28.485679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e HTTP/1.1 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '45d40fa9-9e2b-42f7-a330-74493547fe7e'} Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.489216 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 45d40fa9-9e2b-42f7-a330-74493547fe7e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd2e68e3-6b82-4656-b4eb-c6f9cf3e5728 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e" status: 404 len: 111 microversion: 2.1 time: 0.073625 Jul 18 13:15:28.502760 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1955/3796] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/45d40fa9-9e2b-42f7-a330-74493547fe7e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.504878 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f9c445b-9769-4953-9822-302387b5e297 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.471493 Jul 18 13:15:28.509682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.510879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 4c9a19ee-dc03-42bf-abda-d65e840199a9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.513084 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1842/3797] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:28.525040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.525853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.527273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.528077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.536260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.538552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.560358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.561060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.562091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.562927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 HTTP/1.1 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4c9a19ee-dc03-42bf-abda-d65e840199a9'} Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.566186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. Jul 18 13:15:28.575321 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.576183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.576348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 4c9a19ee-dc03-42bf-abda-d65e840199a9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.576348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1791a68-6ec9-4184-bd28-416fcc37f2b3 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9" status: 404 len: 111 microversion: 2.1 time: 0.069077 Jul 18 13:15:28.576348 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1956/3798] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/4c9a19ee-dc03-42bf-abda-d65e840199a9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.588817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.589872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.601875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.602469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.603367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.603887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.626367 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.627103 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f HTTP/1.1 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e37a04c3-a79c-4b3a-b264-5d127a7f720f'} Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.630584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.640260 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 HTTP/1.1 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bc73bb6f-593b-47db-83ab-a46d14657248'} Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.642421 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.654722 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.657839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.658916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.658916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a253d16-01db-483d-98a6-c1bb8ea79569 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 404 len: 111 microversion: 2.1 time: 0.116177 Jul 18 13:15:28.659383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6209dcb2-6067-43c6-ba3d-60c114298c55 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 404 len: 111 microversion: 2.1 time: 0.053990 Jul 18 13:15:28.659894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1843/3799] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.660129 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1957/3800] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.660394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.660614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.660859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: e37a04c3-a79c-4b3a-b264-5d127a7f720f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.661911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: bc73bb6f-593b-47db-83ab-a46d14657248] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.670312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.670312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.672168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.672996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.683569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.684903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.686302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.687207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.701959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 HTTP/1.1 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc73bb6f-593b-47db-83ab-a46d14657248'} Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.703989 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. Jul 18 13:15:28.712754 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.715093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance bc73bb6f-593b-47db-83ab-a46d14657248 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.715988 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1ab3bc5-c8be-465f-904b-2ad8b39926e4 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248" status: 404 len: 111 microversion: 2.1 time: 0.074541 Jul 18 13:15:28.720610 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1958/3801] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/bc73bb6f-593b-47db-83ab-a46d14657248 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.723847 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f HTTP/1.1 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'e37a04c3-a79c-4b3a-b264-5d127a7f720f'} Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.731779 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. Jul 18 13:15:28.742425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.747247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.747247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.747787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance e37a04c3-a79c-4b3a-b264-5d127a7f720f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.748647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-03a65f65-357d-4295-aa44-e6cfa8384401 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f" status: 404 len: 111 microversion: 2.1 time: 0.105377 Jul 18 13:15:28.754184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.755380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1844/3802] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/e37a04c3-a79c-4b3a-b264-5d127a7f720f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.755712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.757939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.761501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.766026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.775241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.778885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 HTTP/1.1 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0bd55f08-0e1a-4848-af85-e1371d5891c8'} Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.782422 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-03fa3970-f646-40a9-8cb3-ade6fa4e5ba2 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8" status: 404 len: 111 microversion: 2.1 time: 0.027754 Jul 18 13:15:28.789038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1845/3803] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.801677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.802810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 0bd55f08-0e1a-4848-af85-e1371d5891c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.810600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e HTTP/1.1 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1e1a786c-31fc-49b4-8953-726d14fad26e'} Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.813777 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36b01002-f463-476e-b3c6-6648bdb0cef3 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 404 len: 111 microversion: 2.1 time: 0.090147 Jul 18 13:15:28.824844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1959/3804] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.827860 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 HTTP/1.1 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0bd55f08-0e1a-4848-af85-e1371d5891c8'} Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.828746 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 0bd55f08-0e1a-4848-af85-e1371d5891c8 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.844373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94e954e6-cfee-4610-9b41-a43338f244b8 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8" status: 404 len: 111 microversion: 2.1 time: 0.036722 Jul 18 13:15:28.845422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.845593 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1846/3805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/0bd55f08-0e1a-4848-af85-e1371d5891c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.846962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 1e1a786c-31fc-49b4-8953-726d14fad26e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.848893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.849790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.858565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.859356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.860794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.861526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.862499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.863311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.864842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.865624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.890341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e HTTP/1.1 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1e1a786c-31fc-49b4-8953-726d14fad26e'} Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.893173 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 1e1a786c-31fc-49b4-8953-726d14fad26e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b3a26da-cf01-48fd-8001-580118e6f69d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e" status: 404 len: 111 microversion: 2.1 time: 0.070727 Jul 18 13:15:28.903121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1960/3806] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/1e1a786c-31fc-49b4-8953-726d14fad26e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:15:28.914823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.915523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.926955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.927282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:15:28.927914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.929358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:28.929845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:28.968976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad HTTP/1.1 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '40c22e2d-fc6e-47af-a9d4-02372306adad'} Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:28.972220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39202b13-38cd-4d28-836a-1d8ad1a3ef48 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 404 len: 111 microversion: 2.1 time: 0.068429 Jul 18 13:15:28.984995 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1961/3807] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:28.992760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:28.993406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 40c22e2d-fc6e-47af-a9d4-02372306adad] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:28.999317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:29.006485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.008668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.010458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.011822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.046037 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad HTTP/1.1 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '40c22e2d-fc6e-47af-a9d4-02372306adad'} Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.049806 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.065154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 40c22e2d-fc6e-47af-a9d4-02372306adad could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:29.076862 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10475d6a-6eca-4029-9345-720935efc495 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad" status: 404 len: 111 microversion: 2.1 time: 0.083571 Jul 18 13:15:29.084871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1962/3808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:28 2022] GET /compute/v2.1/servers/40c22e2d-fc6e-47af-a9d4-02372306adad => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:29.095972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:29.097295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:29.110056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 HTTP/1.1 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '140b8010-cc11-41c8-bfda-cc62dd83f360'} Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.114338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5515f337-9a43-43e3-93b5-e1bf7fb001bb tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360" status: 404 len: 111 microversion: 2.1 time: 0.041045 Jul 18 13:15:29.135659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1963/3809] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:29 2022] DELETE /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:29.163521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:29.164949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 140b8010-cc11-41c8-bfda-cc62dd83f360] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:29.179063 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2276849a-6e0d-4b70-bd5c-8699de72b0f4 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 204 len: 0 microversion: 2.1 time: 0.337633 Jul 18 13:15:29.187258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1847/3810] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:28 2022] DELETE /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:15:29.187581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 HTTP/1.1 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '140b8010-cc11-41c8-bfda-cc62dd83f360'} Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:29.188608 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 140b8010-cc11-41c8-bfda-cc62dd83f360 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:29.194458 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-601eac54-99d3-4b80-a88d-24092ac9913d tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360" status: 404 len: 111 microversion: 2.1 time: 0.052207 Jul 18 13:15:29.198679 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1964/3811] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:29 2022] GET /compute/v2.1/servers/140b8010-cc11-41c8-bfda-cc62dd83f360 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:29.203682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:29.205380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:29.223370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.224049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.224945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.225487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.524326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:29.526560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:29.535885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.536769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.537943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:29.538792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:29.697440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:29.754415 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74a6ba86-b83d-4e6e-8f43-ef2976ea530f tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1481 microversion: 2.1 time: 0.563333 Jul 18 13:15:29.759778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1848/3812] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:29 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1481 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:30.803963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:30.808399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:30.847544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:30.850030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:30.853158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:30.858612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:31.452832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:31.470583 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-748d602e-2d3c-43ba-9d86-15af9262afab tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1481 microversion: 2.1 time: 0.678698 Jul 18 13:15:31.472108 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1849/3813] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:30 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1481 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:31.990703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:32.024245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec877947-6ff1-4dd7-897f-401fac5d3611 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 2.500731 Jul 18 13:15:32.035779 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1965/3814] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:29 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:32.490954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:32.491936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:32.514183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:32.515921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:32.520619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:32.524538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:32.701274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6cdd36e1-fdf7-4301-9545-6d2fab4a3813 req-294eed8f-ca3d-493f-9144-943bd2541271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "name": "network-vif-plugged", "status": "completed", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:32.726315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:32.734771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6cdd36e1-fdf7-4301-9545-6d2fab4a3813 req-294eed8f-ca3d-493f-9144-943bd2541271 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:32.735496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6cdd36e1-fdf7-4301-9545-6d2fab4a3813 req-294eed8f-ca3d-493f-9144-943bd2541271 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:32.752029 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-089ef0d6-b0b6-4186-b510-3b43019d2b53 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1439 microversion: 2.1 time: 0.265851 Jul 18 13:15:32.755678 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1850/3815] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:32 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1439 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:32.775729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6cdd36e1-fdf7-4301-9545-6d2fab4a3813 req-294eed8f-ca3d-493f-9144-943bd2541271 service nova] Creating event network-vif-plugged:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:15:32.789447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6cdd36e1-fdf7-4301-9545-6d2fab4a3813 req-294eed8f-ca3d-493f-9144-943bd2541271 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090408 Jul 18 13:15:32.793213 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1966/3816] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:15:33.092231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:33.095682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:33.140851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:33.144473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:33.150618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:33.168193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:33.372696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-32d33dde-c5cd-442e-89e1-d2b9f6d43221 req-48fda4ec-4cd5-4a0a-841c-c7e4f9250a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf2bf7f-1966-4058-9947-e59f2a8548a7", "name": "network-vif-deleted", "tag": "ee5263b1-437d-4d6d-8e95-2a285d027cfa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:33.472288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-32d33dde-c5cd-442e-89e1-d2b9f6d43221 req-48fda4ec-4cd5-4a0a-841c-c7e4f9250a38 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:33.473571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-32d33dde-c5cd-442e-89e1-d2b9f6d43221 req-48fda4ec-4cd5-4a0a-841c-c7e4f9250a38 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:33.578302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-32d33dde-c5cd-442e-89e1-d2b9f6d43221 req-48fda4ec-4cd5-4a0a-841c-c7e4f9250a38 service nova] Creating event network-vif-deleted:ee5263b1-437d-4d6d-8e95-2a285d027cfa for instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 on n-h1-850003-3 Jul 18 13:15:33.635663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-32d33dde-c5cd-442e-89e1-d2b9f6d43221 req-48fda4ec-4cd5-4a0a-841c-c7e4f9250a38 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267329 Jul 18 13:15:33.637292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1967/3817] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:33.728756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:33.754520 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fcc2dc3e-fe74-45ab-a053-f1ddee648aa9 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.696999 Jul 18 13:15:33.766797 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1851/3818] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:33 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:33.796008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:33.813564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:33.878297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:33.880615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:33.885490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:33.893114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:34.068698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:34.074848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:34.076310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lazy-loading 'fault' on Instance uuid 1bf2bf7f-1966-4058-9947-e59f2a8548a7 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:15:34.239637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec9b041a764a5e923aafd4d09610e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f2324a4d464b5e8a757112f9e8322c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:34.268008 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-01095f48-3fa6-424c-9c3b-9b34d0df76ad tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 200 len: 1283 microversion: 2.1 time: 0.488212 Jul 18 13:15:34.295743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1968/3819] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:33 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 1283 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:34.790680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:34.791824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:34.825975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:34.826857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:34.828327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:34.829041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:35.308602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:35.309658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] [instance: 1bf2bf7f-1966-4058-9947-e59f2a8548a7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:35.337273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:35.338591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:35.340012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:35.340552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:35.376237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] HTTP exception thrown: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Request method failure captured: Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 HTTP/1.1 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VtBeIFVGbXgCi6TTWlrZpsYg9JT5yd3D751MAjVFVEV8fe4XP75iofy-8uuzM_3OvHCQhmbHHiWT-FHcntRf5dxNG6_4wztUBXwsLo4xiSFolqgf6nAghUWHH5CPEn2wz6pERxzVTpvNqXfEKDdTUGtg-m70EUgkJjaxek1HdT4GTk Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_96f2324a4d464b5e8a757112f9e8322c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/96f2324a4d464b5e8a757112f9e8322c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersTestJSON-1002296324 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 96f2324a4d464b5e8a757112f9e8322c Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersTestJSON-1002296324 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6cec9b041a764a5e923aafd4d09610e1 Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersTestJSON-1002296324-project Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1bf2bf7f-1966-4058-9947-e59f2a8548a7'} Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:35.386348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] Returning 404 to user: Instance 1bf2bf7f-1966-4058-9947-e59f2a8548a7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:35.394303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0693edd9-0f42-4f62-b6b2-66db02215331 tempest-ServersTestJSON-1002296324 tempest-ServersTestJSON-1002296324-project] 10.222.0.88 "GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7" status: 404 len: 111 microversion: 2.1 time: 0.088674 Jul 18 13:15:35.395286 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1969/3820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:35 2022] GET /compute/v2.1/servers/1bf2bf7f-1966-4058-9947-e59f2a8548a7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:15:35.485732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:35.502870 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eec94d02-6c33-4d3d-ad64-6e075e2c0cea tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1324 microversion: 2.1 time: 0.720339 Jul 18 13:15:35.516149 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1852/3821] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:34 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1324 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:36.565319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:36.573140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:36.611654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:36.619112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:36.635093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:36.640059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.223771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:37.258934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd9c38c5-1106-48a3-891a-da8ab2a7db01 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1520 microversion: 2.1 time: 0.716034 Jul 18 13:15:37.269724 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1970/3822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:36 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1520 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:37.296566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2af62b2b-a103-4dc4-9797-e23b5429580c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'create', calling method: .version_select at 0x7f96e4711b80>, body: {"pool": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:37.733734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:37.734467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:37.753237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.753818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.767084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.767084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.828552 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc HTTP/1.1 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '13e940b5-37ea-4069-906b-3da8c53739cc'} Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:37.839324 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.845101 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.851572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:37.852536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d722e4d4-69a9-42d1-a2cb-92e2322d72ff tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 404 len: 111 microversion: 2.1 time: 0.128079 Jul 18 13:15:37.857983 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1971/3823] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:37 2022] DELETE /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:15:37.873226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:37.874296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 13e940b5-37ea-4069-906b-3da8c53739cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:37.890655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.891123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.892154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.893021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.913921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:37.915481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc HTTP/1.1 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '13e940b5-37ea-4069-906b-3da8c53739cc'} Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.919666 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 13e940b5-37ea-4069-906b-3da8c53739cc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f3fcd32-c78a-4f29-84cb-f827282a90b0 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc" status: 404 len: 111 microversion: 2.1 time: 0.058102 Jul 18 13:15:37.928675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1972/3824] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:37 2022] GET /compute/v2.1/servers/13e940b5-37ea-4069-906b-3da8c53739cc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:37.937665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:37.938086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:37.944727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.945192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.946038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.946548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.970114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 HTTP/1.1 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '609fd767-a1e1-4348-bce9-97ad87b2aae6'} Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:37.972626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:37.978636 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a21b684-f2dd-406b-9ac8-6e676f804e6c tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "DELETE /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 404 len: 111 microversion: 2.1 time: 0.041591 Jul 18 13:15:37.979878 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1973/3825] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:15:37 2022] DELETE /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:37.985356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:37.987299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] [instance: 609fd767-a1e1-4348-bce9-97ad87b2aae6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:37.996081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.996920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:37.997839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:37.998850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:38.022763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] HTTP exception thrown: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Request method failure captured: Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 HTTP/1.1 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1VsN_b-PzpHJ1Zd-x2pKZF49_oL0Gi35z-2n5Uc1p65AW-iLSWMJuV8Q23Sdu0TX5FaKoz4XUhSrZDXz7OWaFa4_9i5auNxwdg75vDcOZTwzRMch-Idx9_bP43eBdxcTiY2nlL9tsLGxQlJDekfHhid87KkOlQVqa8y8eP22neVpRqU Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9768e74ecd074a20b20301296b60f22e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9768e74ecd074a20b20301296b60f22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 9768e74ecd074a20b20301296b60f22e Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-132596924 Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff30a9e281264cba8e23efe4476e58fd Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-132596924-project Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '609fd767-a1e1-4348-bce9-97ad87b2aae6'} Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:15:38.024714 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] Returning 404 to user: Instance 609fd767-a1e1-4348-bce9-97ad87b2aae6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:15:38.031603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-745c16f8-df9a-4056-83ad-07fdc2f49e50 tempest-DeleteServersTestJSON-132596924 tempest-DeleteServersTestJSON-132596924-project] 10.222.0.88 "GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6" status: 404 len: 111 microversion: 2.1 time: 0.046518 Jul 18 13:15:38.034175 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1974/3826] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:37 2022] GET /compute/v2.1/servers/609fd767-a1e1-4348-bce9-97ad87b2aae6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:15:38.722530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-282923515", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "962fe070-3fd9-4d45-a987-8b3a37321ca1"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:38.845780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] validate_networks() for [('962fe070-3fd9-4d45-a987-8b3a37321ca1', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:15:40.671959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:15:40.673903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:15:40.673903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:15:40.673903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:15:40.675132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:15:40.708052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:40.711190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:40.715520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:40.717604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:40.831339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Getting quotas for project 7bb7b6bbc6f2458ca82beea1e73d4753. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:15:40.844134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Getting quotas for user 6246972459914f4d8abbcdd7013aa609 and project 7bb7b6bbc6f2458ca82beea1e73d4753. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:15:40.884824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:15:40.890241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:15:41.002098 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6860fbc8-9d47-46c0-a68c-7840f8444118 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.894719 Jul 18 13:15:41.004475 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1975/3827] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:15:41.024563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b469b0dd-9c6f-4fbb-a631-ee9c379e94c8 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:41.032296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b469b0dd-9c6f-4fbb-a631-ee9c379e94c8 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:41.253319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b469b0dd-9c6f-4fbb-a631-ee9c379e94c8 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:41.292447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b469b0dd-9c6f-4fbb-a631-ee9c379e94c8 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1216 microversion: 2.1 time: 0.275236 Jul 18 13:15:41.297045 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1976/3828] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:41 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:42.331742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43811773-60ab-4ce3-ad6a-c3944a79159f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:42.351841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43811773-60ab-4ce3-ad6a-c3944a79159f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:42.635700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-43811773-60ab-4ce3-ad6a-c3944a79159f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:42.656663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43811773-60ab-4ce3-ad6a-c3944a79159f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1216 microversion: 2.1 time: 0.334572 Jul 18 13:15:42.659228 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1977/3829] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:42 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1216 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:43.679392 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2af62b2b-a103-4dc4-9797-e23b5429580c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.390588 Jul 18 13:15:43.680997 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1853/3830] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 13:15:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:43.692148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:43.695780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:43.723657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:43.725347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:43.727745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:43.746202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:43.991159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-119940530", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:44.153397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] validate_networks() for [('3878adc7-5dcd-4c1b-92c7-f58b49518f4c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:15:44.493576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:44.519864 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ed7bb6c4-054c-4a59-9e93-792467d9c8d1 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1268 microversion: 2.1 time: 0.834103 Jul 18 13:15:44.536688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1978/3831] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:43 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1268 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:45.113860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:15:45.114726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:15:45.115946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:15:45.117778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:15:45.118956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:15:45.157258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:45.168835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:45.171643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:45.174946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:45.274319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Getting quotas for project e94ea9219ab648bfbea251e13bd8542c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:15:45.300702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Getting quotas for user 2a21754edbea4264894e37691956513c and project e94ea9219ab648bfbea251e13bd8542c. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:15:45.370684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:15:45.376990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:15:45.493231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e69cfa4c-9a1a-4166-99d9-f093de6b3282 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509940 Jul 18 13:15:45.508172 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1854/3832] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:15:45.514525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0cf97e16-e4b5-4cbe-8808-00eb6a84e81e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:45.519132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0cf97e16-e4b5-4cbe-8808-00eb6a84e81e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:45.577774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:45.579612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:45.612725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:45.613108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:45.621851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:45.626837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:45.689753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0cf97e16-e4b5-4cbe-8808-00eb6a84e81e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:45.706811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0cf97e16-e4b5-4cbe-8808-00eb6a84e81e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1223 microversion: 2.1 time: 0.197201 Jul 18 13:15:45.708934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1979/3833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:45 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1223 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:45.834285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:45.852114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b5befd3-5343-4872-ab29-b07e587be41a tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1274 microversion: 2.1 time: 0.306815 Jul 18 13:15:45.853918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1855/3834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:45 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:46.748669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:46.760306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:46.782651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:46.783922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:46.785975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:46.787165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:46.887062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:46.890304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:46.896503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:46.929390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:46.930860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:46.932642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:46.933832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:46.984493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:47.006265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4b8f94a-8712-4b0d-95dc-b34731070661 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1219 microversion: 2.1 time: 0.282349 Jul 18 13:15:47.009441 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1980/3835] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:46 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1219 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:47.107078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:47.123776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae005c88-6406-45fc-92e2-c4cd1c08013b tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1274 microversion: 2.1 time: 0.245676 Jul 18 13:15:47.125567 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1856/3836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:46 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:48.041843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:48.044079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:48.056142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:48.057383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:48.058977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:48.059760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:48.157341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:48.158550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:48.189521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:48.190444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:48.191950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:48.193241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:48.427906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:48.441627 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e9e7113-43cb-40ae-a18f-5d9f7fe56295 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1281 microversion: 2.1 time: 0.407259 Jul 18 13:15:48.442527 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1981/3837] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:48 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:48.592788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:48.620234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97a0cd5e-2533-4284-990a-d55d06e7642d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.472512 Jul 18 13:15:48.621376 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1857/3838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:48 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:49.464508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:49.465705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:49.487946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:49.488603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:49.495322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:49.499986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:49.652545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:49.654938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:49.667362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:49.668691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:49.670823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:49.672024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:50.196721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:50.213638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb5673ea-adea-4b00-90cf-2a7a71a4cf61 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.569330 Jul 18 13:15:50.214671 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1858/3839] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:49 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:50.225210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:50.228215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:50.237304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:50.238289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:50.239511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:50.240509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:50.647566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:50.674187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a8f6cee-5e9d-490f-a2f0-e092142237b3 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 1.213954 Jul 18 13:15:50.681989 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1982/3840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:49 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:50.756858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:50.801651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:50.815664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:50.833702 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7724992a-2678-43f6-a7d1-c3227ca82b6b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2953 microversion: 2.42 time: 0.616926 Jul 18 13:15:50.858936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1859/3841] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:15:50 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2953 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:50.864439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:50.877058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:50.878661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:50.897893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:50.898997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:50.900176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:50.900937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:51.244167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:51.245128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:51.267983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:51.271156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:51.276328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:51.277092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:51.638709 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0926fc13-b527-4aaa-8351-360bc227f695 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.776557 Jul 18 13:15:51.649881 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1983/3842] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:15:50 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35/os-interface => generated 1830 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:15:51.715141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:51.716604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:51.736303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:51.737126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:51.738634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:51.739545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:52.448408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:52.472590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6cd407dd-4bbb-4372-b1bd-5c28b81b95a7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 1.235903 Jul 18 13:15:52.474128 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1860/3843] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:51 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:52.481162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7b8fea7c-5c66-4fd1-be08-1492c010fd8d req-3891422f-8430-4682-8494-5f4cae76dfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2cb391-71ae-4050-b27a-171355b8058f", "tag": "fe88181a-26f3-4943-b066-718e55c71709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:52.492124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7b8fea7c-5c66-4fd1-be08-1492c010fd8d req-3891422f-8430-4682-8494-5f4cae76dfd2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:52.493075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7b8fea7c-5c66-4fd1-be08-1492c010fd8d req-3891422f-8430-4682-8494-5f4cae76dfd2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:52.527686 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7b8fea7c-5c66-4fd1-be08-1492c010fd8d req-3891422f-8430-4682-8494-5f4cae76dfd2 service nova] Creating event network-changed:fe88181a-26f3-4943-b066-718e55c71709 for instance cd2cb391-71ae-4050-b27a-171355b8058f on n-h2-850003-3 Jul 18 13:15:52.539235 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7b8fea7c-5c66-4fd1-be08-1492c010fd8d req-3891422f-8430-4682-8494-5f4cae76dfd2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062334 Jul 18 13:15:52.541073 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1861/3844] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:52.649376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:52.661006 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ca8f3fa-4007-4e3f-b529-4a77931bb497 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.952437 Jul 18 13:15:52.666466 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1984/3845] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:51 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:52.766990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-88480b11-b7f8-414e-af27-3b040a4bd8a7 req-cba9b209-bf2a-462a-ab02-ea46542d2788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31bbbb0-2291-46f8-8313-0092281c7224", "tag": "87756f71-c377-4b2e-86b5-78ed752bd5b2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:52.782987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-88480b11-b7f8-414e-af27-3b040a4bd8a7 req-cba9b209-bf2a-462a-ab02-ea46542d2788 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:52.784027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-88480b11-b7f8-414e-af27-3b040a4bd8a7 req-cba9b209-bf2a-462a-ab02-ea46542d2788 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:52.810425 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-88480b11-b7f8-414e-af27-3b040a4bd8a7 req-cba9b209-bf2a-462a-ab02-ea46542d2788 service nova] Creating event network-changed:87756f71-c377-4b2e-86b5-78ed752bd5b2 for instance e31bbbb0-2291-46f8-8313-0092281c7224 on n-h1-850003-3 Jul 18 13:15:52.829111 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-88480b11-b7f8-414e-af27-3b040a4bd8a7 req-cba9b209-bf2a-462a-ab02-ea46542d2788 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076000 Jul 18 13:15:52.830716 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1862/3846] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:53.504061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:53.512494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:53.531086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:53.532293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:53.534672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:53.535856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:53.691843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:53.693417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:53.708058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:53.709018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:53.711787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:53.713818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:54.078708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:54.097978 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15e40e25-5073-44da-925f-df835159e298 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.414480 Jul 18 13:15:54.100095 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1863/3847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:53 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:54.700139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:54.738327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9142cc02-ac6d-41e8-b00c-43b36d933480 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 1.237532 Jul 18 13:15:54.743182 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1985/3848] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:53 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:55.145027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:55.146142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:55.169006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:55.169543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:55.170862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:55.171475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:55.227023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:55.354825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:55.734009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:55.776676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:55.777395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:55.780483 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17b9920a-68dc-46a3-8f8d-fcb4c340f607 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.653174 Jul 18 13:15:55.781973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1864/3849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:55 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:55.810362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:55.826701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:55.827626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:55.829140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:55.829973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:56.200410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:56.221531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9bfe8469-6d1e-4a2d-81d6-cc34bffb37c7 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.453551 Jul 18 13:15:56.222139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1986/3850] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:55 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:56.804966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:56.807783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:56.825716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:56.827266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:56.831115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:56.832158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:57.232032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:57.252664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:57.253711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:57.271455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:57.272746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:57.273828 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59b7c796-52fa-417b-8475-6391834e4605 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.477827 Jul 18 13:15:57.276267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:57.277725 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1865/3851] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:56 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:57.291024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:57.825401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:57.851869 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a9e63be-d345-4ea7-b90a-e9c54b198650 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.609728 Jul 18 13:15:57.852980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1987/3852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:57 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:58.307477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:58.312286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:58.343880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:58.345020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:58.351771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:58.353707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:58.381202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:58.843946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:58.863832 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ae27b8b-5f50-47a6-8d19-d33ae51376ef tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.564803 Jul 18 13:15:58.865299 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1866/3853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:58 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:15:58.892348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:58.893557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:58.904377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:15:58.907549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:58.912056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:58.916902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:58.918752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:59.327461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bcd08865-bd19-4156-a851-42a16c09ba48 req-43c74f98-44b9-4aaf-96c5-c545ee27c2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2cb391-71ae-4050-b27a-171355b8058f", "name": "network-vif-plugged", "status": "completed", "tag": "fe88181a-26f3-4943-b066-718e55c71709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:15:59.346837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bcd08865-bd19-4156-a851-42a16c09ba48 req-43c74f98-44b9-4aaf-96c5-c545ee27c2ac service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:59.355372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bcd08865-bd19-4156-a851-42a16c09ba48 req-43c74f98-44b9-4aaf-96c5-c545ee27c2ac service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:59.404465 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bcd08865-bd19-4156-a851-42a16c09ba48 req-43c74f98-44b9-4aaf-96c5-c545ee27c2ac service nova] Creating event network-vif-plugged:fe88181a-26f3-4943-b066-718e55c71709 for instance cd2cb391-71ae-4050-b27a-171355b8058f on n-h2-850003-3 Jul 18 13:15:59.418357 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bcd08865-bd19-4156-a851-42a16c09ba48 req-43c74f98-44b9-4aaf-96c5-c545ee27c2ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094960 Jul 18 13:15:59.420715 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1867/3854] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:15:59.557748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:15:59.586567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee5b9b05-85e9-47d2-a334-a3781cd8d466 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.700159 Jul 18 13:15:59.587788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1988/3855] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:58 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:15:59.904718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:15:59.909294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:15:59.939976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:59.942123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:15:59.949570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:15:59.954513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:00.557946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:00.598263 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b57c4df9-ad7d-4baa-b2cc-fe4ec45e0af5 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.706455 Jul 18 13:16:00.600673 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1868/3856] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:15:59 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:00.618847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:00.624283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:00.651627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:00.652407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:00.653809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:00.654598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:01.655609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:01.659150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:01.675298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:01.677302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:01.680591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:01.681906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:02.209238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:02.226509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:02.244131 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf1b7e60-5950-4bf8-be18-46c58ea3dd51 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 1.634220 Jul 18 13:16:02.246516 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f2ee58c-e8e3-49df-be09-40201db43983 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1323 microversion: 2.1 time: 0.621766 Jul 18 13:16:02.248493 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1989/3857] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:00 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:02.259699 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1869/3858] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:01 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:03.290964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:03.294749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:03.297972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:03.304500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:03.335994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:03.341507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:03.346593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:03.348924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:03.400745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:03.401567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:03.403222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:03.408000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:03.812479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:03.839250 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b01d08e-2a1d-4521-840c-faa95bd64ea4 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.556752 Jul 18 13:16:03.840907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1990/3859] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:03 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:04.281019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:04.311858 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed851c97-8cbd-4342-9d91-90e89e07ef0c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 200 len: 1518 microversion: 2.1 time: 1.029343 Jul 18 13:16:04.312970 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1870/3860] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:03 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 1518 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:04.348262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.143"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:04.360563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:04.403523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:04.404287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:04.405568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:04.406373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:04.419640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1d2811b2-ca76-4d20-8043-4845f3dd0fba req-05d71f1c-532b-447d-b1ba-fdbc0dcd7b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31bbbb0-2291-46f8-8313-0092281c7224", "name": "network-vif-plugged", "status": "completed", "tag": "87756f71-c377-4b2e-86b5-78ed752bd5b2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:04.460575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1d2811b2-ca76-4d20-8043-4845f3dd0fba req-05d71f1c-532b-447d-b1ba-fdbc0dcd7b0c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:04.461438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1d2811b2-ca76-4d20-8043-4845f3dd0fba req-05d71f1c-532b-447d-b1ba-fdbc0dcd7b0c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:04.501043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Acquired lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:16:04.538899 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1d2811b2-ca76-4d20-8043-4845f3dd0fba req-05d71f1c-532b-447d-b1ba-fdbc0dcd7b0c service nova] Creating event network-vif-plugged:87756f71-c377-4b2e-86b5-78ed752bd5b2 for instance e31bbbb0-2291-46f8-8313-0092281c7224 on n-h1-850003-3 Jul 18 13:16:04.571652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1d2811b2-ca76-4d20-8043-4845f3dd0fba req-05d71f1c-532b-447d-b1ba-fdbc0dcd7b0c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151822 Jul 18 13:16:04.573527 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1871/3861] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:16:04.872309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:04.877068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:04.904139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:04.910040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:04.912126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:04.913473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:05.506777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:05.533155 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff9a42aa-1569-4aaf-b9d7-b94c7592ec8f tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.668507 Jul 18 13:16:05.562449 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1872/3862] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:04 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:06.588765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:06.599845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:06.635380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:06.636644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:06.641923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:06.643167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:07.253808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:07.311991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3d0bec43-9c46-4236-a2af-c1bc3c105eb5 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1316 microversion: 2.1 time: 0.727021 Jul 18 13:16:07.319564 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1873/3863] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:06 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1316 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:08.341672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:08.342817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:08.397098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:08.397789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:08.402187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:08.402948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.036604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:09.076675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f873026f-16f8-43f9-bb7e-af15199bb54d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1504 microversion: 2.1 time: 0.743215 Jul 18 13:16:09.097894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1874/3864] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:08 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:09.108223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:09.109656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:09.123648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.125089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.126995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.128267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.192609 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20ede2f2-9e3f-404e-a8a9-716506e724cb tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips" status: 200 len: 108 microversion: 2.1 time: 0.092550 Jul 18 13:16:09.204752 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1875/3865] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:16:09 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips => generated 108 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:09.215830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:09.217405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:09.230265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.231189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.232284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.232976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.312964 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36109aab-5cb9-4df5-ac1b-cef01e1f0b8d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips" status: 200 len: 108 microversion: 2.1 time: 0.105255 Jul 18 13:16:09.324441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1876/3866] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:16:09 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips => generated 108 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:09.334669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:09.336098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:09.348341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.352434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.355070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.356498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.421210 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bf4d269-964b-4969-8418-35b788d9eca9 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips/tempest-ServerAddressesTestJSON-78730954-network" status: 200 len: 93 microversion: 2.1 time: 0.094287 Jul 18 13:16:09.434743 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1877/3867] 10.222.0.88 () {58 vars in 1394 bytes} [Mon Jul 18 13:16:09 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224/ips/tempest-ServerAddressesTestJSON-78730954-network => generated 93 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:16:09.445493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:09.448809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:09.463243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.464642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.467144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:09.468454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:09.578737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:16:09.971218 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4207c1e6-afb3-4ed3-a9f6-04fe2c82a7c3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 204 len: 0 microversion: 2.1 time: 0.521190 Jul 18 13:16:09.978292 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1878/3868] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:16:09 2022] DELETE /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:16:09.989049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:09.990771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:10.016253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:10.017523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:10.019717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:10.027496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:10.542270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Building network info cache for instance {{(pid=131366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:10.558278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=82 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:11.016984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:11.050909 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8998728-3a2e-4063-860d-03ab9fea9b82 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1510 microversion: 2.1 time: 1.070209 Jul 18 13:16:11.052505 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1879/3869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:09 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1510 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:11.066398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-41e889b3-21dc-424e-b589-a29c48e33fdb req-a85a0ab5-b2a3-43ed-b94f-0d23d6e4f2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:11.125504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-41e889b3-21dc-424e-b589-a29c48e33fdb req-a85a0ab5-b2a3-43ed-b94f-0d23d6e4f2df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:11.126108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-41e889b3-21dc-424e-b589-a29c48e33fdb req-a85a0ab5-b2a3-43ed-b94f-0d23d6e4f2df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:11.197474 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-41e889b3-21dc-424e-b589-a29c48e33fdb req-a85a0ab5-b2a3-43ed-b94f-0d23d6e4f2df service nova] Creating event network-changed:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:16:11.235117 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-41e889b3-21dc-424e-b589-a29c48e33fdb req-a85a0ab5-b2a3-43ed-b94f-0d23d6e4f2df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165726 Jul 18 13:16:11.243639 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1880/3870] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:12.091546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:12.099970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:12.140504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:12.144078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:12.151697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:12.153150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:13.132963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:13.198480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5aa2d5e-31b9-4cc8-9d8a-31c8f005c184 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1510 microversion: 2.1 time: 1.099086 Jul 18 13:16:13.204717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1881/3871] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:12 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1510 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:14.274894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:14.280305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:14.314975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:14.315449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:14.325473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:14.325945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:14.402859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:15.906326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:15.908760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Updating instance_info_cache with network_info: [{"id": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c", "address": "fa:16:3e:7b:cd:03", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6dda8e5b-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:15.950448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Releasing lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:16:15.957596 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7e14ba8-d024-4cc4-bc23-319a9d77610d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1510 microversion: 2.1 time: 1.732224 Jul 18 13:16:15.960876 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e59e77b9-1116-4623-9213-fa341cbe648c tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action" status: 202 len: 0 microversion: 2.1 time: 11.618723 Jul 18 13:16:15.966238 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1882/3872] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:14 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1510 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:15.966962 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1991/3873] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:04 2022] POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action => generated 0 bytes in 11628 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 18 13:16:15.997115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.143"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:16.002887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:16.048265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:16.053979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:16.059227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:16.062603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:16.399245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Acquired lock "refresh_cache-cd2cb391-71ae-4050-b27a-171355b8058f" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:16:17.001055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:17.001877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:17.035153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:17.035520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:17.036730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:17.038058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:17.402588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6246972459914f4d8abbcdd7013aa609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb7b6bbc6f2458ca82beea1e73d4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:17.445474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-acfdfe76-c832-45ba-8f4c-2f872ac6d71d tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 200 len: 1468 microversion: 2.1 time: 0.449512 Jul 18 13:16:17.473894 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1992/3874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:16 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 1468 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:17.484422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dfbe8c49-4240-4555-91d0-e0f2a39baaac req-b67a7dbb-055c-4c82-b890-b151eb1f8a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31bbbb0-2291-46f8-8313-0092281c7224", "name": "network-vif-deleted", "tag": "87756f71-c377-4b2e-86b5-78ed752bd5b2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:17.503922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dfbe8c49-4240-4555-91d0-e0f2a39baaac req-b67a7dbb-055c-4c82-b890-b151eb1f8a87 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:17.505131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dfbe8c49-4240-4555-91d0-e0f2a39baaac req-b67a7dbb-055c-4c82-b890-b151eb1f8a87 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:17.535931 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dfbe8c49-4240-4555-91d0-e0f2a39baaac req-b67a7dbb-055c-4c82-b890-b151eb1f8a87 service nova] Creating event network-vif-deleted:87756f71-c377-4b2e-86b5-78ed752bd5b2 for instance e31bbbb0-2291-46f8-8313-0092281c7224 on n-h1-850003-3 Jul 18 13:16:17.581196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dfbe8c49-4240-4555-91d0-e0f2a39baaac req-b67a7dbb-055c-4c82-b890-b151eb1f8a87 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104161 Jul 18 13:16:17.585893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1993/3875] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:18.484113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:18.486198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] [instance: e31bbbb0-2291-46f8-8313-0092281c7224] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:18.514762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:18.524657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:18.529927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:18.531668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:18.602055 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] HTTP exception thrown: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Request method failure captured: Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 HTTP/1.1 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vz5QdQMrLWa9M6MuKvyezi-5vDG0TiKrQMKzoL7sCxmi-RKDbLPL0uWO3dfMhzJZRCOsjIyB3kZ7Mxsaj5KqUfb53eOnNXX2JRQlRbJ5R--bSShstGKo_XGY6UiPIsm7wBIRTS4h5-NLUmczpg1_dw9S_oNYa0kEtyM7ZsenWeauQo Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 7bb7b6bbc6f2458ca82beea1e73d4753 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerAddressesTestJSON-1232458155 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7bb7b6bbc6f2458ca82beea1e73d4753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7bb7b6bbc6f2458ca82beea1e73d4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7bb7b6bbc6f2458ca82beea1e73d4753", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7bb7b6bbc6f2458ca82beea1e73d4753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerAddressesTestJSON-1232458155 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 7bb7b6bbc6f2458ca82beea1e73d4753 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1232458155 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerAddressesTestJSON-1232458155-project Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 6246972459914f4d8abbcdd7013aa609 Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerAddressesTestJSON-1232458155-project Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e31bbbb0-2291-46f8-8313-0092281c7224'} Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:18.617138 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:18.623945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] Returning 404 to user: Instance e31bbbb0-2291-46f8-8313-0092281c7224 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:16:18.624706 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e802a04f-56d4-451c-8718-13d7aee130d3 tempest-ServerAddressesTestJSON-1232458155 tempest-ServerAddressesTestJSON-1232458155-project] 10.222.0.88 "GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224" status: 404 len: 111 microversion: 2.1 time: 0.145091 Jul 18 13:16:18.637023 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1994/3876] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:18 2022] GET /compute/v2.1/servers/e31bbbb0-2291-46f8-8313-0092281c7224 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:16:19.464976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260737159", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:19.655159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] validate_networks() for [('7ffbcecd-c8c6-4cb8-b149-ec03a1516a54', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:16:23.097567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:16:23.098893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:16:23.100151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:16:23.101127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:16:23.102039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:16:23.137380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:23.142732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:23.145877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:23.172582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:23.229661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Getting quotas for project f3ed162730994114a93957c285daea13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:16:23.244142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Getting quotas for user 4d12219a1a404bf9aa04ab46c58a49de and project f3ed162730994114a93957c285daea13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:16:23.304010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:16:23.309530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:16:23.432463 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a65394a-674c-4c61-978e-6a5989d234f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.737622 Jul 18 13:16:23.434108 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1995/3877] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:16:23.813497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.neutron [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] re-assign floating IP 172.25.1.143 from instance 15dcb25b-bc36-485a-9f10-209a161da6c1 Jul 18 13:16:23.953179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Building network info cache for instance {{(pid=131367) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:23.954451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2001825720", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "f4333680-b8f0-40bc-870c-17b737d1c961"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:23.966583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:24.221067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] validate_networks() for [('f4333680-b8f0-40bc-870c-17b737d1c961', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:16:26.019534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:26.575372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Updating instance_info_cache with network_info: [{"id": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c", "address": "fa:16:3e:7b:cd:03", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6dda8e5b-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:26.609130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Building network info cache for instance {{(pid=131367) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:28.310728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Updating instance_info_cache with network_info: [{"id": "fe88181a-26f3-4943-b066-718e55c71709", "address": "fa:16:3e:b0:92:ea", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfe88181a-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:28.347489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Releasing lock "refresh_cache-cd2cb391-71ae-4050-b27a-171355b8058f" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:16:28.348377 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5caa670-bac4-4905-bd96-794699661371 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f/action" status: 202 len: 0 microversion: 2.1 time: 12.375475 Jul 18 13:16:28.356184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1883/3878] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:15 2022] POST /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f/action => generated 0 bytes in 12384 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 18 13:16:28.362709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:28.364096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:28.376745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:28.377313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:28.378320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:28.378767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:28.526609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:16:28.528501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:16:28.530407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:16:28.531692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:16:28.533085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:16:28.537488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:28.556966 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2aa7cc50-4cc9-4f4b-b53f-d4311755dfb5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1275 microversion: 2.1 time: 0.198519 Jul 18 13:16:28.558665 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1884/3879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:28 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:28.564073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-46a2b91d-30fb-42b0-9cfe-1c3e654bf3c7 req-f2d982b8-d31c-414e-9f07-80f001af8fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:28.574799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46a2b91d-30fb-42b0-9cfe-1c3e654bf3c7 req-f2d982b8-d31c-414e-9f07-80f001af8fbd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:28.575731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46a2b91d-30fb-42b0-9cfe-1c3e654bf3c7 req-f2d982b8-d31c-414e-9f07-80f001af8fbd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:28.598766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:28.600763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:28.602798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:28.604098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:28.621060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-46a2b91d-30fb-42b0-9cfe-1c3e654bf3c7 req-f2d982b8-d31c-414e-9f07-80f001af8fbd service nova] Creating event network-changed:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:16:28.653559 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-46a2b91d-30fb-42b0-9cfe-1c3e654bf3c7 req-f2d982b8-d31c-414e-9f07-80f001af8fbd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092567 Jul 18 13:16:28.657473 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1885/3880] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:28.659757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:16:28.677026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for user 2ab4a8758df44a8d97c3add30443cc58 and project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:16:28.702553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: .version_select at 0x7f96e74293a0>, body: {"removeFloatingIp": {"address": "172.25.1.143"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:28.743455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:16:28.748321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:16:28.897384 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1ed3561-678d-4f12-ad37-5bfa486d64eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.460311 Jul 18 13:16:28.909559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1996/3881] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:16:28.930113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-759a10e4-3e67-4879-8416-d13155369a2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:28.931539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-759a10e4-3e67-4879-8416-d13155369a2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:29.407956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-759a10e4-3e67-4879-8416-d13155369a2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:29.438808 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-759a10e4-3e67-4879-8416-d13155369a2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1218 microversion: 2.1 time: 0.526642 Jul 18 13:16:29.439907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1997/3882] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:28 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1218 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:29.588867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:29.590119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:29.622760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:29.625916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:29.629447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:29.630788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:29.769244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:29.799781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:29.803139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:29.805135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:29.807203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:30.347576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:30.406881 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3feab611-e090-4c81-8816-8638b3af5afa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1275 microversion: 2.1 time: 0.826154 Jul 18 13:16:30.424964 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1998/3883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:29 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1275 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:30.948796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] HTTP exception thrown: Floating IP 172.25.1.143 is not associated with instance 15dcb25b-bc36-485a-9f10-209a161da6c1. Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Request method failure captured: Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action HTTP/1.1 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 49 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vza19Wx-WoQ7pcsZu_V0uqV1pHeW-qwfH6oPuYJBBWbjmFUqRu2GUTqOtXDexzav7g_IFDNP_2wmG72ey4Kgqiu42L8pso_cTNUGlHsOSMLNjQ0seeJ1t2BXPLLjtKl2Enf9WqMhYK1p4kYK9ZuuxhBZNKdHaz60YW-jVA2Yu0z538 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e94ea9219ab648bfbea251e13bd8542c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2a21754edbea4264894e37691956513c Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: {"removeFloatingIp": {"address": "172.25.1.143"}} Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: exception: Floating IP 172.25.1.143 is not associated with instance 15dcb25b-bc36-485a-9f10-209a161da6c1. Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '15dcb25b-bc36-485a-9f10-209a161da6c1', 'body': {'removeFloatingIp': {'address': '172.25.1.143'}}} Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.143 is not associated with instance 15dcb25b-bc36-485a-9f10-209a161da6c1. Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.143 is not associated with instance 15dcb25b-bc36-485a-9f10-209a161da6c1. Jul 18 13:16:30.953109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:30.964366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Returning 409 to user: Floating IP 172.25.1.143 is not associated with instance 15dcb25b-bc36-485a-9f10-209a161da6c1. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:16:30.964366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-29daf634-f0cc-4e06-9e97-66fa663ceb8e tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action" status: 409 len: 146 microversion: 2.1 time: 2.293715 Jul 18 13:16:30.964366 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1886/3884] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:28 2022] POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action => generated 146 bytes in 2296 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:16:30.972007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:30.972910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:30.993722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:30.994769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:30.996344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:31.003324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:31.099662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:31.100553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:31.113669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:31.113669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:31.115880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:31.116977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:31.197760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:31.223446 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50b8064b-458a-4b0b-b0b9-98fae0dd04eb tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1270 microversion: 2.1 time: 0.264227 Jul 18 13:16:31.239789 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1887/3885] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:30 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1270 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:31.258167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ae384f24-d8f5-429d-8aee-fe77320d09c3 req-6ccfc6a8-a345-4c94-986d-f5bf93a27332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2cb391-71ae-4050-b27a-171355b8058f", "tag": "fe88181a-26f3-4943-b066-718e55c71709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:31.309250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ae384f24-d8f5-429d-8aee-fe77320d09c3 req-6ccfc6a8-a345-4c94-986d-f5bf93a27332 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:31.311731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ae384f24-d8f5-429d-8aee-fe77320d09c3 req-6ccfc6a8-a345-4c94-986d-f5bf93a27332 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:31.357573 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ae384f24-d8f5-429d-8aee-fe77320d09c3 req-6ccfc6a8-a345-4c94-986d-f5bf93a27332 service nova] Creating event network-changed:fe88181a-26f3-4943-b066-718e55c71709 for instance cd2cb391-71ae-4050-b27a-171355b8058f on n-h2-850003-3 Jul 18 13:16:31.372610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ae384f24-d8f5-429d-8aee-fe77320d09c3 req-6ccfc6a8-a345-4c94-986d-f5bf93a27332 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119878 Jul 18 13:16:31.374618 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1888/3886] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:31.388169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.143"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:32.112013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:32.138427 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e1db7f1-560e-4a9e-b2f0-f31b54490f73 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.707385 Jul 18 13:16:32.148407 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 1999/3887] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:30 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:32.168051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:32.182286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:32.209457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:32.214361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:32.215942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:32.218289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:32.219358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:32.231676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:32.233289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:32.235144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:32.238557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:33.063160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Acquired lock "refresh_cache-cd2cb391-71ae-4050-b27a-171355b8058f" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:16:33.147814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:33.164717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75a94ea8-b2d0-49a9-a53b-5722a8ef8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 1.013291 Jul 18 13:16:33.175494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2000/3888] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:32 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:33.196996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:33.198465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:33.217184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:33.217901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:33.219671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:33.220741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:34.140981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:34.188788 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5fa5367-ead9-4ef0-974b-616a1d3fd838 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 1.010826 Jul 18 13:16:34.194650 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2001/3889] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:33 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:34.209666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:34.211592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:34.230646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:34.232476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:34.256097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:34.258123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:34.962264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:34.996779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-530faabd-effb-4228-b44d-5cd6dcb2fb43 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1276 microversion: 2.1 time: 0.796195 Jul 18 13:16:35.010300 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2002/3890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:34 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1276 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:35.019764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:35.022265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:35.046352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:35.050086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:35.055840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:35.056496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:35.819291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Building network info cache for instance {{(pid=131367) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:35.940792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:35.957486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa617450-5ca6-4909-a9c9-130e0e0b6ed4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.958008 Jul 18 13:16:35.982655 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2003/3891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:34 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:35.988201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:35.990053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:36.010915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:36.012004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:36.013406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:36.014486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:36.748921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:36.800853 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2da2a9f3-10f0-4954-99ba-c528d4fd0b32 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.826835 Jul 18 13:16:36.827324 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2004/3892] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:35 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:36.844851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-605c6b39-6272-40d1-a028-0c42358c3121 req-a7914238-4d6b-42b9-aea8-3f4fe72047d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2cb391-71ae-4050-b27a-171355b8058f", "tag": "fe88181a-26f3-4943-b066-718e55c71709"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:36.872807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-605c6b39-6272-40d1-a028-0c42358c3121 req-a7914238-4d6b-42b9-aea8-3f4fe72047d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:36.875116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-605c6b39-6272-40d1-a028-0c42358c3121 req-a7914238-4d6b-42b9-aea8-3f4fe72047d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:36.907476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-605c6b39-6272-40d1-a028-0c42358c3121 req-a7914238-4d6b-42b9-aea8-3f4fe72047d5 service nova] Creating event network-changed:fe88181a-26f3-4943-b066-718e55c71709 for instance cd2cb391-71ae-4050-b27a-171355b8058f on n-h2-850003-3 Jul 18 13:16:36.925475 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-605c6b39-6272-40d1-a028-0c42358c3121 req-a7914238-4d6b-42b9-aea8-3f4fe72047d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090839 Jul 18 13:16:36.929272 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2005/3893] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:36.997037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:36.998430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:37.021509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:37.022379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:37.046182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:37.046882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:38.283287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Updating instance_info_cache with network_info: [{"id": "fe88181a-26f3-4943-b066-718e55c71709", "address": "fa:16:3e:b0:92:ea", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfe88181a-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:38.324390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Releasing lock "refresh_cache-cd2cb391-71ae-4050-b27a-171355b8058f" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:16:38.326059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62d2c46c-c251-4f7a-bf9d-67c698370a8a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f/action" status: 202 len: 0 microversion: 2.1 time: 6.947398 Jul 18 13:16:38.334989 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1889/3894] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:31 2022] POST /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f/action => generated 0 bytes in 6959 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 13:16:38.344676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:38.345947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:38.356991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:38.358580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:38.360043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:38.361103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:38.633070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:38.668174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:38.690132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-116879b7-280f-4ca5-bae2-a490f96706fc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 1.739667 Jul 18 13:16:38.703240 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2006/3895] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:36 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:38.720937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:38.731667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:38.752329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:38.753544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:38.755409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:38.756450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:38.859795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:38.886242 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-adaa8b7a-9d91-415a-9682-71cfc47098ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.549276 Jul 18 13:16:38.899740 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1890/3896] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:38 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:39.437412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:39.466799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-99218eb8-8010-434d-95c5-1c67c1824777 req-7077ee90-7f4c-4a66-b817-df1bd36036b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:39.488348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-99218eb8-8010-434d-95c5-1c67c1824777 req-7077ee90-7f4c-4a66-b817-df1bd36036b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:39.488789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-99218eb8-8010-434d-95c5-1c67c1824777 req-7077ee90-7f4c-4a66-b817-df1bd36036b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:39.529935 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-99218eb8-8010-434d-95c5-1c67c1824777 req-7077ee90-7f4c-4a66-b817-df1bd36036b1 service nova] Creating event network-changed:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:16:39.542331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-99218eb8-8010-434d-95c5-1c67c1824777 req-7077ee90-7f4c-4a66-b817-df1bd36036b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617871 Jul 18 13:16:39.543460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1891/3897] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:39.564891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:39.566481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:39.578080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:39.581602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:39.584295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:39.587821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:39.668049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:16:39.838651 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37d149f2-57f5-4dd9-8b2c-74a6d9077bab tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 204 len: 0 microversion: 2.1 time: 0.292664 Jul 18 13:16:39.839290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1892/3898] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:16:39 2022] DELETE /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:16:39.863496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-89222d9b-24ad-4fd8-a084-f75b4ee5c622 req-821fc54f-14e4-43d9-a164-6ac0b22a23a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1732b2-28cc-4f34-b80d-ec100b8f7ab3", "tag": "7b4721f5-4acf-4d4d-a614-bee4cac404bc"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:39.893452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-89222d9b-24ad-4fd8-a084-f75b4ee5c622 req-821fc54f-14e4-43d9-a164-6ac0b22a23a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:39.894293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-89222d9b-24ad-4fd8-a084-f75b4ee5c622 req-821fc54f-14e4-43d9-a164-6ac0b22a23a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:39.917152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:39.922700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-89222d9b-24ad-4fd8-a084-f75b4ee5c622 req-821fc54f-14e4-43d9-a164-6ac0b22a23a5 service nova] Creating event network-changed:7b4721f5-4acf-4d4d-a614-bee4cac404bc for instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 on n-h2-850003-3 Jul 18 13:16:39.944546 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ed7edcc-acb6-452f-8642-dbe1f9f0e8d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 1.238955 Jul 18 13:16:39.945610 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2007/3899] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:38 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:39.972870 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-89222d9b-24ad-4fd8-a084-f75b4ee5c622 req-821fc54f-14e4-43d9-a164-6ac0b22a23a5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118447 Jul 18 13:16:39.978402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-783650352", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "609839e4-f25f-4b03-a576-8c39127f230c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:39.994986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1893/3900] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:40.034491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:40.035882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:40.083176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:40.084179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:40.085910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:40.087102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:40.146888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] validate_networks() for [('609839e4-f25f-4b03-a576-8c39127f230c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:16:40.404083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:40.422921 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be059ba3-2be9-4cdf-8d79-86063888d57a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.420195 Jul 18 13:16:40.425037 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1894/3901] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:39 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:40.438931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.143"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:40.443070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:40.453359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:40.453923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:40.455278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:40.455835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:40.517384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Acquired lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:16:41.311510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:16:41.312620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:16:41.313522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:16:41.314493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:16:41.315580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:16:41.329407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.329957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:41.330961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.331471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:41.345483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=74,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:41.373512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:16:41.388654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:16:41.405323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:16:41.409164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:16:41.488712 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bab81037-8d30-4a8d-911a-1f17616142d3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541449 Jul 18 13:16:41.490673 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2008/3902] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:16:41.497213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:41.497936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:41.507019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.507613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:41.510432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.510917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:41.771838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:41.782118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e98dc5de-e37b-4c04-a715-d4414f8e48b5 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.289936 Jul 18 13:16:41.787425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2009/3903] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:41 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:41.798334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:41.798970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:41.818296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.818758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:41.819550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:41.819978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:42.191704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:42.216010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ace768d1-9131-4da5-a4ed-aaf173fa1f78 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.425129 Jul 18 13:16:42.222721 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2010/3904] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:41 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:42.232628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:42.235626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:42.249178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:42.250304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:42.251356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:42.252696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:42.343037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:42.354320 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9cecada4-0e4e-40c3-a3b5-a289ffc539aa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1218 microversion: 2.1 time: 0.129561 Jul 18 13:16:42.355871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2011/3905] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:42 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:42.812812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:42.813988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:42.824726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:42.825458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:42.826891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:42.827657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:43.070888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:43.080934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8c378f2d-ea0a-4ae9-9a5f-a78329226145 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.274165 Jul 18 13:16:43.095583 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2012/3906] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:42 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:43.258034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:43.261001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:43.287609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:43.290818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:43.300622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:43.302532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:43.737604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:43.759482 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-167494dc-ca66-47da-899a-a7b930c1bff4 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.511031 Jul 18 13:16:43.761059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2013/3907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:43 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:43.772267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:43.774491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:43.793046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:43.794314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:43.796174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:43.798263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:44.156089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:44.174987 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f49cb02a-cf87-4e6a-813a-89c76d4d31c7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1266 microversion: 2.1 time: 0.409230 Jul 18 13:16:44.187229 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2014/3908] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:43 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1266 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:44.192913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:44.194212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:44.215529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:44.216739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:44.218012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:44.218735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:44.554625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:44.572242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ebef590-5db3-4e3d-b399-5e60afc683bc tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.383217 Jul 18 13:16:44.575533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2015/3909] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:44 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:44.791334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:44.795646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:44.798909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:44.832028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:44.833379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:44.834984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:44.835788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:44.981084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Building network info cache for instance {{(pid=131367) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:45.569647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:45.598498 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c121712e-2da6-43e1-ac2e-4309a5305656 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.812483 Jul 18 13:16:45.615931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2016/3910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:44 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:45.636250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f22a3126-a3ec-4fb2-bb32-88808b6d4870 req-4d08c9e5-869a-4416-8476-a643b40f2757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:45.654330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f22a3126-a3ec-4fb2-bb32-88808b6d4870 req-4d08c9e5-869a-4416-8476-a643b40f2757 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:45.655065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f22a3126-a3ec-4fb2-bb32-88808b6d4870 req-4d08c9e5-869a-4416-8476-a643b40f2757 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.008843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f22a3126-a3ec-4fb2-bb32-88808b6d4870 req-4d08c9e5-869a-4416-8476-a643b40f2757 service nova] Creating event network-changed:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:16:46.017358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f22a3126-a3ec-4fb2-bb32-88808b6d4870 req-4d08c9e5-869a-4416-8476-a643b40f2757 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398771 Jul 18 13:16:46.018659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2017/3911] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:46.030353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:46.033222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:46.042497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.043371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.044516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.045074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.245375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:46.246326 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9d4caa8-bd03-4f34-9931-fc11b026cc4a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1272 microversion: 2.1 time: 0.224095 Jul 18 13:16:46.249747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2018/3912] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:46 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:46.261912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:46.263661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:46.290953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.291885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.295135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.314500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.826114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:46.838356 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d04a7a2-6299-4caa-8eeb-81f58f7b08b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.587232 Jul 18 13:16:46.838943 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2019/3913] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:46.855020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:46.857322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:46.879378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.880483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:46.881319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:46.881762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:47.274704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:47.309269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72532ed9-e083-4919-ab9f-2368d04d6249 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.463791 Jul 18 13:16:47.310748 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2020/3914] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:46 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:47.325113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:47.326331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:47.350492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:47.351278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:47.357544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:47.358360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:47.514035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:47.529563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58647af4-91e9-4ca8-ac29-7ec4b77ab56b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1272 microversion: 2.1 time: 0.217007 Jul 18 13:16:47.530573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2021/3915] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:47 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:47.870780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:47.874482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:47.911538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:47.914965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:47.918635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:47.919383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:48.429161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:48.457346 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70e026f0-019d-4a41-b552-bb3f03529cc0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.600155 Jul 18 13:16:48.462058 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2022/3916] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:47 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:48.482880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:48.494416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:48.506285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:48.507089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:48.508103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:48.513903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:48.913151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Updating instance_info_cache with network_info: [{"id": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c", "address": "fa:16:3e:7b:cd:03", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6dda8e5b-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:48.969931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Releasing lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:16:48.972232 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2eeabf1-bd99-4d52-89db-0b7603baf75f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action" status: 202 len: 0 microversion: 2.1 time: 8.543707 Jul 18 13:16:48.974881 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1895/3917] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:40 2022] POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action => generated 0 bytes in 8549 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 13:16:48.996041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:48.999926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:49.026216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:49.026798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:49.028159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:49.028798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:49.074771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:49.098690 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2ae580b0-9896-48a8-8f6c-cc95cea7fb2d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.632656 Jul 18 13:16:49.100324 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2023/3918] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:48 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:49.125146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-eac69c9d-6b8e-44e5-9511-ec6f8891d7d9 req-014f1717-9d72-4a30-957a-f994825f401a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2cb391-71ae-4050-b27a-171355b8058f", "name": "network-vif-deleted", "tag": "fe88181a-26f3-4943-b066-718e55c71709"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:49.180669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eac69c9d-6b8e-44e5-9511-ec6f8891d7d9 req-014f1717-9d72-4a30-957a-f994825f401a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:49.181481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eac69c9d-6b8e-44e5-9511-ec6f8891d7d9 req-014f1717-9d72-4a30-957a-f994825f401a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:49.256796 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-eac69c9d-6b8e-44e5-9511-ec6f8891d7d9 req-014f1717-9d72-4a30-957a-f994825f401a service nova] Creating event network-vif-deleted:fe88181a-26f3-4943-b066-718e55c71709 for instance cd2cb391-71ae-4050-b27a-171355b8058f on n-h2-850003-3 Jul 18 13:16:49.283151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-eac69c9d-6b8e-44e5-9511-ec6f8891d7d9 req-014f1717-9d72-4a30-957a-f994825f401a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175655 Jul 18 13:16:49.284542 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2024/3919] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:49.308816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f5aebe2-0a99-4444-b64f-662b605f2a3f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '.version_select at 0x7f96e4146af0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:50.051058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:50.082571 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-609bcecc-891b-46cd-a447-a9caa82fd64c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 1.102978 Jul 18 13:16:50.101010 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1896/3920] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:48 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:50.141303 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f5aebe2-0a99-4444-b64f-662b605f2a3f tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/6b673e34-4a5e-4b75-8674-9f27bcdfe1b8" status: 200 len: 185 microversion: 2.1 time: 0.848568 Jul 18 13:16:50.143283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2025/3921] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 13:16:49 2022] GET /compute/v2.1/os-floating-ips/6b673e34-4a5e-4b75-8674-9f27bcdfe1b8 => generated 185 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:50.150786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:50.157285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:50.167576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:50.185933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:50.194313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:50.197306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:50.202649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:50.203329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:50.214812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:50.215606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:50.217047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:50.217838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:50.611730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:50.647681 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8c89f8bf-e517-4ca3-a547-91be6deea8c5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.489896 Jul 18 13:16:50.649026 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2026/3922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:50 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:50.661251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.143"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:50.741457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:50.757514 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96a5a6be-9c23-4111-a907-ea00113c0973 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.654159 Jul 18 13:16:50.758419 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1897/3923] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:50 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:51.127799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:51.128739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:51.161913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:51.164074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:51.167476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:51.168248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:51.238464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:51.326221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:51.335171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:51.336822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:51.340122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:51.342718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:51.413027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:51.415175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:51.648867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:51.673952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0137236b-dc32-4c8a-a642-6006be2d8f03 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.549797 Jul 18 13:16:51.684457 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1898/3924] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:51 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:16:52.080613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8796b956-aa08-4a4d-842e-621a1e23d211 req-76d5d4cc-2910-4833-b2bd-2c1bf650345b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "name": "network-vif-plugged", "status": "completed", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:52.107157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8796b956-aa08-4a4d-842e-621a1e23d211 req-76d5d4cc-2910-4833-b2bd-2c1bf650345b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.108490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8796b956-aa08-4a4d-842e-621a1e23d211 req-76d5d4cc-2910-4833-b2bd-2c1bf650345b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:52.130786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8796b956-aa08-4a4d-842e-621a1e23d211 req-76d5d4cc-2910-4833-b2bd-2c1bf650345b service nova] Creating event network-vif-plugged:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:16:52.138434 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8796b956-aa08-4a4d-842e-621a1e23d211 req-76d5d4cc-2910-4833-b2bd-2c1bf650345b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460377 Jul 18 13:16:52.139683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1899/3925] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:52.151838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e60cb9d4-6085-4f59-8081-7c4d215636ff req-68682acf-e248-4ba2-a4e2-5aa111fdc93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79319dc7-b0ad-464c-be95-4e2b2f850b48", "tag": "0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:52.165260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e60cb9d4-6085-4f59-8081-7c4d215636ff req-68682acf-e248-4ba2-a4e2-5aa111fdc93d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.165926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e60cb9d4-6085-4f59-8081-7c4d215636ff req-68682acf-e248-4ba2-a4e2-5aa111fdc93d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:52.185456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e60cb9d4-6085-4f59-8081-7c4d215636ff req-68682acf-e248-4ba2-a4e2-5aa111fdc93d service nova] Creating event network-changed:0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659 for instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 on n-h1-850003-3 Jul 18 13:16:52.197174 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e60cb9d4-6085-4f59-8081-7c4d215636ff req-68682acf-e248-4ba2-a4e2-5aa111fdc93d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050930 Jul 18 13:16:52.199292 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1900/3926] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:52.207700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:52.210766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:52.227619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.234698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:52.235077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Acquired lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:16:52.235920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.237017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:52.776529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:52.786876 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-afe96043-72c0-41b7-926a-28bddc3ea4ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.585388 Jul 18 13:16:52.800333 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1901/3927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:52 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:52.800333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:52.800333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:52.807415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.809428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:52.811178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:52.811716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:53.111322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:53.124225 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-718f98b8-69e8-4be9-8b80-9811be320b49 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.333873 Jul 18 13:16:53.138191 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1902/3928] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:52 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:53.138191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:53.138191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:53.151059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:53.151059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:53.151059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:53.151059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:53.388728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:53.415576 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cadca9bd-cef4-4617-868e-4378f8d50bb1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.287202 Jul 18 13:16:53.417904 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1903/3929] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:53 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:53.822921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:53.824015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:53.835145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:53.835869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:53.837116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:53.837886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:54.021773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:54.032277 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6c10982d-1a6b-45d4-a00f-6b9ff524e210 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.216879 Jul 18 13:16:54.033950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1904/3930] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:53 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:54.169506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:54.173032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:54.186368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:54.187382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:54.188571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:54.189418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:54.420250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Building network info cache for instance {{(pid=131366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:16:54.427540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:54.435528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:54.445786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3d81219-fe8c-4637-9334-a9ba2f1aec95 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.286407 Jul 18 13:16:54.456731 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1905/3931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:54.462373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-cbcf0570-ab31-4466-abf9-8b398372dc1f req-b551f321-a51d-4a73-8463-7e1541a5a4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1732b2-28cc-4f34-b80d-ec100b8f7ab3", "name": "network-vif-plugged", "status": "completed", "tag": "7b4721f5-4acf-4d4d-a614-bee4cac404bc"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:54.474964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cbcf0570-ab31-4466-abf9-8b398372dc1f req-b551f321-a51d-4a73-8463-7e1541a5a4d7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:54.475794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-cbcf0570-ab31-4466-abf9-8b398372dc1f req-b551f321-a51d-4a73-8463-7e1541a5a4d7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:54.496380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-cbcf0570-ab31-4466-abf9-8b398372dc1f req-b551f321-a51d-4a73-8463-7e1541a5a4d7 service nova] Creating event network-vif-plugged:7b4721f5-4acf-4d4d-a614-bee4cac404bc for instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 on n-h2-850003-3 Jul 18 13:16:54.502960 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-cbcf0570-ab31-4466-abf9-8b398372dc1f req-b551f321-a51d-4a73-8463-7e1541a5a4d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044528 Jul 18 13:16:54.504792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1906/3932] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:54.511233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:54.512598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:54.521518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:54.522332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:54.523562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:54.524188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:55.065584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:55.079178 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7309a647-7f0d-4d96-b94f-b77e8f8a4e70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.569457 Jul 18 13:16:55.089963 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1907/3933] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:54 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:55.096307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9d812991-3281-450d-89a7-80d964f7686d req-2f33be51-e56c-495f-a489-fa270b1952a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:16:55.117999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9d812991-3281-450d-89a7-80d964f7686d req-2f33be51-e56c-495f-a489-fa270b1952a3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:55.118754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9d812991-3281-450d-89a7-80d964f7686d req-2f33be51-e56c-495f-a489-fa270b1952a3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:55.163215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9d812991-3281-450d-89a7-80d964f7686d req-2f33be51-e56c-495f-a489-fa270b1952a3 service nova] Creating event network-changed:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:16:55.177280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9d812991-3281-450d-89a7-80d964f7686d req-2f33be51-e56c-495f-a489-fa270b1952a3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085745 Jul 18 13:16:55.183356 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1908/3934] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:16:55.219031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:55.227374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:55.249250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:55.250012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:55.252262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:55.255233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:55.918126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Updating instance_info_cache with network_info: [{"id": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c", "address": "fa:16:3e:7b:cd:03", "network": {"id": "3878adc7-5dcd-4c1b-92c7-f58b49518f4c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-811956015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e94ea9219ab648bfbea251e13bd8542c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6dda8e5b-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:16:55.946023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Releasing lock "refresh_cache-15dcb25b-bc36-485a-9f10-209a161da6c1" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:16:55.947717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f428849-c556-4396-a944-0fdaf828b121 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action" status: 202 len: 0 microversion: 2.1 time: 5.297554 Jul 18 13:16:55.960083 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2027/3935] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:16:50 2022] POST /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1/action => generated 0 bytes in 5311 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 13:16:55.971341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:55.976573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:55.979969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:55.988633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-325c8d49-9c33-43c5-ac45-42b1af2a2ccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1318 microversion: 2.1 time: 0.803080 Jul 18 13:16:55.996189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:55.996664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:55.997507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:55.997960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.004313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1909/3936] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:55 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:56.014343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:56.017478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:56.037625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:16:56.046700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.051989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.053112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.053435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.093782 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] HTTP exception thrown: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Request method failure captured: Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f HTTP/1.1 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vza19Wx-WoQ7pcsZu_V0uqV1pHeW-qwfH6oPuYJBBWbjmFUqRu2GUTqOtXDexzav7g_IFDNP_2wmG72ey4Kgqiu42L8pso_cTNUGlHsOSMLNjQ0seeJ1t2BXPLLjtKl2Enf9WqMhYK1p4kYK9ZuuxhBZNKdHaz60YW-jVA2Yu0z538 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e94ea9219ab648bfbea251e13bd8542c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2a21754edbea4264894e37691956513c Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'cd2cb391-71ae-4050-b27a-171355b8058f'} Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:16:56.095606 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Returning 404 to user: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79dd8c40-4391-414a-8d9e-c1efe82378c0 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 404 len: 111 microversion: 2.1 time: 0.091933 Jul 18 13:16:56.104735 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1910/3937] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:16:56 2022] DELETE /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:16:56.130606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:56.136558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:56.177238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.177711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.187629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.189932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.266178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:56.282212 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afd17301-0026-47dc-97a9-de887a5cd4cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1317 microversion: 2.1 time: 0.320590 Jul 18 13:16:56.283163 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2028/3938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:55 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:56.295153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:56.301698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: cd2cb391-71ae-4050-b27a-171355b8058f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:56.322712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.336637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.346970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:56.347714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:56.411794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] HTTP exception thrown: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Request method failure captured: Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f HTTP/1.1 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vza19Wx-WoQ7pcsZu_V0uqV1pHeW-qwfH6oPuYJBBWbjmFUqRu2GUTqOtXDexzav7g_IFDNP_2wmG72ey4Kgqiu42L8pso_cTNUGlHsOSMLNjQ0seeJ1t2BXPLLjtKl2Enf9WqMhYK1p4kYK9ZuuxhBZNKdHaz60YW-jVA2Yu0z538 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e94ea9219ab648bfbea251e13bd8542c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 2a21754edbea4264894e37691956513c Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'cd2cb391-71ae-4050-b27a-171355b8058f'} Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.425921 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. Jul 18 13:16:56.430840 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:16:56.438350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Returning 404 to user: Instance cd2cb391-71ae-4050-b27a-171355b8058f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:16:56.440586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80d82089-3422-43ec-b755-6f8cbf3f5010 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f" status: 404 len: 111 microversion: 2.1 time: 0.155478 Jul 18 13:16:56.448218 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2029/3939] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:56 2022] GET /compute/v2.1/servers/cd2cb391-71ae-4050-b27a-171355b8058f => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:16:56.480653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d7b8ff4-1847-4826-85a6-7871135810ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '.version_select at 0x7f96e455bb80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:56.844272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:56.891663 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f403216b-93fa-423f-888f-5bb30b5a2ac1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.781510 Jul 18 13:16:56.901950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1911/3940] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:56 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:57.021854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:57.028954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:57.077068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:57.079644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:57.084728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:57.088106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:57.827968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:57.866386 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cbb418dc-b884-47e8-bdff-8672bbb296ed tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1509 microversion: 2.1 time: 0.854728 Jul 18 13:16:57.869376 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1912/3941] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:57 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1509 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:57.916963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:57.916963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:57.952639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:57.954105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:57.955007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:57.956304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.107993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d7b8ff4-1847-4826-85a6-7871135810ca tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/6b673e34-4a5e-4b75-8674-9f27bcdfe1b8" status: 202 len: 0 microversion: 2.1 time: 2.653744 Jul 18 13:16:59.110142 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2030/3942] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:16:56 2022] DELETE /compute/v2.1/os-floating-ips/6b673e34-4a5e-4b75-8674-9f27bcdfe1b8 => generated 0 bytes in 2658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:16:59.130248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:59.146963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:59.148302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:59.150095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96779795-e383-4801-9247-dd57605330d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.254036 Jul 18 13:16:59.157227 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1913/3943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:57 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:59.172702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:59.174470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.177555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:59.178662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.181577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.186405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.198510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.199195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.200189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.200910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.648157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:16:59.663993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dca863be-c4a5-41d6-9ad6-6f001ebd0243 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1509 microversion: 2.1 time: 0.550934 Jul 18 13:16:59.667513 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2031/3944] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:59 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:16:59.685755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:16:59.686352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:16:59.705751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.706836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.708412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:16:59.709378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:16:59.786758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:17:00.003192 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bbb53508-3913-4297-8414-a4ca11a4c36a tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "DELETE /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 204 len: 0 microversion: 2.1 time: 0.321339 Jul 18 13:17:00.004532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2032/3945] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:16:59 2022] DELETE /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:17:00.028700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1269487486", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:00.150385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] validate_networks() for [('7ffbcecd-c8c6-4cb8-b149-ec03a1516a54', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:01.333703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:01.367380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c20b03ed-0caa-4039-b2be-188d2195f93a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 2.208370 Jul 18 13:17:01.369570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:01.370358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:01.370734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:01.371157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:01.371585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:01.373585 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1914/3946] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:16:59 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:01.395931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.396500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.397333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.397834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.401969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:01.410427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:01.458748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Getting quotas for project f3ed162730994114a93957c285daea13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:01.471880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.475206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.478812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Getting quotas for user 4d12219a1a404bf9aa04ab46c58a49de and project f3ed162730994114a93957c285daea13. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:01.496459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.497425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.539254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:17:01.548076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:17:01.743829 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8aae9e3-1e90-412f-8568-9610e62c61e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733680 Jul 18 13:17:01.752994 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2033/3947] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:17:01.762842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:01.763509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:01.773805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.774465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.775577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:01.776259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:01.852270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:01.852687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:01.854663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:01.867049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:01.867917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:02.141350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:02.181823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.182654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.183938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.184702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.392700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08eb0912-95cd-4f32-8344-0d3bf32472be tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "POST /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3/action" status: 202 len: 1111 microversion: 2.1 time: 1.006899 Jul 18 13:17:02.401818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1915/3948] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:17:01 2022] POST /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3/action => generated 1111 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 13:17:02.442464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:02.449784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce5db0ce-0354-43a2-beb7-2590f21e152e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:02.457578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ce5db0ce-0354-43a2-beb7-2590f21e152e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:02.477630 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62650b93-48a4-4cba-9229-3150a808bdb2 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1526 microversion: 2.1 time: 0.722498 Jul 18 13:17:02.478680 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2034/3949] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:01 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1526 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:02.504921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-81962f4c-6216-4cde-ae16-80d50973d515 req-fb7768af-733e-4277-970f-a4fb6f4eef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79319dc7-b0ad-464c-be95-4e2b2f850b48", "name": "network-vif-plugged", "status": "completed", "tag": "0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:02.551986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-81962f4c-6216-4cde-ae16-80d50973d515 req-fb7768af-733e-4277-970f-a4fb6f4eef00 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.553163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-81962f4c-6216-4cde-ae16-80d50973d515 req-fb7768af-733e-4277-970f-a4fb6f4eef00 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.607006 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-81962f4c-6216-4cde-ae16-80d50973d515 req-fb7768af-733e-4277-970f-a4fb6f4eef00 service nova] Creating event network-vif-plugged:0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659 for instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 on n-h1-850003-3 Jul 18 13:17:02.626775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-81962f4c-6216-4cde-ae16-80d50973d515 req-fb7768af-733e-4277-970f-a4fb6f4eef00 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144384 Jul 18 13:17:02.632699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2035/3950] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:02.646762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:02.649263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:02.681290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.685087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.689421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.691914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.846676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ce5db0ce-0354-43a2-beb7-2590f21e152e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:02.878915 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce5db0ce-0354-43a2-beb7-2590f21e152e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1217 microversion: 2.1 time: 0.470695 Jul 18 13:17:02.903898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1916/3951] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:02 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:02.935955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:02.946655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:02.995660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:02.996534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:02.997963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:03.017070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:03.041639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:03.465516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:03.480724 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5c59607-4b39-4117-b4a5-154151f82f13 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.842702 Jul 18 13:17:03.495138 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2036/3952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:02 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:03.508413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:03.511183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:03.522943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:03.523709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:03.524691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:03.525286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:03.701595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:03.738805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a775d06-5440-4f82-9354-689c247fd1e8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.830627 Jul 18 13:17:03.745421 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1917/3953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:02 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:03.791948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a21754edbea4264894e37691956513c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ea9219ab648bfbea251e13bd8542c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:03.802600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d065337-a837-4329-a624-cb6ae969b5d4 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 200 len: 1526 microversion: 2.1 time: 0.305601 Jul 18 13:17:03.810184 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2037/3954] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:03 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 1526 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:03.913679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:03.915021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:03.927862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:03.928812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:03.930627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:03.931831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:04.075244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:04.088178 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5761a766-d437-44d6-84e3-69ac5e8976f0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1269 microversion: 2.1 time: 0.181850 Jul 18 13:17:04.089604 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1918/3955] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:03 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:04.352915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-53e1a1e9-d5e3-45f9-ab51-a1495a673bc0 req-bdff2846-4b8d-4ff2-b3a9-db0fc0f0401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dcb25b-bc36-485a-9f10-209a161da6c1", "name": "network-vif-deleted", "tag": "6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:04.379464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-53e1a1e9-d5e3-45f9-ab51-a1495a673bc0 req-bdff2846-4b8d-4ff2-b3a9-db0fc0f0401c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:04.383488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-53e1a1e9-d5e3-45f9-ab51-a1495a673bc0 req-bdff2846-4b8d-4ff2-b3a9-db0fc0f0401c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:04.424542 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-53e1a1e9-d5e3-45f9-ab51-a1495a673bc0 req-bdff2846-4b8d-4ff2-b3a9-db0fc0f0401c service nova] Creating event network-vif-deleted:6dda8e5b-48b9-4f93-9ccd-0b16c3fc4c8c for instance 15dcb25b-bc36-485a-9f10-209a161da6c1 on n-h2-850003-3 Jul 18 13:17:04.448504 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-53e1a1e9-d5e3-45f9-ab51-a1495a673bc0 req-bdff2846-4b8d-4ff2-b3a9-db0fc0f0401c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106766 Jul 18 13:17:04.460050 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2038/3956] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:04.513055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:04.514831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:04.562817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:04.563817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:04.565297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:04.566099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:04.831884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-528212256", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "04398b70-5b4f-4eee-9fc7-5311b5fff43b"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:05.033135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] validate_networks() for [('04398b70-5b4f-4eee-9fc7-5311b5fff43b', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:05.301114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:05.313271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-01f20d6a-fb77-4008-85df-929173a9def0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1314 microversion: 2.1 time: 0.807201 Jul 18 13:17:05.313887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1919/3957] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:04 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:05.326960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:05.327842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:05.344085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.344756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.346076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.346774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.850562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:05.851366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:05.852563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:05.853605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:05.854649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:05.880818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.882003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.883129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.883924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.885418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:05.907180 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1118930a-4711-41c6-8686-4c8ddb21cae7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.585253 Jul 18 13:17:05.908709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Getting quotas for project e82802d752fe4f89ac5d8cf3221a4ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:05.910274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1920/3958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:05 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:05.916063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Getting quotas for user c14ddd6901844fc9aab93b5ff761123f and project e82802d752fe4f89ac5d8cf3221a4ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:05.926868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:05.929535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] [instance: 15dcb25b-bc36-485a-9f10-209a161da6c1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:05.937609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:17:05.940545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:17:05.948681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.949641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.952835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:05.954073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:05.986420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] HTTP exception thrown: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Request method failure captured: Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 HTTP/1.1 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vza19Wx-WoQ7pcsZu_V0uqV1pHeW-qwfH6oPuYJBBWbjmFUqRu2GUTqOtXDexzav7g_IFDNP_2wmG72ey4Kgqiu42L8pso_cTNUGlHsOSMLNjQ0seeJ1t2BXPLLjtKl2Enf9WqMhYK1p4kYK9ZuuxhBZNKdHaz60YW-jVA2Yu0z538 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e94ea9219ab648bfbea251e13bd8542c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e94ea9219ab648bfbea251e13bd8542c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e94ea9219ab648bfbea251e13bd8542c Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2016577454 Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2a21754edbea4264894e37691956513c Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2016577454-project Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '15dcb25b-bc36-485a-9f10-209a161da6c1'} Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:05.990870 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. Jul 18 13:17:05.997154 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:06.001165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] Returning 404 to user: Instance 15dcb25b-bc36-485a-9f10-209a161da6c1 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:06.004987 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5daa2ead-9546-4e72-93d7-ef2fc9d8f447 tempest-FloatingIPsAssociationTestJSON-2016577454 tempest-FloatingIPsAssociationTestJSON-2016577454-project] 10.222.0.88 "GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1" status: 404 len: 111 microversion: 2.1 time: 0.091008 Jul 18 13:17:06.005591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94d1b33a-26b3-4317-97df-d94f5638a1c9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385664 Jul 18 13:17:06.014563 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2039/3959] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:17:06.014563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:06.014563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:06.016535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1921/3960] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:05 2022] GET /compute/v2.1/servers/15dcb25b-bc36-485a-9f10-209a161da6c1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:17:06.026245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3f3e1ea-1f0c-4119-b090-de5d401e65d7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:06.027818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f3f3e1ea-1f0c-4119-b090-de5d401e65d7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:06.039687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.040786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:06.042780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.044270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:06.186076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:06.199060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ea0aac1-63db-490c-bcd8-bc3b8956cfc4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1275 microversion: 2.1 time: 0.191239 Jul 18 13:17:06.199670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2040/3961] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:06 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:06.276774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f3f3e1ea-1f0c-4119-b090-de5d401e65d7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:06.297118 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f3f3e1ea-1f0c-4119-b090-de5d401e65d7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1224 microversion: 2.1 time: 0.278152 Jul 18 13:17:06.302534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1922/3962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:06 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:06.337361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:06.340120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:06.354376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.355322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:06.356669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.358255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:06.928430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:06.930019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:06.949918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.950416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:06.958759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:06.960133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:07.503823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:07.518741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30bcacd0-0576-4b23-9b6b-7fce9bb212ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.594689 Jul 18 13:17:07.522580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1923/3963] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:06 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:07.533943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:07.534621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:07.547694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:07.554961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:07.557401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:07.559590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:07.561651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:07.564923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb6356de-8bb6-4d63-95f8-e385980e0c43 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1502 microversion: 2.1 time: 1.236083 Jul 18 13:17:07.570661 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2041/3964] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:06 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1502 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:07.610009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:07.610823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:07.641022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:07.642361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:07.646276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:07.647525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:08.019055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:08.047576 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba76eeae-272c-4ec1-84c6-6c56a2718840 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1228 microversion: 2.1 time: 0.474855 Jul 18 13:17:08.051711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:08.053720 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2042/3965] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:07 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1228 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:08.070833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:08.083868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-172dbb1c-fc6c-4809-86b0-39e58fc42d02 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.559756 Jul 18 13:17:08.084182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:08.086687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1924/3966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:07 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:08.121809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:08.122683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:08.124793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:08.125618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:08.556708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:08.557868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:08.594663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:08.598441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:08.600325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:08.603079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:08.824097 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.network.security_group_api [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Removing security group 4e13a8e4-a541-4071-a07a-d168313cbaaa from port 0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659 Jul 18 13:17:09.500815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:09.514205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-457406ad-d6af-446b-9206-b80159577d64 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.965448 Jul 18 13:17:09.515608 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1925/3967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:08 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:09.521772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:09.523007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:09.530587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:09.531474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:09.532520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:09.533297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:09.705633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:09.749359 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b40d1940-8c96-4673-8008-4fc42d9b3e60 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1282 microversion: 2.1 time: 0.232114 Jul 18 13:17:09.751618 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1926/3968] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:09 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:09.758584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:09.759608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:09.799419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:09.801026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:09.803025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:09.805001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:10.605085 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ca45f58-50a5-4c3a-96f3-0b7fc7efb875 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48/action" status: 202 len: 0 microversion: 2.1 time: 2.549140 Jul 18 13:17:10.609906 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2043/3969] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:17:08 2022] POST /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48/action => generated 0 bytes in 2555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:17:10.623862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d72155d6-37cc-413e-910a-a93346590b42 req-d8bdd1e2-fd59-4c8d-a415-d2908978d8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a0647e-a1ad-4143-ac29-c9104449da1f", "tag": "e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:10.705376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d72155d6-37cc-413e-910a-a93346590b42 req-d8bdd1e2-fd59-4c8d-a415-d2908978d8f1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:10.706055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d72155d6-37cc-413e-910a-a93346590b42 req-d8bdd1e2-fd59-4c8d-a415-d2908978d8f1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:10.755596 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d72155d6-37cc-413e-910a-a93346590b42 req-d8bdd1e2-fd59-4c8d-a415-d2908978d8f1 service nova] Creating event network-changed:e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c for instance b6a0647e-a1ad-4143-ac29-c9104449da1f on n-h2-850003-3 Jul 18 13:17:10.767108 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d72155d6-37cc-413e-910a-a93346590b42 req-d8bdd1e2-fd59-4c8d-a415-d2908978d8f1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153751 Jul 18 13:17:10.769290 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2044/3970] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:10.787283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:10.790034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:10.809222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:10.822308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:10.823279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:10.826714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:10.827691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:10.845769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f929fb8a-e750-43a1-bc5f-d04b70fa10f4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 1.092112 Jul 18 13:17:10.846839 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1927/3971] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:09 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:10.867074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:10.872250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:10.905433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:10.913587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:10.916492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:10.917610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:11.216147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:11.233269 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cea032e-1ba6-4c46-93a2-7a9817c6fd8e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1460 microversion: 2.1 time: 0.382086 Jul 18 13:17:11.238866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1928/3972] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:10 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1460 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:11.270486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8e5dd7a0-f494-4efa-abdd-e505c41ba7d9 req-2959556e-835e-4bdb-8392-ce361b52505f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79319dc7-b0ad-464c-be95-4e2b2f850b48", "tag": "0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:11.295021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8e5dd7a0-f494-4efa-abdd-e505c41ba7d9 req-2959556e-835e-4bdb-8392-ce361b52505f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:11.295935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8e5dd7a0-f494-4efa-abdd-e505c41ba7d9 req-2959556e-835e-4bdb-8392-ce361b52505f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:11.312480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8e5dd7a0-f494-4efa-abdd-e505c41ba7d9 req-2959556e-835e-4bdb-8392-ce361b52505f service nova] Creating event network-changed:0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659 for instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 on n-h1-850003-3 Jul 18 13:17:11.322245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8e5dd7a0-f494-4efa-abdd-e505c41ba7d9 req-2959556e-835e-4bdb-8392-ce361b52505f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074221 Jul 18 13:17:11.323689 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1929/3973] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:11.330459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:11.331572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:11.340462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:11.341290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:11.342623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:11.343246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:11.859051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:11.895955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-720ac159-58ae-4269-bce4-75d77ecad9db tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 1.122011 Jul 18 13:17:11.933327 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2045/3974] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:10 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:11.971853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:11.977376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:11.988610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:11.989403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:11.991454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:11.991931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:12.656968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:12.681302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36867e71-799a-4a1f-b2b8-dec986b9196c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.743890 Jul 18 13:17:12.682703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2046/3975] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:11 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:12.701701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:12.704354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:12.717891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:12.718705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:12.720686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:12.721746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:12.730763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:12.983987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:13.005464 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bfc2c059-80c2-4f56-a791-e40235998cc0 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 1.679586 Jul 18 13:17:13.007522 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1930/3976] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:11 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:13.017701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:13.019388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:13.032749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.033725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.035957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.037080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.237617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:13.250862 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ce7aad4b-f928-480a-a91c-afe3950d33d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.566442 Jul 18 13:17:13.252067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2047/3977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:12 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:13.259592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:13.260567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:13.269066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.270281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.271562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.272634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.415280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:13.437927 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39b40c1b-3c7c-48cc-9875-586e8fce7944 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.428079 Jul 18 13:17:13.439440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1931/3978] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:13.468152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:13.469308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:13.483163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.484343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.486092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.487196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.710322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:13.729772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4df8e41-b7b8-416b-b7ee-f8686f97c278 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.476383 Jul 18 13:17:13.755208 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2048/3979] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:13 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:13.874236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:13.891574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81bf761c-a0fa-4d82-af7c-0ca1bedd25a2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.430907 Jul 18 13:17:13.892403 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1932/3980] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:13.913600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:13.915085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:13.927329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.928713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:13.930646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:13.931850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.039607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:14.043565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:14.080377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.082473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.084319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.086208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.313252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:14.329220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b13d9f3-e3d1-4397-ba4b-53f1bb0d28de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.420825 Jul 18 13:17:14.330594 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2049/3981] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:13 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:14.341170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:14.342710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:14.353763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.354608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.356447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.357855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.464730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:14.490632 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0bc2d3f-ddf6-4e17-8de2-ef77e0e91601 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.457358 Jul 18 13:17:14.508918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1933/3982] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:14 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:14.652232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1895171410", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "609839e4-f25f-4b03-a576-8c39127f230c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:14.803149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] validate_networks() for [('609839e4-f25f-4b03-a576-8c39127f230c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:14.880121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:14.892484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb59da88-c690-4b3d-b8a5-c62779e0fc09 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.560526 Jul 18 13:17:14.897591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2050/3983] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:14 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:14.912933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:14.913484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:14.919969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:14.923161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.923642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:14.924488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:14.924930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:15.368916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:15.385043 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26831e05-fb82-4c7f-8836-e00571dc5a5c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.476851 Jul 18 13:17:15.393817 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2051/3984] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:14 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:15.534967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:15.536266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:15.571024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:15.571487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:15.572326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:15.573344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:15.897572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:15.936081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:16.286983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:16.548862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:16.580519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-172cad91-aeb1-4bca-a116-99d24cd30710 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 1.062762 Jul 18 13:17:16.588122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2052/3985] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:15 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:16.600011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:16.601555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:16.620795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:16.621980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:16.624536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:16.625677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:16.925968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:16.927265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:16.929007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:16.930207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:16.930974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:16.966796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:16.982116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:16.990314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:16.991085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:17.051727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:17.058920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Getting quotas for user 82f71d1ab3c5486baee0f8160f0648d5 and project aef8bec8cefb49b6882b116e4a92ba44. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:17.092086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:17:17.098362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:17:17.217792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:17.241693 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97b61f82-6f29-4280-9391-cf0212b65586 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.599029 Jul 18 13:17:17.247610 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1934/3986] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:17:17.251611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e9fc7a4-9a18-4a2e-84fe-4ff904f42f6d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.659893 Jul 18 13:17:17.253788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2053/3987] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:16 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:17.262734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-947c1a07-599b-40d5-80f6-e9fe09d57649 req-5c62e872-7c34-4ade-bff5-6c101021502a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f63b8e3-f28d-4f85-a505-44400f577e94", "tag": "17921577-d7fa-46f0-bac6-0f27eeb3e6bb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:17.277215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:17.279535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-947c1a07-599b-40d5-80f6-e9fe09d57649 req-5c62e872-7c34-4ade-bff5-6c101021502a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:17.280432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:17.281093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-947c1a07-599b-40d5-80f6-e9fe09d57649 req-5c62e872-7c34-4ade-bff5-6c101021502a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:17.315003 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-947c1a07-599b-40d5-80f6-e9fe09d57649 req-5c62e872-7c34-4ade-bff5-6c101021502a service nova] Creating event network-changed:17921577-d7fa-46f0-bac6-0f27eeb3e6bb for instance 3f63b8e3-f28d-4f85-a505-44400f577e94 on n-h2-850003-3 Jul 18 13:17:17.321346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:17.323907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:17.325230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:17.329094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:17.334433 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-947c1a07-599b-40d5-80f6-e9fe09d57649 req-5c62e872-7c34-4ade-bff5-6c101021502a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073784 Jul 18 13:17:17.338579 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2054/3988] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:17.352306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09719324-0062-4dea-9c4e-9db68285466c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:17.359173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09719324-0062-4dea-9c4e-9db68285466c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:17.695839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09719324-0062-4dea-9c4e-9db68285466c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:17.747609 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09719324-0062-4dea-9c4e-9db68285466c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1215 microversion: 2.1 time: 0.406925 Jul 18 13:17:17.763617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2055/3989] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:17 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1215 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:17.789434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:17.792412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:17.832468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:17.841864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:17.843870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:17.853917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:18.102680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:18.137802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49e941d1-640a-499f-8948-650bdc78493a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.885033 Jul 18 13:17:18.141792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1935/3990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:17 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:18.177719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-298d8235-2f5a-4ee8-8f92-483dac805f73 req-3a507f07-0085-4021-b561-c79da3c3be6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a0647e-a1ad-4143-ac29-c9104449da1f", "name": "network-vif-plugged", "status": "completed", "tag": "e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:18.227036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-298d8235-2f5a-4ee8-8f92-483dac805f73 req-3a507f07-0085-4021-b561-c79da3c3be6d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:18.227791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-298d8235-2f5a-4ee8-8f92-483dac805f73 req-3a507f07-0085-4021-b561-c79da3c3be6d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:18.257477 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-298d8235-2f5a-4ee8-8f92-483dac805f73 req-3a507f07-0085-4021-b561-c79da3c3be6d service nova] Creating event network-vif-plugged:e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c for instance b6a0647e-a1ad-4143-ac29-c9104449da1f on n-h2-850003-3 Jul 18 13:17:18.269075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-298d8235-2f5a-4ee8-8f92-483dac805f73 req-3a507f07-0085-4021-b561-c79da3c3be6d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122296 Jul 18 13:17:18.281142 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1936/3991] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:18.330239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:18.336268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:18.388052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:18.395517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:18.404776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:18.405906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:18.479952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:19.019364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:19.047950 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c0c30984-aa2d-4be1-8082-827357fd481e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.762912 Jul 18 13:17:19.049981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1937/3992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:18 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:19.073145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:19.073884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:19.095950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:19.096402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:19.097956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:19.098525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:19.328334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:19.347994 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ca1ee01-26aa-4442-8226-9842b4e762fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1211 microversion: 2.1 time: 0.294124 Jul 18 13:17:19.351081 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1938/3993] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:19 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1211 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:19.371399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:19.374487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:19.410388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:19.411107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:19.412358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:19.413067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:19.526711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:19.543146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b954c916-62fd-4a65-b89c-99c31da6ccc7 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 1.775328 Jul 18 13:17:19.544800 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2056/3994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:17 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:19.688497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:19.705118 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63db48cc-0198-46a5-8030-9f918736c49b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.351402 Jul 18 13:17:19.708494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1939/3995] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:19 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:20.084117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:20.085124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:20.104065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.104835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.106615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.107244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.388307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:20.391383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:20.402383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.403335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.404784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.405916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.601778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:20.625441 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe2c0032-858e-4ec7-a5f0-fac654c31f21 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1273 microversion: 2.1 time: 0.246830 Jul 18 13:17:20.637642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:20.641663 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1940/3996] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:20 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:20.660771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:20.662963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:20.685554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.687457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.689109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5828bd16-979c-412a-a5ea-0a7778c2be7b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1317 microversion: 2.1 time: 0.613754 Jul 18 13:17:20.690527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.692621 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2057/3997] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:20 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:20.693441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.744524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:20.748507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:20.773883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.775003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:20.776903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:20.777368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:21.248181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:21.268607 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c704a55e-c11f-4e72-b3e8-98b1e3334de5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.538448 Jul 18 13:17:21.270494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2058/3998] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:20 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:21.383346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:21.403580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7308e497-27c5-40dd-a2db-d3f6d6a27ff9 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.751977 Jul 18 13:17:21.418703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1941/3999] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:20 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:21.673216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:21.677850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:21.692024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:21.692790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:21.694513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:21.696002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:21.722970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:21.728650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:21.765854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:21.769871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:21.773067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:21.776144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:22.233755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:22.285339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a103c3c-a0f0-4a93-a075-7712b6e53c6c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.628558 Jul 18 13:17:22.296105 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2059/4000] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:21 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:22.316013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:22.329180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:22.356903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:22.360732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:22.366337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:22.367128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.056284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:23.076822 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bfbf77c2-6ccd-4582-9478-4a2230d45086 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.772091 Jul 18 13:17:23.086409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2060/4001] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:22 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:23.092140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:23.095154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:23.106795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:23.119158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.119817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.121109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.135232 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24a801b3-bfa6-4b9c-85a8-bde97983d2f7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1507 microversion: 2.1 time: 1.418809 Jul 18 13:17:23.135628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.137299 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1942/4002] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:21 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1507 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:23.173691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:23.175981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:23.199035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.203407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.204949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.205627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.263248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:17:23.431136 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33eeca56-4d5b-4632-9e5a-a5f3c7e39d28 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 204 len: 0 microversion: 2.1 time: 0.266195 Jul 18 13:17:23.434118 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1943/4003] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:17:23 2022] DELETE /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:17:23.445966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:23.447492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:23.461517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.462961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.465072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:23.465947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:23.609244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:23.625164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9caaa945-9240-4a15-8d8e-3448b73c6581 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.536956 Jul 18 13:17:23.627250 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2061/4004] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:23 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:23.960302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7693722b-aa2a-4fc9-b120-282f45f95a98 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d7a07550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLwNVamL5pTGpm5ofk7DVUh0fYqhmv9hOA90bDazdLbZ09THy+YxYiKdNvSGwik7ecwsAw71qUjoTNJXP2Kjz7eU6wkIlmQTTD3EbNtMYbqYGHQzFPIUfpbZovbfGrtxQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:23.976361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7693722b-aa2a-4fc9-b120-282f45f95a98 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 13:17:23.985277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7693722b-aa2a-4fc9-b120-282f45f95a98 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 257 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLwNVamL5pTGpm5ofk7DVUh0fYqhmv9hOA90bDazdLbZ09THy+YxYiKdNvSGwik7ecwsAw71qUjoTNJXP2Kjz7eU6wkIlmQTTD3EbNtMYbqYGHQzFPIUfpbZovbfGrtxQ=="}} Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLwNVamL5pTGpm5ofk7DVUh0fYqhmv9hOA90bDazdLbZ09THy+YxYiKdNvSGwik7ecwsAw71qUjoTNJXP2Kjz7eU6wkIlmQTTD3EbNtMYbqYGHQzFPIUfpbZovbfGrtxQ=='}}} Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:23.986770 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 13:17:23.993501 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:23.998193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7693722b-aa2a-4fc9-b120-282f45f95a98 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:23.999424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7693722b-aa2a-4fc9-b120-282f45f95a98 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.369750 Jul 18 13:17:24.000244 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2062/4005] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:23 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:24.006791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec6d7831-b86e-4c1f-9f2c-e3bb8e6be1c4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.568796 Jul 18 13:17:24.010927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:24.011816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:24.022039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:24.022821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1944/4006] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:23 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:24.025422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:24.027359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:24.029018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:24.041310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d796f790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-276722083", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:24.072732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:24.090877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:24.101892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for user bb56509d091d401280334374a58b5661 and project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:24.171323 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:17:24.633520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:24.665533 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36d2d4ae-6bc4-49a3-b38c-4693ad331daa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1513 microversion: 2.1 time: 0.663364 Jul 18 13:17:24.667556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2063/4007] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:24 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1513 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:24.687061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:24.688544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:24.714019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:24.720743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:24.727082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:24.728404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.159496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:25.180812 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 51210. Jul 18 13:17:25.194543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-397464f9-1ef0-49fb-8142-36c8a2e22b1f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.517198 Jul 18 13:17:25.196170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:25.201870 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2064/4008] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:24 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 2166 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-276722083", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:25.211776 n-d-850003-3 devstack@n-api.service[131367]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-276722083', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:25.214752 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:25.218211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:25.222278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:25.223995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-88c078b1-b860-4caf-8b3f-dfcf7ca3fe20 req-3fcea280-e9d6-4c2d-8868-66af26bcc5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a72f842-29be-45f9-814f-de2fe85afc29", "tag": "034db7d6-b05a-4515-b940-996313b507a6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:25.231812 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-03d910ec-8b99-4edf-9d16-0580602d4d2a tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 1.207593 Jul 18 13:17:25.235490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1945/4009] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 18 13:17:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 1212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:17:25.265256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:25.266460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:25.270214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-88c078b1-b860-4caf-8b3f-dfcf7ca3fe20 req-3fcea280-e9d6-4c2d-8868-66af26bcc5c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:25.271032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-88c078b1-b860-4caf-8b3f-dfcf7ca3fe20 req-3fcea280-e9d6-4c2d-8868-66af26bcc5c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.291884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:25.294605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.296000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:25.299226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.312763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-88c078b1-b860-4caf-8b3f-dfcf7ca3fe20 req-3fcea280-e9d6-4c2d-8868-66af26bcc5c5 service nova] Creating event network-changed:034db7d6-b05a-4515-b940-996313b507a6 for instance 0a72f842-29be-45f9-814f-de2fe85afc29 on n-h1-850003-3 Jul 18 13:17:25.333219 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-88c078b1-b860-4caf-8b3f-dfcf7ca3fe20 req-3fcea280-e9d6-4c2d-8868-66af26bcc5c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128776 Jul 18 13:17:25.338599 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2065/4010] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:25.352362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:25.353533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:25.380998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:25.381657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.389678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:25.390659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:25.840717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:25.861199 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ab4d6f4f-66bc-4a33-8ce5-2f601612b7ae tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.520107 Jul 18 13:17:25.862220 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2066/4011] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:25 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:25.881552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2fd0d82-6e0a-43fb-bf94-728218d09029 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d7a07f70>, body: {"keypair": {"name": "tempest-keypair-1352811393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIZms0yKWAOwJf1tK7fiNgjI6tOwCCNHUdNEMi4se6WvGSOrAb5Qiwz4tJuPCHug6Sp6gulOB1QpEGQR1cm6Bl6ZLNrou5fBK1Yp6Ot2/Jz8rf9QGY4occk4xmitfJbVw=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:25.924722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a2fd0d82-6e0a-43fb-bf94-728218d09029 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:25.945797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a2fd0d82-6e0a-43fb-bf94-728218d09029 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for user bb56509d091d401280334374a58b5661 and project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:25.999567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2fd0d82-6e0a-43fb-bf94-728218d09029 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131279 Jul 18 13:17:26.000822 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2067/4012] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:26.009383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:26.010364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:26.019957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.020964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:26.022936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.023941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:26.033804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:26.074308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:26.109544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3fae848-cc5c-4c66-8905-d0582013f505 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.869767 Jul 18 13:17:26.115023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1946/4013] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:25 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:26.125871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d7919a60>, body: {"keypair": {"name": "tempest-keypair-1352811393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4KiwVjkyXffkOLBKdi0xblDvwlY9I2opw52uaLjUNi9AkDC8n2A836cD+W/0ntC2BgKtjiLwjVu0emoqoUnuncmQh3cZzv+7ROXDKShVfQKM3vJ/Y/HBH406SqJzXsA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:26.191577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:26.233096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for user bb56509d091d401280334374a58b5661 and project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:26.262923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:26.277669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-adda3ecf-706d-4598-8083-630eaf9cf5d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1513 microversion: 2.1 time: 0.274522 Jul 18 13:17:26.279205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Key pair 'tempest-keypair-1352811393' already exists. Jul 18 13:17:26.282687 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2068/4014] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:26 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:26.289964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:26.290910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 273 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "tempest-keypair-1352811393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4KiwVjkyXffkOLBKdi0xblDvwlY9I2opw52uaLjUNi9AkDC8n2A836cD+W/0ntC2BgKtjiLwjVu0emoqoUnuncmQh3cZzv+7ROXDKShVfQKM3vJ/Y/HBH406SqJzXsA=="}} Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: exception: Key pair 'tempest-keypair-1352811393' already exists. Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1352811393', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4KiwVjkyXffkOLBKdi0xblDvwlY9I2opw52uaLjUNi9AkDC8n2A836cD+W/0ntC2BgKtjiLwjVu0emoqoUnuncmQh3cZzv+7ROXDKShVfQKM3vJ/Y/HBH406SqJzXsA=='}}} Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result.read() Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'bb56509d091d401280334374a58b5661-tempest-keypair-1352811393' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 13:17:26.294103 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result.read() Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 13:17:26.298681 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'bb56509d091d401280334374a58b5661-tempest-keypair-1352811393' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 13, 17, 26, 266973), 'updated_at': None, 'name': 'tempest-keypair-1352811393', 'user_id': 'bb56509d091d401280334374a58b5661', 'fingerprint': 'e4:58:1c:bb:55:20:10:67:ff:f9:24:68:fe:d4:c4:bc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4KiwVjkyXffkOLBKdi0xblDvwlY9I2opw52uaLjUNi9AkDC8n2A836cD+W/0ntC2BgKtjiLwjVu0emoqoUnuncmQh3cZzv+7ROXDKShVfQKM3vJ/Y/HBH406SqJzXsA==', 'type': 'ssh'}] Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi keypair.create() Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._create() Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1352811393' already exists. Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 18 13:17:26.311252 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1352811393' already exists. Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1352811393' already exists. Jul 18 13:17:26.318284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.319567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.319567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:26.319567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.319567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:26.320118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 409 to user: Key pair 'tempest-keypair-1352811393' already exists. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.320118 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c70ae5d4-152b-40d2-bea2-2c7b3a066c11 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.192354 Jul 18 13:17:26.320118 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1947/4015] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:26 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:17:26.328048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffbcb44b-441c-4af0-a892-b3d955b2b6d0 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Calling method '.version_select at 0x7f96d782b9d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:26.352638 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffbcb44b-441c-4af0-a892-b3d955b2b6d0 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352811393" status: 202 len: 0 microversion: 2.1 time: 0.028990 Jul 18 13:17:26.354181 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1948/4016] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352811393 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:17:26.380863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5c37aff-68eb-4d14-8f31-6b3825f0a5fc tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d7805820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8F0BoQ9XE1HQBaICrlnRj7oFgFZt0AYHt12rzQiLN+ay5M850gmYjtaocne6hBj2nYIo0KoVayOEpEyf5fr/NO8yEdwoSYTotCgArb9lrzmsCs1+xRXGJEhH+CpPjHw=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5c37aff-68eb-4d14-8f31-6b3825f0a5fc tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 247 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8F0BoQ9XE1HQBaICrlnRj7oFgFZt0AYHt12rzQiLN+ay5M850gmYjtaocne6hBj2nYIo0KoVayOEpEyf5fr/NO8yEdwoSYTotCgArb9lrzmsCs1+xRXGJEhH+CpPjHw=="}} Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8F0BoQ9XE1HQBaICrlnRj7oFgFZt0AYHt12rzQiLN+ay5M850gmYjtaocne6hBj2nYIo0KoVayOEpEyf5fr/NO8yEdwoSYTotCgArb9lrzmsCs1+xRXGJEhH+CpPjHw=='}}} Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '' Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:26.390536 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:17:26.395549 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.399625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5c37aff-68eb-4d14-8f31-6b3825f0a5fc tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.403459 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e5c37aff-68eb-4d14-8f31-6b3825f0a5fc tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.032096 Jul 18 13:17:26.404567 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1949/4017] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:26 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:26.417929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d77fbe50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1517529948", "public_key": " "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:26.457215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:26.477982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for user bb56509d091d401280334374a58b5661 and project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:26.519801 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 95 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1517529948", "public_key": " "}} Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1517529948', 'public_key': ' '}}} Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.524468 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.533067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.540293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.540617 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-744a3847-2cb3-40ba-b7b1-fd9f98e9db91 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.127727 Jul 18 13:17:26.551988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1950/4018] 10.222.0.88 () {60 vars in 1157 bytes} [Mon Jul 18 13:17:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 18 13:17:26.565406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cde42dd5-7480-4bb9-bfea-5e570450a24c tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d77eb430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvwruerDrc/RcK4d7GGaRikmq0YhDVHEakvQ53X9z5UXCe8Z58X50Jf66M/YNl7EIHZqzUVpfpz/QXP9AYMN66+zuTEithg5WrZG+h5EC05UfqM7oHn2fRZnnO2SyvvQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cde42dd5-7480-4bb9-bfea-5e570450a24c tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 507 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvwruerDrc/RcK4d7GGaRikmq0YhDVHEakvQ53X9z5UXCe8Z58X50Jf66M/YNl7EIHZqzUVpfpz/QXP9AYMN66+zuTEithg5WrZG+h5EC05UfqM7oHn2fRZnnO2SyvvQ=="}} Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvwruerDrc/RcK4d7GGaRikmq0YhDVHEakvQ53X9z5UXCe8Z58X50Jf66M/YNl7EIHZqzUVpfpz/QXP9AYMN66+zuTEithg5WrZG+h5EC05UfqM7oHn2fRZnnO2SyvvQ=='}}} Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 18 13:17:26.573643 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 13:17:26.578511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.585723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cde42dd5-7480-4bb9-bfea-5e570450a24c tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.587443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:26.588773 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cde42dd5-7480-4bb9-bfea-5e570450a24c tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.033469 Jul 18 13:17:26.598278 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1951/4019] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 13:17:26.606644 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7094694-ddae-4b8c-87d2-d16849fb305e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.321925 Jul 18 13:17:26.611089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Action: 'create', calling method: .version_select at 0x7f96d782bb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2076960718", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:26.611905 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2069/4020] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:26 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:26.654993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:26.666455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Getting quotas for user bb56509d091d401280334374a58b5661 and project ddf98f2c79944ea7b6fe2f0d0708bb88. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:26.697422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 118 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2076960718", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2076960718', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 13:17:26.699390 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3500715-c800-4b7c-a3d9-6ecfff11b8e3 tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.101103 Jul 18 13:17:26.708887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1952/4021] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:17:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:17:26.715169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-832e41bc-a574-4ce8-a5c0-33958779cc0b tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Calling method '.version_select at 0x7f96e43cc8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:26.732049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-832e41bc-a574-4ce8-a5c0-33958779cc0b tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-832e41bc-a574-4ce8-a5c0-33958779cc0b tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Request method failure captured: Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71092956 HTTP/1.1 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1jkjmiqVExG7QkO4znw1pb-qSVBPhrxFC_Lt-LlpSpcgRqh3tXhaTXKsb28bdxhuMMsmsA4GS5aqTTp-h-2g4N5VWzqhZTjEdRJ9FY2usa6SDfl3C67LnPAS07qa2Ad4AcHzwA-m9oaU932U_NWofp2ZMXCXcjj3N9ti8uzRa3o98 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ddf98f2c79944ea7b6fe2f0d0708bb88", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ddf98f2c79944ea7b6fe2f0d0708bb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: ddf98f2c79944ea7b6fe2f0d0708bb88 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1803551966 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: bb56509d091d401280334374a58b5661 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1803551966-project Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: exception: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'tempest-keypair-non-existent-71092956'} Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.734412 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 Jul 18 13:17:26.738348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:26.743426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-832e41bc-a574-4ce8-a5c0-33958779cc0b tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] Returning 404 to user: Keypair tempest-keypair-non-existent-71092956 not found for user bb56509d091d401280334374a58b5661 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:26.745337 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-832e41bc-a574-4ce8-a5c0-33958779cc0b tempest-KeyPairsNegativeTestJSON-1803551966 tempest-KeyPairsNegativeTestJSON-1803551966-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71092956" status: 404 len: 143 microversion: 2.1 time: 0.034811 Jul 18 13:17:26.746109 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2070/4022] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 13:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71092956 => generated 143 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:17:26.887028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:26.887746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:26.898007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.898723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:26.901449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:26.902847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.030973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:27.147498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:27.151486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:27.162091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.162970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.164798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.165503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.383067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:27.398738 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f27ca26-6076-44d2-bfc9-cd1105f1a23a tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.261765 Jul 18 13:17:27.412292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2071/4023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:27 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:27.423162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:27.424785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:27.437077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.438278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.439922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.441626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.544844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:27.560793 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e4f35e1-4543-4eea-8e55-7e99128400a8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1471 microversion: 2.1 time: 0.146846 Jul 18 13:17:27.566541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2072/4024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:27 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:27.651076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:27.651883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:27.682097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.683438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.685975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.686955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.689452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:27.707945 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69ff84a7-e536-431b-a422-a67298339b7d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.827529 Jul 18 13:17:27.718813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1953/4025] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:26 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:27.729822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-be347baa-9da8-44d2-87da-ac8244ddf709 req-18838371-2acc-4827-b0e3-f457124201d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f63b8e3-f28d-4f85-a505-44400f577e94", "name": "network-vif-plugged", "status": "completed", "tag": "17921577-d7fa-46f0-bac6-0f27eeb3e6bb"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:27.751199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be347baa-9da8-44d2-87da-ac8244ddf709 req-18838371-2acc-4827-b0e3-f457124201d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.757400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be347baa-9da8-44d2-87da-ac8244ddf709 req-18838371-2acc-4827-b0e3-f457124201d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:27.782764 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-be347baa-9da8-44d2-87da-ac8244ddf709 req-18838371-2acc-4827-b0e3-f457124201d5 service nova] Creating event network-vif-plugged:17921577-d7fa-46f0-bac6-0f27eeb3e6bb for instance 3f63b8e3-f28d-4f85-a505-44400f577e94 on n-h2-850003-3 Jul 18 13:17:27.801197 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-be347baa-9da8-44d2-87da-ac8244ddf709 req-18838371-2acc-4827-b0e3-f457124201d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080549 Jul 18 13:17:27.810359 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1954/4026] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:27.966698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-659eb77b-8ef8-4af8-90a2-9a721176a800 req-bc1aeb77-5de2-4ea3-8fad-176e6f7e6725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a0647e-a1ad-4143-ac29-c9104449da1f", "name": "network-vif-deleted", "tag": "e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:27.996822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-659eb77b-8ef8-4af8-90a2-9a721176a800 req-bc1aeb77-5de2-4ea3-8fad-176e6f7e6725 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:27.997699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-659eb77b-8ef8-4af8-90a2-9a721176a800 req-bc1aeb77-5de2-4ea3-8fad-176e6f7e6725 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.053830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-659eb77b-8ef8-4af8-90a2-9a721176a800 req-bc1aeb77-5de2-4ea3-8fad-176e6f7e6725 service nova] Creating event network-vif-deleted:e7cbfc6e-6fcc-483d-8bf3-1be8fc566f5c for instance b6a0647e-a1ad-4143-ac29-c9104449da1f on n-h2-850003-3 Jul 18 13:17:28.078262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-659eb77b-8ef8-4af8-90a2-9a721176a800 req-bc1aeb77-5de2-4ea3-8fad-176e6f7e6725 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125883 Jul 18 13:17:28.079772 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1955/4027] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:17:28.171137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:28.210748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bdfd2514-ffb1-44f1-8606-919c7a0a61a8 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.574235 Jul 18 13:17:28.222408 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2073/4028] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:27 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:28.424667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:28.426448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:28.440226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.441984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.443948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.445187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.584164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:28.585674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:28.607500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.608311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.609548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.613933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.702295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.702801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.703480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'fault' on Instance uuid b6a0647e-a1ad-4143-ac29-c9104449da1f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:17:28.934912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:28.948342 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c074d1f-915b-48f6-b27b-a16623c417ca tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 200 len: 1307 microversion: 2.1 time: 0.372220 Jul 18 13:17:28.952285 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2074/4029] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:28 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:28.962338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:28.968021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:28.980413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.983780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:28.985382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:28.992557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:29.082416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:29.113392 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2d4451f-cf16-4820-9fdf-34d122d6c317 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.696889 Jul 18 13:17:29.127221 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1956/4030] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:28 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:29.278059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:29.285148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:29.314745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:29.320305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:29.324949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:29.326579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:29.741871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:29.763950 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00b2ded4-6bb1-4d1e-b947-63bbf7bf5232 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.514157 Jul 18 13:17:29.770020 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1957/4031] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:29 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:29.805119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:29.837444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1758452-b7f3-4ea9-9cc0-348c146fed7a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.883224 Jul 18 13:17:29.839108 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2075/4032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:28 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:29.985051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:29.989780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:30.012327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.013584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.015981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.016801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.052590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f HTTP/1.1 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b6a0647e-a1ad-4143-ac29-c9104449da1f'} Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:30.061427 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b9895565-a22a-4a78-be5a-937b623386b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 404 len: 111 microversion: 2.1 time: 0.087631 Jul 18 13:17:30.072472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1958/4033] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:29 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:17:30.088890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:30.091110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:30.118364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.119787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.124056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.131571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.154345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:30.162696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:30.214700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.215810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.220419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.231386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.724021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:30.745263 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fbaacc0a-df3e-43be-9688-bfe13a8bf151 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.667595 Jul 18 13:17:30.746767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2076/4034] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:30 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:30.748007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:30.755849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:30.756769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:30.765140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.766189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.767265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.767520 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9beba67f-7e77-4a03-8254-e556e62857c4 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1324 microversion: 2.1 time: 0.620837 Jul 18 13:17:30.768166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.769088 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1959/4035] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:30 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:30.807884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:30.808489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:30.820780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.823502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.827563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:30.829334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:30.844052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:17:31.152730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f686d118-08cf-4dfa-83e6-84f421670524 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "DELETE /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 204 len: 0 microversion: 2.32 time: 0.403094 Jul 18 13:17:31.161054 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2077/4036] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:17:30 2022] DELETE /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:17:31.173166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:31.174271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:31.185005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.185785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.187028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.187639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.319367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:31.345664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1ab5d8a-47a2-4ec5-a2d4-bd29af650f32 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.541881 Jul 18 13:17:31.350176 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1960/4037] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:30 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:31.369578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-503ed09c-db1c-4293-a9ec-3748b87f481c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-503ed09c-db1c-4293-a9ec-3748b87f481c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 163 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": 12345, "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 12345 Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:31.371945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 13:17:31.375457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:31.378171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-503ed09c-db1c-4293-a9ec-3748b87f481c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:31.379266 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-503ed09c-db1c-4293-a9ec-3748b87f481c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.027805 Jul 18 13:17:31.380059 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1961/4038] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:31 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:31.392626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:31.394392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:31.403193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.405533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.405533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.405533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.463020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:31.540487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:31.583439 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a422b5ed-06a9-4eb4-ac9c-887dc99437f2 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.414474 Jul 18 13:17:31.587582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2078/4039] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:31 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:31.612946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:31.615337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:31.637047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.638981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.641885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.644660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.807235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:31.825741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:31.832809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:31.837365 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eaa84b04-fbc0-478b-aed1-a635e081af06 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2950 microversion: 2.32 time: 0.450814 Jul 18 13:17:31.856472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1962/4040] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:31 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2950 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:31.872457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:31.876348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:31.889698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.891196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:31.894658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:31.895728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.119087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:32.144280 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a142223-cfb7-4206-a3f8-4de035df3b29 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.552043 Jul 18 13:17:32.144943 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2079/4041] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:31 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:32.168488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:32.169755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:32.188485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.189241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.190567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.191328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.215288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:32.244696 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c8357e2-7284-44ce-ba03-fe5d4c01ad66 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1521 microversion: 2.1 time: 0.383741 Jul 18 13:17:32.244696 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1963/4042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:31 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:32.273286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:32.275090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:32.286576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.287366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.288885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.289698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.344003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] HTTP exception thrown: Instance is not a member of specified network Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Request method failure captured: Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94/ips/invalid HTTP/1.1 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V1Q7DmvxQOFK9QXuIUvfAyBW-Mh6fzmI_ZW_0S8DSYxTqoH5E8YxqYdtnXrQUX7882y5P_w6k9Aq92cbRNdsUGC5BMNg-UTd_dsEnbwD6y3vk0o3TN6rzeOwVj3HawqqxSTkzEp_ahB6-QY6IUdY5ECVzqKa5SHG_Y8f9jGLDfpuWg Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e82802d752fe4f89ac5d8cf3221a4ba1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: c14ddd6901844fc9aab93b5ff761123f Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance is not a member of specified network Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': '3f63b8e3-f28d-4f85-a505-44400f577e94', 'id': 'invalid'} Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 18 13:17:32.358447 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.381687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:32.381687 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8b8bd7c9-d947-4a28-9e28-948984f5b9ff tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.096227 Jul 18 13:17:32.381687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1964/4043] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:17:32 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94/ips/invalid => generated 91 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:17:32.381687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:32.381687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:32.396771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.398086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.399633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.401413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.512032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:32.526623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4309ee4-0e31-4d56-bac1-fc0d93fb595a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.362810 Jul 18 13:17:32.535482 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2080/4044] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:32 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:32.550545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:32.551906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Failed to fetch instance by id 999 {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 13:17:32.553175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] HTTP exception thrown: Instance 999 could not be found. Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Request method failure captured: Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1Q7DmvxQOFK9QXuIUvfAyBW-Mh6fzmI_ZW_0S8DSYxTqoH5E8YxqYdtnXrQUX7882y5P_w6k9Aq92cbRNdsUGC5BMNg-UTd_dsEnbwD6y3vk0o3TN6rzeOwVj3HawqqxSTkzEp_ahB6-QY6IUdY5ECVzqKa5SHG_Y8f9jGLDfpuWg Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e82802d752fe4f89ac5d8cf3221a4ba1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: c14ddd6901844fc9aab93b5ff761123f Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 999 could not be found. Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '999'} Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 13:17:32.557193 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:32.569830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:32.572236 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-efe90460-34b0-46e0-a227-bb09199df35e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.034894 Jul 18 13:17:32.573955 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2081/4045] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 13:17:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:17:32.602122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:32.605388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:32.625024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.625340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.626210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:32.626626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:32.759144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:17:32.965625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:32.999068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d67ec2bd-166a-4e0f-9fd7-03227b3d8b7e tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 0.625176 Jul 18 13:17:33.007838 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1965/4046] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:32 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:33.028044 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0bb309a8-8eee-4730-8902-7c1ecdfc8c43 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 204 len: 0 microversion: 2.1 time: 0.439173 Jul 18 13:17:33.036292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2082/4047] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:17:32 2022] DELETE /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:17:33.037776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:33.039383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:33.053491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:33.055111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:33.073251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.075077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:33.077672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.081883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.081883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:33.085673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:33.097676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.104088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:33.133573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:33.633473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:33.656245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:33.659617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:33.663722 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ef818fe-0c15-4b37-84e8-fee0c8aec25a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2950 microversion: 2.32 time: 0.628162 Jul 18 13:17:33.665156 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2083/4048] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:33 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2950 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:33.688034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:33.691223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:33.714046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.715209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:33.757989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:33.759586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:34.011096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:34.033201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0426c135-81ef-4c79-9ac8-ab563a4c39a5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 1.022250 Jul 18 13:17:34.035525 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1966/4049] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:33 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:34.045841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7ba71cbe-6263-4b2c-9ba9-70ee0409ddc0 req-ef1c49f6-99d6-48de-97a8-c93131f35772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a72f842-29be-45f9-814f-de2fe85afc29", "name": "network-vif-plugged", "status": "completed", "tag": "034db7d6-b05a-4515-b940-996313b507a6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:34.085612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7ba71cbe-6263-4b2c-9ba9-70ee0409ddc0 req-ef1c49f6-99d6-48de-97a8-c93131f35772 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:34.093421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7ba71cbe-6263-4b2c-9ba9-70ee0409ddc0 req-ef1c49f6-99d6-48de-97a8-c93131f35772 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:34.142803 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7ba71cbe-6263-4b2c-9ba9-70ee0409ddc0 req-ef1c49f6-99d6-48de-97a8-c93131f35772 service nova] Creating event network-vif-plugged:034db7d6-b05a-4515-b940-996313b507a6 for instance 0a72f842-29be-45f9-814f-de2fe85afc29 on n-h1-850003-3 Jul 18 13:17:34.164794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:34.165503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7ba71cbe-6263-4b2c-9ba9-70ee0409ddc0 req-ef1c49f6-99d6-48de-97a8-c93131f35772 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126138 Jul 18 13:17:34.166675 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1967/4050] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:34.187720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:34.189515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:34.204029 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a734482-3fcb-4de4-9df9-d74dd9b9147e tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1527 microversion: 2.1 time: 0.536326 Jul 18 13:17:34.207420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:34.208483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:34.210611 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2084/4051] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:33 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1527 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:34.212337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:34.216338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:34.703854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:34.715807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:34.729451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:34.744166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:34.746078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:34.747229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:35.699376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:35.730770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:35.737072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:35.742259 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6fe4cb73-1eb4-42ad-aab8-dfe2039e2fb4 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2950 microversion: 2.32 time: 1.044988 Jul 18 13:17:35.753099 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2085/4052] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:34 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2950 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:35.765888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:35.771536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:35.772051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:35.782927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:35.783386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:35.787477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:35.787947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:35.808096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5efdbc1d-be51-44ad-9021-8e0081221092 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1516 microversion: 2.1 time: 1.638612 Jul 18 13:17:35.818957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1968/4053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:34 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1516 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:35.836705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:35.842680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:35.876828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:35.879022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:35.884661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:35.886583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:35.969087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:36.304773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:36.333572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69332616-b4a7-4cb8-888f-ef79f92cd7de tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1315 microversion: 2.1 time: 0.578171 Jul 18 13:17:36.335137 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2086/4054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:35 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:36.511590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a16ff96e-0655-45eb-8c90-18b64d2a5455 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1649669801", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8379f79f-1e5a-48a9-ae0b-b20eff47b694", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:36.663397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a16ff96e-0655-45eb-8c90-18b64d2a5455 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a16ff96e-0655-45eb-8c90-18b64d2a5455 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 358 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1649669801", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8379f79f-1e5a-48a9-ae0b-b20eff47b694", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: exception: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1649669801', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8379f79f-1e5a-48a9-ae0b-b20eff47b694'}], 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:36.673291 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a16ff96e-0655-45eb-8c90-18b64d2a5455 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Block Device 8379f79f-1e5a-48a9-ae0b-b20eff47b694 is not bootable. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:36.680383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a16ff96e-0655-45eb-8c90-18b64d2a5455 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.170702 Jul 18 13:17:36.685631 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2087/4055] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:36.687433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=22 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:36.696465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:36.715055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:36.728472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:36.729327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:36.730604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:36.731037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:36.823917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:36.849956 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-130cf326-67cc-4a15-884a-f14756a9d5a3 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1527 microversion: 2.1 time: 1.028780 Jul 18 13:17:36.851477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1969/4056] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:35 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1527 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:36.868362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:36.869848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:36.895052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:36.908919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:36.913019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:36.914215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:37.494437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:37.505395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fe78a07-e87c-44fa-9cf9-c0663be430b9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.820129 Jul 18 13:17:37.505621 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2088/4057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:36 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:37.518865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:37.519551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:37.555361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:37.556204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:37.557857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:37.579723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:38.344816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:38.368915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:38.371998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:38.375712 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ceb04004-b6a2-454f-b4c0-f2b755ff4179 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2950 microversion: 2.32 time: 1.522630 Jul 18 13:17:38.381214 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1970/4058] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:36 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2950 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:38.398745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:38.400375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:38.423254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:38.427266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:38.428806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:38.429494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:38.889657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:38.920711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-68f49c43-a318-4106-80da-9c93a4665e47 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 1.412983 Jul 18 13:17:38.926420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2089/4059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:37 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:38.955995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:38.960580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:38.967657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:39.010250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.016922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.019076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.020131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.371750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:39.407538 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b68cb87a-2b74-49cf-84e5-92a4e707f472 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1503 microversion: 2.1 time: 1.020906 Jul 18 13:17:39.411681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1971/4060] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:38 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1503 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:39.430288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:39.434618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:39.466630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.468159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.472749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.477812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.576486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.578045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.579306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lazy-loading 'fault' on Instance uuid 3f63b8e3-f28d-4f85-a505-44400f577e94 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:17:39.579470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:39.596513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-952974eb-b8a2-4b9f-8a05-07adc5b5cb99 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.667633 Jul 18 13:17:39.597077 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2090/4061] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:38 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:39.608497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3c44bf00-58b5-43d5-a337-8f21b8d533f3 req-11794e84-1c31-4903-942d-91d3b6cf3da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f63b8e3-f28d-4f85-a505-44400f577e94", "name": "network-vif-deleted", "tag": "17921577-d7fa-46f0-bac6-0f27eeb3e6bb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:39.648246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3c44bf00-58b5-43d5-a337-8f21b8d533f3 req-11794e84-1c31-4903-942d-91d3b6cf3da0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.649127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3c44bf00-58b5-43d5-a337-8f21b8d533f3 req-11794e84-1c31-4903-942d-91d3b6cf3da0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.693680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3c44bf00-58b5-43d5-a337-8f21b8d533f3 req-11794e84-1c31-4903-942d-91d3b6cf3da0 service nova] Creating event network-vif-deleted:17921577-d7fa-46f0-bac6-0f27eeb3e6bb for instance 3f63b8e3-f28d-4f85-a505-44400f577e94 on n-h2-850003-3 Jul 18 13:17:39.719132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3c44bf00-58b5-43d5-a337-8f21b8d533f3 req-11794e84-1c31-4903-942d-91d3b6cf3da0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116753 Jul 18 13:17:39.720307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2091/4062] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:39.732581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:39.739976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:39.759738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.764882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.766136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:39.768388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:39.908211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14ddd6901844fc9aab93b5ff761123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82802d752fe4f89ac5d8cf3221a4ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:39.925353 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77e767eb-8dc1-4f98-99d2-00ff5aee1418 tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 200 len: 1314 microversion: 2.1 time: 0.506260 Jul 18 13:17:39.947581 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1972/4063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:39 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:39.965317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:39.988470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:40.001289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.003113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:40.009004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.010113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:40.167226 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-84cae984-75c4-4be6-abdd-1f9afb72622a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29/action" status: 202 len: 0 microversion: 2.1 time: 0.216275 Jul 18 13:17:40.175318 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1973/4064] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:17:39 2022] POST /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:17:40.191302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:40.195873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:40.232299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.236305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:40.240010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.240595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:40.664205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:40.674734 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2574125-0f83-4c75-ae09-1c507533b8bf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 0.495765 Jul 18 13:17:40.682875 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1974/4065] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:40 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:40.691973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:40.696797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:40.717714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.718464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:40.722831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:40.724003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.058565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:41.106836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:41.123320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:41.125056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8564f9cc-663c-4548-8a16-99290f019209 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2929 microversion: 2.32 time: 1.402315 Jul 18 13:17:41.125667 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2092/4066] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:39 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2929 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:41.136603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-aeb4b3e5-b9d2-44f3-af46-bfd22939d52e req-2b8d4251-a124-44e1-be4b-efbad1571cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-unplugged", "status": "completed", "tag": "a5655267-e11d-4f82-8970-49c5b34333be"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:41.178118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aeb4b3e5-b9d2-44f3-af46-bfd22939d52e req-2b8d4251-a124-44e1-be4b-efbad1571cda service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.185421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aeb4b3e5-b9d2-44f3-af46-bfd22939d52e req-2b8d4251-a124-44e1-be4b-efbad1571cda service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.226101 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aeb4b3e5-b9d2-44f3-af46-bfd22939d52e req-2b8d4251-a124-44e1-be4b-efbad1571cda service nova] Creating event network-vif-unplugged:a5655267-e11d-4f82-8970-49c5b34333be for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:41.245507 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-aeb4b3e5-b9d2-44f3-af46-bfd22939d52e req-2b8d4251-a124-44e1-be4b-efbad1571cda service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116195 Jul 18 13:17:41.246937 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2093/4067] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:41.260840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:41.262594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] [instance: 3f63b8e3-f28d-4f85-a505-44400f577e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:41.286464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:41.294080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.300522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.301922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.305202 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-821da67c-fa0c-4253-a7b4-ed732adeddd1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1488 microversion: 2.1 time: 0.618093 Jul 18 13:17:41.305876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1975/4068] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:40 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1488 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:41.307330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.323838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:41.324484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:41.338391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.338859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.339677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.340124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.380978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] HTTP exception thrown: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Request method failure captured: Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 HTTP/1.1 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1Q7DmvxQOFK9QXuIUvfAyBW-Mh6fzmI_ZW_0S8DSYxTqoH5E8YxqYdtnXrQUX7882y5P_w6k9Aq92cbRNdsUGC5BMNg-UTd_dsEnbwD6y3vk0o3TN6rzeOwVj3HawqqxSTkzEp_ahB6-QY6IUdY5ECVzqKa5SHG_Y8f9jGLDfpuWg Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e82802d752fe4f89ac5d8cf3221a4ba1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e82802d752fe4f89ac5d8cf3221a4ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e82802d752fe4f89ac5d8cf3221a4ba1 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-291582356 Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: c14ddd6901844fc9aab93b5ff761123f Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-291582356-project Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3f63b8e3-f28d-4f85-a505-44400f577e94'} Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:41.392499 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. Jul 18 13:17:41.402657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:41.404481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lazy-loading 'flavor' on Instance uuid 0a72f842-29be-45f9-814f-de2fe85afc29 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:17:41.408236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] Returning 404 to user: Instance 3f63b8e3-f28d-4f85-a505-44400f577e94 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:41.410357 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b3796cb0-905c-43ea-b49b-bb3b0d31bb3d tempest-ServerAddressesNegativeTestJSON-291582356 tempest-ServerAddressesNegativeTestJSON-291582356-project] 10.222.0.88 "GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94" status: 404 len: 111 microversion: 2.1 time: 0.161330 Jul 18 13:17:41.412236 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2094/4069] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:41 2022] GET /compute/v2.1/servers/3f63b8e3-f28d-4f85-a505-44400f577e94 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:17:41.585304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:41.699476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:41.700473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:41.719029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.719795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:41.720816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:41.722012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:42.026524 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd5bb3af-22bf-4061-91a3-e4b169699fd4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29/action" status: 202 len: 0 microversion: 2.1 time: 0.704933 Jul 18 13:17:42.030511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1976/4070] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:17:41 2022] POST /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:17:42.043402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:42.048014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:42.069585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:42.070446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:42.071483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:42.072123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:42.449814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:42.467101 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba4ae759-b5d1-4959-a4cc-6b1bbfd13057 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1494 microversion: 2.1 time: 0.430618 Jul 18 13:17:42.486412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1977/4071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:42 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1494 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:42.493258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:42.494207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:42.502106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:42.503536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:42.504819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:42.506646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:42.745599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:42.764188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-571c18b2-4212-4fc1-8e04-671f6f32552c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 1.068491 Jul 18 13:17:42.765470 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2095/4072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:41 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:42.852660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:42.869579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:42.871904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:42.873635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69302c04-99ca-41e1-aa4a-5c74495ffd24 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2908 microversion: 2.32 time: 0.385078 Jul 18 13:17:42.882893 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1978/4073] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:42 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2908 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:42.968856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65e66f6b-ca55-4b80-bece-e096268248ea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980587834", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "df1d514c-8a50-4216-9a84-c81f6f685344", "destination_type": "local"}, {"source_type": "volume", "uuid": "c98e11dc-eba9-4da8-a303-3e79cfc91e49", "destination_type": "invalid"}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65e66f6b-ca55-4b80-bece-e096268248ea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 495 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980587834", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "df1d514c-8a50-4216-9a84-c81f6f685344", "destination_type": "local"}, {"source_type": "volume", "uuid": "c98e11dc-eba9-4da8-a303-3e79cfc91e49", "destination_type": "invalid"}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1980587834', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c98e11dc-eba9-4da8-a303-3e79cfc91e49', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:42.973272 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 13:17:42.978099 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:42.981046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65e66f6b-ca55-4b80-bece-e096268248ea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:42.982187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65e66f6b-ca55-4b80-bece-e096268248ea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018478 Jul 18 13:17:42.986699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2096/4074] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:42 2022] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:42.993133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:42.993981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:43.001391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.002256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.003418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.004091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.220222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:43.242247 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c667f6a-8973-4a85-9145-014167a6a6e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.253783 Jul 18 13:17:43.243534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1979/4075] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:42 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:43.268103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:43.268839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:43.277658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.282054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.283463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.284831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.397219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-unplugged", "status": "completed", "tag": "1971fd4f-36e3-45e1-9819-2469791698ad"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-unplugged", "status": "completed", "tag": "d9b46508-549b-4942-a526-4ee162fb2863"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:43.406361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:43.409342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.410141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.433479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] Creating event network-vif-unplugged:1971fd4f-36e3-45e1-9819-2469791698ad for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:43.434972 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] Creating event network-vif-unplugged:d9b46508-549b-4942-a526-4ee162fb2863 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:43.443336 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-39f13357-7aeb-48b6-a81d-1d9d13ee22c6 req-b3cb3b50-5410-4a64-a6a2-c3e35342c7c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.050456 Jul 18 13:17:43.445320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1980/4076] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:43.506803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:43.509932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:43.526029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.526800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.528206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.528938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.797474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:43.816094 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9aaecba9-8245-4420-8d80-4105e80b2394 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1494 microversion: 2.1 time: 0.332526 Jul 18 13:17:43.828876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1981/4077] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:43 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1494 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:43.839056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:43.840561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:43.856598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.858272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:43.860799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:43.862684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.065818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:44.110815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ed8babcd-6f3a-4de6-87fe-ab1c925898d2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.846328 Jul 18 13:17:44.112710 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2097/4078] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:43 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:44.155919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:44.161473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:44.172501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:44.186883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.187338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.189694 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff14061e-9a2c-4a7f-90a9-764ade25c567 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 0.361044 Jul 18 13:17:44.198039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.199881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.203731 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1982/4079] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:43 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:44.221619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-21b9f5cd-1e82-4905-91b1-bbdb981fe851 req-2ad0f7ef-cffa-4b3b-98a1-75a75e90f237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-deleted", "tag": "d9b46508-549b-4942-a526-4ee162fb2863"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:44.239276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21b9f5cd-1e82-4905-91b1-bbdb981fe851 req-2ad0f7ef-cffa-4b3b-98a1-75a75e90f237 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.254805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21b9f5cd-1e82-4905-91b1-bbdb981fe851 req-2ad0f7ef-cffa-4b3b-98a1-75a75e90f237 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.312548 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-21b9f5cd-1e82-4905-91b1-bbdb981fe851 req-2ad0f7ef-cffa-4b3b-98a1-75a75e90f237 service nova] Creating event network-vif-deleted:d9b46508-549b-4942-a526-4ee162fb2863 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:44.323820 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-21b9f5cd-1e82-4905-91b1-bbdb981fe851 req-2ad0f7ef-cffa-4b3b-98a1-75a75e90f237 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112244 Jul 18 13:17:44.328600 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1983/4080] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:44.333834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7884d28c-cc33-42c3-9c1c-87d004bfda1c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-418794109", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7884d28c-cc33-42c3-9c1c-87d004bfda1c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 491 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-418794109", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-418794109', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 18 13:17:44.337155 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7884d28c-cc33-42c3-9c1c-87d004bfda1c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7884d28c-cc33-42c3-9c1c-87d004bfda1c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009422 Jul 18 13:17:44.342990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1984/4081] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:44 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:44.366659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:44.368145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:44.392775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.393292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.394165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.394635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.694981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:44.709780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ab232ce-3962-4b5d-95b8-2818ed710409 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.358607 Jul 18 13:17:44.728969 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1985/4082] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:44 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:44.734992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:44.735782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:44.743391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.743846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.744667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.745111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.923867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:44.934300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e402a4f5-1322-4032-a95b-12e4868547ac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.203623 Jul 18 13:17:44.949173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1986/4083] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:44 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:44.949173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:44.949173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:44.965140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.965590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:44.966418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:44.966863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.270960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.280358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58596024-214b-4af2-8404-3f2c843f5120 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1515 microversion: 2.1 time: 0.340586 Jul 18 13:17:45.291291 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1987/4084] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:44 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:45.297335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b64a8af9-ae3e-4781-8da7-863f2cfa760a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b64a8af9-ae3e-4781-8da7-863f2cfa760a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 416 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:45.300741 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:17:45.304313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:45.306982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b64a8af9-ae3e-4781-8da7-863f2cfa760a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:45.308058 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b64a8af9-ae3e-4781-8da7-863f2cfa760a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014956 Jul 18 13:17:45.309186 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1988/4085] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:45 2022] POST /compute/v2.1/servers => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:45.315703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:45.318032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:45.326117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.326902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.328353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.328950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.329201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.358195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.362434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.374054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c242f70-6441-4bbe-be31-62d4daa58cf6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2862 microversion: 2.32 time: 1.259454 Jul 18 13:17:45.389318 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2098/4086] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:44 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2862 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:45.396385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:45.399066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:45.408227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.409727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.410963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.411881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.599509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.612487 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-afd645d8-c268-4d2f-aebf-fd1d3dae7d09 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 0.301241 Jul 18 13:17:45.623347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1989/4087] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:45 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:45.629145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-unplugged", "status": "completed", "tag": "5783181c-6d5c-4774-acf0-5a3a9820e65a"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-unplugged", "status": "completed", "tag": "7f349224-d4c9-4f4a-a01b-62ec8d49e2e1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:45.638994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.639505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.652890 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] Creating event network-vif-unplugged:5783181c-6d5c-4774-acf0-5a3a9820e65a for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:45.653406 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] Creating event network-vif-unplugged:7f349224-d4c9-4f4a-a01b-62ec8d49e2e1 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:45.659534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c63e4f2f-0938-4bf2-8f6e-80907610f0c3 req-272250ad-eb9d-4c12-a543-906541bbd2a5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.035149 Jul 18 13:17:45.661030 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1990/4088] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:45.893073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:45.918033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f86cf5a9-96f6-4fb0-b1c9-32cebe882d7a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.527053 Jul 18 13:17:45.919183 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2099/4089] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:45 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:45.939601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:45.943372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:45.954251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.954720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:45.955889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:45.956139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.164318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:46.179169 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-691d44f9-96ea-4ee7-b03c-0af5346286d7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.245321 Jul 18 13:17:46.180792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1991/4090] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:45 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:46.243327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-652442b2-d174-4b27-89cf-72a63836af58 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201183107", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": -1, "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:46.263925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-652442b2-d174-4b27-89cf-72a63836af58 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Flavor -1 could not be found. Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-652442b2-d174-4b27-89cf-72a63836af58 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 205 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201183107", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": -1, "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: exception: Flavor -1 could not be found. Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-201183107', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': -1, 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:46.268935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-652442b2-d174-4b27-89cf-72a63836af58 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:46.273641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-652442b2-d174-4b27-89cf-72a63836af58 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032896 Jul 18 13:17:46.277691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2100/4091] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:17:46.285931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:46.288036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:46.297574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.298568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.302858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.303472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.322370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:46.327531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:46.355986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.356631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.357444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.358187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.551629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:46.560546 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23e471eb-b3b4-428c-944a-16f780f03291 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.281414 Jul 18 13:17:46.562094 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1992/4092] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:46.579472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:46.580958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:46.594739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.595974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.598054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.598947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.873357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:46.890677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:46.892470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:46.899420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbd170ba-bbbf-499a-b55b-bd665e1b2c1a tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2748 microversion: 2.32 time: 0.332901 Jul 18 13:17:46.913422 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1993/4093] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:46 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2748 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:46.920079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:46.920719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:46.931640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.932191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.933083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:46.933631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:46.985352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:47.007387 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c295341-2570-4f29-aec7-49f957a49e0e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1515 microversion: 2.1 time: 0.700996 Jul 18 13:17:47.008363 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2101/4094] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:46 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1515 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:47.023072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:47.024222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:47.042576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.043860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.048674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.050569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.212904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:47.221887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a0b94d9-1d0f-4643-885b-049aaa3345ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.319545 Jul 18 13:17:47.222523 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1994/4095] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:47.333346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-902fd0ea-012e-43df-b5f2-21775f157473 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202604221", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-902fd0ea-012e-43df-b5f2-21775f157473 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 173 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202604221", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1202604221', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi -1 Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:17:47.337159 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 13:17:47.341419 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:47.343623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-902fd0ea-012e-43df-b5f2-21775f157473 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:47.346855 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-902fd0ea-012e-43df-b5f2-21775f157473 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019428 Jul 18 13:17:47.356148 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1995/4096] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:47 2022] POST /compute/v2.1/servers => generated 145 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:47.367452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:47.368248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:47.382257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.382988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.383973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.400166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.675170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:47.730417 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e73eaed-a871-48e7-88ad-f40707c0a071 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 0.714164 Jul 18 13:17:47.750990 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2102/4097] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:47 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:47.767831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-00193c47-ef9e-4fdd-9315-397eeb7b8cd2 req-ab7653f3-f420-44c9-ad01-0c35007210a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1732b2-28cc-4f34-b80d-ec100b8f7ab3", "name": "network-vif-plugged", "status": "completed", "tag": "7b4721f5-4acf-4d4d-a614-bee4cac404bc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:47.782435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:47.807301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dcc54758-e682-484e-987e-00b84b8d2e4a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.446198 Jul 18 13:17:47.809767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-00193c47-ef9e-4fdd-9315-397eeb7b8cd2 req-ab7653f3-f420-44c9-ad01-0c35007210a1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.813772 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1996/4098] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:47 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:47.815571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-00193c47-ef9e-4fdd-9315-397eeb7b8cd2 req-ab7653f3-f420-44c9-ad01-0c35007210a1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.838435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:47.839965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:47.851007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.852594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.854274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.855368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.863120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-00193c47-ef9e-4fdd-9315-397eeb7b8cd2 req-ab7653f3-f420-44c9-ad01-0c35007210a1 service nova] Creating event network-vif-plugged:7b4721f5-4acf-4d4d-a614-bee4cac404bc for instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 on n-h2-850003-3 Jul 18 13:17:47.876090 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-00193c47-ef9e-4fdd-9315-397eeb7b8cd2 req-ab7653f3-f420-44c9-ad01-0c35007210a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122117 Jul 18 13:17:47.879774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2103/4099] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:47.935687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:47.945044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:47.961521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.962107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:47.965193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:47.965614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:48.243169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:48.256593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a7676f69-32ae-445c-bf3f-0c67383ea0da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.424549 Jul 18 13:17:48.257927 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1997/4100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:47 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:48.266659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:48.267568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:48.313067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:48.317226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:48.335995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:48.340345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:48.427313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:48.779852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:48.806572 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c279655-f893-425d-9a4c-0b9761146833 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.547208 Jul 18 13:17:48.807204 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1998/4101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:48 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:48.819357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de7b81d1-6049-47d9-8bcf-5e6e689f673c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-864962284", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:48.828075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-de7b81d1-6049-47d9-8bcf-5e6e689f673c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de7b81d1-6049-47d9-8bcf-5e6e689f673c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 215 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-864962284", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-864962284', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:48.829736 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 13:17:48.836115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:48.842741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de7b81d1-6049-47d9-8bcf-5e6e689f673c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:48.842741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de7b81d1-6049-47d9-8bcf-5e6e689f673c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030251 Jul 18 13:17:48.842741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 1999/4102] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:48 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:48.866841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:48.867819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:48.902898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:48.904155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:48.908062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:48.914646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.327335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:49.356344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-527df92e-37f1-4ba1-92c0-9cad41f52ada tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1522 microversion: 2.1 time: 0.511320 Jul 18 13:17:49.357547 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2000/4103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:48 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:49.369792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:49.376193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:49.398344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.398826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.399626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.400084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.444718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:49.468259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:49.475949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:49.478878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-865b5e5b-8618-43e9-9b1b-220bb9b8a1f8 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2702 microversion: 2.32 time: 1.560426 Jul 18 13:17:49.487334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2104/4104] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:47 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2702 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:49.806193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:49.824101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:49.825011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:49.825127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b928514-35d7-4b1a-ac75-d192f9ce2bf2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.463967 Jul 18 13:17:49.827111 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2001/4105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:49 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:49.856942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.857991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.859960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.860727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.866343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:49.867512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:49.891751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.906917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.912254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:49.914969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:49.942823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:17:50.352198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:50.378924 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ee4395a-b308-47f6-bff1-9276019d0952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.518611 Jul 18 13:17:50.381006 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2002/4106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:49 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:50.412196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-96556a81-9b59-4c68-9b9d-4f77bf469b1c req-29dad1f3-fce3-47a1-b5ed-3748f5dee2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a72f842-29be-45f9-814f-de2fe85afc29", "name": "network-vif-plugged", "status": "completed", "tag": "034db7d6-b05a-4515-b940-996313b507a6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:50.422243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-96556a81-9b59-4c68-9b9d-4f77bf469b1c req-29dad1f3-fce3-47a1-b5ed-3748f5dee2ad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:50.422919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-96556a81-9b59-4c68-9b9d-4f77bf469b1c req-29dad1f3-fce3-47a1-b5ed-3748f5dee2ad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:50.458608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-96556a81-9b59-4c68-9b9d-4f77bf469b1c req-29dad1f3-fce3-47a1-b5ed-3748f5dee2ad service nova] Creating event network-vif-plugged:034db7d6-b05a-4515-b940-996313b507a6 for instance 0a72f842-29be-45f9-814f-de2fe85afc29 on n-h1-850003-3 Jul 18 13:17:50.473213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:50.486056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-96556a81-9b59-4c68-9b9d-4f77bf469b1c req-29dad1f3-fce3-47a1-b5ed-3748f5dee2ad service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079155 Jul 18 13:17:50.495677 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2003/4107] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:50.501503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64fe5459-4c96-4aae-a904-29cabb7f4729 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.681288 Jul 18 13:17:50.506860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:50.507812 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2105/4108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:49 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:17:50.508796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:50.517248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:50.518638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:50.519781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:50.520971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:50.527750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:50.528782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:50.542500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:50.543484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:50.547735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:50.548771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:50.945310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:50.965656 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-90020261-423b-4f26-a6a4-eda59bc1ed67 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1507 microversion: 2.1 time: 0.467982 Jul 18 13:17:50.967311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2004/4109] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:50 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:50.977575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1517769339", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-key-774044399", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:51.090944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] validate_networks() for [('7ffbcecd-c8c6-4cb8-b149-ec03a1516a54', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:51.624413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:51.655640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:51.668078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:51.677450 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b140d411-a705-400e-82a5-383c4a3d3ab6 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2702 microversion: 2.32 time: 1.153373 Jul 18 13:17:51.679498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2106/4110] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:50 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2702 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:17:51.708156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:51.709931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:51.740266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:51.741353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:51.743000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:51.743955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:52.703946 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Invalid key_name provided. Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 246 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1517769339", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-key-774044399", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid key_name provided. Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1517769339', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'key_name': 'tempest-key-774044399', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-774044399 not found for user 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:52.713814 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 18 13:17:52.720356 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:17:52.733712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid key_name provided. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:52.740992 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbd6f749-c21c-4432-bf78-a0f3c8d3039e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.769508 Jul 18 13:17:52.748029 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2005/4111] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:50 2022] POST /compute/v2.1/servers => generated 70 bytes in 1780 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 13:17:52.780039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-560d52b6-8e55-47a6-bbed-61e6211e8cf5 req-0cff7898-17e6-4676-8f8a-17072e6eec94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-deleted", "tag": "1971fd4f-36e3-45e1-9819-2469791698ad"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:52.814137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-560d52b6-8e55-47a6-bbed-61e6211e8cf5 req-0cff7898-17e6-4676-8f8a-17072e6eec94 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:52.826983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-560d52b6-8e55-47a6-bbed-61e6211e8cf5 req-0cff7898-17e6-4676-8f8a-17072e6eec94 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:52.858546 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-560d52b6-8e55-47a6-bbed-61e6211e8cf5 req-0cff7898-17e6-4676-8f8a-17072e6eec94 service nova] Creating event network-vif-deleted:1971fd4f-36e3-45e1-9819-2469791698ad for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:52.885321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:52.897854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-997c4b63-fff0-4e8c-b4b9-9a9cc3553189 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 200 len: 1507 microversion: 2.1 time: 1.215204 Jul 18 13:17:52.902407 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-560d52b6-8e55-47a6-bbed-61e6211e8cf5 req-0cff7898-17e6-4676-8f8a-17072e6eec94 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148521 Jul 18 13:17:52.915803 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2006/4112] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:52.916986 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2107/4113] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:51 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 1507 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:52.945896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:52.959253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:52.962813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:52.965256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:53.002884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:53.007513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:53.008272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:53.008678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:53.012896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:53.019001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:53.022853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:53.023743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:53.930471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:53.940451 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8593dd5-0a28-45d3-8b81-b4a8724bbeb3 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 1.018069 Jul 18 13:17:53.961779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2007/4114] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:52 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:53.972931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:53.985219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:54.018934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.019785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:54.027025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.029660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:54.056680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:54.107215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:54.116166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:54.126519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de41f025-7551-4b41-a266-2893452a693e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2414 microversion: 2.32 time: 1.203985 Jul 18 13:17:54.144342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2108/4115] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:52 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2414 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:54.172254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:54.172774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:54.212188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.212651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:54.213456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.213905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:54.315823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:17:54.592115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23d1c81d-ad7d-4209-8944-03a2a8580017 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 204 len: 0 microversion: 2.1 time: 0.438503 Jul 18 13:17:54.592688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2109/4116] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:17:54 2022] DELETE /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:17:54.813519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:54.848044 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1857603b-588a-4d4b-a69d-515556e01c97 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.881550 Jul 18 13:17:54.855513 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2008/4117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:53 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:54.886699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:54.889761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:54.921484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.923154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:54.927569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:54.929833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:55.279439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1354695295", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "75192150-29d8-4da7-96e7-f5336182df0a"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:55.515530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] validate_networks() for [('75192150-29d8-4da7-96e7-f5336182df0a', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:55.818243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:55.881568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70f2ecd5-71e2-47f0-89c6-af6703eee0bf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.008251 Jul 18 13:17:55.899833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2009/4118] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:55.940561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2087001570", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "f4333680-b8f0-40bc-870c-17b737d1c961"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:56.155014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] validate_networks() for [('f4333680-b8f0-40bc-870c-17b737d1c961', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:17:56.812935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:56.813480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:56.813819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:56.814906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:56.815226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:56.843680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:56.844384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:56.846610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:56.850400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:56.888492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Getting quotas for project 0ffe7bf9be6c4ad6a3632134a2b3d3fa. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:56.900506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Getting quotas for user 497839e56b0f461785b0991f1d5578f8 and project 0ffe7bf9be6c4ad6a3632134a2b3d3fa. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:56.932030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:17:56.936987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:17:57.055400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05d89164-cb97-4637-a625-0f3e9f3438a6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.456805 Jul 18 13:17:57.056207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2110/4119] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:17:57.075937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:57.076755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:57.093876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:57.096998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:57.098690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:57.101185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:57.567502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:57.608464 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ca86736-6e49-4104-bb41-c1cd50c70d77 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.545290 Jul 18 13:17:57.615738 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2111/4120] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:57 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:17:57.632459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:57.633710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:57.654755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:57.655689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:57.659422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:57.663495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:58.552693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:58.609397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:58.619289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:17:58.621693 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-165c6694-d998-4bd6-adcc-0e655b052efe tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2322 microversion: 2.32 time: 1.003697 Jul 18 13:17:58.626659 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2112/4121] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:17:57 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2322 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:17:58.651471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d62bf4e5-86cb-429a-93bc-510adaef1363 req-ad68cd15-7c0f-44c1-9d93-12586942dcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-deleted", "tag": "7f349224-d4c9-4f4a-a01b-62ec8d49e2e1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:58.673497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d62bf4e5-86cb-429a-93bc-510adaef1363 req-ad68cd15-7c0f-44c1-9d93-12586942dcec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:58.683106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d62bf4e5-86cb-429a-93bc-510adaef1363 req-ad68cd15-7c0f-44c1-9d93-12586942dcec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:58.732254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d62bf4e5-86cb-429a-93bc-510adaef1363 req-ad68cd15-7c0f-44c1-9d93-12586942dcec service nova] Creating event network-vif-deleted:7f349224-d4c9-4f4a-a01b-62ec8d49e2e1 for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:17:58.770033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d62bf4e5-86cb-429a-93bc-510adaef1363 req-ad68cd15-7c0f-44c1-9d93-12586942dcec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140887 Jul 18 13:17:58.770033 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2113/4122] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:17:58.790499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2017671534", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:17:59.308386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:17:59.309152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:17:59.310613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:17:59.312056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:17:59.313808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:17:59.433935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:59.435366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:59.438711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:59.441682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:59.517163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.security_group_api [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Neutron security group does_not_exist not found {{(pid=131366) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 18 13:17:59.518186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 258 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2017671534", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2017671534', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 18 13:17:59.534091 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 18 13:17:59.541702 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:17:59.555329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:17:59.561013 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f645ba2-c72b-419e-a45d-e695ddfcacb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.767908 Jul 18 13:17:59.574293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2114/4123] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 803 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:17:59.581036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:17:59.615400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for user 2ab4a8758df44a8d97c3add30443cc58 and project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:17:59.637965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:17:59.641806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:17:59.694754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:17:59.714162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:17:59.725528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:59.727824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:59.733446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:17:59.738981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:17:59.937468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9e58fd1-1270-447a-ad15-801e55fbe183 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.034000 Jul 18 13:17:59.939994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2010/4124] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:18:00.239948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:00.262611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ec676d8-8753-48a8-a4c9-d25a18891cbb tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1277 microversion: 2.1 time: 0.682574 Jul 18 13:18:00.272276 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2115/4125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:17:59 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1277 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:00.302518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:00.303969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:00.337195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.344361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:00.345296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.346326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:00.558321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:00.558893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:00.596915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.597492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:00.599455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.600022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:00.637454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:18:00.821365 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a0025d2-bbd5-4afc-a80b-5f24262bd864 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 204 len: 0 microversion: 2.42 time: 0.879736 Jul 18 13:18:00.823462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2011/4126] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:17:59 2022] DELETE /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:18:00.830994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:00.832422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:00.841722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.842662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:00.843766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:00.844508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.238518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.250841 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c470e7ae-1fd9-40e6-a5d6-0d08b77f194e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.425690 Jul 18 13:18:01.266460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2012/4127] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:00 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:01.275083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:01.281632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.289120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:01.301744 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4d58663-b45e-499a-a57f-8f4bf8c6e265 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 1.024925 Jul 18 13:18:01.311018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:01.316560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2116/4128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:00 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:01.320400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.321546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:01.323102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.332863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c117f4bc-616a-4ecd-a30d-4393bacfb671 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:01.336900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c117f4bc-616a-4ecd-a30d-4393bacfb671 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:01.551708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.584743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.593501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.599949 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-28635ff0-7d7f-44fb-a903-0e36a5cd6ab0 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 2143 microversion: 2.32 time: 0.331203 Jul 18 13:18:01.615295 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2013/4129] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:01 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 2143 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:01.620761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c117f4bc-616a-4ecd-a30d-4393bacfb671 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:01.633616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c117f4bc-616a-4ecd-a30d-4393bacfb671 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1218 microversion: 2.1 time: 0.315424 Jul 18 13:18:01.658125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2117/4130] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:01 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1218 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:01.670002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:01.675869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:01.693598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:01.694349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.695313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:01.695986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.700730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-deleted", "tag": "5783181c-6d5c-4774-acf0-5a3a9820e65a"}, {"server_uuid": "df6b6d79-5473-4855-b99c-40e1f2d6882a", "name": "network-vif-deleted", "tag": "a5655267-e11d-4f82-8970-49c5b34333be"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:01.749336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:01.749794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:01.855171 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] Creating event network-vif-deleted:5783181c-6d5c-4774-acf0-5a3a9820e65a for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:18:01.865054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] Creating event network-vif-deleted:a5655267-e11d-4f82-8970-49c5b34333be for instance df6b6d79-5473-4855-b99c-40e1f2d6882a on n-h1-850003-3 Jul 18 13:18:01.911558 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ff3dfb39-fe80-4ef8-ac8d-391a21aef7a6 req-77e23fd4-8e69-44d2-958a-3b6622d012ee service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.251890 Jul 18 13:18:01.917298 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2118/4131] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:01.973209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ba3fe817-13c8-45e2-b795-eda219c9d5ab req-f65c9bbf-711b-4767-8e7f-5b695a2ae7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1732b2-28cc-4f34-b80d-ec100b8f7ab3", "name": "network-vif-deleted", "tag": "7b4721f5-4acf-4d4d-a614-bee4cac404bc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:02.040391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ba3fe817-13c8-45e2-b795-eda219c9d5ab req-f65c9bbf-711b-4767-8e7f-5b695a2ae7b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.040872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ba3fe817-13c8-45e2-b795-eda219c9d5ab req-f65c9bbf-711b-4767-8e7f-5b695a2ae7b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.163617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ba3fe817-13c8-45e2-b795-eda219c9d5ab req-f65c9bbf-711b-4767-8e7f-5b695a2ae7b3 service nova] Creating event network-vif-deleted:7b4721f5-4acf-4d4d-a614-bee4cac404bc for instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 on n-h2-850003-3 Jul 18 13:18:02.203966 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ba3fe817-13c8-45e2-b795-eda219c9d5ab req-f65c9bbf-711b-4767-8e7f-5b695a2ae7b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275074 Jul 18 13:18:02.205533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2119/4132] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:02.230037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:02.243496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:02.279069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.279551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.321591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.322317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.587530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:02.601827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:02.607420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:02.611285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32ef6685-1c9c-44b8-8992-5c436d94b9af tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2959 microversion: 2.42 time: 0.974997 Jul 18 13:18:02.612619 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2014/4133] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:01 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2959 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:02.619158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:02.620142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:02.630459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.632913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.636625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.638766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.842647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:02.857339 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c26fc2e-eefe-492c-9277-ad1c8bd8ef8f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1275 microversion: 2.1 time: 0.240838 Jul 18 13:18:02.859347 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2015/4134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:02 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:02.877037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:02.878081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:02.900391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.901171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:02.906021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:02.907648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.268618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.285069 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90b266a9-f704-4bac-9b29-8565c399c941 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.070292 Jul 18 13:18:03.303374 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2120/4135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:02 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:03.319329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:03.320616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:03.342988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.346866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.347970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.348666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.562594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.583602 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d7e8cc5-bd72-47a0-bf75-82b0ad578d62 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.720476 Jul 18 13:18:03.602322 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2016/4136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:02 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:03.629355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:03.638172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:03.652204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.680026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.689783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.695026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.696976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.699909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59a48b2c-236f-417d-975f-09bf632f3722 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.393893 Jul 18 13:18:03.700047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.700395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.702392 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2121/4137] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:03 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:03.708792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:03.709606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 3f3d6fac-4e05-437a-b0ff-c201b2839163] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:03.716294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/3f3d6fac-4e05-437a-b0ff-c201b2839163 HTTP/1.1 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3f3d6fac-4e05-437a-b0ff-c201b2839163'} Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:03.718635 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. Jul 18 13:18:03.722807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:03.724759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 3f3d6fac-4e05-437a-b0ff-c201b2839163 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:03.725923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02c22007-9fea-432e-bccd-47dead9f2769 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3f3d6fac-4e05-437a-b0ff-c201b2839163" status: 404 len: 111 microversion: 2.1 time: 0.022235 Jul 18 13:18:03.731807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2122/4138] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:18:03 2022] DELETE /compute/v2.1/servers/3f3d6fac-4e05-437a-b0ff-c201b2839163 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:03.745177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:03.746879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:03.768571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.773972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.774553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:03.778342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:03.779008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:03.959323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:03.978165 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a51fb9cc-a0a1-4c46-ad13-cd73a516898f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1288 microversion: 2.1 time: 0.376288 Jul 18 13:18:03.998374 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2017/4139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:03 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1288 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:04.005202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:04.005826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:04.022522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:04.023191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:04.025215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:04.027852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:04.760975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:04.777860 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f16fbf39-f01a-42e8-8caa-8ac81d287f3c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.778024 Jul 18 13:18:04.779336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2018/4140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:03 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:04.785228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:04.786246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:04.794975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:04.796198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:04.797399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:04.798066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:04.953714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:04.976409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:04.978044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:04.982117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71253183-c98b-478d-8919-6ffe697fbe3c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2959 microversion: 2.42 time: 1.248864 Jul 18 13:18:04.984967 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2123/4141] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:03 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2959 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:04.993670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:04.994730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:05.019364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.022478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.023763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.026370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.308284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.333008 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6446d8ea-973f-41e8-af2f-50d13815a27f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.345531 Jul 18 13:18:05.333635 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2124/4142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:04 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:05.349444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:05.350079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:05.381051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.393240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c77d9b8-1fdf-4cd4-b21c-63de3bb5b43f tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.611499 Jul 18 13:18:05.402309 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2019/4143] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:04 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:05.410402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.411246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.413080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.413851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:05.414979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.415906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:05.429133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.435871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.437069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.455151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.612997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.628099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.640468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.641790 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71d9ab84-3bcd-48c3-a6fb-04042f0c4a1f tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.307119 Jul 18 13:18:05.663347 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2125/4144] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:05 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:05.668042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:05.669009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:05.697841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.706589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.707745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:05.708383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:05.714401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:05.895546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:05.904617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-105dc1db-932d-450d-ab73-f94603a37a02 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1276 microversion: 2.1 time: 0.250914 Jul 18 13:18:05.913177 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2126/4145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:05 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:06.007743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:06.008736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:06.021342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:06.021809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:06.036982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:06.036982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:06.668198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:06.690652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:06.697218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:06.699078 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f01e6049-b79c-4ed5-9242-8fddf3dcad1e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2959 microversion: 2.42 time: 0.696447 Jul 18 13:18:06.699863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2127/4146] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:06 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2959 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:06.727838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ed3663ce-84db-4089-8997-100e6388513b req-ec1a4b1e-05ed-4e42-8693-e7e102c533b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8f81c-8945-454a-ab7a-bad6853711d2", "tag": "ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:06.750695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ed3663ce-84db-4089-8997-100e6388513b req-ec1a4b1e-05ed-4e42-8693-e7e102c533b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:06.751442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ed3663ce-84db-4089-8997-100e6388513b req-ec1a4b1e-05ed-4e42-8693-e7e102c533b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:06.782288 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ed3663ce-84db-4089-8997-100e6388513b req-ec1a4b1e-05ed-4e42-8693-e7e102c533b8 service nova] Creating event network-changed:ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2 for instance 4da8f81c-8945-454a-ab7a-bad6853711d2 on n-h1-850003-3 Jul 18 13:18:06.791723 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ed3663ce-84db-4089-8997-100e6388513b req-ec1a4b1e-05ed-4e42-8693-e7e102c533b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084119 Jul 18 13:18:06.795386 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2128/4147] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:06.802436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:06.812763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:06.837972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:06.838838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:06.839899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:06.840567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:06.894635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:07.492633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:07.527329 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e5cc980-8538-49ba-a74c-a75d9586acdd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.729889 Jul 18 13:18:07.528018 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2129/4148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:06 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:07.533637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:07.558795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:07.565546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:07.575713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:07.576461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:07.577638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:07.578289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:07.836244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:07.849890 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a5d5718-acfd-43a4-ac23-1feec87f8f72 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 2.446172 Jul 18 13:18:07.867492 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2020/4149] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:05 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:07.898964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:07.900042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:07.955566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:07.957641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:07.969671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:07.969883 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b3d84e19-ab82-4280-922a-03733bfc3603 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.440530 Jul 18 13:18:07.975258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2130/4150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:07 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:07.978431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:07.982649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:07.987425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:07.991215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:08.007675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.008380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.009351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.014974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.360720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:08.363412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:08.372249 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-958b2604-0b5b-42b8-8b3b-096f2e6e3081 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 0.395009 Jul 18 13:18:08.388574 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2131/4151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:07 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:08.410754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-35349199-d9a2-4f89-9db9-58c6b690b156 req-dd48ce81-742b-43a1-9f30-08846da5b726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "a55f2463-da87-436c-bdce-5622c0a24659"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:08.415218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:08.417758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:08.419905 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c24d2c5-28fb-43e6-8e18-b410cdf67e2c tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.550562 Jul 18 13:18:08.425338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2021/4152] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:07 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:08.457161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:08.458281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:08.469332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-35349199-d9a2-4f89-9db9-58c6b690b156 req-dd48ce81-742b-43a1-9f30-08846da5b726 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.470714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-35349199-d9a2-4f89-9db9-58c6b690b156 req-dd48ce81-742b-43a1-9f30-08846da5b726 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.492705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.493624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.495320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.502701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.509679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-35349199-d9a2-4f89-9db9-58c6b690b156 req-dd48ce81-742b-43a1-9f30-08846da5b726 service nova] Creating event network-vif-unplugged:a55f2463-da87-436c-bdce-5622c0a24659 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:08.518958 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-35349199-d9a2-4f89-9db9-58c6b690b156 req-dd48ce81-742b-43a1-9f30-08846da5b726 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128834 Jul 18 13:18:08.520936 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2132/4153] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:08.528702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:08.531084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 13:18:08.531779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 9223372036854775808 could not be found. Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9223372036854775808'} Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:08.536729 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:08.540772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:08.540772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:08.540772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:08.540772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 18 13:18:08.540772 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:08.544356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:08.546400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f6effa0-5a2b-474c-b413-089efe1245a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023799 Jul 18 13:18:08.549122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2133/4154] 10.222.0.88 () {58 vars in 1187 bytes} [Mon Jul 18 13:18:08 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:18:08.562777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:08.573262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:08.603316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.603932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:08.605070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:08.606629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.112784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:09.122016 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8059db2e-3f76-423d-8322-3769daa088f7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.569219 Jul 18 13:18:09.126240 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2134/4155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:08 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:09.146039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:09.146725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:09.155746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:09.179039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.181200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.185031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.185747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.201832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:09.206279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:09.207630 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-adcfc819-6114-46c9-857f-12eca5044726 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2938 microversion: 2.42 time: 0.772665 Jul 18 13:18:09.221199 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2022/4156] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:08 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2938 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:09.255834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:09.256474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:09.277888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:09.285779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.286272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.288125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.288582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.501914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:09.648003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:09.666519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:09.668412 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ddd0a5a-5864-4ee0-abfb-d8f1d0a319a2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.539829 Jul 18 13:18:09.671493 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2135/4157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:09 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:09.677545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:09.678583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:09.698396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.701384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:09.703278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:09.705835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.069442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:10.082435 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75296479-1122-4116-85ba-9895c9fc5bc7 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.846492 Jul 18 13:18:10.086975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2023/4158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:09 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:10.105988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:10.107327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:10.117992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.121987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.123220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.126014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.307769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:10.328052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:10.333583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:10.338019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf3ef7aa-f113-4118-a2bd-6d996b1dd38b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.249673 Jul 18 13:18:10.341678 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2024/4159] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:10 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:10.349206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:10.367894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:10.371258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:10.384812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5b2630b-32cb-4b95-bde4-1e60f38ac085 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 0.711809 Jul 18 13:18:10.386787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.387820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.391480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.392420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.403095 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2136/4160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:09 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:10.415262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:10.416389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:10.435801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.436520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:10.438443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:10.440050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:11.370188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:11.381814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e6a4b3ff-130b-45eb-949b-4a2084a9cfea tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.038606 Jul 18 13:18:11.391731 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2025/4161] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:10 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:11.409396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:11.411176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:11.435833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:11.442996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:11.447881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:11.448792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:11.627087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:11.711412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:11.721327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bab00c08-b0db-4c51-b74e-22bb35cd214f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 1.316648 Jul 18 13:18:11.725796 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2137/4162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:10 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:11.741823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "89a431b7-da19-47fb-9aae-199f2600baf7"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "e55910a4-60fb-4c9c-9429-97cd52f7ff56"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "2658726f-8f22-4a68-949c-9c30639612d1"}, {"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "c9972e1f-8e69-4009-8b8b-ac6965438f43"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:11.771692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:11.772317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:11.804518 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Creating event network-vif-unplugged:89a431b7-da19-47fb-9aae-199f2600baf7 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:11.805405 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Creating event network-vif-unplugged:e55910a4-60fb-4c9c-9429-97cd52f7ff56 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:11.806120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Creating event network-vif-unplugged:2658726f-8f22-4a68-949c-9c30639612d1 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:11.806952 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] Creating event network-vif-unplugged:c9972e1f-8e69-4009-8b8b-ac6965438f43 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:11.829678 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-056065de-17c4-49ac-8ec7-aa0aae220300 req-a9bddd0b-ca0f-4b45-aaaa-b78816084f88 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.094832 Jul 18 13:18:11.834121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2138/4163] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:11.855428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:11.880979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:11.901577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:11.905414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:11.906931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:11.909215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:12.348419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.375313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.380529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.386500 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c16e973-d5b1-4a1e-b6b8-99d2b0a68c36 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2938 microversion: 2.42 time: 0.992951 Jul 18 13:18:12.396694 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2026/4164] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:11 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2938 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:12.436088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:12.437188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:12.464349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:12.465029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:12.466763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:12.468595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:12.756067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.778853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.785172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:12.787953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24a381e7-c5f8-4d67-a350-00b1ce1c9e29 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.383840 Jul 18 13:18:12.791818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2027/4165] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:12 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:12.803564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:12.804623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:12.827916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:12.828930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:12.830278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:12.832266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:12.990230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:13.001577 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dd64119-3e9d-4a06-9225-1b7b42ff94ba tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 1.163871 Jul 18 13:18:13.015746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2139/4166] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:11 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:13.036716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:13.038944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Failed to fetch instance by id -1 {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 13:18:13.045346 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance -1 could not be found. Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance -1 could not be found. Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '-1'} Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:13.049000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:13.053616 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:13.053616 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:13.053616 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 18 13:18:13.053616 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:13.063088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:13.065944 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-277dbff8-8eb9-4c0a-a57f-02f6fe3c10d9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.047498 Jul 18 13:18:13.071069 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2140/4167] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:18:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:18:13.092432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a48177bb-10b5-4761-a610-2e5ca9e10659 req-b21d6801-4cf4-4dde-b673-3a339eed4681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be825e3-37fc-46d1-8a0a-82b51f67e479", "tag": "346b19a4-3c63-4918-bb8f-971fc6c07bec"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:13.136084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a48177bb-10b5-4761-a610-2e5ca9e10659 req-b21d6801-4cf4-4dde-b673-3a339eed4681 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:13.143530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a48177bb-10b5-4761-a610-2e5ca9e10659 req-b21d6801-4cf4-4dde-b673-3a339eed4681 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:13.189732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a48177bb-10b5-4761-a610-2e5ca9e10659 req-b21d6801-4cf4-4dde-b673-3a339eed4681 service nova] Creating event network-changed:346b19a4-3c63-4918-bb8f-971fc6c07bec for instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 on n-h2-850003-3 Jul 18 13:18:13.200474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a48177bb-10b5-4761-a610-2e5ca9e10659 req-b21d6801-4cf4-4dde-b673-3a339eed4681 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124987 Jul 18 13:18:13.203033 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2141/4168] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:13.217944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:13.222692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:13.244984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:13.250959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:13.252605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:13.257151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:13.889558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:13.903189 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9000887-7101-4b0f-a521-fdbd8a6042cb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.695264 Jul 18 13:18:13.904431 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2142/4169] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:13 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:13.944346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:13.945928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:13.966593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:13.972951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:13.973800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:13.975910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:13.978832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:13.983667 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7b34536-62ad-44d6-947a-ea40ac620760 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 1.190195 Jul 18 13:18:13.984843 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2028/4170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:12 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:13.993980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:13.995749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:14.010358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:14.012482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:14.015897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:14.018334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:15.255177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.319168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.332753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.339511 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb2678c5-955c-476b-8e6f-3f1ca3cac9a9 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2917 microversion: 2.42 time: 1.350093 Jul 18 13:18:15.346014 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2029/4171] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:13 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2917 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:15.358958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:15.359928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:15.369355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:15.370131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:15.379172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:15.380012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:15.592076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.621460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.631096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:15.634486 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c57b6be-eea2-46bf-b375-29c0d661618e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.285486 Jul 18 13:18:15.654194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2030/4172] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:15 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:15.654450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e06bdca3-7b70-4c91-83e9-b4aefcf145d9 req-3a114849-1db2-4cb1-aee4-500c57283307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-unplugged", "status": "completed", "tag": "8791c0a2-8139-4af5-9ac2-a0f217024850"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:15.689333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e06bdca3-7b70-4c91-83e9-b4aefcf145d9 req-3a114849-1db2-4cb1-aee4-500c57283307 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:15.689862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e06bdca3-7b70-4c91-83e9-b4aefcf145d9 req-3a114849-1db2-4cb1-aee4-500c57283307 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:15.729783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e06bdca3-7b70-4c91-83e9-b4aefcf145d9 req-3a114849-1db2-4cb1-aee4-500c57283307 service nova] Creating event network-vif-unplugged:8791c0a2-8139-4af5-9ac2-a0f217024850 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:15.762681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e06bdca3-7b70-4c91-83e9-b4aefcf145d9 req-3a114849-1db2-4cb1-aee4-500c57283307 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120118 Jul 18 13:18:15.763468 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2031/4173] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:15.791279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:15.792707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:15.839304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:15.840196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:15.848768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:15.849293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:16.452729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:16.484879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ae77b8e-04dd-4822-be94-b6cba2847ca6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 2.562768 Jul 18 13:18:16.488051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2143/4174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:13 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 2583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:16.501669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:16.503232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:16.522039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:16.527354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:16.534372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:16.535731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:16.564503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:16.588065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4fb8889-5b11-46cb-8be2-2ba00bab8218 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.822383 Jul 18 13:18:16.627408 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2032/4175] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:15 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:16.649543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:16.661492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:16.691447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:16.702585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:16.705275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:16.708340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:17.270255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:17.287945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60c7864b-edeb-4737-8572-3cb3285460f5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.797941 Jul 18 13:18:17.289607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2144/4176] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:16 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:17.301617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:17.305676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:17.322911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:17.327778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:17.332847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:17.333804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:17.591294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:17.600398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f51733d1-7724-4f3d-9a4d-2b489e84e1a0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 0.971371 Jul 18 13:18:17.608089 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2033/4177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:16 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:17.618706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:17.619613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:17.644826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:17.645548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:17.648967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:17.649435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.075336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.080808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:18.097290 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27509688-f14a-41e4-9679-e8f84598e3f8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.487621 Jul 18 13:18:18.103726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2034/4178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:17 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:18.133537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.146633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.159853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:18.160998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:18.185170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.186991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.189162 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8eb25ee5-bde2-40cc-af5c-109dfdd624a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2870 microversion: 2.42 time: 0.897714 Jul 18 13:18:18.189810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.191324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.192107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.198756 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2145/4179] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:17 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2870 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:18.204709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-be08a3ef-759b-4b02-9aae-12987e9e1aab req-6da05821-d2de-4d68-ab06-6b4b514cb13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-deleted", "tag": "c9972e1f-8e69-4009-8b8b-ac6965438f43"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:18.233897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-be08a3ef-759b-4b02-9aae-12987e9e1aab req-6da05821-d2de-4d68-ab06-6b4b514cb13a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.238580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-be08a3ef-759b-4b02-9aae-12987e9e1aab req-6da05821-d2de-4d68-ab06-6b4b514cb13a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.265390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-be08a3ef-759b-4b02-9aae-12987e9e1aab req-6da05821-d2de-4d68-ab06-6b4b514cb13a service nova] Creating event network-vif-deleted:c9972e1f-8e69-4009-8b8b-ac6965438f43 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:18.283791 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-be08a3ef-759b-4b02-9aae-12987e9e1aab req-6da05821-d2de-4d68-ab06-6b4b514cb13a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080923 Jul 18 13:18:18.286565 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2146/4180] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:18.313616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:18.323030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:18.357103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.358063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.361256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.361844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.605638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.640162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.647353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:18.651586 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a280581-1324-4430-9cb1-e6eb4350d08e tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.544031 Jul 18 13:18:18.652804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2035/4181] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:18 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:18.671557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1f98b504-5ee4-41c4-bfb2-334177e72051 req-3f9ddd59-8e03-41b5-8d1e-e1eed11c8148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8f81c-8945-454a-ab7a-bad6853711d2", "name": "network-vif-plugged", "status": "completed", "tag": "ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:18.726526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1f98b504-5ee4-41c4-bfb2-334177e72051 req-3f9ddd59-8e03-41b5-8d1e-e1eed11c8148 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.727059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1f98b504-5ee4-41c4-bfb2-334177e72051 req-3f9ddd59-8e03-41b5-8d1e-e1eed11c8148 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.763695 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1f98b504-5ee4-41c4-bfb2-334177e72051 req-3f9ddd59-8e03-41b5-8d1e-e1eed11c8148 service nova] Creating event network-vif-plugged:ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2 for instance 4da8f81c-8945-454a-ab7a-bad6853711d2 on n-h1-850003-3 Jul 18 13:18:18.779902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1f98b504-5ee4-41c4-bfb2-334177e72051 req-3f9ddd59-8e03-41b5-8d1e-e1eed11c8148 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125663 Jul 18 13:18:18.780881 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2036/4182] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:18.789822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:18.794749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 97a44cda-602c-4f56-b41c-b502dc3acff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:18.827750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/97a44cda-602c-4f56-b41c-b502dc3acff9/action HTTP/1.1 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 19 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: {"forceDelete": {}} Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '97a44cda-602c-4f56-b41c-b502dc3acff9', 'body': {'forceDelete': {}}} Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:18.851954 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 97a44cda-602c-4f56-b41c-b502dc3acff9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:18.856053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9d6978e-d546-44c7-a1a7-869e6a3cb82b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/97a44cda-602c-4f56-b41c-b502dc3acff9/action" status: 404 len: 111 microversion: 2.1 time: 0.073311 Jul 18 13:18:18.863016 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2037/4183] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:18 2022] POST /compute/v2.1/servers/97a44cda-602c-4f56-b41c-b502dc3acff9/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:18.874208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:18.874856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:18.895881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.896351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:18.900922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:18.901694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:19.140946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:19.150586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a2cc0b4-d8c4-4a30-8137-89c62541f0f6 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.862531 Jul 18 13:18:19.165518 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2147/4184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:18 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:19.177653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:19.190202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:19.207252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:19.207722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:19.210982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:19.211547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:19.272265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:19.978977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:19.992923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b62e418f-d7f5-4ed5-8302-f90e1bf169bc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 0.829907 Jul 18 13:18:19.999472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2148/4185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:19 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:20.007145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:20.008863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:20.026952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:20.029298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:20.032486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:20.034869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:20.906449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:20.923990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-332a23c2-56b6-4b62-b4d6-92ace05cc46a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 2.059578 Jul 18 13:18:20.925184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2038/4186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:18 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:20.932322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:20.933199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:20.958343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:20.959183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:20.963314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:20.964014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.035972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.045830 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-54ce4c13-4a15-483d-9026-fcc796cc87da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.044606 Jul 18 13:18:21.054611 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2149/4187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:19 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:21.061729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:21.065706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:21.077825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.079820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.082903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.087125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.241581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.255824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.264244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.272532 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-362ec1eb-c4cc-46bd-abd8-224b56d403de tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.216222 Jul 18 13:18:21.273432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2150/4188] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:21 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:21.307981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:21.308351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:21.340357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.340838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.341689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.342137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.760440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.769500 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0320033-93d2-45d7-ac64-ee1bb32b76c2 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1317 microversion: 2.1 time: 0.494267 Jul 18 13:18:21.783171 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2151/4189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:21 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:21.792501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-09247533-ada7-4e61-88dc-1a37cfff3a04 req-8a0a58e5-dad8-4d4c-8882-4b51908a585b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be825e3-37fc-46d1-8a0a-82b51f67e479", "name": "network-vif-plugged", "status": "completed", "tag": "346b19a4-3c63-4918-bb8f-971fc6c07bec"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:21.818381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-09247533-ada7-4e61-88dc-1a37cfff3a04 req-8a0a58e5-dad8-4d4c-8882-4b51908a585b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.823368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-09247533-ada7-4e61-88dc-1a37cfff3a04 req-8a0a58e5-dad8-4d4c-8882-4b51908a585b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.871614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-09247533-ada7-4e61-88dc-1a37cfff3a04 req-8a0a58e5-dad8-4d4c-8882-4b51908a585b service nova] Creating event network-vif-plugged:346b19a4-3c63-4918-bb8f-971fc6c07bec for instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 on n-h2-850003-3 Jul 18 13:18:21.874692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:21.889091 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-09247533-ada7-4e61-88dc-1a37cfff3a04 req-8a0a58e5-dad8-4d4c-8882-4b51908a585b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103928 Jul 18 13:18:21.894690 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2152/4190] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:21.909321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:21.921387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:21.953285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.955729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.958393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:21.959433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:21.972066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:22.016281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:22.018866 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42a273c4-ccee-4cd8-9f5f-1b96f720b8eb tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2710 microversion: 2.42 time: 1.092068 Jul 18 13:18:22.038971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2039/4191] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:20 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2710 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:22.059378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a6408a93-6518-4ba9-847c-d68c97174ffe req-499a90e4-75ad-49e9-9384-8f09a1298140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-deleted", "tag": "8791c0a2-8139-4af5-9ac2-a0f217024850"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:22.102133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6408a93-6518-4ba9-847c-d68c97174ffe req-499a90e4-75ad-49e9-9384-8f09a1298140 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.104851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6408a93-6518-4ba9-847c-d68c97174ffe req-499a90e4-75ad-49e9-9384-8f09a1298140 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.146407 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a6408a93-6518-4ba9-847c-d68c97174ffe req-499a90e4-75ad-49e9-9384-8f09a1298140 service nova] Creating event network-vif-deleted:8791c0a2-8139-4af5-9ac2-a0f217024850 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:22.158285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a6408a93-6518-4ba9-847c-d68c97174ffe req-499a90e4-75ad-49e9-9384-8f09a1298140 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115689 Jul 18 13:18:22.165319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2040/4192] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:22.192596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:22.194320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:22.222185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.226688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.234652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.236351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.323027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:22.352519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91fcbbae-5ce6-4594-8373-cbff1418f021 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1318 microversion: 2.1 time: 0.442802 Jul 18 13:18:22.353227 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2153/4193] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:21 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:22.362551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:22.363192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:22.395508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.395976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.396792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.397236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.759165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:22.771687 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f3701bcb-d021-4bc3-8359-4a814656874b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.603974 Jul 18 13:18:22.796276 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2041/4194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:22 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:22.818295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:22.821539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:22.840496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.841363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:22.844179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:22.845451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.008850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:23.039593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58b17b32-2991-4a90-a105-cccdb9d50853 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.684774 Jul 18 13:18:23.041650 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2154/4195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:22 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:23.054852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:23.063873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:23.065951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:23.066579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:23.067816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:23.072130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33bbb5e0-5a45-4b3d-b06f-7bacc770f68b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.274200 Jul 18 13:18:23.076791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.077743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.079506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.080171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.093676 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2042/4196] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:22 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:23.105833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:23.108152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: de080a22-10c7-45c1-8108-8aa38d34196f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:23.129806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/de080a22-10c7-45c1-8108-8aa38d34196f/action HTTP/1.1 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 39 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: {"os-getConsoleOutput": {"length": 10}} Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'de080a22-10c7-45c1-8108-8aa38d34196f', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:23.148073 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. Jul 18 13:18:23.152881 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:23.154779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance de080a22-10c7-45c1-8108-8aa38d34196f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:23.155883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e47c384b-8994-4549-b87f-7b1fd57cadcd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/de080a22-10c7-45c1-8108-8aa38d34196f/action" status: 404 len: 111 microversion: 2.1 time: 0.060946 Jul 18 13:18:23.160653 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2043/4197] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:23 2022] POST /compute/v2.1/servers/de080a22-10c7-45c1-8108-8aa38d34196f/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:23.167141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:23.168173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:23.182870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.183399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.193085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.194016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.844453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:23.871866 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27df5fc7-810c-4c06-8361-ea80d4c81b61 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1506 microversion: 2.1 time: 0.808331 Jul 18 13:18:23.877757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2155/4198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:23 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1506 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:23.917036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:23.918018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:23.948206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.949089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:23.955808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:23.956481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.165645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:24.234595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:24.243205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:24.251968 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c03c4b2f-0808-4116-94de-18be692ed4a8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2549 microversion: 2.42 time: 1.089169 Jul 18 13:18:24.255194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2044/4199] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:23 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2549 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:24.288503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:24.289366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:24.305251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.305690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.306422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.307003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.790604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:24.803895 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-234f1a3e-5872-421f-9c0e-5efa60dcc5af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1508 microversion: 2.1 time: 0.533256 Jul 18 13:18:24.810397 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2045/4200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:24 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1508 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:24.831941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:24.832724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:24.843556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.847840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.849172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.850334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.942669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:24.944066 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-01381780-d327-48bd-a34b-febe46bac6a3 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/os-instance-actions/req-05d89164-cb97-4637-a625-0f3e9f3438a6" status: 200 len: 313 microversion: 2.1 time: 0.132398 Jul 18 13:18:24.955136 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2046/4201] 10.222.0.88 () {58 vars in 1418 bytes} [Mon Jul 18 13:18:24 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/os-instance-actions/req-05d89164-cb97-4637-a625-0f3e9f3438a6 => generated 313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:24.960690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:24.961563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:24.970884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.971888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:24.972847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:24.973445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.117902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:25.133258 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40d7055a-b1bc-44c5-9692-2c2ff5222a50 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.250952 Jul 18 13:18:25.133878 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2156/4202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:23 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:25.148395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:25.153179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:25.186699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.187677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.192042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.194474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.416383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:25.450853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:25.464199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:25.467525 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f79a449-730e-435a-a676-e1dbcda69123 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.325931 Jul 18 13:18:25.483278 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2157/4203] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:25 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:25.512580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-98527ad8-c948-461b-8256-f8aa8d00b7e9 req-34d992ac-3c4f-4b21-834d-78e402896d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-deleted", "tag": "89a431b7-da19-47fb-9aae-199f2600baf7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:25.554114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-98527ad8-c948-461b-8256-f8aa8d00b7e9 req-34d992ac-3c4f-4b21-834d-78e402896d9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.560773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-98527ad8-c948-461b-8256-f8aa8d00b7e9 req-34d992ac-3c4f-4b21-834d-78e402896d9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.597368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:25.605916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-98527ad8-c948-461b-8256-f8aa8d00b7e9 req-34d992ac-3c4f-4b21-834d-78e402896d9e service nova] Creating event network-vif-deleted:89a431b7-da19-47fb-9aae-199f2600baf7 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:25.611016 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2d5d6f5-f328-49d3-8cc9-cc16f9a66226 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1510 microversion: 2.1 time: 0.653759 Jul 18 13:18:25.613679 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2047/4204] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:24 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1510 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:25.626813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:25.627542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:25.635758 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-98527ad8-c948-461b-8256-f8aa8d00b7e9 req-34d992ac-3c4f-4b21-834d-78e402896d9e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149623 Jul 18 13:18:25.643492 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2158/4205] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:25.645425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.645881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.646849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.647383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.698912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:25.711981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:25.770466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.776038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.780480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:25.781930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:25.968313 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a6f2c06-c9b4-4c7b-9c9a-59b2d0d18a36 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "POST /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/action" status: 202 len: 0 microversion: 2.1 time: 0.322503 Jul 18 13:18:25.969814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2159/4206] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:25 2022] POST /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:18:25.986277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:25.996001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:26.030218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.034756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:26.040730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.046593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:26.156423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:26.193126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-66f97b80-22d3-4ce7-b108-0801657b2dfc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1508 microversion: 2.1 time: 0.575170 Jul 18 13:18:26.197556 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2048/4207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:25 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:26.213224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:26.224429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:26.237625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.238535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:26.239534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.241652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:26.875559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:26.901267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:26.903148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:26.907480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-02e7659f-74dd-4291-9660-b53d93a40ee5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2436 microversion: 2.42 time: 0.707904 Jul 18 13:18:26.910874 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2049/4208] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:26 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2436 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:26.917412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:26.918340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:26.931183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.931899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:26.932912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:26.933520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.238812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:27.260650 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a2fba7b-e344-4374-b82d-14214f3c8b48 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1508 microversion: 2.1 time: 0.344759 Jul 18 13:18:27.263309 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2050/4209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:26 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:27.274260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:27.279143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:27.298815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.303224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.308365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.312260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.447803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:27.472972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa15072d-68a4-448e-8dc7-83a4671469c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.501170 Jul 18 13:18:27.482308 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2160/4210] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:25 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:27.501680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:27.503972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:27.514042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.514785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.515586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.516030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.551460 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a624f161-2678-42d6-89c1-57d469b2998d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "PUT /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1080 microversion: 2.1 time: 0.280408 Jul 18 13:18:27.557293 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2051/4211] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:18:27 2022] PUT /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1080 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:27.578107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:27.581417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:27.602768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.603887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.606302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.608332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.776280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:27.786811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:27.801377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:27.803858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ab8f9c15-0fe9-4790-8a87-7538510d62bb tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.319648 Jul 18 13:18:27.818660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2161/4212] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:27 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:27.837379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:27.839250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: bc16c015-99a8-478d-9355-81987f2f0f65] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:27.889222 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bc16c015-99a8-478d-9355-81987f2f0f65 HTTP/1.1 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc16c015-99a8-478d-9355-81987f2f0f65'} Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:27.891830 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance bc16c015-99a8-478d-9355-81987f2f0f65 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4aca4e53-2c67-46b4-8e2f-9f2b0d626074 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/bc16c015-99a8-478d-9355-81987f2f0f65" status: 404 len: 111 microversion: 2.1 time: 0.073443 Jul 18 13:18:27.901020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2162/4213] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:27 2022] GET /compute/v2.1/servers/bc16c015-99a8-478d-9355-81987f2f0f65 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:27.903260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:27.903915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:27.930787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.930787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:27.930787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:27.931169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:28.162444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:28.190388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8437b5a4-0304-426b-a583-b3a5c49f516f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1507 microversion: 2.1 time: 0.630022 Jul 18 13:18:28.191297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2052/4214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:27 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:28.228059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:28.229648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:28.248196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:28.249042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:28.250310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:28.251631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:28.696225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:28.710274 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f77d3890-c08f-4c05-a054-5f9bc65aa90d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1506 microversion: 2.1 time: 0.812908 Jul 18 13:18:28.733348 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2163/4215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:27 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:28.748110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:28.748923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:28.786307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:28.787003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:28.787877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:28.788327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.133282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.157663 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a4cf7f37-a790-4d2f-a92b-014c2f2556e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.952034 Jul 18 13:18:29.160908 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2053/4216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:28 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:29.193668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7795ac31-f3ec-497f-b70d-b13196f7149e req-5acfa855-ac0b-41aa-81e8-332c05ab314f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-deleted", "tag": "e55910a4-60fb-4c9c-9429-97cd52f7ff56"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:29.205968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.226203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7795ac31-f3ec-497f-b70d-b13196f7149e req-5acfa855-ac0b-41aa-81e8-332c05ab314f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.226685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7795ac31-f3ec-497f-b70d-b13196f7149e req-5acfa855-ac0b-41aa-81e8-332c05ab314f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.239930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.245139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.246938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:29.250507 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df999b29-dfa0-4bde-8ab6-da1f015832e7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 2389 microversion: 2.42 time: 0.515270 Jul 18 13:18:29.273641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2164/4217] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:28 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 2389 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:29.281043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:29.282533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:29.290994 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7795ac31-f3ec-497f-b70d-b13196f7149e req-5acfa855-ac0b-41aa-81e8-332c05ab314f service nova] Creating event network-vif-deleted:e55910a4-60fb-4c9c-9429-97cd52f7ff56 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:29.306591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.308817 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7795ac31-f3ec-497f-b70d-b13196f7149e req-5acfa855-ac0b-41aa-81e8-332c05ab314f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145643 Jul 18 13:18:29.311400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.314282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.315225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.318652 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2054/4218] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:29.336932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:29.341944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:29.355088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.364124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.366661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.370922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.713731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.723265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-172fb204-bfdb-4c2d-ae50-221b95df8355 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1513 microversion: 2.1 time: 0.448104 Jul 18 13:18:29.733870 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2165/4219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:29 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:29.741132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:29.742108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:29.749354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.749967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.763642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:29.764250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:29.781794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:29.852212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.861618 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a029c82-c8fe-4d0a-9ac1-0a97588a619d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1506 microversion: 2.1 time: 0.541402 Jul 18 13:18:29.873524 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2055/4220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:29 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:29.957952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.984012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.986492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:29.987738 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-101606f8-6b79-450f-b32a-8a5876d71d11 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.252216 Jul 18 13:18:29.988311 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2166/4221] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:29 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:30.005997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:30.008199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:30.019919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:30.021106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:30.022885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:30.023830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:30.303242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-36876967", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:30.461462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] validate_networks() for [('6f82a65d-903a-41e8-bd40-22fcc2558dbb', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:18:30.577937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:30.591754 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81abbeb3-f20b-4710-9df4-1e13609f4e18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.598519 Jul 18 13:18:30.606283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2167/4222] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:29 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:30.626227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:30.627387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:30.642017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:30.646694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:30.655348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:30.656359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.095681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:31.110871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d098121f-27f4-484b-9ca9-9769861cf1ab tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1507 microversion: 2.1 time: 0.501727 Jul 18 13:18:31.116304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2168/4223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:30 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:31.137268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ea3eff8e-e7ba-4907-bcc3-f3b07757b0ce req-8a40976e-b818-4621-b2f5-ece69d71658f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a72f842-29be-45f9-814f-de2fe85afc29", "name": "network-vif-unplugged", "status": "completed", "tag": "034db7d6-b05a-4515-b940-996313b507a6"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:31.206606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ea3eff8e-e7ba-4907-bcc3-f3b07757b0ce req-8a40976e-b818-4621-b2f5-ece69d71658f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.207347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ea3eff8e-e7ba-4907-bcc3-f3b07757b0ce req-8a40976e-b818-4621-b2f5-ece69d71658f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.274034 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ea3eff8e-e7ba-4907-bcc3-f3b07757b0ce req-8a40976e-b818-4621-b2f5-ece69d71658f service nova] Creating event network-vif-unplugged:034db7d6-b05a-4515-b940-996313b507a6 for instance 0a72f842-29be-45f9-814f-de2fe85afc29 on n-h1-850003-3 Jul 18 13:18:31.289731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ea3eff8e-e7ba-4907-bcc3-f3b07757b0ce req-8a40976e-b818-4621-b2f5-ece69d71658f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171442 Jul 18 13:18:31.293660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2169/4224] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:31.300959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:31.323147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:31.330601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.334680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.335749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.340706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.589036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:18:31.590122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:18:31.591169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:18:31.592142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:18:31.592906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:18:31.700055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:31.728197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.729849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.734005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.736077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.789921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:18:31.790743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:18:31.790932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:18:31.791284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:18:31.791910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:18:31.812856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.819901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.823315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.825544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.857233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97bdb075-a6d9-4da0-bba3-fa94c4b12bca tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "POST /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479/action" status: 202 len: 1112 microversion: 2.1 time: 0.560544 Jul 18 13:18:31.871944 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2170/4225] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:31 2022] POST /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479/action => generated 1112 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 13:18:31.892395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:31.897033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:31.907655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:18:31.927025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.930605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for user 0f5208cdf4ea47eea1b961b15e3c0ea8 and project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:18:31.943529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.943529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:31.948226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:31.966303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:18:31.969132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:18:32.152984 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-954f0023-fe43-43da-9fcd-5d689e948a74 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.277882 Jul 18 13:18:32.166882 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2056/4226] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:18:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:18:32.171920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.182458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:32.186069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:32.212157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.216133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.221040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e2c7f0d5-ee29-4159-bd03-16df4a7cdb13 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.360178 Jul 18 13:18:32.238530 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2171/4227] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:31 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:32.238780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.238883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac39a359-e728-432f-a657-80f2e7bbf0c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-261243966", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:32.241402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.242603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.243708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac39a359-e728-432f-a657-80f2e7bbf0c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 237 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-261243966", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-261243966', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:18:32.258470 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:32.264451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac39a359-e728-432f-a657-80f2e7bbf0c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:32.279553 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac39a359-e728-432f-a657-80f2e7bbf0c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.054559 Jul 18 13:18:32.287522 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2172/4228] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:18:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:18:32.299822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:32.304095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:32.336257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.336828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.337686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.338136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.586236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.599581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-043c7bae-5479-4006-a897-7f7b40273b56 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1506 microversion: 2.1 time: 0.431082 Jul 18 13:18:32.601161 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2057/4229] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:32 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:32.607262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d28903c5-c84c-457c-bdbf-f04d174330d0 req-6c2db713-5e2d-46ec-8410-5c1b937244bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0db110-4810-4c4e-a95a-a3284a61ca35", "name": "network-vif-deleted", "tag": "a55f2463-da87-436c-bdce-5622c0a24659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:32.617096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d28903c5-c84c-457c-bdbf-f04d174330d0 req-6c2db713-5e2d-46ec-8410-5c1b937244bc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.617840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d28903c5-c84c-457c-bdbf-f04d174330d0 req-6c2db713-5e2d-46ec-8410-5c1b937244bc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.635114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.638166 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d28903c5-c84c-457c-bdbf-f04d174330d0 req-6c2db713-5e2d-46ec-8410-5c1b937244bc service nova] Creating event network-vif-deleted:a55f2463-da87-436c-bdce-5622c0a24659 for instance ac0db110-4810-4c4e-a95a-a3284a61ca35 on n-h1-850003-3 Jul 18 13:18:32.645824 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d28903c5-c84c-457c-bdbf-f04d174330d0 req-6c2db713-5e2d-46ec-8410-5c1b937244bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Jul 18 13:18:32.650508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2058/4230] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:32.658003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:32.658804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:32.666350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.666815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.668555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.669006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.674506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.678978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:32.680837 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0553441-a908-4d8b-83a0-fadd55f8f579 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.395455 Jul 18 13:18:32.681977 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2173/4231] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:32 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:32.695484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:32.696138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:32.709039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.709475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:32.710208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:32.710652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.041991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.054828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cdcb41a5-bc4d-4f66-9bd5-fe53bba2c53e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 200 len: 1450 microversion: 2.1 time: 0.369445 Jul 18 13:18:33.056191 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2174/4232] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:32 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 1450 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:33.066276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b4fe9f7-a4c7-4e9e-9400-5e7fefd54e05 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.067645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b4fe9f7-a4c7-4e9e-9400-5e7fefd54e05 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.105036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.144711 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aee14e2e-dd70-4756-865f-c7e9f0401699 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.492415 Jul 18 13:18:33.145814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2059/4233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:32 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:33.171228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.173071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.186304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.187071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.188605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.190293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.193677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b4fe9f7-a4c7-4e9e-9400-5e7fefd54e05 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.211627 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b4fe9f7-a4c7-4e9e-9400-5e7fefd54e05 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1220 microversion: 2.1 time: 0.150357 Jul 18 13:18:33.227928 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2175/4234] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:33 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:33.261821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '.version_select at 0x7f96e4efa8b0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.265541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.290257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.290794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.296288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.300288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.368461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2ba4107-4843-459a-b749-de0c2419ff40 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.138577 Jul 18 13:18:33.374364 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2176/4235] 10.222.0.88 () {58 vars in 1295 bytes} [Mon Jul 18 13:18:33 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2/os-instance-actions => generated 611 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:33.396576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.404292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.427256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.427817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.428908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.429709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.618375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.646757 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0446b4b0-a2f5-4d0f-938e-768a17ce96c3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.482856 Jul 18 13:18:33.650265 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2060/4236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:33 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:33.678219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.679519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.707155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.707619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.708412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.708852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.751585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.761647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58013f29-cf5b-406a-a758-8f1fa8f15f64 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.385642 Jul 18 13:18:33.762880 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2177/4237] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:33 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:33.771042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1341890880", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:33.860698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] validate_networks() for [('6f82a65d-903a-41e8-bd40-22fcc2558dbb', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:18:33.874791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.888525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.890570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:33.893991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ef72754-139a-423a-a980-222dbe4eb96c tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.241920 Jul 18 13:18:33.894925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2061/4238] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:33 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:33.900855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:33.901407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:33.922767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.923373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:33.924194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:33.924721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.019940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:18:34.315799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8b2ce21b-ceca-4df8-a3da-ba868a819bf4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 204 len: 0 microversion: 2.1 time: 0.419534 Jul 18 13:18:34.317086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2062/4239] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:18:33 2022] DELETE /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:18:34.324907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:34.326699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:34.334463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:34.337324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.338053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.339574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.340231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.573344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:18:34.574786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:18:34.575745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:18:34.577553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:18:34.578906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:18:34.597265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.598670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.600089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.600867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.602850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:34.627584 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-138c5054-c162-44c7-adb1-b7fc0de6cc2f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.308056 Jul 18 13:18:34.645780 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2063/4240] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:34 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:34.645780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:34.645780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:34.652434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.653155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.654048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.654542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.667281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:34.694844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:18:34.712957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for user 0f5208cdf4ea47eea1b961b15e3c0ea8 and project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:18:34.755394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:18:34.760633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:18:34.775434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:34.797947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:34.801980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:34.805741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98a0e820-069a-4bb9-a763-7d91fa0428af tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.175148 Jul 18 13:18:34.814311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2064/4241] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:34 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:34.829487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:34.830502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:34.841926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3fdee6ee-f97c-4e37-a221-772b3bef1b3f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.077537 Jul 18 13:18:34.844352 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2178/4242] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:18:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:18:34.848444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.849122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.850137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.854359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.857823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:34.858552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:34.892022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.896837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:34.899463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:34.900937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.115049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.142315 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d077522-42ce-46ce-8b7d-2bb115e62261 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.332972 Jul 18 13:18:35.144170 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2065/4243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:34 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:35.149995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:35.151082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:35.163783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.164602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.165611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.166399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.290075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.300184 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42c90035-1ec7-40ed-8b50-5ee1184adccd tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.454494 Jul 18 13:18:35.301895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2179/4244] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:34 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:35.310200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41b2ca28-75ac-4ee8-a9d3-bf750aa889ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1005821200", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41b2ca28-75ac-4ee8-a9d3-bf750aa889ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 235 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1005821200", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1005821200', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:35.323784 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:35.332757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41b2ca28-75ac-4ee8-a9d3-bf750aa889ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:35.342232 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41b2ca28-75ac-4ee8-a9d3-bf750aa889ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023982 Jul 18 13:18:35.362341 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2180/4245] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:18:35 2022] POST /compute/v2.1/servers => generated 133 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:18:35.375492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec5b93f0-fe1c-4ca1-a4b6-6a55b88e97c3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:35.379447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec5b93f0-fe1c-4ca1-a4b6-6a55b88e97c3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:35.517439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec5b93f0-fe1c-4ca1-a4b6-6a55b88e97c3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.518234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.525344 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec5b93f0-fe1c-4ca1-a4b6-6a55b88e97c3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1222 microversion: 2.1 time: 0.161101 Jul 18 13:18:35.527255 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2181/4246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:35 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:35.532222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:35.532849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:35.551405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.551869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.552696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.553141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.573301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24790786-eb77-46f3-b5a1-8d73d7ba1a7d tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1512 microversion: 2.1 time: 0.425443 Jul 18 13:18:35.582250 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2066/4247] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:35 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:35.595510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:35.596486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:35.619564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.629078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.629078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.629078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.721126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.736648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.742437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:35.747715 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b875cc3-2c09-47f6-8726-f1fad13a92a5 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.219314 Jul 18 13:18:35.751996 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2182/4248] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:35 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:35.762886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:35.763898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:35.792545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.793740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:35.795696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:35.797035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.070431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.092512 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fc53e486-726d-4f59-99c3-25168a11d0bb tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.512030 Jul 18 13:18:36.103824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2067/4249] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:35 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:36.113161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:36.131732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:36.144515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.148860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.154684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.156793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.157866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.176343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6030bbe7-2b07-4cce-b806-8e480400d1db tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.422793 Jul 18 13:18:36.178291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2183/4250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:35 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:36.210504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:36.215610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:36.260765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.261493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.264150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.265357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.370618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.395109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.398172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ff01c9115c4931812cb211af0e9515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9554635c7e94296bd6d3069eaf2e2fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.401680 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d2fd83f-4c3a-4af3-bc62-579c7aa0619b tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 200 len: 1873 microversion: 2.32 time: 0.295505 Jul 18 13:18:36.403308 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2068/4251] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:36 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 1873 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:36.415026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:36.416454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:36.432163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.433286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.435227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.436245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.787652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.814117 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a786ade7-9431-4e8f-9dcb-8a9a40530ed8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.408800 Jul 18 13:18:36.815088 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2069/4252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:36 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:36.825291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:36.832486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:36.833558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:36.858490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.859525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.861900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.862755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.863059 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e81c355-ce5b-486b-99fa-30c9b8f171e5 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.681657 Jul 18 13:18:36.865328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2184/4253] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:36 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:36.896291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:36.901418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:36.933393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.936091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:36.939983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:36.942254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:37.188585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:37.222626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f54cd709-cfc9-48be-9c9e-64153b428f41 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1274 microversion: 2.1 time: 0.354722 Jul 18 13:18:37.241917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2185/4254] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:36 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:37.257183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:37.259272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:37.272519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:37.273631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:37.275351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:37.276391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:37.376867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:38.101785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:38.137227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d31679bb-d7de-4329-97a9-a7fe7329f879 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1512 microversion: 2.1 time: 0.889009 Jul 18 13:18:38.142591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2186/4255] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:37 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1512 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:38.173491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:38.180098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:38.204397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.205327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.210434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.212205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.465980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:38.513982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:38.522245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:38.535117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c28f92f1-c5c7-4584-9b46-b15be180f1de tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.390198 Jul 18 13:18:38.536776 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2187/4256] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:38 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:38.551513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:38.555630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 25cfffc9-0362-46fd-ae88-65f57df7f4af] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:38.581394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/25cfffc9-0362-46fd-ae88-65f57df7f4af/action HTTP/1.1 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 13 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: {"pause": {}} Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '25cfffc9-0362-46fd-ae88-65f57df7f4af', 'body': {'pause': {}}} Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:38.589846 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:38.596165 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:38.596165 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:38.596165 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. Jul 18 13:18:38.596165 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.596165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 25cfffc9-0362-46fd-ae88-65f57df7f4af could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:38.597306 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-720a831a-29b5-47bc-af6e-828dd7289a1e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/25cfffc9-0362-46fd-ae88-65f57df7f4af/action" status: 404 len: 111 microversion: 2.1 time: 0.058279 Jul 18 13:18:38.602774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2188/4257] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:38 2022] POST /compute/v2.1/servers/25cfffc9-0362-46fd-ae88-65f57df7f4af/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:38.610856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-803fec3c-cab7-4758-b57b-7103114d336f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:38.634243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:38.645472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-803fec3c-cab7-4758-b57b-7103114d336f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.649699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-803fec3c-cab7-4758-b57b-7103114d336f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.671594 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-84c4750d-64ee-4644-9c95-248cd253a0ec tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 1.852556 Jul 18 13:18:38.673560 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2070/4258] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:36 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:38.692872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:38.693811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:38.706608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-803fec3c-cab7-4758-b57b-7103114d336f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:18:38.710590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.711382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.720418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.721456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.735843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:38.757380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] HTTP exception thrown: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Request method failure captured: Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a HTTP/1.1 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtsYHqaJT0tYUFnY7suoP-KTm1-5lA5rSuA5xH32r01yorLXhIClItk4LwCsZp2oG_VmD3uYhZpNEfUTam8efeK3Gszr3UixCmV5HotnwVHXJfG8Dl7xh0uaj4otL5NIRTPLV07xkEAZMYlTDqRrKjjtHpXP8fb-VnDELqu_sU7MYw Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f9554635c7e94296bd6d3069eaf2e2fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 67ff01c9115c4931812cb211af0e9515 Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'df6b6d79-5473-4855-b99c-40e1f2d6882a'} Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:38.760434 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Returning 404 to user: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:38.768318 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-834db9ff-8fe5-4d70-9980-8654d44bf465 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 404 len: 111 microversion: 2.32 time: 0.086681 Jul 18 13:18:38.773672 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2071/4259] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:38 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:18:38.780981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:38.782772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:38.799224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.800294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.801721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.802419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.808505 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-803fec3c-cab7-4758-b57b-7103114d336f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.201048 Jul 18 13:18:38.815834 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2189/4260] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:38 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:18:38.824972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-33122cb8-5518-41c3-9f17-279c4f7e8f4c req-bec29fa1-bf0b-4564-85a8-50383e6ab149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8f81c-8945-454a-ab7a-bad6853711d2", "name": "network-vif-deleted", "tag": "ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:38.877167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-33122cb8-5518-41c3-9f17-279c4f7e8f4c req-bec29fa1-bf0b-4564-85a8-50383e6ab149 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.877949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-33122cb8-5518-41c3-9f17-279c4f7e8f4c req-bec29fa1-bf0b-4564-85a8-50383e6ab149 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.910563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-33122cb8-5518-41c3-9f17-279c4f7e8f4c req-bec29fa1-bf0b-4564-85a8-50383e6ab149 service nova] Creating event network-vif-deleted:ed6151b2-c416-4fa4-ad7a-e47f5d3c84f2 for instance 4da8f81c-8945-454a-ab7a-bad6853711d2 on n-h1-850003-3 Jul 18 13:18:38.922111 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-33122cb8-5518-41c3-9f17-279c4f7e8f4c req-bec29fa1-bf0b-4564-85a8-50383e6ab149 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103231 Jul 18 13:18:38.923671 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2190/4261] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:38.936196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:38.938683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:38.960971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.962030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:38.963556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:38.964819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.076730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:39.105725 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-78e5e20e-3c09-4cc1-a28a-8e4298d53cd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1280 microversion: 2.1 time: 0.330128 Jul 18 13:18:39.109448 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2072/4262] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:38 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:39.141715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c7ef2a1-c787-404e-8dcb-cd6a7a777fa9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '.version_select at 0x7f96e4281ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:39.221261 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c7ef2a1-c787-404e-8dcb-cd6a7a777fa9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514235463" status: 204 len: 0 microversion: 2.32 time: 0.100543 Jul 18 13:18:39.223343 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2073/4263] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 18 13:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514235463 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:18:39.234656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:39.237973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:39.259106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.260167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.263479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.264374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.323643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:39.341563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b982d310-fad6-4faa-a233-49ea238e6c82 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.414640 Jul 18 13:18:39.342199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2191/4264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:38 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:39.351239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:39.358491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:39.394766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.397699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.399470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.405313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.499052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.501563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.503952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lazy-loading 'fault' on Instance uuid 4da8f81c-8945-454a-ab7a-bad6853711d2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:18:39.743056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497839e56b0f461785b0991f1d5578f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe7bf9be6c4ad6a3632134a2b3d3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:39.761532 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd95442c-ebb6-4e1e-8fae-7a6338b894c4 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 200 len: 1307 microversion: 2.1 time: 0.411867 Jul 18 13:18:39.764798 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2192/4265] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:39 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:39.776315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:39.778578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:39.821532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.824045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:39.825686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:39.827979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.434752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:40.462006 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8dc72e45-b54a-4451-b0c0-4761e73b2615 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 1.236717 Jul 18 13:18:40.463154 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2074/4266] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:39 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:40.483874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:40.491832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:40.521557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.522676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.524368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.525373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.682319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:40.768510 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd4d8b8c-e05d-4947-9f8b-152e333dbd63 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.001929 Jul 18 13:18:40.773618 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2193/4267] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:39 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:40.800694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:40.802574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:40.806551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:40.822872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.824739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.826667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.828115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.837696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:40.857503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:40.860803 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32f82895-6c82-4007-b851-95543d26eeff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.383991 Jul 18 13:18:40.874234 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2075/4268] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:40 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:40.884025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:40.889172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:40.916187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.921766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:40.932990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:40.934174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.512798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:41.537946 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-580f2d44-3e2a-4fc9-b7a2-cb4441769dd0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.761956 Jul 18 13:18:41.546623 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2194/4269] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:40 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:41.564630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:41.565265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] [instance: 4da8f81c-8945-454a-ab7a-bad6853711d2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:41.593014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.593864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.595422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.596191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.667356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:41.676265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] HTTP exception thrown: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. Jul 18 13:18:41.686612 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8292fce3-c532-4e5a-a305-46029b55db2f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.809985 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Request method failure captured: Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 HTTP/1.1 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2C3z1g4ePcgjkt4Y02Jlaynlx_UOe61cofplG0RW5ju3NAGpmHFRQxtl_xUjIxmcjfMVbde8o2jDyNqvKPBh5WNkj0SwdmtgZ8UP7rmdu3KtONJ4kes-rBCqBj8aVDpsjvR1bGklusvxtnY_CEJEeKxX8cinBobVq_I2Vk0b2O490 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0ffe7bf9be6c4ad6a3632134a2b3d3fa Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceActionsTestJSON-651922207 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0ffe7bf9be6c4ad6a3632134a2b3d3fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ffe7bf9be6c4ad6a3632134a2b3d3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0ffe7bf9be6c4ad6a3632134a2b3d3fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ffe7bf9be6c4ad6a3632134a2b3d3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceActionsTestJSON-651922207 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0ffe7bf9be6c4ad6a3632134a2b3d3fa Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceActionsTestJSON-651922207 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceActionsTestJSON-651922207-project Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 497839e56b0f461785b0991f1d5578f8 Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceActionsTestJSON-651922207-project Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '4da8f81c-8945-454a-ab7a-bad6853711d2'} Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:41.688858 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] Returning 404 to user: Instance 4da8f81c-8945-454a-ab7a-bad6853711d2 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f12114eb-4a3b-4650-842d-a1786a3c9309 tempest-InstanceActionsTestJSON-651922207 tempest-InstanceActionsTestJSON-651922207-project] 10.222.0.88 "GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2" status: 404 len: 111 microversion: 2.1 time: 0.133095 Jul 18 13:18:41.693111 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2195/4271] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:41 2022] GET /compute/v2.1/servers/4da8f81c-8945-454a-ab7a-bad6853711d2 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:41.693934 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2076/4271] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:40 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:41.702002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:41.711194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:41.714972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:41.715980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:41.724883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.725554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.726448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.727060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.756683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.757837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.759604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.760658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.877086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:41.948861 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a21906f-7df2-49bd-b9c3-56d1f33c5c43 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.254336 Jul 18 13:18:41.949987 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2196/4272] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:41 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:18:41.954898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:41.956641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:41.959111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:41.966769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.967903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:41.969261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:41.970116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.088499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:42.101401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:42.103570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:42.105075 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75130b08-e5d3-4201-a4ed-d601387d72ff tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.153669 Jul 18 13:18:42.105901 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2197/4273] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:41 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:42.113091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:42.114100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:42.121866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.122732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.123746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.124772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.276668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:42.301782 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db9062c0-983b-4fc3-995b-31faa053b425 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.606364 Jul 18 13:18:42.302448 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2077/4274] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:41 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:42.566493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:42.567852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:42.592779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.593501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.595246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.596085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.656123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:42.711632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9173ef9-57d8-4086-bbc3-55744080d694 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1512 microversion: 2.1 time: 0.602451 Jul 18 13:18:42.720738 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2198/4275] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:42 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:42.753273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:42.754120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:42.785995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.787874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:42.789568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:42.790208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.129387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:43.171054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f26a494f-6b24-47d7-9d1e-6c26e991317d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.448055 Jul 18 13:18:43.172607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2199/4276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:42 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:43.182815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:43.183818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:43.220777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.223483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.226245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.246710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.407839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:43.436718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:43.440871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:43.443504 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4bbb598-6ba7-43b0-92c7-045b995dcdd6 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.268782 Jul 18 13:18:43.462788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2200/4277] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:43 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:43.473334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:43.474566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:43.488215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.488759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.489496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.490311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.754187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:43.773451 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-793310ed-723e-4473-9741-07789b3c75fa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.308883 Jul 18 13:18:43.774715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2201/4278] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:43 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:43.795913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:43.798430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:43.818563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.819192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:43.820507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:43.820931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.003635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:44.031114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cced4a6e-8cdd-4355-884a-fd1ec9076337 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 1.469006 Jul 18 13:18:44.046197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2078/4279] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:42 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:44.103476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:44.113725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:44.117108 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ffd1a761-12d7-4d87-bf5d-5a6530416fb3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1492 microversion: 2.1 time: 0.330246 Jul 18 13:18:44.130743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2202/4280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:43 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1492 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:44.148293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:44.149648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:44.162288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.163111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.164407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.165302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.202480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:44.204450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:44.223843 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'pause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state paused Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 13 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: {"pause": {}} Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'pause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state paused Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'pause': {}}} Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state paused. Cannot pause while the instance is in this state. Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state paused Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:44.226827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:44.234594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:44.234594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:44.234594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:44.234594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state paused Jul 18 13:18:44.234594 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:44.235227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.235227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.235227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.235227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.237086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'pause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state paused {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:44.239117 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b311bc64-43a9-415c-986b-84b45fb162c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 143 microversion: 2.1 time: 0.097788 Jul 18 13:18:44.240745 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2079/4281] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:44 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 143 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:18:44.258570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:44.260081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:44.272662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.273926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.275858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.277254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.498096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8be3f9fe-097b-43ed-aa8c-cef6c269ef5a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.249007 Jul 18 13:18:44.525048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2080/4282] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:44 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:18:44.548048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:44.550722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:44.587838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.592569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.593871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.595446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.618438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:44.655084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:44.677093 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-debb15fc-0dbf-41ce-b2d9-c2c923e63b96 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.484162 Jul 18 13:18:44.680379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2203/4283] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:44 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:18:44.716184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:44.716947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:44.739567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.741355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.745049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:44.745800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:44.987704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:45.010194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:45.028192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:45.038621 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c8e6d2b-df3c-4216-a2b3-f92d496c11c1 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.508465 Jul 18 13:18:45.039760 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2081/4284] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:44 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:45.070403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:45.072125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:45.084819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.087613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:45.089348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.090438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:45.205348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:45.235915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21ad00e6-437e-458c-9862-d44b267e13fa tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1499 microversion: 2.1 time: 0.538537 Jul 18 13:18:45.237780 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2204/4285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:44 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1499 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:45.248638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:45.254818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:45.285052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.285865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:45.288914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.290396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:45.525341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:45.629799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:45.653873 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9ec0c59-a837-45dd-8190-9b94fa79644f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.412155 Jul 18 13:18:45.655735 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2205/4286] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:45 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:45.712879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:45.714598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:45.735943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.737322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:45.739896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:45.741062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.093808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.109792 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b18c2570-61f7-4a89-8fe3-1fdf671eb478 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.404208 Jul 18 13:18:46.127401 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2206/4287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:45 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:18:46.138817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:46.140468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:46.152821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.154120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.155812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.157540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.309385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.334491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.338754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.342056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1895d21-2c45-4304-bebd-a198668213b7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.212180 Jul 18 13:18:46.344614 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2207/4288] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:46 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:46.354329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:46.355962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:46.369944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.371492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.373371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.374595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.537747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.565539 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d76aa601-306c-40b7-ab76-5130b53583f1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 1.507587 Jul 18 13:18:46.582200 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2082/4289] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:45 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:46.679045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:46.682465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:46.683798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:46.696903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28b4a5fc-7eb4-4a23-8f12-c09559e6fa8b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.350307 Jul 18 13:18:46.697203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.710208 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2208/4290] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:46.710798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.710798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.710798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.727718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:46.728361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:46.742122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.742625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:46.743533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:46.744010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.070237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:47.092539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9efc4a13-aeae-41d5-a07b-dffac8c4188a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.368805 Jul 18 13:18:47.094313 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2209/4291] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:47.121815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:47.124915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:47.150804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.151985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.153716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.155006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.185154 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action HTTP/1.1 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 28 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: {"reboot": {"type": "SOFT"}} Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b6a0647e-a1ad-4143-ac29-c9104449da1f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:47.188860 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:47.195959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:47.197804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:47.200391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d980eaa-d1a4-478c-ab85-ff83312d89b1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action" status: 404 len: 111 microversion: 2.1 time: 0.083633 Jul 18 13:18:47.206533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2210/4292] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:47 2022] POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:47.215344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:47.215899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:47.242746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.244487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.246978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.248343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.543830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:47.558054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e028849e-6a5c-42d7-bd2e-c3561b862a48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.349371 Jul 18 13:18:47.559699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2211/4293] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:47 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:47.570852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:47.572564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:47.588911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.590094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.591659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.592432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.626538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:47.647073 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6871b5e3-f7d9-4f27-b96e-34cb7d74841d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.978034 Jul 18 13:18:47.664838 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2083/4294] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:46 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:18:47.670714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:47.671346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:47.701415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.701920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.702885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.703904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.879555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:47.901623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-323e1dd6-b7ef-457b-bafc-3a2fdf7c1d70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.338909 Jul 18 13:18:47.918203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2212/4295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:47 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:47.918203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:47.918203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:47.919421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.921623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:47.929148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:47.929148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:48.184152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:48.200594 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0e46e26-ce0d-449e-8b75-5f09e9039930 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.296559 Jul 18 13:18:48.201220 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2213/4296] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:47 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:48.215692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-54fa8bfc-44da-42ae-8316-4465b233b815 req-4f08a807-a84f-4f5d-ba30-9d97bdcfca80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759af7c7-2105-449b-aaa8-597abc961e94", "tag": "c5c50f1b-a2e5-4119-925f-58946459f701"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:48.236688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:48.237018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54fa8bfc-44da-42ae-8316-4465b233b815 req-4f08a807-a84f-4f5d-ba30-9d97bdcfca80 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:48.237531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54fa8bfc-44da-42ae-8316-4465b233b815 req-4f08a807-a84f-4f5d-ba30-9d97bdcfca80 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:48.261264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:48.265124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:48.268559 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c175f4f0-e5db-4c5a-8d06-a82786ee180e tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.601748 Jul 18 13:18:48.270470 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2084/4297] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:47 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:48.279565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:48.296950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:48.300191 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-54fa8bfc-44da-42ae-8316-4465b233b815 req-4f08a807-a84f-4f5d-ba30-9d97bdcfca80 service nova] Creating event network-changed:c5c50f1b-a2e5-4119-925f-58946459f701 for instance 759af7c7-2105-449b-aaa8-597abc961e94 on n-h1-850003-3 Jul 18 13:18:48.316102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:48.316686 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-54fa8bfc-44da-42ae-8316-4465b233b815 req-4f08a807-a84f-4f5d-ba30-9d97bdcfca80 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113691 Jul 18 13:18:48.317234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:48.319301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:48.320804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2214/4298] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:48.321925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:48.599327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:48.600554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:48.666676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:48.669150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:48.671010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:48.672476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:49.527988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:49.567772 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d950ea10-082a-4ff7-b704-f7e661042114 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.295221 Jul 18 13:18:49.587709 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2085/4299] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:48 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:49.618194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:49.621070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:49.636760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:49.637790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:49.639509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:49.642683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:49.695913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:49.737518 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7ad95d4-6d44-4690-b6d4-84b87d483122 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 1.151756 Jul 18 13:18:49.750980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2215/4300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:48 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:18:49.758051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:49.770375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:49.784278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:49.785094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:49.786137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:49.786861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:50.130628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:50.146040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96541389-77d8-4161-b40c-3bffa7cc185d tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.393510 Jul 18 13:18:50.151074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2216/4301] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:49 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:50.158725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:50.160330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:50.197818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:50.201366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:50.202529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:50.205453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:50.459640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:50.490878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:50.510502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:50.512641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-76d94641-107a-4dc4-8611-58ac9eed090a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.358624 Jul 18 13:18:50.519368 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2217/4302] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:50 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:50.525239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:50.531643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:50.553360 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc/action HTTP/1.1 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 28 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: {"reboot": {"type": "SOFT"}} Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. Jul 18 13:18:50.569584 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f42ed20-9804-4ff3-b248-7a835fbd8164 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc/action" status: 404 len: 111 microversion: 2.1 time: 0.051013 Jul 18 13:18:50.573588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2218/4303] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:50 2022] POST /compute/v2.1/servers/ecf4133d-e6e2-4dab-8642-5c1ab5a7d3cc/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:50.587409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:50.588577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:50.679224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:50.679772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:50.680970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:50.681635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:50.975059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:51.018195 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d06303f8-1ff1-4732-8bdb-f46ec78cb814 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 1.428245 Jul 18 13:18:51.035282 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2086/4304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:49 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:51.035282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-15f65d47-f587-4826-9ca2-9d70e233b843 req-aebb9b82-4eee-4445-b0f4-f17bd15cfcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e3f93c-c3f1-41a7-bddd-b09fa7303659", "tag": "0ba9a6e8-cc19-43ce-9dbd-290a629b318b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:51.044500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-15f65d47-f587-4826-9ca2-9d70e233b843 req-aebb9b82-4eee-4445-b0f4-f17bd15cfcdc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:51.045526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-15f65d47-f587-4826-9ca2-9d70e233b843 req-aebb9b82-4eee-4445-b0f4-f17bd15cfcdc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:51.086916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-15f65d47-f587-4826-9ca2-9d70e233b843 req-aebb9b82-4eee-4445-b0f4-f17bd15cfcdc service nova] Creating event network-changed:0ba9a6e8-cc19-43ce-9dbd-290a629b318b for instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 on n-h2-850003-3 Jul 18 13:18:51.111898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-15f65d47-f587-4826-9ca2-9d70e233b843 req-aebb9b82-4eee-4445-b0f4-f17bd15cfcdc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090195 Jul 18 13:18:51.118260 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2087/4305] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:51.136127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:51.137678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:51.171640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:51.172612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:51.188152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:51.195269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:51.456341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:51.478773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57a906d2-3e29-4d58-8562-0c835f1978a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.897982 Jul 18 13:18:51.479799 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2219/4306] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:50 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:18:51.493136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:51.500858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:51.533649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:51.534278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:51.535504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:51.536250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:52.008144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:52.008902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:52.026037 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0ef2d49-8670-4109-81ba-927f10f6d536 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.544224 Jul 18 13:18:52.031738 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2220/4307] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:51 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:52.049005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:52.054816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:52.072859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9337ffce-90e1-4aa3-a760-d817e176f6cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.952569 Jul 18 13:18:52.079294 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2088/4308] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:51 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:52.090511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:52.092191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:52.105210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:52.105930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:52.107609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:52.108035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:52.112339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:52.113760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:52.115595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:52.116785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:52.202605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:53.098901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:53.118247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:53.132004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:53.137877 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cad11fce-7987-448f-98a8-c88b99d77b2f tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 1.056027 Jul 18 13:18:53.142449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:53.143060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2089/4309] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:52 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:53.147415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:53.157165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:53.170762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:53.171661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5b03f03-6d87-482f-8fb2-5c5a68deb952 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.137347 Jul 18 13:18:53.174041 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2221/4310] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:52 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:53.185876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:53.194903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.195757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:53.196914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.197386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:53.197801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:53.205823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:18:53.209992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.210823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:53.211879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.212546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:53.899951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:53.924074 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-47922b42-b949-47a8-b54f-5026f356a34c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1676 microversion: 2.1 time: 0.748044 Jul 18 13:18:53.938743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2222/4311] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:53 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1676 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:53.954210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:53.958570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:53.982977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.984723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:53.986479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:53.987532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.163047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:54.194273 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64aede88-19fa-4db6-805d-2977d5cb83f5 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 1.049991 Jul 18 13:18:54.201100 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2090/4312] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:53 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:54.225227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:54.229148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:54.263283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.265819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.272056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.273320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.338806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action HTTP/1.1 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 65 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b6a0647e-a1ad-4143-ac29-c9104449da1f', 'body': {'rebuild': {'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344'}}} Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 13:18:54.343096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:18:54.348505 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:54.352895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:54.355063 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dcbc7821-5fd3-46e2-9ebe-39208fcf3647 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action" status: 404 len: 111 microversion: 2.1 time: 0.150725 Jul 18 13:18:54.362498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2091/4313] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:54 2022] POST /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f/action => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:54.383091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:54.389318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:54.419794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.421182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.423264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.424531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.715690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:54.755508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:54.768768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:54.771341 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed5fe31e-e251-4988-894f-2d8f12595979 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.406407 Jul 18 13:18:54.777399 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2092/4314] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:54 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:54.786866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:54.788188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:54.835270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.836237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.838218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:54.840279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:54.910082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:54.946312 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ccb9e162-020c-44dd-a612-a80b273b9d80 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.997818 Jul 18 13:18:54.958346 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2223/4315] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:53 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:54.986348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:54.987940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:55.018007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:55.018696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:55.020972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:55.021691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:55.477503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:55.515691 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9af9eac5-cdbb-419e-b3cb-03c0196adfdc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1653 microversion: 2.1 time: 0.554879 Jul 18 13:18:55.517457 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2224/4316] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:54 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1653 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:55.538044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:55.539732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:55.560096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:55.561269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:55.568969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:55.570406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.006741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.023704 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4c7a455-7a8f-48b0-a519-828d833151e1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.244431 Jul 18 13:18:56.031557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.060905 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2093/4317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:56.091437 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93cdcce6-fcf3-4eb8-81d8-f75b0ae7dec7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.571652 Jul 18 13:18:56.092502 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2225/4318] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:55 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:56.104530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a64e951-71ae-4460-a10a-64fe1a7e9cee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:56.106271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.107220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.121476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a64e951-71ae-4460-a10a-64fe1a7e9cee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.122727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a64e951-71ae-4460-a10a-64fe1a7e9cee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.123993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.124469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.125639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.133224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.183765 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] HTTP exception thrown: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Request method failure captured: Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a HTTP/1.1 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtsYHqaJT0tYUFnY7suoP-KTm1-5lA5rSuA5xH32r01yorLXhIClItk4LwCsZp2oG_VmD3uYhZpNEfUTam8efeK3Gszr3UixCmV5HotnwVHXJfG8Dl7xh0uaj4otL5NIRTPLV07xkEAZMYlTDqRrKjjtHpXP8fb-VnDELqu_sU7MYw Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f9554635c7e94296bd6d3069eaf2e2fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 67ff01c9115c4931812cb211af0e9515 Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'df6b6d79-5473-4855-b99c-40e1f2d6882a'} Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:56.185501 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Returning 404 to user: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:56.192678 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50787ff2-7905-428d-8dfe-9d7e0a6f1dfa tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "DELETE /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 404 len: 111 microversion: 2.32 time: 0.107014 Jul 18 13:18:56.193864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2094/4319] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:18:56 2022] DELETE /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:18:56.200773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a64e951-71ae-4460-a10a-64fe1a7e9cee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Going to try to start instance {{(pid=131366) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 13:18:56.203441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.203871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.217155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.219237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.221334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.222069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.304224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a64e951-71ae-4460-a10a-64fe1a7e9cee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.208684 Jul 18 13:18:56.306740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2226/4320] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:56 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:18:56.316525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.318503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.329367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.330134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.331733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.332596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.610994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.632672 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-447d20a5-cf0e-48a9-9517-cac12023630d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 0.323492 Jul 18 13:18:56.634124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2227/4321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:56 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:56.676552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.686456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.701901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.703577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.705910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.706641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.779159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.821562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.833942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:56.839014 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96b0c908-5f9e-4f0c-bb5a-85b51d17ca5a tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.643758 Jul 18 13:18:56.843256 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2095/4322] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:56 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:56.851582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.853173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] [instance: df6b6d79-5473-4855-b99c-40e1f2d6882a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.865704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.867324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.869742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.870702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.920900 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] HTTP exception thrown: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Request method failure captured: Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a HTTP/1.1 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1VtsYHqaJT0tYUFnY7suoP-KTm1-5lA5rSuA5xH32r01yorLXhIClItk4LwCsZp2oG_VmD3uYhZpNEfUTam8efeK3Gszr3UixCmV5HotnwVHXJfG8Dl7xh0uaj4otL5NIRTPLV07xkEAZMYlTDqRrKjjtHpXP8fb-VnDELqu_sU7MYw Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f9554635c7e94296bd6d3069eaf2e2fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f9554635c7e94296bd6d3069eaf2e2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f9554635c7e94296bd6d3069eaf2e2fa Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1071153072 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 67ff01c9115c4931812cb211af0e9515 Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TaggedBootDevicesTest-1071153072-project Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'df6b6d79-5473-4855-b99c-40e1f2d6882a'} Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:56.925134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. Jul 18 13:18:56.931983 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:56.938912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] Returning 404 to user: Instance df6b6d79-5473-4855-b99c-40e1f2d6882a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:56.941083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dfa6e835-e99c-4871-a055-13499cf43ad9 tempest-TaggedBootDevicesTest-1071153072 tempest-TaggedBootDevicesTest-1071153072-project] 10.222.0.88 "GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a" status: 404 len: 111 microversion: 2.32 time: 0.095492 Jul 18 13:18:56.943971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2096/4323] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:56 2022] GET /compute/v2.1/servers/df6b6d79-5473-4855-b99c-40e1f2d6882a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:18:56.955479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:56.956766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:56.975560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.977052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:56.979187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:56.980745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:57.060795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:57.084671 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-138d10ba-7534-4026-aae7-e7bcdd61ee18 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.448711 Jul 18 13:18:57.085954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2228/4324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:56 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:57.112685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e486e239-f45a-4167-8e4a-ec61a2e933ff req-23ea85c2-8d71-46e9-91b6-e36b7df73f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e3f93c-c3f1-41a7-bddd-b09fa7303659", "name": "network-vif-plugged", "status": "completed", "tag": "0ba9a6e8-cc19-43ce-9dbd-290a629b318b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:57.127866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e486e239-f45a-4167-8e4a-ec61a2e933ff req-23ea85c2-8d71-46e9-91b6-e36b7df73f17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:57.129998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e486e239-f45a-4167-8e4a-ec61a2e933ff req-23ea85c2-8d71-46e9-91b6-e36b7df73f17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:57.177179 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e486e239-f45a-4167-8e4a-ec61a2e933ff req-23ea85c2-8d71-46e9-91b6-e36b7df73f17 service nova] Creating event network-vif-plugged:0ba9a6e8-cc19-43ce-9dbd-290a629b318b for instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 on n-h2-850003-3 Jul 18 13:18:57.190718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e486e239-f45a-4167-8e4a-ec61a2e933ff req-23ea85c2-8d71-46e9-91b6-e36b7df73f17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081029 Jul 18 13:18:57.192128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2229/4325] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:18:57.220732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:57.224454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: bb438a88-478f-41e3-a0db-ee8864472600] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:57.232105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/bb438a88-478f-41e3-a0db-ee8864472600/action HTTP/1.1 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 65 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bb438a88-478f-41e3-a0db-ee8864472600', 'body': {'rebuild': {'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344'}}} Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 13:18:57.236504 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. Jul 18 13:18:57.240179 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:18:57.242850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance bb438a88-478f-41e3-a0db-ee8864472600 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:57.244794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a2f15a0-6b30-48c7-a7fd-b8ed003f39da tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/bb438a88-478f-41e3-a0db-ee8864472600/action" status: 404 len: 111 microversion: 2.1 time: 0.046889 Jul 18 13:18:57.246560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2230/4326] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:57 2022] POST /compute/v2.1/servers/bb438a88-478f-41e3-a0db-ee8864472600/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:57.251929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:57.253063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:57.278928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:57.279561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:57.282137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:57.282838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:57.577452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:57.602897 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d0ed515-6c23-4cc7-b75e-af1055bbd162 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.353522 Jul 18 13:18:57.620266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2231/4327] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:57 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:57.634372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:57.636221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:57.649514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:57.651128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:57.663550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:57.663550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.016438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.034383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.051707 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ccd77128-e684-433c-96b3-5c768c5c56ff tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1662 microversion: 2.1 time: 1.093530 Jul 18 13:18:58.063885 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ea63143-5cf9-41d5-bbc7-fa0d1eae704f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.441065 Jul 18 13:18:58.072831 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2097/4328] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:56 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1662 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:58.073876 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2232/4329] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:57 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:58.104634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:58.110247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:58.113196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:58.120200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:58.139280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.145594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.146368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.147544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.156270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.156430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.156556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.161747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.508469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.533192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.536575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.539032 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a21804f2-dd12-4ef5-9923-d8dfc1c4a778 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.462649 Jul 18 13:18:58.540617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2233/4330] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:18:58 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:18:58.549698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:58.550868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:58.564204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.565048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.567025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:58.567843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:58.981556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:58.997536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91965634-a74e-4d57-b1fb-e0f2ee5b4574 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.455121 Jul 18 13:18:59.010718 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2234/4331] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:58 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:59.027308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:59.028813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:59.041497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.042708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:59.044253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.045519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:59.096315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:59.131549 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ae9f767-a3d5-4496-937f-f8256b39b9ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1322 microversion: 2.1 time: 1.051497 Jul 18 13:18:59.152200 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2098/4332] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:58 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1322 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:59.161524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:18:59.162812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 54b96cd3-f73b-490b-b396-24b5f88f1f8b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:59.174678 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/54b96cd3-f73b-490b-b396-24b5f88f1f8b/action HTTP/1.1 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 15 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: {"restore": {}} Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '54b96cd3-f73b-490b-b396-24b5f88f1f8b', 'body': {'restore': {}}} Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:18:59.178324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:18:59.184610 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:18:59.184610 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:18:59.184610 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. Jul 18 13:18:59.184610 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:18:59.188591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 54b96cd3-f73b-490b-b396-24b5f88f1f8b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:18:59.190305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7197fe59-4360-4e43-a971-c7472aae7ea8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/54b96cd3-f73b-490b-b396-24b5f88f1f8b/action" status: 404 len: 111 microversion: 2.1 time: 0.035966 Jul 18 13:18:59.192023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2099/4333] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:18:59 2022] POST /compute/v2.1/servers/54b96cd3-f73b-490b-b396-24b5f88f1f8b/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:18:59.199504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:59.200982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:59.212254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.213432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:59.215266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.216537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:59.594864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:18:59.613406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa572316-1d94-4a0f-aebf-2b75bd1664c3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.592258 Jul 18 13:18:59.615552 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2235/4334] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:59 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:18:59.626486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:18:59.628285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:18:59.664246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.666677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:18:59.669094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:18:59.672940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:00.187801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:00.219288 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1a34da1-4ec8-469e-b8d3-f1f338dc20dd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.598693 Jul 18 13:19:00.221315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2236/4335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:59 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:00.232027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-243419f5-3dce-49db-bc81-dd9ec9242d80 req-ea20c166-b6f0-4bc3-8074-9e4c9a1a4d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759af7c7-2105-449b-aaa8-597abc961e94", "name": "network-vif-plugged", "status": "completed", "tag": "c5c50f1b-a2e5-4119-925f-58946459f701"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:00.255356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-243419f5-3dce-49db-bc81-dd9ec9242d80 req-ea20c166-b6f0-4bc3-8074-9e4c9a1a4d31 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:00.255356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-243419f5-3dce-49db-bc81-dd9ec9242d80 req-ea20c166-b6f0-4bc3-8074-9e4c9a1a4d31 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:00.289261 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-243419f5-3dce-49db-bc81-dd9ec9242d80 req-ea20c166-b6f0-4bc3-8074-9e4c9a1a4d31 service nova] Creating event network-vif-plugged:c5c50f1b-a2e5-4119-925f-58946459f701 for instance 759af7c7-2105-449b-aaa8-597abc961e94 on n-h1-850003-3 Jul 18 13:19:00.298345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-243419f5-3dce-49db-bc81-dd9ec9242d80 req-ea20c166-b6f0-4bc3-8074-9e4c9a1a4d31 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074588 Jul 18 13:19:00.305639 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2237/4336] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:00.317971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:00.319866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:00.349253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:00.357399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:00.359827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:00.361910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:00.540661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:00.566022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:00.568293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:00.572429 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f172fe8f-e43e-4cee-9fcb-6435443e3bc7 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.263296 Jul 18 13:19:00.573862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2238/4337] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:00 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:00.582068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:00.582869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:00.603130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:00.607202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:00.608158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:00.610036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.016167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:01.023926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:01.048216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-55bd3457-a69f-4abe-958c-9baf8764ed12 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1516 microversion: 2.1 time: 0.472346 Jul 18 13:19:01.052981 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2239/4338] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:00 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:01.068741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:01.080830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:01.098647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:01.101866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.102528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.108077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.109120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.136090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3d2bf5fc-db70-457f-ab77-7c6b37742ec8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1662 microversion: 2.1 time: 1.941619 Jul 18 13:19:01.142915 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2100/4339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:18:59 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1662 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:01.168653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:01.171200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:01.204662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.206132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.208219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.209671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.610603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:01.625230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-628d9498-c0d4-46de-a4c6-2287963e869c tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.479534 Jul 18 13:19:01.627324 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2101/4340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:01 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:01.653610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:01.659351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:01.665512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:01.676754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.677871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.679533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.680499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.724616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9250f6f-49bf-4592-8eeb-9b0fe91aecb6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.664659 Jul 18 13:19:01.724616 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2240/4341] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:01 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:01.748685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:01.750347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:01.757508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'flavor' on Instance uuid a7e3f93c-c3f1-41a7-bddd-b09fa7303659 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:01.773876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.774683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.775549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:01.776006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:01.985858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:02.045241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:02.049897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:02.071088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bfa0aea8-96b6-4cd9-a392-0d269bdf2b41 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.345036 Jul 18 13:19:02.077051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2241/4342] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:01 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:02.084748 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af8e61e4-5b2f-41e4-b97e-a35702fe71d4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action" status: 200 len: 32 microversion: 2.1 time: 0.455621 Jul 18 13:19:02.095119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:02.095727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:02.099866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2102/4343] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:01 2022] POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action => generated 32 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:19:02.128631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:02.130232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:02.144286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.161576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.162411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:02.166750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:02.168389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.170545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.171437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:02.172833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:02.324670 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'restore' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 15 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: {"restore": {}} Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'restore' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'restore': {}}} Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state active. Cannot restore while the instance is in this state. Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:02.354014 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:02.363253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'restore' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:02.368768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d3e2ed1-247e-45c8-8e93-b05879c9e57c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 145 microversion: 2.1 time: 0.289919 Jul 18 13:19:02.386264 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2242/4344] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:02 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 145 bytes in 312 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:19:02.427596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:02.432867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:02.473484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.474425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:02.481116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:02.482505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:03.288040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:03.308796 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9f4c908-4797-4a3f-92dc-51af8e938109 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.908229 Jul 18 13:19:03.334195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2243/4345] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:02 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:03.350888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:03.350888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:03.386823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:03.387667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:03.388751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:03.389693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:03.845150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:03.859646 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24b23e70-5241-41a3-bc7f-69bbc15c37ca tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 1.757225 Jul 18 13:19:03.861729 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2103/4346] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:02 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:03.869605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:03.876806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:03.903186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:03.903648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:03.904478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:03.905025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:03.934315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:03.955147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2791ddd5-f1ad-44bd-ba93-902ded010bf7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.628844 Jul 18 13:19:03.975639 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2244/4347] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:03 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:03.994838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:03.995208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:04.009741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.010962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.016373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.024288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.194119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:04.207389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:04.210597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:04.223118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afe74ec8-b772-4534-9d4d-910021b8290b tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.241273 Jul 18 13:19:04.224035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2245/4348] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:03 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:04.230450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:04.231292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:04.240818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.241668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.242824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.243515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.641903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:04.672178 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3175ab2-da95-4e15-b79f-add63a628ecc tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1517 microversion: 2.1 time: 0.808243 Jul 18 13:19:04.680959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2104/4349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:03 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1517 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:04.714689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:04.719835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:04.725646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:04.730057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:04.732024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.732734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.733783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.734422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.738980 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f83069a-5de6-4b34-b91d-7feb356c38d1 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.513581 Jul 18 13:19:04.754206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2246/4350] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:04 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:04.777050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:04.778055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:04.792455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.795900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:04.797738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:04.798761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.119935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:05.153881 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5ca002c-0609-416a-a5a8-9b46f930288b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.376664 Jul 18 13:19:05.166548 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2247/4351] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:04 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:05.200855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:05.205708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:05.236743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.237549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.242047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.245281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.649658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:05.677959 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-40944526-fa8e-44cd-b534-657058b5a344 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.992870 Jul 18 13:19:05.681853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2105/4352] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:04 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:05.697433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:05.704227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:05.719055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.719925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.723546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.724691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.777315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:05.813109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cec8990c-f545-4aff-9a4c-37dd6e56aec9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.643923 Jul 18 13:19:05.814688 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2248/4353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:05 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:05.830106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:05.831165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:05.850099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.851198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:05.852820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:05.868027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.021204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.053433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.056865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.065772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d39ab03d-81a4-4ff4-880d-db72350d1509 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.248777 Jul 18 13:19:06.079510 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2249/4354] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:05 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:06.097279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:06.098539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:06.121181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.125932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.125932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.125932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.136180 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e24c0038-1ac5-4c25-82d5-71341689d362 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.453091 Jul 18 13:19:06.136697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.143813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2106/4355] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:05 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:06.151585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:06.152858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 6b316228-e260-4872-9bea-661d5a914245] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:06.169888 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/6b316228-e260-4872-9bea-661d5a914245/action HTTP/1.1 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 14 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: {"resume": {}} Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6b316228-e260-4872-9bea-661d5a914245', 'body': {'resume': {}}} Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:06.176945 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:06.182368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:06.182368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:06.182368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. Jul 18 13:19:06.182368 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:06.185034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 6b316228-e260-4872-9bea-661d5a914245 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:06.186225 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-540d4d57-9e54-4e5f-aa32-3d8f1aa83a38 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/6b316228-e260-4872-9bea-661d5a914245/action" status: 404 len: 111 microversion: 2.1 time: 0.040694 Jul 18 13:19:06.194954 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2107/4356] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:06 2022] POST /compute/v2.1/servers/6b316228-e260-4872-9bea-661d5a914245/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:06.204250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:06.205454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:06.229954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.230723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.231825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.232417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.239796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:06.509637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.541753 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-824a2fcb-ba5a-426b-a797-33186051b298 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1523 microversion: 2.1 time: 0.459944 Jul 18 13:19:06.558190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2250/4357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:06 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:06.576530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:06.586319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:06.608281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.609651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.613332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.614191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.662181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:06.678405 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8095fa4-3227-4323-acc5-784ee6359c4b tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.480683 Jul 18 13:19:06.680377 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2108/4358] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:06 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:06.711714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:06.715408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:06.746739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.747534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.760480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:06.761226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:06.855453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lazy-loading 'flavor' on Instance uuid 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:07.076530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b7a1b61-5d23-437e-9956-81500022ff3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.368376 Jul 18 13:19:07.085395 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2109/4359] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:06 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:19:07.118543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:07.119400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:07.149804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.150836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.152207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.152951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.176797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:07.210180 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ced30758-477e-44a1-8bf2-919a7a41d46a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.664314 Jul 18 13:19:07.211916 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2251/4360] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:06 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:07.225217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:07.232317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:07.250195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.251073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.254610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.255637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.762086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:07.798917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:07.804499 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a349fdff-e904-4618-9f96-01bab957029d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.716267 Jul 18 13:19:07.805579 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2110/4361] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:07 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:07.825570 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-733de82c-723c-4e75-84e1-db90e0316283 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1674 microversion: 2.1 time: 0.611502 Jul 18 13:19:07.829083 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2252/4362] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:07 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1674 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:07.837052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:07.837944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:07.847186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:07.849577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:07.871243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.874698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.874946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.875209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.876825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.877488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:07.879186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:07.879812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.147931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.176844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.181228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.184295 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38ac4e72-eef8-4385-afab-985bb45ce9d3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.376732 Jul 18 13:19:08.185610 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2111/4363] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:07 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:08.193376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:08.194589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:08.207526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.209884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.212182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.213471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.261552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.301770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5a64208-dc18-4707-a2b6-69eb2109453e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.464337 Jul 18 13:19:08.305088 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2253/4364] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:07 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:08.348207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:08.349178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:08.372531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.373345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.374893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.375690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.432237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'resume' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 14 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: {"resume": {}} Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'resume' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'resume': {}}} Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state active. Cannot resume while the instance is in this state. Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:08.436721 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:08.440295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'resume' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:08.442269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eb196c5b-aa16-40f8-a660-6dd843febdc8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 144 microversion: 2.1 time: 0.107678 Jul 18 13:19:08.444312 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2254/4365] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:08 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 144 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 13:19:08.454074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:08.455221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:08.465036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.465729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.467104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.467949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.546982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.560106 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-827561ca-80d1-4ace-bb77-b1228d62b9af tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1523 microversion: 2.1 time: 0.372852 Jul 18 13:19:08.565519 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2112/4366] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:08 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:08.795711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:08.812297 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f91d9765-389d-4ea7-bda3-e3b3d2d2698b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.362066 Jul 18 13:19:08.821218 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2255/4367] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:08 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:08.826967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:08.829299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:08.839670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.840552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.841950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.842714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.869892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:08.871461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:08.883048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.883769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:08.885400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:08.886053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.126303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.137423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8e8ea1b-25ec-445f-90ce-e54246209b45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.314704 Jul 18 13:19:09.138037 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2113/4368] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:08 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:09.165045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:09.165931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:09.174553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.175951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.177963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.179734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.201696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.245561 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5060f186-35f2-4db8-99f0-bfd7cd63146f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.391956 Jul 18 13:19:09.246891 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2256/4369] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:08 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:09.273516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:09.276352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:09.312694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.314028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.315322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.317073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.333200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:09.506847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.522929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.525094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.527940 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6040a6b-c2d0-4a61-8b98-fa8c5aace254 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.278568 Jul 18 13:19:09.529467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2257/4370] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:09 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:09.550956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-999a5fe8-4761-4119-92c0-3d2a6e43f46f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-999a5fe8-4761-4119-92c0-3d2a6e43f46f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 160 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "7ffbcecd-c8c6-4cb8-b149-ec03a1516a54"}]}} Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': '', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'networks': [{'uuid': '7ffbcecd-c8c6-4cb8-b149-ec03a1516a54'}]}}} Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi '' Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:19:09.553428 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-999a5fe8-4761-4119-92c0-3d2a6e43f46f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:09.557877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-999a5fe8-4761-4119-92c0-3d2a6e43f46f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015536 Jul 18 13:19:09.565769 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2258/4371] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:19:09 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:19:09.571511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:09.572196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:09.580164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.580660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.581403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.581851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.729206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:09.747961 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a02c936-aac6-440a-baae-b223f6d881ee tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1657 microversion: 2.1 time: 0.578502 Jul 18 13:19:09.761255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2114/4372] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:09 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1657 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:09.773624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:09.774579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:09.789973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.790705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:09.791696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:09.792289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.034658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:10.062447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73ac7aa0-6eb3-4547-b7ca-35e4d1f265cf tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.493823 Jul 18 13:19:10.085284 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2259/4373] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:09 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:10.103019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:10.104442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:10.115227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.116125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.117486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.118276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.273850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0e4ea4c-880f-4c28-b226-e09376b55a3c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action" status: 202 len: 0 microversion: 2.1 time: 0.180166 Jul 18 13:19:10.283273 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2260/4374] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:10 2022] POST /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:19:10.290241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:10.291023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:10.299159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.299606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.300714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.301224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.549360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:10.587066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:10.606976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d5773b7-4b99-4cae-a7e8-d55cd6ff7244 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.321609 Jul 18 13:19:10.608017 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2261/4375] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:10 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:10.623356 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb0d5b23-2dde-45f4-95f9-a4ffdc77b607 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1523 microversion: 2.1 time: 0.853440 Jul 18 13:19:10.638181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:10.638418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2115/4376] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:09 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1523 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:10.638504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:10.642214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:10.646416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.647275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.648044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:10.648585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.649328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.659073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.659542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:10.661751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:10.663033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.201438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:11.214868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b813a6e-23b4-4418-96f4-2c045d54811e tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1663 microversion: 2.1 time: 0.583213 Jul 18 13:19:11.238728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2116/4377] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:10 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1663 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:11.248757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:11.250201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:11.262547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.263539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.265629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.266631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.305149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:11.334128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cdcd32c1-847a-4b96-a44b-8dfe6d7ebc23 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.711119 Jul 18 13:19:11.340339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2262/4378] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:10 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:11.361445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:11.362735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: bb7d918f-dfa3-4046-bdb8-6c98ebc812e7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:11.388444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/bb7d918f-dfa3-4046-bdb8-6c98ebc812e7/action HTTP/1.1 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 14 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: {"shelve": {}} Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bb7d918f-dfa3-4046-bdb8-6c98ebc812e7', 'body': {'shelve': {}}} Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:11.397297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:11.404959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:11.404959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:11.404959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. Jul 18 13:19:11.404959 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:11.424097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance bb7d918f-dfa3-4046-bdb8-6c98ebc812e7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:11.427436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37a369e6-f8ed-478e-b075-c63c447f564b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/bb7d918f-dfa3-4046-bdb8-6c98ebc812e7/action" status: 404 len: 111 microversion: 2.1 time: 0.084888 Jul 18 13:19:11.434307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2263/4379] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:11 2022] POST /compute/v2.1/servers/bb7d918f-dfa3-4046-bdb8-6c98ebc812e7/action => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:11.461573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:11.463382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:11.493470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.494792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.499031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.502515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.612540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:11.626479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:11.629026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:11.630919 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c77b2656-3194-4af6-a239-bfe413a47cfc tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1604 microversion: 2.42 time: 0.390500 Jul 18 13:19:11.631696 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2117/4380] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:11 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:11.653069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bd09dbfc-f879-460e-98bc-3c47784b83cf req-71fdbbdc-7ca3-4d0d-9caa-0b6dff297796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be825e3-37fc-46d1-8a0a-82b51f67e479", "name": "network-vif-plugged", "status": "completed", "tag": "346b19a4-3c63-4918-bb8f-971fc6c07bec"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:11.673725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bd09dbfc-f879-460e-98bc-3c47784b83cf req-71fdbbdc-7ca3-4d0d-9caa-0b6dff297796 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.679813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bd09dbfc-f879-460e-98bc-3c47784b83cf req-71fdbbdc-7ca3-4d0d-9caa-0b6dff297796 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.737495 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bd09dbfc-f879-460e-98bc-3c47784b83cf req-71fdbbdc-7ca3-4d0d-9caa-0b6dff297796 service nova] Creating event network-vif-plugged:346b19a4-3c63-4918-bb8f-971fc6c07bec for instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 on n-h2-850003-3 Jul 18 13:19:11.754348 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bd09dbfc-f879-460e-98bc-3c47784b83cf req-71fdbbdc-7ca3-4d0d-9caa-0b6dff297796 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108305 Jul 18 13:19:11.757159 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2118/4381] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:11.798013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:11.801212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:11.819019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.820141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:11.821830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:11.824433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:12.081269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:12.094905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79582cf0-e049-476f-a96e-78b54ce7fa41 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.647758 Jul 18 13:19:12.114220 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2264/4382] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:11 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:12.120586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:12.122559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:12.133824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:12.134628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:12.147458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:12.148230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:12.332100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:12.352156 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a3b117c-ebfe-48ec-9e2f-cb85b3a32223 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1523 microversion: 2.1 time: 0.592618 Jul 18 13:19:12.360137 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2119/4383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:11 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1523 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:12.383131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:12.385339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:12.403471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:12.403887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:12.405407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:12.407045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:12.924463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:12.945472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:12.962388 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46e06bcc-fe5d-4d2f-95ee-a9029a9c325c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.845650 Jul 18 13:19:12.965658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd740dfe-4a55-4703-b368-526c3d3211e7 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1663 microversion: 2.1 time: 0.600767 Jul 18 13:19:12.967662 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2120/4384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:12 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1663 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:12.968718 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2265/4385] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:12 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:12.996607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:13.011652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:13.013127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:13.016716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:13.032782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.033530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.036045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.036836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.037405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.038138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.039280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.039918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.135698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.137543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.138669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lazy-loading 'fault' on Instance uuid ac0db110-4810-4c4e-a95a-a3284a61ca35 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:13.261165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:13.281679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:13.284886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ecc5b14c041808dd284e49ba361d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b2c2c435e344ce916120d2372fde2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:13.287456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5cc7f054-9cd4-4c0f-a1a3-798e85339992 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 200 len: 1609 microversion: 2.42 time: 0.314390 Jul 18 13:19:13.302188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2121/4386] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:12 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 1609 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:13.302188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:13.302188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:13.313411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.313991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.315498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.316239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.371780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'flavor' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:13.434371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:13.564558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:13.614301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d8715d8-d68f-44e2-ba1a-daa050d7cabf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.643846 Jul 18 13:19:13.616413 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2266/4387] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:12 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:13.631658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:13.633669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:13.650178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.651790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:13.653984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:13.656286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:14.249369 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cca5bdfd-b19a-44d3-844d-b7a37dff82c7 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.957109 Jul 18 13:19:14.256870 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2122/4388] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:13 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:19:14.261770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:14.263138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:14.275365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:14.276172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:14.277511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:14.278363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:14.725075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:14.743380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-21b8c028-4d08-4ee9-b6e1-81719775d885 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.489631 Jul 18 13:19:14.746313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2123/4389] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:14 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:14.757405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:14.759143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:14.773458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:14.774857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:14.776737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:14.777944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:14.944141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:14.989686 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a08f2974-1fe2-4663-8728-24f67c2d40b3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1523 microversion: 2.1 time: 1.370711 Jul 18 13:19:14.991143 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2267/4390] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:13 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1523 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:15.025979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:15.028556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:15.051499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.053110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.054797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.055804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.157320 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] HTTP exception thrown: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Request method failure captured: Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 HTTP/1.1 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vu3bs6gRQkjYwtGuE2VDmwwZA11ztSQ7Mw5ccxG9OzW4bTBJ0X_vMGPbmq5BYVioG1ji0Sd0OAC2C7EE393nugx3h8qRujaoBJI_xr1zqcmdxYzFPqWXc_7BjYeLVGLoWY752L3OUiQVX6l14vND3L47dL9YTUE8QTMyWZDo8Uy4OY Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_29b2c2c435e344ce916120d2372fde2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa4ecc5b14c041808dd284e49ba361d6 Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ac0db110-4810-4c4e-a95a-a3284a61ca35'} Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:15.160297 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:15.168975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Returning 404 to user: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:15.174186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88908c09-d244-4d0a-bf87-d14fa3b56a68 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 404 len: 111 microversion: 2.42 time: 0.152824 Jul 18 13:19:15.181652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2268/4391] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:15 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:19:15.206504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:15.216527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:15.245498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.264222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.266031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.266853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.347109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:15.378081 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e4e3ff7-fa1e-42e9-8b81-ad051d91d39c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.629835 Jul 18 13:19:15.390264 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2124/4392] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:14 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:15.396979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:15.398621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:15.423866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.425090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.429039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:15.432078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:15.928540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:15.950901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-065b476e-d1a1-4a21-83db-b47f4a0e1ac4 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1666 microversion: 2.1 time: 0.569442 Jul 18 13:19:15.953404 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2125/4393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:15 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1666 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:15.962228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7f800b98-bdd8-4915-9fe1-0556e77282a4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '.version_select at 0x7f96e4c61940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:16.002352 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7f800b98-bdd8-4915-9fe1-0556e77282a4 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027042077" status: 204 len: 0 microversion: 2.42 time: 0.046532 Jul 18 13:19:16.004664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2126/4394] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 13:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027042077 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:19:16.020042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:16.021431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:16.037877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.039451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:16.041393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.042573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:16.107623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:16.122286 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Working on deleting snapshot e9b1aea2-6302-4f60-b245-f001e3855a0b from shelved instance... Jul 18 13:19:16.135632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:16.183499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b51741d9-d993-43d3-9314-3d03479cccd8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.999890 Jul 18 13:19:16.189128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2269/4395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:15 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:16.211808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:16.213117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:16.253565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.253801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:16.265096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.272716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:16.812963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:16.854470 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbdd81e5-b174-4e60-8348-f4a3c0c00923 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1508 microversion: 2.1 time: 0.658083 Jul 18 13:19:16.856425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2270/4396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:16 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1508 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:16.867316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:16.869867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:16.904598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.909500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:16.911554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:16.917010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:18.007130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:18.036214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d3f4cf7-5e01-48e0-b29d-e3c74986610d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 1.177467 Jul 18 13:19:18.049280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2271/4397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:16 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:18.079826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:18.081131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:18.113161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:18.134921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:18.136283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:18.137018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:18.175737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Doing local delete in cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) {{(pid=131367) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 13:19:18.176759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:18.177303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:18.177897 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 13:19:18.197349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] deallocate_for_instance() {{(pid=131367) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 13:19:18.951330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:18.970012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46585cd7-1ac2-4e6d-8335-0dd009bcdc82 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 200 len: 1508 microversion: 2.1 time: 0.915762 Jul 18 13:19:18.997467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2272/4398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:18 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 1508 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:19.006922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:19.019451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:19.023573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:19.053115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:19.054286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:19.055764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:19.056685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:19.957431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:19.971352 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ed31db83-ca8a-4b65-b279-397bff075d1f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.971496 Jul 18 13:19:19.976978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2273/4399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:18 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:19.984700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:19.985533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:20.008695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:20.011554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:20.012885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:20.014822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:20.133943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:20.248184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:20.446802 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c74ba548-5451-4340-9924-8045ffbef069 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 204 len: 0 microversion: 2.1 time: 0.466649 Jul 18 13:19:20.461783 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2274/4400] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:19 2022] DELETE /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:20.492935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:20.495462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:20.531814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:20.533173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:20.537669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:20.540184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:21.610423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:21.652083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb361d9b-cd78-4032-972f-df3b8cab0ba3 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 1.186709 Jul 18 13:19:21.656712 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2275/4401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:20 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:21.687387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1023627753", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "f4333680-b8f0-40bc-870c-17b737d1c961"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:21.860265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Updating instance_info_cache with network_info: [] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:19:21.986332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] validate_networks() for [('f4333680-b8f0-40bc-870c-17b737d1c961', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:19:23.242119 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-78ca953a-d0c9-48c4-a279-d1fd2b78567a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 204 len: 0 microversion: 2.1 time: 7.234954 Jul 18 13:19:23.248413 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2127/4402] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:16 2022] DELETE /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 0 bytes in 7238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:23.259774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:23.265735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:23.284094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:23.284923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:23.285935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:23.288911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:24.373057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:24.390081 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0ee4cb1-1973-44db-a933-ee5e90ff88f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 1.139440 Jul 18 13:19:24.392311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2128/4403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:23 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:24.400906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c5fe14bf-3841-466c-a90a-a2a25ef8e73e req-b55ecb72-4552-4b09-97c9-0c8cc7bc989e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a72f842-29be-45f9-814f-de2fe85afc29", "name": "network-vif-deleted", "tag": "034db7d6-b05a-4515-b940-996313b507a6"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:24.422461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c5fe14bf-3841-466c-a90a-a2a25ef8e73e req-b55ecb72-4552-4b09-97c9-0c8cc7bc989e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:24.423285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c5fe14bf-3841-466c-a90a-a2a25ef8e73e req-b55ecb72-4552-4b09-97c9-0c8cc7bc989e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:24.443724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_external_events [req-c5fe14bf-3841-466c-a90a-a2a25ef8e73e req-b55ecb72-4552-4b09-97c9-0c8cc7bc989e service nova] Unable to find a host for instance 0a72f842-29be-45f9-814f-de2fe85afc29. Dropping event network-vif-deleted {{(pid=131367) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 13:19:24.445334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c5fe14bf-3841-466c-a90a-a2a25ef8e73e req-b55ecb72-4552-4b09-97c9-0c8cc7bc989e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.050825 Jul 18 13:19:24.448452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2129/4404] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 13:19:24.457943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:24.458904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:24.472760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:24.473602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:24.475460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:24.476430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.032766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:19:25.034118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:19:25.034804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:19:25.035331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:19:25.035882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:19:25.067106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.068215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.069443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.074662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.107577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:19:25.115525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Getting quotas for user 2ab4a8758df44a8d97c3add30443cc58 and project 62bf061f6ecf4a5aabbaca99db28b5a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:19:25.148141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:19:25.153246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:19:25.230498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:25.252484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25561471-adc3-4ee5-8a36-fbb6ebab79a1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.802412 Jul 18 13:19:25.254331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2130/4405] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:24 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:25.259233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:25.274298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 0a72f842-29be-45f9-814f-de2fe85afc29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:25.282632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.283338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.284528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.285167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.298014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de2cae4e-808d-432c-8bb1-090b7f8aba49 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.635839 Jul 18 13:19:25.311909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2276/4406] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:19:25.320282 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 HTTP/1.1 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0a72f842-29be-45f9-814f-de2fe85afc29'} Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:25.328970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. Jul 18 13:19:25.334905 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:25.337266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 404 to user: Instance 0a72f842-29be-45f9-814f-de2fe85afc29 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:25.338893 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-827c2983-a435-411c-b334-68966c70cf58 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29" status: 404 len: 111 microversion: 2.1 time: 0.083535 Jul 18 13:19:25.340400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e639b60-91ef-4001-9075-169aeca7d239 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:25.341295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e639b60-91ef-4001-9075-169aeca7d239 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:25.346386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2131/4407] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:25 2022] GET /compute/v2.1/servers/0a72f842-29be-45f9-814f-de2fe85afc29 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:25.359908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:25.360425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:25.372093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.372555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.373751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.375054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.424831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:25.538470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:25.604486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3e639b60-91ef-4001-9075-169aeca7d239 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:25.633981 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e639b60-91ef-4001-9075-169aeca7d239 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1218 microversion: 2.1 time: 0.313760 Jul 18 13:19:25.640934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2277/4408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:25 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1218 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:25.657264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:25.657899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:25.693887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.694755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.696115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.696796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.699499 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96908d7a-17cd-46f0-a0c5-96c17f5facbe tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 204 len: 0 microversion: 2.1 time: 0.346988 Jul 18 13:19:25.702707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2132/4409] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:25 2022] DELETE /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:25.724790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:25.728239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:25.771165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.774896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:25.781748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:25.782523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:26.230443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:26.254859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b552368-fe02-43f1-8d91-99da00392d70 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1466 microversion: 2.1 time: 0.546419 Jul 18 13:19:26.280571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2133/4410] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:25 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1466 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:19:26.297178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:26.300323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:26.333900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:26.335765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:26.340048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:26.343579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:26.958953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:26.974485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b0a4de76-2d42-45a6-9b05-be5c78dd7380 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.691841 Jul 18 13:19:26.975519 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2134/4411] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:26 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:27.000071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:27.001131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:27.015985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:27.020731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:27.023327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:27.025685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:27.324699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:27.338173 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26e79bb0-971b-4fa0-b382-eb6361aaa520 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1214 microversion: 2.1 time: 0.360628 Jul 18 13:19:27.338686 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2135/4412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:26 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:27.383728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-23636e04-1063-4019-844d-9f3809b558ab req-43014c9a-d49e-421b-a593-c495cd04c83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be825e3-37fc-46d1-8a0a-82b51f67e479", "name": "network-vif-deleted", "tag": "346b19a4-3c63-4918-bb8f-971fc6c07bec"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:27.411494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-23636e04-1063-4019-844d-9f3809b558ab req-43014c9a-d49e-421b-a593-c495cd04c83d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:27.411938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-23636e04-1063-4019-844d-9f3809b558ab req-43014c9a-d49e-421b-a593-c495cd04c83d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:27.465490 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-23636e04-1063-4019-844d-9f3809b558ab req-43014c9a-d49e-421b-a593-c495cd04c83d service nova] Creating event network-vif-deleted:346b19a4-3c63-4918-bb8f-971fc6c07bec for instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 on n-h2-850003-3 Jul 18 13:19:27.483428 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-23636e04-1063-4019-844d-9f3809b558ab req-43014c9a-d49e-421b-a593-c495cd04c83d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138277 Jul 18 13:19:27.488155 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2136/4413] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:27.517831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:27.518579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:27.558698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:27.559371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:27.560818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:27.562954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:27.634442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:27.648047 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-27d5419e-0f9b-459f-b38f-70a24e928a77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 2.005582 Jul 18 13:19:27.685724 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2278/4414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:25 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:28.002637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:28.003171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:28.020995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:28.037902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:28.039737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:28.041997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:28.042952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:28.075583 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eee2a876-035c-47cc-a753-cd8081527a3f tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1466 microversion: 2.1 time: 0.584778 Jul 18 13:19:28.083562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2137/4415] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:27 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1466 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:28.382001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-498411272", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "34b58645-1186-4c39-ae63-7eda3ce4da81"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:28.581816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] validate_networks() for [('34b58645-1186-4c39-ae63-7eda3ce4da81', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:19:28.689203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:28.704852 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-971349bb-0903-4246-adfc-d3654b4296e4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.705232 Jul 18 13:19:28.716284 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2279/4416] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:27 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:28.730125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:28.734034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:28.748138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:28.749486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:28.750815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:28.751703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:28.914723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:28.942348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e98818dd-d83e-4c2d-96da-e67a624a131a tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1276 microversion: 2.1 time: 0.221373 Jul 18 13:19:28.944757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2280/4417] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:28 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:28.967125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:28.968467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:29.008746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:29.009896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:29.013505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:29.014734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:30.569514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:30.640070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfaae466-0f96-492b-a58c-a95b7995dca4 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 1.683009 Jul 18 13:19:30.658315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2281/4418] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:28 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:30.674583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:30.676410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:30.714338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:30.715593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:30.719099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:30.722373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:30.836207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:30.837560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:30.840478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lazy-loading 'fault' on Instance uuid 79319dc7-b0ad-464c-be95-4e2b2f850b48 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:31.110481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:19:31.111276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:19:31.112130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:19:31.113028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:19:31.113580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:19:31.188682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.189814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.190696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.191239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.217844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:31.245877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9130c9e0-41fc-4132-8e6c-1fb0763a7e3a tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 200 len: 1304 microversion: 2.1 time: 0.599555 Jul 18 13:19:31.252365 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2282/4419] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:30 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 1304 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:31.269390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:31.271141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:31.292232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.293013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.294264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Getting quotas for project a913df555a6649b38411fe3a887b0ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:19:31.298435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.299566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.309880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Getting quotas for user 5f1cfd40f22a448788b4f0171a5a3db7 and project a913df555a6649b38411fe3a887b0ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:19:31.368353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:19:31.374815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:19:31.495977 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5801762b-8df8-4705-999b-3208edaf98b8 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.378349 Jul 18 13:19:31.497154 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2138/4420] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:19:31.536227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:31.537270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:31.567773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:31.570727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.571498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.572672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.575129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.803764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:31.833224 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8a2275b-8d83-4ee9-98d9-a1260a047752 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1276 microversion: 2.1 time: 0.322459 Jul 18 13:19:31.839086 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2139/4421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:31 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:31.851815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-80f2b4ea-1d17-45cd-a25c-50c836bc43b8 req-acd845bd-759b-4026-829f-a6b644ffabe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79319dc7-b0ad-464c-be95-4e2b2f850b48", "name": "network-vif-deleted", "tag": "0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:31.893969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-80f2b4ea-1d17-45cd-a25c-50c836bc43b8 req-acd845bd-759b-4026-829f-a6b644ffabe3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:31.894900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-80f2b4ea-1d17-45cd-a25c-50c836bc43b8 req-acd845bd-759b-4026-829f-a6b644ffabe3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:31.944747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-80f2b4ea-1d17-45cd-a25c-50c836bc43b8 req-acd845bd-759b-4026-829f-a6b644ffabe3 service nova] Creating event network-vif-deleted:0fb2ff1d-4b19-4c9d-bf5d-b6fcd2c10659 for instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 on n-h1-850003-3 Jul 18 13:19:31.966335 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-80f2b4ea-1d17-45cd-a25c-50c836bc43b8 req-acd845bd-759b-4026-829f-a6b644ffabe3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122411 Jul 18 13:19:31.968106 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2140/4422] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:31.980232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:31.981661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:32.196076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:32.217784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:32.229374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:32.246468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d14ab941-512c-4206-834a-416965c8e629 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1258 microversion: 2.21 time: 0.276215 Jul 18 13:19:32.249118 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2141/4423] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:31 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1258 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:32.253989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:32.255110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:32.276774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:32.278080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:32.279984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:32.280838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:32.788439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:32.807807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98bc68fc-0847-424e-88f7-9f0c8260d90c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.559101 Jul 18 13:19:32.808615 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2142/4424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:32 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:32.835751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:32.837565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 79319dc7-b0ad-464c-be95-4e2b2f850b48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:32.880920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:32.882089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:32.886101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:32.893001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:32.925093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:32.939010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29f0dc62-892f-4354-b4de-5c24eac148ff tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 1.680961 Jul 18 13:19:32.945552 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2283/4425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:31 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:32.961358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 HTTP/1.1 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '79319dc7-b0ad-464c-be95-4e2b2f850b48'} Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:32.963873 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. Jul 18 13:19:32.968671 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:32.970215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:32.970766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 404 to user: Instance 79319dc7-b0ad-464c-be95-4e2b2f850b48 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:32.971834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be1d40ca-0104-4195-9dac-66383ceba556 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48" status: 404 len: 111 microversion: 2.1 time: 0.159549 Jul 18 13:19:32.977055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:32.977303 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2143/4426] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:32 2022] GET /compute/v2.1/servers/79319dc7-b0ad-464c-be95-4e2b2f850b48 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:32.982844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:32.983352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:33.004121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.004873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.016712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.017681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.018253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.020830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.029144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.030863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.130301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:33.652690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-faef9fb6-8f47-4d91-ba30-5170e7b9ddcd tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 204 len: 0 microversion: 2.1 time: 0.667803 Jul 18 13:19:33.655792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2144/4427] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:32 2022] DELETE /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:33.670969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:33.673661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:33.706300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.707141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.710328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.712253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.789365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:33.815365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-acbedf4d-259f-4f79-88ab-8d3dd6710ed0 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1276 microversion: 2.1 time: 0.864967 Jul 18 13:19:33.823911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2284/4428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:32 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1276 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:33.842518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:33.844217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:33.876967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.877417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.878424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:33.878932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:33.948803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:34.018170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:34.029971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:34.049864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a92e1f7-9d89-4189-9f9a-5fc1cc7d09f4 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1254 microversion: 2.21 time: 0.387203 Jul 18 13:19:34.065695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2145/4429] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:33 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1254 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:34.088181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:34.093524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:34.122010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:34.122986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:34.125433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:34.127315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:34.744526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:34.761079 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa5ebde3-81be-4bcf-86e0-372aee4f8ea0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.693517 Jul 18 13:19:34.775857 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2146/4430] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:34 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:34.803440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:34.804998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:34.828144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:34.828990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:34.830067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:34.830899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:35.086807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:35.613531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:35.637421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:35.684102 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-892aedca-36d1-4f7e-8b17-41036b5b5913 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1508 microversion: 2.1 time: 1.857780 Jul 18 13:19:35.687751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2285/4431] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:33 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1508 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:35.696898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:35.698615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:35.719209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:35.721058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:35.730265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:35.732899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.016747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:36.032217 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9d35ad90-65b7-49c3-bf84-71b21939a4df tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 1.254370 Jul 18 13:19:36.039623 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2147/4432] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:34 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:36.046496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:36.052092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:36.083664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.084931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.090545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.093005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.682505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:36.694067 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a0ad5d4-e977-463a-b4a7-02576ea6ba88 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 1.004344 Jul 18 13:19:36.706739 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2286/4433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:35 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:36.723796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:36.724790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:36.739368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.749303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.751069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.752456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.816461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] HTTP exception thrown: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Request method failure captured: Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 HTTP/1.1 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vu3bs6gRQkjYwtGuE2VDmwwZA11ztSQ7Mw5ccxG9OzW4bTBJ0X_vMGPbmq5BYVioG1ji0Sd0OAC2C7EE393nugx3h8qRujaoBJI_xr1zqcmdxYzFPqWXc_7BjYeLVGLoWY752L3OUiQVX6l14vND3L47dL9YTUE8QTMyWZDo8Uy4OY Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_29b2c2c435e344ce916120d2372fde2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa4ecc5b14c041808dd284e49ba361d6 Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ac0db110-4810-4c4e-a95a-a3284a61ca35'} Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:36.827137 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:36.835455 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:36.838833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Returning 404 to user: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:36.841930 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f062e5f8-6b24-4552-9a63-60e2e12604f3 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 404 len: 111 microversion: 2.42 time: 0.133027 Jul 18 13:19:36.844631 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2287/4434] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:19:36 2022] DELETE /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:19:36.858372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:36.859915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:36.872829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.874580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:36.876301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:36.877411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.290948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:37.320598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:37.331660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:37.336422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bb320b3-e284-4e09-af39-fecd7c449fb6 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1316 microversion: 2.21 time: 1.294935 Jul 18 13:19:37.346817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2148/4435] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:36 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1316 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:37.362322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1627438425", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "ca7bed02-6d6a-4123-8719-58a0a0debff6"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:37.363828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:37.389264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3765c6be-20b4-45d6-bdf5-1272cf3e3aa6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.537627 Jul 18 13:19:37.406708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2288/4436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:36 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:37.423292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:37.424710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:37.443143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.445371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.447583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.449589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.559051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] validate_networks() for [('ca7bed02-6d6a-4123-8719-58a0a0debff6', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:19:37.740545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:37.762451 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8c2358bf-7101-49a5-9c63-b78f59c4a702 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 200 len: 1466 microversion: 2.1 time: 0.353515 Jul 18 13:19:37.768001 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2289/4437] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:37 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 1466 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:37.790559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:37.796900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] [instance: ac0db110-4810-4c4e-a95a-a3284a61ca35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:37.833292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.836603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.838485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.839204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.894539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] HTTP exception thrown: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Request method failure captured: Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 HTTP/1.1 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vu3bs6gRQkjYwtGuE2VDmwwZA11ztSQ7Mw5ccxG9OzW4bTBJ0X_vMGPbmq5BYVioG1ji0Sd0OAC2C7EE393nugx3h8qRujaoBJI_xr1zqcmdxYzFPqWXc_7BjYeLVGLoWY752L3OUiQVX6l14vND3L47dL9YTUE8QTMyWZDo8Uy4OY Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_29b2c2c435e344ce916120d2372fde2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/29b2c2c435e344ce916120d2372fde2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 29b2c2c435e344ce916120d2372fde2a Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1398421422 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa4ecc5b14c041808dd284e49ba361d6 Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1398421422-project Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ac0db110-4810-4c4e-a95a-a3284a61ca35'} Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:37.899348 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. Jul 18 13:19:37.906561 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:37.912920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] Returning 404 to user: Instance ac0db110-4810-4c4e-a95a-a3284a61ca35 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:37.914870 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7fbb438a-8b85-442d-a2dd-8711c439eed8 tempest-TaggedBootDevicesTest_v242-1398421422 tempest-TaggedBootDevicesTest_v242-1398421422-project] 10.222.0.88 "GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35" status: 404 len: 111 microversion: 2.42 time: 0.142191 Jul 18 13:19:37.916000 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2290/4438] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:37 2022] GET /compute/v2.1/servers/ac0db110-4810-4c4e-a95a-a3284a61ca35 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:19:37.938553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:37.948343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:37.977144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.981505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:37.985071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:37.986985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:38.575477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:38.614095 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-040d602d-1a89-4d8b-99f7-a54658ee8534 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1534 microversion: 2.1 time: 0.694126 Jul 18 13:19:38.621423 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2291/4439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:37 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1534 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:38.651888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:38.653632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:38.696955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:38.697630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:38.703635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:38.708658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.432367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:39.457584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-733f07d2-3294-4619-856b-f8dc2540f149 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 0.831124 Jul 18 13:19:39.458309 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2292/4440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:38 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:39.474605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2bbd2903-8551-4bde-bc6e-07d78e7feb91 req-50aecb02-4b1c-4277-9a37-ee66de656635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1212db38-4f34-4a1b-aa7d-27e1f3e8eab9", "name": "network-vif-deleted", "tag": "c236389b-1572-429b-945e-9b33f5609779"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:39.501126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2bbd2903-8551-4bde-bc6e-07d78e7feb91 req-50aecb02-4b1c-4277-9a37-ee66de656635 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:39.503598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2bbd2903-8551-4bde-bc6e-07d78e7feb91 req-50aecb02-4b1c-4277-9a37-ee66de656635 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.515233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:39.543341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2bbd2903-8551-4bde-bc6e-07d78e7feb91 req-50aecb02-4b1c-4277-9a37-ee66de656635 service nova] Creating event network-vif-deleted:c236389b-1572-429b-945e-9b33f5609779 for instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 on n-h2-850003-3 Jul 18 13:19:39.562742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2bbd2903-8551-4bde-bc6e-07d78e7feb91 req-50aecb02-4b1c-4277-9a37-ee66de656635 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100872 Jul 18 13:19:39.568243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2293/4441] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:39.584954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:39.589041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:39.611106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:39.611695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.612756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:39.622443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.720259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:19:39.721265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:19:39.722318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:19:39.723199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:19:39.723774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:19:39.749499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:39.750717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.753631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:39.755380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:39.854307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Getting quotas for project a3cb301c1df8416fbfa30433dc1b8cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:19:39.882668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Getting quotas for user 15fc70a08b8742b39cc0fbdf62ccd8ba and project a3cb301c1df8416fbfa30433dc1b8cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:19:39.935811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:19:39.949061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:19:40.109554 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-692e6086-eb5d-4f6f-93d4-e3f0a3a79808 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.757816 Jul 18 13:19:40.115818 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2149/4442] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:19:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:19:40.127322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:40.128038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:40.168266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:40.172025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:40.178206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:40.178943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:40.778752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:40.798470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:40.808809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:40.811220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d035b5f-87bf-475c-a2c6-9d4a643c9234 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 1.235928 Jul 18 13:19:40.811663 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2294/4443] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:39 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:40.833899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:40.833899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:40.844433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:40.850381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:40.850891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:40.851786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:40.862356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:40.871506 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8480773-935c-4e50-a9e6-51aeb1f6df82 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.753322 Jul 18 13:19:40.875017 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2150/4444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:40 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:40.894879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2cf3046d-dfe4-44ab-adfc-b270d5151d20 req-b10251a8-0f88-467c-9782-e8334066ce4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9815a964-1cb0-4cde-ab02-ae9f3047ef78", "tag": "84551beb-63f3-49fb-910e-0d089e7e99c2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:40.923864 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 HTTP/1.1 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1212db38-4f34-4a1b-aa7d-27e1f3e8eab9'} Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:40.932325 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 404 to user: Instance 1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:40.937576 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ab310fdc-e167-4cd6-b35c-8a5b5fb66c39 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9" status: 404 len: 111 microversion: 2.1 time: 0.121488 Jul 18 13:19:40.938117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2cf3046d-dfe4-44ab-adfc-b270d5151d20 req-b10251a8-0f88-467c-9782-e8334066ce4a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:40.938117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2cf3046d-dfe4-44ab-adfc-b270d5151d20 req-b10251a8-0f88-467c-9782-e8334066ce4a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:40.942719 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2295/4445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:40 2022] GET /compute/v2.1/servers/1212db38-4f34-4a1b-aa7d-27e1f3e8eab9 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:40.966718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:40.967595 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2cf3046d-dfe4-44ab-adfc-b270d5151d20 req-b10251a8-0f88-467c-9782-e8334066ce4a service nova] Creating event network-changed:84551beb-63f3-49fb-910e-0d089e7e99c2 for instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 on n-h1-850003-3 Jul 18 13:19:40.967897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:40.979024 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2cf3046d-dfe4-44ab-adfc-b270d5151d20 req-b10251a8-0f88-467c-9782-e8334066ce4a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101417 Jul 18 13:19:40.980342 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2151/4446] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:40.996906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91c0db5e-7c97-41e6-b793-5e83ac35e024 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:41.003112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.003752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.004853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.005585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.016573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91c0db5e-7c97-41e6-b793-5e83ac35e024 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:41.247567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-91c0db5e-7c97-41e6-b793-5e83ac35e024 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:41.273635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91c0db5e-7c97-41e6-b793-5e83ac35e024 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1219 microversion: 2.1 time: 0.291551 Jul 18 13:19:41.281203 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2152/4447] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:40 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1219 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:41.301625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7ec8f43a-74c7-44af-b9bd-9868c4478589 req-71abfb5e-cb46-4a4d-9564-217975925664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "name": "network-vif-plugged", "status": "completed", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:41.320034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7ec8f43a-74c7-44af-b9bd-9868c4478589 req-71abfb5e-cb46-4a4d-9564-217975925664 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.320871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7ec8f43a-74c7-44af-b9bd-9868c4478589 req-71abfb5e-cb46-4a4d-9564-217975925664 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.391447 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7ec8f43a-74c7-44af-b9bd-9868c4478589 req-71abfb5e-cb46-4a4d-9564-217975925664 service nova] Creating event network-vif-plugged:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:19:41.400557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7ec8f43a-74c7-44af-b9bd-9868c4478589 req-71abfb5e-cb46-4a4d-9564-217975925664 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117547 Jul 18 13:19:41.410484 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2153/4448] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:41.430767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:41.432457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:41.445766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.447375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.448754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.449382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.455708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:41.826760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:41.840797 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d3f9de5-7f6a-4eb0-80d0-39ffecdca1f3 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 0.425564 Jul 18 13:19:41.842315 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2154/4449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:41 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:41.853222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:41.856287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:41.871010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.871511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.875275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:41.876251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:41.934841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:42.129106 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d39b4eb6-f6bd-4727-a895-c243d70871ba tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 204 len: 0 microversion: 2.1 time: 0.282346 Jul 18 13:19:42.132068 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2155/4450] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:41 2022] DELETE /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:42.158450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:42.161493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:42.176340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.176794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.177600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.178046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.491503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:42.541588 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f9b94bb-a451-4b9d-83df-32aeba04ef2a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 1.597293 Jul 18 13:19:42.545226 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2296/4451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:40 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:42.554397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:42.557257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:42.578390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.579375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.580353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.580954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.866126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:42.899196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:42.909798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:42.912480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:42.912660 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb35433e-d640-4c4f-b721-8c04ac0162ad tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.365907 Jul 18 13:19:42.918340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4cff748-3876-41ed-91bd-738668621d75 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 0.781888 Jul 18 13:19:42.922570 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2297/4452] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:42 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:42.933399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d1ebebef-dfd7-42ac-b0a6-f5fe8883e4bc req-5d654ab7-4118-4195-b6c6-a19decc8bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c1c779-e03c-488d-a531-417267387335", "tag": "d25640e0-0989-468d-9e5b-e2c82d4100c5"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:42.936459 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2156/4453] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:42 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:42.955758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1ebebef-dfd7-42ac-b0a6-f5fe8883e4bc req-5d654ab7-4118-4195-b6c6-a19decc8bcd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.956237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1ebebef-dfd7-42ac-b0a6-f5fe8883e4bc req-5d654ab7-4118-4195-b6c6-a19decc8bcd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.971762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:42.972978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:42.983280 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d1ebebef-dfd7-42ac-b0a6-f5fe8883e4bc req-5d654ab7-4118-4195-b6c6-a19decc8bcd0 service nova] Creating event network-changed:d25640e0-0989-468d-9e5b-e2c82d4100c5 for instance 56c1c779-e03c-488d-a531-417267387335 on n-h2-850003-3 Jul 18 13:19:42.987729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.989989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.992208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:42.992935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:42.998986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d1ebebef-dfd7-42ac-b0a6-f5fe8883e4bc req-5d654ab7-4118-4195-b6c6-a19decc8bcd0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068215 Jul 18 13:19:43.000291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2298/4454] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:43.009881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:43.015977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:43.039956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.043891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.045950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.050535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.319074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:43.343076 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-029e3a20-cf00-4403-b342-e07efb8ecdc9 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1495 microversion: 2.1 time: 0.386915 Jul 18 13:19:43.362852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2157/4455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:42 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1495 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:43.372789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:43.374524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:43.384426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.385321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.386686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.387344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.402989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:43.422900 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4cbd9f3-4935-453f-be66-07ceab82b011 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1289 microversion: 2.1 time: 0.420710 Jul 18 13:19:43.436489 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2299/4456] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:43 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1289 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:43.567561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:43.568353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:43.582767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.583606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.586297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.593554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.743195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:43.769508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-685f7cf6-6c7d-405b-a2d0-2448505d29ad tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 0.404504 Jul 18 13:19:43.776997 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2158/4457] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:43 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:43.950247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:43.954536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:43.967543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.968273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:43.969708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:43.970615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.150225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.168856 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d3bd43c-cb9d-41f9-b543-6d50368926d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.608152 Jul 18 13:19:44.169474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2300/4458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:43 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:19:44.184698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:44.185544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:44.212845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.213330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.214179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.219810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.486043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.517240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fadd2d03-02a7-41d8-970c-48c34d067516 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 0.571031 Jul 18 13:19:44.537300 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2159/4459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:43 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:44.549944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:44.551570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:44.573571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.575401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.577064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.577482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.634133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.660644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.662673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.664986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f741217-855d-4e36-832c-b92c3189ec3f tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 0.491933 Jul 18 13:19:44.674576 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2301/4460] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:44 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:44.690630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:44.705080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:44.741867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.750612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.755831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:44.761675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:44.961575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:44.995615 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f8b55f7-68cf-4562-aa16-cfc8ebc2feba tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1289 microversion: 2.1 time: 0.316428 Jul 18 13:19:44.999907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2302/4461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:44 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1289 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:45.047482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:45.051271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:45.090019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.093681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:45.095189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.095697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:45.316198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:45.332142 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c97594f-772a-43a9-8568-8d70510c56af tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1495 microversion: 2.1 time: 0.793250 Jul 18 13:19:45.333986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2160/4462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:44 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1495 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:45.347565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:45.348923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:45.363742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.365450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:45.370035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.372508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:45.809169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:45.824692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be9cda57-8aea-4538-921d-2d25cefab910 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.484067 Jul 18 13:19:45.826698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2161/4463] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:45 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:45.852312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:45.853204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:45.864677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.874459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:45.875744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:45.876433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:46.341503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:46.360856 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-85073d03-0ae9-4d20-8936-ee44a0f6f238 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 1.358614 Jul 18 13:19:46.371899 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2303/4464] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:44 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:46.400166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:46.401247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:46.425534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:46.426321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:46.427535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:46.428340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:47.035088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:47.049360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-716febc7-2c6f-455b-8d30-8a8a5d92a6c5 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1522 microversion: 2.1 time: 1.216000 Jul 18 13:19:47.060551 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2162/4465] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:45 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1522 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:47.076862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:47.080200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:47.164919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:47.171691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:47.192425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:47.197671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.308650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:48.340453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-31e92475-7526-4d89-a6d9-648a12972b24 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 1.277354 Jul 18 13:19:48.354211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2163/4466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:47 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:48.366901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:48.366901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:48.394743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.395717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.402804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.403614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.557611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:48.580783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:48.591966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:48.617146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd4b87c2-ecca-402f-b2b0-90633ab8a660 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 2.240046 Jul 18 13:19:48.625774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2304/4467] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:46 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:48.672693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:48.676353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:48.732449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:48.742951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.753887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.764590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.775059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.808608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3ac37a8-085e-4aac-a752-406f05926dbc tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 200 len: 1453 microversion: 2.1 time: 0.464478 Jul 18 13:19:48.844146 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2164/4468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:48 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 1453 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:48.904920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:48.906091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:48.951581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.952116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:48.953109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:48.953558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:49.495838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:49.512746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb3a33e2-09ac-44de-a3c2-17b3e7d7ba9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.882848 Jul 18 13:19:49.514714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2305/4469] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:48 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:49.520589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:49.527500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:49.549690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:49.560904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:49.569496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:49.570413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:49.570889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:49.782328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:50.153305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:50.208489 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2771489f-eab6-4722-80f2-7ffdcccd56ac tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 1.351496 Jul 18 13:19:50.212431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2165/4470] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:48 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:50.245356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0bdef62c-4145-470c-aad2-02e39ea8af4e req-9ed980f6-4453-46dc-9529-c9f97f6d01d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21787a3c-9911-451e-bcae-c07aff3b5b9a", "name": "network-vif-deleted", "tag": "dfb531cb-fbc8-4aa0-bdbf-482f29506871"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:50.326487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0bdef62c-4145-470c-aad2-02e39ea8af4e req-9ed980f6-4453-46dc-9529-c9f97f6d01d0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:50.328595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0bdef62c-4145-470c-aad2-02e39ea8af4e req-9ed980f6-4453-46dc-9529-c9f97f6d01d0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:50.406230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0bdef62c-4145-470c-aad2-02e39ea8af4e req-9ed980f6-4453-46dc-9529-c9f97f6d01d0 service nova] Creating event network-vif-deleted:dfb531cb-fbc8-4aa0-bdbf-482f29506871 for instance 21787a3c-9911-451e-bcae-c07aff3b5b9a on n-h1-850003-3 Jul 18 13:19:50.462534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0bdef62c-4145-470c-aad2-02e39ea8af4e req-9ed980f6-4453-46dc-9529-c9f97f6d01d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236387 Jul 18 13:19:50.470649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:50.472018 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2166/4471] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:50.487172 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c55ffc8a-b59d-4bdc-88f6-bc29a50beaeb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1502 microversion: 2.1 time: 0.970843 Jul 18 13:19:50.487801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2306/4472] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:49 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1502 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:50.523563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:50.534913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:50.535412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:50.536133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:50.569929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:50.591131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:50.593082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:50.595377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:50.598221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:50.599037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:50.601533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:50.610585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.208716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:51.226552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:51.228206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:51.229719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60fe1104-4387-4271-804b-9236a1c5719b tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 0.715150 Jul 18 13:19:51.238121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2307/4473] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:50 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:51.255185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:51.256146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 21787a3c-9911-451e-bcae-c07aff3b5b9a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:51.266066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.270683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.272432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:51.274060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.274897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.308125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a HTTP/1.1 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '21787a3c-9911-451e-bcae-c07aff3b5b9a'} Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:51.311857 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. Jul 18 13:19:51.317534 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:51.323164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 404 to user: Instance 21787a3c-9911-451e-bcae-c07aff3b5b9a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:51.324485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-86ef3cc7-42cd-4f55-8f04-2ddfb3901990 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a" status: 404 len: 111 microversion: 2.1 time: 0.085181 Jul 18 13:19:51.327907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2308/4474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:51 2022] GET /compute/v2.1/servers/21787a3c-9911-451e-bcae-c07aff3b5b9a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:51.339231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:51.346078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:51.374753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.377649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.381473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.383480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.431129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:51.440037 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36dcb2f4-df36-4746-8924-ad34ab2ec114 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.962479 Jul 18 13:19:51.440639 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2167/4475] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:50 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:51.453435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:51.458783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:51.489294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.490140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.491453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.492061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.666030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:51.698272 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-993c6522-5416-4ce9-a49e-5af8e985a203 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1514 microversion: 2.1 time: 0.357289 Jul 18 13:19:51.699399 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2309/4476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:51 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:51.712550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ba2f5871-7345-4310-b31b-9223983e4580 req-372c109d-d36d-49bf-9043-41e39cf69e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a", "tag": "1680a25b-8a7c-487c-a72b-4e0f1e9d6a93"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:51.737546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ba2f5871-7345-4310-b31b-9223983e4580 req-372c109d-d36d-49bf-9043-41e39cf69e14 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.738603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ba2f5871-7345-4310-b31b-9223983e4580 req-372c109d-d36d-49bf-9043-41e39cf69e14 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.780959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ba2f5871-7345-4310-b31b-9223983e4580 req-372c109d-d36d-49bf-9043-41e39cf69e14 service nova] Creating event network-changed:1680a25b-8a7c-487c-a72b-4e0f1e9d6a93 for instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a on n-h1-850003-3 Jul 18 13:19:51.806489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ba2f5871-7345-4310-b31b-9223983e4580 req-372c109d-d36d-49bf-9043-41e39cf69e14 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103684 Jul 18 13:19:51.807440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2310/4477] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:51.813346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d49db16e-54cf-4877-9c1e-cd6da973762e req-84efae14-c464-4d40-80ad-d27808fca505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9815a964-1cb0-4cde-ab02-ae9f3047ef78", "name": "network-vif-plugged", "status": "completed", "tag": "84551beb-63f3-49fb-910e-0d089e7e99c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:51.824857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d49db16e-54cf-4877-9c1e-cd6da973762e req-84efae14-c464-4d40-80ad-d27808fca505 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.825891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d49db16e-54cf-4877-9c1e-cd6da973762e req-84efae14-c464-4d40-80ad-d27808fca505 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.845589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d49db16e-54cf-4877-9c1e-cd6da973762e req-84efae14-c464-4d40-80ad-d27808fca505 service nova] Creating event network-vif-plugged:84551beb-63f3-49fb-910e-0d089e7e99c2 for instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 on n-h1-850003-3 Jul 18 13:19:51.908810 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d49db16e-54cf-4877-9c1e-cd6da973762e req-84efae14-c464-4d40-80ad-d27808fca505 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094079 Jul 18 13:19:51.911713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2311/4478] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:51.925144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:51.926039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:51.941367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.942136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:51.943244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:51.954586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.347216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:52.363896 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e257f856-7121-4656-bb94-beba03dde487 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 0.445971 Jul 18 13:19:52.367434 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2312/4479] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:51 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:52.382220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:52.384645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:52.404880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.405537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.406847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.408019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.479661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:52.483804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:52.637806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:52.661295 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-caeb66d4-dddb-4086-9df5-a51365dd1325 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 1.213477 Jul 18 13:19:52.662808 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2168/4480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:51 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:52.665725 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-044c71d8-45f5-41c2-a68f-bc852ee2e1c8 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 204 len: 0 microversion: 2.1 time: 0.294333 Jul 18 13:19:52.666831 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2313/4481] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:19:52 2022] DELETE /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:19:52.684070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:52.686300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:52.686827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 9ae6cc34-9795-44d5-8f6e-c576b88df6a3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:52.687275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:52.703215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.704503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. Jul 18 13:19:52.707247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.709770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.710325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/9ae6cc34-9795-44d5-8f6e-c576b88df6a3/action HTTP/1.1 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 14 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: {"rescue": {}} Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '9ae6cc34-9795-44d5-8f6e-c576b88df6a3', 'body': {'rescue': {}}} Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:52.713221 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. Jul 18 13:19:52.718561 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:19:52.719809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 404 to user: Instance 9ae6cc34-9795-44d5-8f6e-c576b88df6a3 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:52.721047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ecda63a-1c79-420e-a59c-0078bd7513b2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/9ae6cc34-9795-44d5-8f6e-c576b88df6a3/action" status: 404 len: 111 microversion: 2.1 time: 0.056440 Jul 18 13:19:52.722132 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2169/4482] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:52 2022] POST /compute/v2.1/servers/9ae6cc34-9795-44d5-8f6e-c576b88df6a3/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:19:52.727972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:52.737650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:52.760016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.761112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:52.762793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:52.763316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.295138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:53.310196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:53.316191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:53.332709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c89e0d36-0057-4b07-b514-4723f7153b2c tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.609006 Jul 18 13:19:53.336342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:53.336880 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2170/4483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:52 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:53.343082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:53.351461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f79d38fa-e3a5-4527-a127-cb600852abff tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 0.682224 Jul 18 13:19:53.360567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:53.364116 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2314/4484] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:52 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:53.374874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:53.375873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:53.380530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:53.385757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.386459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.387430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.388624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.418047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.418865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.419970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.420605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.557314 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ac4f9fb-9555-49b1-ba83-7b675b9f2faf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action" status: 202 len: 0 microversion: 2.1 time: 0.190586 Jul 18 13:19:53.562164 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2315/4485] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:53 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:19:53.582004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:53.597399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:53.617079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.619801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.621698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:53.635219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:53.924324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:53.952135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8912facb-188d-43bb-9a39-2d74f72cabad tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1672 microversion: 2.1 time: 0.613233 Jul 18 13:19:53.959651 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2171/4486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:53 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1672 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:53.974042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:53.975647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:54.002747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.003888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.005564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.006590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.479726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:54.509421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-28804310-5dfd-4192-9c25-0abe4a3e653f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 0.947651 Jul 18 13:19:54.531112 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2316/4487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:53 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:54.553013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:54.560779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:54.588164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.589183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.593155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.594105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.613172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:54.630381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0b6b2dc-f76a-4ae1-a6ea-d71d3939257e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1519 microversion: 2.1 time: 0.661445 Jul 18 13:19:54.639340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2172/4488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:53 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1519 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:54.664666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-92d2339a-6fad-4374-b8bd-cfc3e466eb1b req-69faf775-d65b-4d56-8c7c-e968a2a79628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c1c779-e03c-488d-a531-417267387335", "name": "network-vif-plugged", "status": "completed", "tag": "d25640e0-0989-468d-9e5b-e2c82d4100c5"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:54.674814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92d2339a-6fad-4374-b8bd-cfc3e466eb1b req-69faf775-d65b-4d56-8c7c-e968a2a79628 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.675351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92d2339a-6fad-4374-b8bd-cfc3e466eb1b req-69faf775-d65b-4d56-8c7c-e968a2a79628 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.728236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-92d2339a-6fad-4374-b8bd-cfc3e466eb1b req-69faf775-d65b-4d56-8c7c-e968a2a79628 service nova] Creating event network-vif-plugged:d25640e0-0989-468d-9e5b-e2c82d4100c5 for instance 56c1c779-e03c-488d-a531-417267387335 on n-h2-850003-3 Jul 18 13:19:54.770789 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-92d2339a-6fad-4374-b8bd-cfc3e466eb1b req-69faf775-d65b-4d56-8c7c-e968a2a79628 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118529 Jul 18 13:19:54.771618 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2173/4489] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:54.785218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:54.786375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:54.793618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:19:54.797141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.797767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:54.798725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:54.799329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.270975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:55.286834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b947ca04-137a-4093-9a8b-f661cf1d64ef tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.509803 Jul 18 13:19:55.298714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2174/4490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:54 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:55.303933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:55.304609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:55.334259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.335239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.345918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.348933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.417326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:55.451146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-acf02291-1b80-4d44-b009-ac98cb7f225f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.912452 Jul 18 13:19:55.465950 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2317/4491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:55.479785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:55.489889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:55.521043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.525178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.526250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.530789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.831788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:55.851214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:55.857602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:55.861665 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ed0aa73-e0b3-4c77-9d77-b6892599077c tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1358 microversion: 2.21 time: 0.568084 Jul 18 13:19:55.877853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2175/4492] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:55 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1358 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:55.886904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:55.886904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:55.901368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.901825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:55.906520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:55.907469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:56.174091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:56.185945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02321522-4090-41d2-aeb4-c98aca471faa tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1672 microversion: 2.1 time: 0.718540 Jul 18 13:19:56.195143 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2318/4493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:55 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1672 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:56.202493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:56.212175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:56.225929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:56.226735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:56.227725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:56.233931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:56.733539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:56.767012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0924f3de-6418-4e79-a84a-3b4acee167db tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1499 microversion: 2.1 time: 0.569705 Jul 18 13:19:56.785004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2319/4494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:56 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1499 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:56.816993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:56.832255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:56.861370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:56.862676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:56.864397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:56.865528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.302966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:57.334984 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54aebb37-d0c4-47f0-8031-cea0c60e665d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1318 microversion: 2.1 time: 1.455275 Jul 18 13:19:57.336598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2176/4495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:55 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1318 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:57.346106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:57.356797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:57.376210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.377531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.379594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.380719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.515128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:57.532484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c8cc36c-cda8-4975-8f5e-67d24c9e95f4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.745282 Jul 18 13:19:57.546837 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2320/4496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:56 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:57.561114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:57.563909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:57.582660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.583999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.585766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.587945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.640575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'flavor' on Instance uuid 759af7c7-2105-449b-aaa8-597abc961e94 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:19:57.683664 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Cannot 'rescue' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state paused Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action HTTP/1.1 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 14 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: {"rescue": {}} Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'rescue' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state paused Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '759af7c7-2105-449b-aaa8-597abc961e94', 'body': {'rescue': {}}} Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 759af7c7-2105-449b-aaa8-597abc961e94 in vm_state paused. Cannot rescue while the instance is in this state. Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state paused Jul 18 13:19:57.688627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state paused Jul 18 13:19:57.702108 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:19:57.706040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 409 to user: Cannot 'rescue' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state paused {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:19:57.712038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0195b0e9-7eae-44fc-9fda-c602f9a71dc1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action" status: 409 len: 144 microversion: 2.1 time: 0.163119 Jul 18 13:19:57.712646 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2321/4497] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:57 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action => generated 144 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:19:57.724858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:57.725863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:57.734774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.736645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:57.737738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:57.738383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.123217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:58.162306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:58.186684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:58.196554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:58.212000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3333ee80-7e8d-460b-8d94-76f475ac505e tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1550 microversion: 2.21 time: 0.472523 Jul 18 13:19:58.215039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-295fa9cc-6d68-4d0d-ba95-a7fb0a44b0b8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.876493 Jul 18 13:19:58.219110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2322/4498] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:57 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1550 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:19:58.230013 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2177/4499] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:57 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:58.248191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:58.248913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:58.252147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:58.255071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:58.268787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.269894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.270911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.274462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.274928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.275771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.276212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.278270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.501999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6674fff-04ab-47fc-b772-23d90fbf53b1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action" status: 202 len: 0 microversion: 2.1 time: 0.269648 Jul 18 13:19:58.508562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2178/4500] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:19:58 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:19:58.528030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ca624ebb-4c78-45f0-9416-95c822c36007 req-0d293688-80a9-4b69-9433-3f2ec4a01e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b2ac7-9dfd-4893-9af0-4d2760a36550", "name": "network-vif-deleted", "tag": "a5d879b8-8462-40ce-a6a9-d902fcb1a3ef"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:19:58.560662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ca624ebb-4c78-45f0-9416-95c822c36007 req-0d293688-80a9-4b69-9433-3f2ec4a01e89 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.563464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ca624ebb-4c78-45f0-9416-95c822c36007 req-0d293688-80a9-4b69-9433-3f2ec4a01e89 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.608124 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ca624ebb-4c78-45f0-9416-95c822c36007 req-0d293688-80a9-4b69-9433-3f2ec4a01e89 service nova] Creating event network-vif-deleted:a5d879b8-8462-40ce-a6a9-d902fcb1a3ef for instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 on n-h2-850003-3 Jul 18 13:19:58.625809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ca624ebb-4c78-45f0-9416-95c822c36007 req-0d293688-80a9-4b69-9433-3f2ec4a01e89 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110814 Jul 18 13:19:58.627990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2179/4501] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:19:58.646348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:58.649567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:58.683312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.687645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.687975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:58.689780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.696871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.729563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ce67e158-f5f5-4ba3-b636-92ed2811200c tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1321 microversion: 2.1 time: 0.492400 Jul 18 13:19:58.740132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2323/4502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:58 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:58.763644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:19:58.766655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:58.767889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:58.828930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.829744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.830867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:58.843453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:58.976715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed7586d0-afac-4bc5-a820-6c0f85b20a42 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "DELETE /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 204 len: 0 microversion: 2.21 time: 0.346237 Jul 18 13:19:58.980681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2180/4503] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:19:58 2022] DELETE /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:19:58.998447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:59.001269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:59.030862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.032150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:59.039515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.042417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:59.594551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:59.661869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eefd4874-2477-4021-b0b3-1e85a5b44580 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1506 microversion: 2.1 time: 0.676984 Jul 18 13:19:59.665919 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2181/4504] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:58 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:59.691553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:59.695291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:59.729762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.730577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:59.731895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.732555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:59.876415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:19:59.892730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b168224-225e-414f-9ad9-411d74f0e2fe tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1508 microversion: 2.1 time: 1.149642 Jul 18 13:19:59.898707 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2324/4505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:58 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1508 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:19:59.926509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:19:59.927289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:19:59.979893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.980734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:19:59.982754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:19:59.983505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.209795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:00.224474 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-95fcba2f-c922-4c7d-ae97-90ca39672d7b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.556672 Jul 18 13:20:00.237308 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2182/4506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:19:59 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:00.245234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:00.246010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:00.281138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.289554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.291096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.291911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.660214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:00.709414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:00.717028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:00.726858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9ad2ded-c4b7-412d-9bbb-bd284c471356 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1556 microversion: 2.21 time: 0.825170 Jul 18 13:20:00.738818 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2325/4507] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:19:59 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1556 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:00.738818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:00.758501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:00.776357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.777313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.784467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.785109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.892002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.900117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.901056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lazy-loading 'fault' on Instance uuid 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:20:00.928679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:00.951603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a25216f4-206e-422e-8f14-0ecacd59a586 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.707335 Jul 18 13:20:00.954450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2183/4508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:00 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:00.967801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:00.970646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:00.994882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:00.996347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:00.998744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:01.000510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:01.137191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f71d1ab3c5486baee0f8160f0648d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8bec8cefb49b6882b116e4a92ba44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:01.172728 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37af0b79-f3e6-4661-8c20-1691b0402da0 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 200 len: 1326 microversion: 2.1 time: 0.443446 Jul 18 13:20:01.173544 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2326/4509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:00 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 1326 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:01.194760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:01.195462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:01.221000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:01.229081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:01.235423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:01.239297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:01.319176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:01.670104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:01.702842 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d7a3375-bf57-4162-909b-8763feb87891 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1508 microversion: 2.1 time: 0.746823 Jul 18 13:20:01.712318 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2184/4510] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:00 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:01.738266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:01.739350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:01.764387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:01.780851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:01.786946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:01.787427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.308067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:02.318083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f95a31b1-cf1e-4739-93c5-f02d085e3af6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1514 microversion: 2.1 time: 1.134130 Jul 18 13:20:02.326199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2327/4511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:01 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1514 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:02.337927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-44f173e0-32de-4c01-891f-780f01b6fe20 req-ae016116-5ed0-4eed-a14e-8ff851fb9a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a", "name": "network-vif-plugged", "status": "completed", "tag": "1680a25b-8a7c-487c-a72b-4e0f1e9d6a93"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:02.361333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44f173e0-32de-4c01-891f-780f01b6fe20 req-ae016116-5ed0-4eed-a14e-8ff851fb9a49 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.363123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44f173e0-32de-4c01-891f-780f01b6fe20 req-ae016116-5ed0-4eed-a14e-8ff851fb9a49 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.395543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-44f173e0-32de-4c01-891f-780f01b6fe20 req-ae016116-5ed0-4eed-a14e-8ff851fb9a49 service nova] Creating event network-vif-plugged:1680a25b-8a7c-487c-a72b-4e0f1e9d6a93 for instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a on n-h1-850003-3 Jul 18 13:20:02.422836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-44f173e0-32de-4c01-891f-780f01b6fe20 req-ae016116-5ed0-4eed-a14e-8ff851fb9a49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092850 Jul 18 13:20:02.423534 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2328/4512] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:20:02.475219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:02.480087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:02.534112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.534112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.535131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.535641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.611592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:02.631214 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b402d46f-34ad-438a-8f9e-e6e5793534ca tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.917488 Jul 18 13:20:02.631842 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2185/4513] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:01 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:02.670090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:02.682826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:02.720415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.721501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.724149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.731054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.761868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:02.810639 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02fab97f-a831-4004-aaf5-da625666b847 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "PUT /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1080 microversion: 2.1 time: 0.385052 Jul 18 13:20:02.811289 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2329/4514] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:20:02 2022] PUT /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1080 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:02.819348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:02.827059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:02.839252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.840753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:02.842553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:02.843596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.275228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:03.291596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:03.293448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:03.297163 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9071d850-0e18-41a3-8801-ba0e1068c3b2 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1556 microversion: 2.21 time: 0.664154 Jul 18 13:20:03.297792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2186/4515] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:02 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1556 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:03.311430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:03.322330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] [instance: 2f3b2ac7-9dfd-4893-9af0-4d2760a36550] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:03.340449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.340869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.341872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.346819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.371114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] HTTP exception thrown: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Request method failure captured: Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 HTTP/1.1 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Vq0wqoudkLdfKX2Kv6Dw6bCzJlBBZ3haf0Jt1fyvZsDc7zs_CGnjeK14FPGQioRICjg84VE_rLMX5t-aKm4CAoX0k687oxeohh_3UDXM3kqBFRNERJeV-z-v6RUnEDjtJdfuZUEBdIel9rCV1GNHeE1iEGjsc0fgtN5L5hFc7ZrnR0 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aef8bec8cefb49b6882b116e4a92ba44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aef8bec8cefb49b6882b116e4a92ba44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: aef8bec8cefb49b6882b116e4a92ba44 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-1519048127 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 82f71d1ab3c5486baee0f8160f0648d5 Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-1519048127-project Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2f3b2ac7-9dfd-4893-9af0-4d2760a36550'} Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:03.400947 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. Jul 18 13:20:03.405495 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:03.407073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Returning 404 to user: Instance 2f3b2ac7-9dfd-4893-9af0-4d2760a36550 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:03.408178 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8596704d-74ee-4ef1-863a-0d756c827fb6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550" status: 404 len: 111 microversion: 2.1 time: 0.109395 Jul 18 13:20:03.409332 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2187/4516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:03 2022] GET /compute/v2.1/servers/2f3b2ac7-9dfd-4893-9af0-4d2760a36550 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:03.425716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:03.426756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:03.456232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.456986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.462256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.463055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.713569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:03.758535 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ec31344-2715-4004-ac09-8ccdc529811f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.941184 Jul 18 13:20:03.769166 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2330/4517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:02 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:03.783412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bec8027f-b874-4ca3-b89f-54cd49e8f0c6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] Calling method '.version_select at 0x7f96e46fe670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:03.840143 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bec8027f-b874-4ca3-b89f-54cd49e8f0c6 tempest-ServerActionsTestJSON-1519048127 tempest-ServerActionsTestJSON-1519048127-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415955086" status: 202 len: 0 microversion: 2.1 time: 0.067607 Jul 18 13:20:03.841108 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2331/4518] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415955086 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:20:03.852832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:03.853649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:03.875050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.875784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.877494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.878219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.912965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:03.926886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb2bfecd-4ad6-43ff-88d2-20a3e7888d07 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1506 microversion: 2.1 time: 0.512429 Jul 18 13:20:03.932123 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2188/4519] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:03 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:03.948610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:03.949647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:03.965460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.966957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:03.968072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:03.968774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.463535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:04.485924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-539bf842-b1db-4f9e-9f19-eb9bde771d65 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1319 microversion: 2.1 time: 0.643170 Jul 18 13:20:04.498314 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2332/4520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:03 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1319 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:04.498314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:04.498702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:04.515118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.516430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.518100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.518608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.689649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:04.717143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:04.732597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f1cfd40f22a448788b4f0171a5a3db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a913df555a6649b38411fe3a887b0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:04.734955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4303f82-0530-4450-b681-5079d5efd3dd tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 200 len: 1514 microversion: 2.21 time: 0.246558 Jul 18 13:20:04.736666 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2333/4521] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:04 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:04.789156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:04.791422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:04.814757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.815459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.816518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.818359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.941223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:04.955032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f72036fc-1cb1-4af1-bbf5-69d8fff24982 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1506 microversion: 2.1 time: 1.010627 Jul 18 13:20:04.956012 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2189/4522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:03 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1506 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:04.975138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:04.976400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:04.990197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.990671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:04.991526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:04.991910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:05.135604 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b55ec6bc-8168-46ee-b4cf-5d2600496675 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "PUT /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1082 microversion: 2.1 time: 0.164562 Jul 18 13:20:05.137379 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2190/4523] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:20:04 2022] PUT /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1082 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:05.154644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:05.155523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:05.166476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:05.168302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:05.170830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:05.171614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:05.766982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:05.801917 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-093165f2-d26e-4608-91da-7b1d906ce2b4 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 1.028021 Jul 18 13:20:05.806835 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2334/4524] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:04 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:05.820228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-872bd740-e2cc-46d9-8d77-88b65f6b251a req-3728f7f3-6f55-4ca0-9c97-877585cfd351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c1c779-e03c-488d-a531-417267387335", "name": "network-vif-deleted", "tag": "d25640e0-0989-468d-9e5b-e2c82d4100c5"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:05.869066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-872bd740-e2cc-46d9-8d77-88b65f6b251a req-3728f7f3-6f55-4ca0-9c97-877585cfd351 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:05.875151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-872bd740-e2cc-46d9-8d77-88b65f6b251a req-3728f7f3-6f55-4ca0-9c97-877585cfd351 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:05.926341 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-872bd740-e2cc-46d9-8d77-88b65f6b251a req-3728f7f3-6f55-4ca0-9c97-877585cfd351 service nova] Creating event network-vif-deleted:d25640e0-0989-468d-9e5b-e2c82d4100c5 for instance 56c1c779-e03c-488d-a531-417267387335 on n-h2-850003-3 Jul 18 13:20:05.937828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-872bd740-e2cc-46d9-8d77-88b65f6b251a req-3728f7f3-6f55-4ca0-9c97-877585cfd351 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126010 Jul 18 13:20:05.940894 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2335/4525] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:20:05.956129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:05.957029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:05.982785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:05.983411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:05.984472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:05.990100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.428081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:06.462596 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30f1ff7c-5954-4b1e-8a4d-f30c1715a446 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1508 microversion: 2.1 time: 1.311609 Jul 18 13:20:06.466899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:06.467198 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2191/4526] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:05 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1508 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:06.481915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12a1d5af-41b7-4aae-a11e-6df70024acee tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1508 microversion: 2.1 time: 0.529502 Jul 18 13:20:06.486961 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2336/4527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:05 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:06.493762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:06.497192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:06.499216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:06.500204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:06.531031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.533453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.534096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.534942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.535421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.544341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.549499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.550262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.577076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] HTTP exception thrown: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Request method failure captured: Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 HTTP/1.1 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V3fASYX-yShA_SvpAOBStF09m98kDh8jBFf0iPy9LkE6vo4zBSyLPxrSrfN4m4zavuLuYQOEE7o8L55j9fsGMgEp_k5KdMkocKy19hRcVRmQyIBAzFM5oFCDAq1EW1Ar10CuMjuviUA6bXzcr3_VikXhqe0crKEVPn7kPVUa-sq3Hk Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913df555a6649b38411fe3a887b0ed8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 5f1cfd40f22a448788b4f0171a5a3db7 Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '56c1c779-e03c-488d-a531-417267387335'} Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:06.583946 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:06.588346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:06.591951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Returning 404 to user: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:06.599398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-561c1b9d-b6e0-4557-b19a-56080c8731ae tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 404 len: 111 microversion: 2.21 time: 0.111018 Jul 18 13:20:06.604074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'flavor' on Instance uuid 759af7c7-2105-449b-aaa8-597abc961e94 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:20:06.618280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2337/4528] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:06 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:20:06.627232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:06.633435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:06.658433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.663916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.666590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.675335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.857627 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d1b52126-8f86-43c9-971d-a6b76862909d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action" status: 200 len: 32 microversion: 2.1 time: 0.382585 Jul 18 13:20:06.863306 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2192/4529] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:20:06 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:20:06.873123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '.version_select at 0x7f96e4532160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:06.888287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:06.912787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.913529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:06.914749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:06.915351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.135342 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-99d3c872-bd41-41ec-a5c6-5f000093bd02 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.269482 Jul 18 13:20:07.144314 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2193/4530] 10.222.0.88 () {60 vars in 1336 bytes} [Mon Jul 18 13:20:06 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335/os-instance-actions => generated 611 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:20:07.158942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:07.159829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:07.177448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.177908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.178960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.179572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.228782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:07.244484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07cff3b4-c0f7-46fe-8c76-93a09f887739 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1508 microversion: 2.1 time: 0.624589 Jul 18 13:20:07.245862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2338/4531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:06 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:07.253242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:07.263147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:07.275725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.284862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.286234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.287269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.921454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:07.930911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0249efb1-fd49-43f2-b3e4-c75928c47e10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.683637 Jul 18 13:20:07.948069 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2339/4532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:07 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:07.971219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:07.972028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:07.974656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:07.980591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.981904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.987536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:07.988235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:07.991375 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5101ebb6-c204-4459-9f9f-3d25928b9592 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.837563 Jul 18 13:20:07.998995 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2194/4533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:07 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:08.005106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:08.006603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:08.013985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.014875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.016664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.017755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.051071 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] HTTP exception thrown: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Request method failure captured: Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 HTTP/1.1 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V3fASYX-yShA_SvpAOBStF09m98kDh8jBFf0iPy9LkE6vo4zBSyLPxrSrfN4m4zavuLuYQOEE7o8L55j9fsGMgEp_k5KdMkocKy19hRcVRmQyIBAzFM5oFCDAq1EW1Ar10CuMjuviUA6bXzcr3_VikXhqe0crKEVPn7kPVUa-sq3Hk Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913df555a6649b38411fe3a887b0ed8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 5f1cfd40f22a448788b4f0171a5a3db7 Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '56c1c779-e03c-488d-a531-417267387335'} Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:08.052796 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Returning 404 to user: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:08.061867 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-95c35d9e-5ed1-425e-9b5c-e2bde91a5c81 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "DELETE /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 404 len: 111 microversion: 2.21 time: 0.105736 Jul 18 13:20:08.065927 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2340/4534] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:20:07 2022] DELETE /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:20:08.080846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:08.088099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:20:08.089095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] [instance: 56c1c779-e03c-488d-a531-417267387335] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:08.110563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.117369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.118374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.124178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.171616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] HTTP exception thrown: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Request method failure captured: Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 HTTP/1.1 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V3fASYX-yShA_SvpAOBStF09m98kDh8jBFf0iPy9LkE6vo4zBSyLPxrSrfN4m4zavuLuYQOEE7o8L55j9fsGMgEp_k5KdMkocKy19hRcVRmQyIBAzFM5oFCDAq1EW1Ar10CuMjuviUA6bXzcr3_VikXhqe0crKEVPn7kPVUa-sq3Hk Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913df555a6649b38411fe3a887b0ed8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913df555a6649b38411fe3a887b0ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a913df555a6649b38411fe3a887b0ed8 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-93229502 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 5f1cfd40f22a448788b4f0171a5a3db7 Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-InstanceActionsV221TestJSON-93229502-project Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '56c1c779-e03c-488d-a531-417267387335'} Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.175975 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. Jul 18 13:20:08.180300 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:08.186383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] Returning 404 to user: Instance 56c1c779-e03c-488d-a531-417267387335 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:08.188311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3adbfaca-d7e3-45a1-9eaa-56a02ccf5a36 tempest-InstanceActionsV221TestJSON-93229502 tempest-InstanceActionsV221TestJSON-93229502-project] 10.222.0.88 "GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335" status: 404 len: 111 microversion: 2.21 time: 0.122658 Jul 18 13:20:08.195552 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2341/4535] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:08 2022] GET /compute/v2.1/servers/56c1c779-e03c-488d-a531-417267387335 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:20:08.350736 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6cf8972-467f-404c-ae23-e734cdf05b23 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 204 len: 0 microversion: 2.1 time: 0.347213 Jul 18 13:20:08.352884 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2195/4536] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:20:07 2022] DELETE /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:20:08.367976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:08.375265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:08.383310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.384006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.384982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.385585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.437126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:20:08.580220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Instance is already in deleting state, ignoring this request Jul 18 13:20:08.581086 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91624827-47ba-4dc9-849d-1db35df4123d tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 204 len: 0 microversion: 2.1 time: 0.217135 Jul 18 13:20:08.584741 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2342/4537] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:20:08 2022] DELETE /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:20:08.601455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:08.602917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:08.648854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.654447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.661687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:08.662552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:08.963709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:08.964872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:09.003176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:09.005741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:09.007387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:09.011873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:09.149570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:09.213152 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2575dd5a-37a2-4c27-be5e-e9468d57e6df tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1514 microversion: 2.1 time: 0.626158 Jul 18 13:20:09.213778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2196/4538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:08 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1514 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:09.221299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:09.221935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:09.239586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:09.240052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:09.240878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:09.241331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:09.508883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:09.519044 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-011e7d36-db8a-45b9-9861-57b208ec9271 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.301887 Jul 18 13:20:09.525163 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2197/4539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:09 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:10.239276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:10.240619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:10.260570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:10.261396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:10.262235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:10.262711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:10.835834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:10.882116 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69aa77f2-0aee-4866-b3cf-d7a7be61edff tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 1.927965 Jul 18 13:20:10.887765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2343/4540] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:08 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:10.912386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:10.913530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:10.962611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:10.967285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:10.968839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:10.973687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:11.155310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:11.176417 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be3c03b6-7e64-40fa-aad5-308d49cd0bef tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1514 microversion: 2.1 time: 0.945419 Jul 18 13:20:11.181691 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2198/4541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:10 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1514 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:11.727295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:11.751073 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-245cbb9f-3ba1-4449-9318-cf0c4aefdd6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.860814 Jul 18 13:20:11.765176 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2344/4542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:10 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:11.904936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:11.905629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:11.956678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:11.964263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:11.970072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:11.973560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.012588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:12.169248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-586d30ac-a312-45d1-944d-96628067667c req-3b81fd8f-a6ee-403a-a857-e5185e1d53e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9815a964-1cb0-4cde-ab02-ae9f3047ef78", "name": "network-vif-deleted", "tag": "84551beb-63f3-49fb-910e-0d089e7e99c2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:12.253539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-586d30ac-a312-45d1-944d-96628067667c req-3b81fd8f-a6ee-403a-a857-e5185e1d53e7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.254394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-586d30ac-a312-45d1-944d-96628067667c req-3b81fd8f-a6ee-403a-a857-e5185e1d53e7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.318183 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-586d30ac-a312-45d1-944d-96628067667c req-3b81fd8f-a6ee-403a-a857-e5185e1d53e7 service nova] Creating event network-vif-deleted:84551beb-63f3-49fb-910e-0d089e7e99c2 for instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 on n-h1-850003-3 Jul 18 13:20:12.343309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-586d30ac-a312-45d1-944d-96628067667c req-3b81fd8f-a6ee-403a-a857-e5185e1d53e7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188162 Jul 18 13:20:12.350980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2345/4543] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:20:12.357529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:12.358290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:12.407191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.407661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.427091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.427682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.572240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.572849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.573412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lazy-loading 'fault' on Instance uuid 9815a964-1cb0-4cde-ab02-ae9f3047ef78 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:20:12.659532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:12.674221 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e674de3a-0f78-43a0-874d-8be866f75a45 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.770009 Jul 18 13:20:12.685925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2199/4544] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:11 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:12.775676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:12.777147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:12.781827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4a8758df44a8d97c3add30443cc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf061f6ecf4a5aabbaca99db28b5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:12.785603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.786007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:12.786625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.787673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:12.788343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:12.790860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd6438ad-71ec-4d08-af7b-82bb2b9176d2 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 200 len: 1308 microversion: 2.1 time: 0.438528 Jul 18 13:20:12.791454 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2346/4545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:12 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:13.216349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:13.235149 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50a889ad-2a12-4623-82a9-dfa582da58fb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.457710 Jul 18 13:20:13.238849 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2200/4546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:12 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:13.692497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:13.693224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:13.716023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:13.716497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:13.717305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:13.717746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:13.820638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:13.828113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 9815a964-1cb0-4cde-ab02-ae9f3047ef78] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:13.847839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:13.851763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:13.855188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:13.856604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:13.913056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] HTTP exception thrown: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Request method failure captured: Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 HTTP/1.1 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0jTycGzrSj1IBDWGL09gPx8oeKuEUJ0vxQNpJ7Iatqr1Ru0dkuQFB2GWDL0KRyBStTwzR6jb3NlinT6XModCs5DTNC9q3L2zyx7rMD2xqX-2fIISiCF1LK840I3caMkj16e3owCDXZQ-6RQMD-EHjJZuPCrAVJtE-6w1orx6QszJA Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_62bf061f6ecf4a5aabbaca99db28b5a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2ab4a8758df44a8d97c3add30443cc58 Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '9815a964-1cb0-4cde-ab02-ae9f3047ef78'} Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:13.920347 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. Jul 18 13:20:13.927499 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:13.931130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Returning 404 to user: Instance 9815a964-1cb0-4cde-ab02-ae9f3047ef78 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:13.937936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f17598fc-e947-4a4b-ba65-1c53efc1328f tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78" status: 404 len: 111 microversion: 2.1 time: 0.130468 Jul 18 13:20:13.941993 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2201/4547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:13 2022] GET /compute/v2.1/servers/9815a964-1cb0-4cde-ab02-ae9f3047ef78 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:13.970894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:13.977094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:13.995700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.000762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.006911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.008294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.049839 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] HTTP exception thrown: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Request method failure captured: Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 HTTP/1.1 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0jTycGzrSj1IBDWGL09gPx8oeKuEUJ0vxQNpJ7Iatqr1Ru0dkuQFB2GWDL0KRyBStTwzR6jb3NlinT6XModCs5DTNC9q3L2zyx7rMD2xqX-2fIISiCF1LK840I3caMkj16e3owCDXZQ-6RQMD-EHjJZuPCrAVJtE-6w1orx6QszJA Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_62bf061f6ecf4a5aabbaca99db28b5a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2ab4a8758df44a8d97c3add30443cc58 Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7be825e3-37fc-46d1-8a0a-82b51f67e479'} Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:14.058976 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.063256 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.068406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Returning 404 to user: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:14.070936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92c71c41-88c6-4f09-981e-9cb07de2be5b tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 404 len: 111 microversion: 2.1 time: 0.121777 Jul 18 13:20:14.073095 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2202/4548] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:20:13 2022] DELETE /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:14.093370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:14.100518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 7be825e3-37fc-46d1-8a0a-82b51f67e479] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:14.144509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.148597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.149631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.151113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.202672 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] HTTP exception thrown: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Request method failure captured: Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 HTTP/1.1 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0jTycGzrSj1IBDWGL09gPx8oeKuEUJ0vxQNpJ7Iatqr1Ru0dkuQFB2GWDL0KRyBStTwzR6jb3NlinT6XModCs5DTNC9q3L2zyx7rMD2xqX-2fIISiCF1LK840I3caMkj16e3owCDXZQ-6RQMD-EHjJZuPCrAVJtE-6w1orx6QszJA Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_62bf061f6ecf4a5aabbaca99db28b5a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2ab4a8758df44a8d97c3add30443cc58 Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '7be825e3-37fc-46d1-8a0a-82b51f67e479'} Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.212124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. Jul 18 13:20:14.217827 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.220041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Returning 404 to user: Instance 7be825e3-37fc-46d1-8a0a-82b51f67e479 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:14.223301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c8103f1-7708-42de-b5c9-899f6a7b9345 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479" status: 404 len: 111 microversion: 2.1 time: 0.144795 Jul 18 13:20:14.226476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2203/4549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:14 2022] GET /compute/v2.1/servers/7be825e3-37fc-46d1-8a0a-82b51f67e479 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:14.241806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:14.242964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:14.271320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.271870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.272635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.273078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.355754 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] HTTP exception thrown: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Request method failure captured: Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 HTTP/1.1 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0jTycGzrSj1IBDWGL09gPx8oeKuEUJ0vxQNpJ7Iatqr1Ru0dkuQFB2GWDL0KRyBStTwzR6jb3NlinT6XModCs5DTNC9q3L2zyx7rMD2xqX-2fIISiCF1LK840I3caMkj16e3owCDXZQ-6RQMD-EHjJZuPCrAVJtE-6w1orx6QszJA Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_62bf061f6ecf4a5aabbaca99db28b5a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 2ab4a8758df44a8d97c3add30443cc58 Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6a1732b2-28cc-4f34-b80d-ec100b8f7ab3'} Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:14.361284 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.365329 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.367562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:14.368931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Returning 404 to user: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:14.371648 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5678c00-81a7-4175-b558-e52160ceeccf tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 404 len: 111 microversion: 2.1 time: 0.142127 Jul 18 13:20:14.375102 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2204/4550] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:20:14 2022] DELETE /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:14.380261 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73bd4a22-3fd6-44dc-811c-2fc5f42cb2d9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.691683 Jul 18 13:20:14.386813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2347/4551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:13 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:14.398251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:14.398927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:14.408574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:14.409836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] [instance: 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:14.427479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.428032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.428851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.429301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.435844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.436937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.439313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:14.439989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:14.477993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] HTTP exception thrown: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Request method failure captured: Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 HTTP/1.1 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0jTycGzrSj1IBDWGL09gPx8oeKuEUJ0vxQNpJ7Iatqr1Ru0dkuQFB2GWDL0KRyBStTwzR6jb3NlinT6XModCs5DTNC9q3L2zyx7rMD2xqX-2fIISiCF1LK840I3caMkj16e3owCDXZQ-6RQMD-EHjJZuPCrAVJtE-6w1orx6QszJA Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_62bf061f6ecf4a5aabbaca99db28b5a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/62bf061f6ecf4a5aabbaca99db28b5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 62bf061f6ecf4a5aabbaca99db28b5a0 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-640062261 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 2ab4a8758df44a8d97c3add30443cc58 Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerDiskConfigTestJSON-640062261-project Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '6a1732b2-28cc-4f34-b80d-ec100b8f7ab3'} Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:14.480172 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. Jul 18 13:20:14.484027 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:20:14.486083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] Returning 404 to user: Instance 6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:14.487352 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5c01f35-f397-4d82-9570-b49e5c7e6be7 tempest-ServerDiskConfigTestJSON-640062261 tempest-ServerDiskConfigTestJSON-640062261-project] 10.222.0.88 "GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3" status: 404 len: 111 microversion: 2.1 time: 0.096998 Jul 18 13:20:14.490814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2348/4552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:14 2022] GET /compute/v2.1/servers/6a1732b2-28cc-4f34-b80d-ec100b8f7ab3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:20:15.000843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:15.015497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42ee9085-fdea-461b-a2c5-5a7812ff2a6c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1529 microversion: 2.1 time: 0.638999 Jul 18 13:20:15.021145 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2205/4553] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:14 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1529 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:15.400055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:15.400897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:15.427521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:15.429218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:15.430728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:15.442512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.009373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-977746211", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:16.098242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:16.098959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:16.099441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:16.099858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:16.100265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:16.110787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.111542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.111667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:16.112657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.116833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.142660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Getting quotas for project 991e702e2842490fab9dbb00b86001db. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:16.146779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6be36533-7fb9-4df4-a2ec-3fe285816694 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.750148 Jul 18 13:20:16.150823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Getting quotas for user 094f4f1f1b0d44e4aabcbd38bef6fab7 and project 991e702e2842490fab9dbb00b86001db. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:16.159067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2349/4554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:15 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:16.173971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:16.178919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:20:16.187602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:20:16.189609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:16.193039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:16.202879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.204108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.205676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.206677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.312517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-16c7185a-7d07-440e-bf44-1ee7b2fa9fac tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.542466 Jul 18 13:20:16.329009 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2206/4555] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 13:20:16.343764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:16.345349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:16.528528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:16.545054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:16.546872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:16.548232 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51e4c657-3888-4751-aa8b-f1bbf30e9e07 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 200 len: 1277 microversion: 2.47 time: 0.217977 Jul 18 13:20:16.553167 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2207/4556] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:16 2022] GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:16.720662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-32755875", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:16.906274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:16.911303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:16.912355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:16.914952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:16.920137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:16.953555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.954902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.957534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:16.958436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:16.989387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:16.999441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Getting quotas for project 991e702e2842490fab9dbb00b86001db. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:17.022846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Getting quotas for user 094f4f1f1b0d44e4aabcbd38bef6fab7 and project 991e702e2842490fab9dbb00b86001db. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:17.083189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:20:17.097526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:20:17.201910 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4dd808e1-a752-40f3-8834-cafbb8f9b181 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.484007 Jul 18 13:20:17.206333 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2208/4557] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 13:20:17.227387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:17.231780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:17.256191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:17.258866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:17.260522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:17.266780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:17.267728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:17.298207 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bc86624-1cc9-4c36-90eb-09a4c17673cd tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1511 microversion: 2.1 time: 1.133379 Jul 18 13:20:17.307087 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2350/4558] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:16 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1511 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:17.330088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2c5f07d-3b50-4923-a519-d04d4e709d71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:17.334804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2c5f07d-3b50-4923-a519-d04d4e709d71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:17.485499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2c5f07d-3b50-4923-a519-d04d4e709d71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "PUT /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 990 microversion: 2.47 time: 0.176581 Jul 18 13:20:17.487036 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2351/4559] 10.222.0.88 () {62 vars in 1296 bytes} [Mon Jul 18 13:20:17 2022] PUT /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 990 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:20:17.515383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:17.516725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:17.718381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:17.735044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:17.740895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:17.740895 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f35963e-c3d6-40da-ac7f-4a80a28d6309 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1276 microversion: 2.47 time: 0.237558 Jul 18 13:20:17.757258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2352/4560] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:17 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:18.232291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:18.255953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-efdfd79f-9aa6-4fcd-b4ac-0c39b2d0d381 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 1.045019 Jul 18 13:20:18.257532 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2209/4561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:17 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:18.340028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:18.342327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:18.361870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:18.363145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:18.364340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:18.375406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:18.766540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:18.767388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:18.794912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:18.796393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:18.800612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:18.807512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:19.054350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:19.084098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:19.088336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:19.094083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38ec712a-1ce8-43d3-b362-278cf8b4d2f4 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1328 microversion: 2.47 time: 0.332198 Jul 18 13:20:19.108109 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2210/4562] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:18 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:19.126028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1a669a2b-7288-4964-887f-339e5eb9b373 req-c5584fb3-55dc-48aa-a6ce-62cc15ac379d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "name": "network-vif-unplugged", "status": "completed", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:19.145749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a669a2b-7288-4964-887f-339e5eb9b373 req-c5584fb3-55dc-48aa-a6ce-62cc15ac379d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:19.147278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a669a2b-7288-4964-887f-339e5eb9b373 req-c5584fb3-55dc-48aa-a6ce-62cc15ac379d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:19.168536 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1a669a2b-7288-4964-887f-339e5eb9b373 req-c5584fb3-55dc-48aa-a6ce-62cc15ac379d service nova] Creating event network-vif-unplugged:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:20:19.184522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1a669a2b-7288-4964-887f-339e5eb9b373 req-c5584fb3-55dc-48aa-a6ce-62cc15ac379d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073382 Jul 18 13:20:19.194777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2211/4563] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:20:19.287700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:19.293441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:19.319429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:19.329446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:19.335048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:19.336571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:19.375378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:19.395484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30de6f04-3868-4fef-af94-3017b3a08403 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1511 microversion: 2.1 time: 1.059756 Jul 18 13:20:19.396662 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2353/4564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:18 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1511 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:19.930030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:19.948762 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94d55c37-8638-4a30-8726-b2cbc0d05177 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.676869 Jul 18 13:20:19.952295 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2212/4565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:19 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:20.118116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:20.120933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:20.138736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:20.140692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:20.142714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:20.144590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:20.372773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:20.392748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:20.395993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:20.410486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ff8f374-26c8-4b52-bf6e-b9cc77e6276e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1336 microversion: 2.47 time: 0.283917 Jul 18 13:20:20.412145 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2354/4566] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:20 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1336 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:20.426526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:20.427699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:20.440017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:20.440490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:20.441332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:20.441792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:20.974646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:20.975485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:20.998778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:20.999242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:21.005086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:21.007510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:21.304687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:21.344473 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5dad5bb-9850-48ca-ab24-831a2405dab1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1511 microversion: 2.1 time: 0.934566 Jul 18 13:20:21.346314 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2213/4567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:20 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1511 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:21.430709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:21.431650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:21.453334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:21.455620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:21.459282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:21.462240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:21.615985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:21.629279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:21.646736 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74d9b486-289e-4332-8f72-f8b7c36f536d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.676325 Jul 18 13:20:21.647322 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2355/4568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:20 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:21.655033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:21.657198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:21.659303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37fe2416-a5cd-441d-9010-9b3c16a7aabc tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1334 microversion: 2.47 time: 0.232861 Jul 18 13:20:21.660716 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2214/4569] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:21 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1334 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:22.371718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:22.375333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:22.410571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:22.412064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:22.413089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:22.413717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:22.664837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:22.666119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:22.681897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:22.683861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:22.686022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:22.690096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:22.905329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:22.966905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee7c7474-987d-4424-8d94-395b830a61f2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1454 microversion: 2.1 time: 0.606880 Jul 18 13:20:22.986759 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2356/4570] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:22 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1454 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:23.013544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:23.017392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:23.055948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:23.060662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:23.064430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:23.065414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:23.263514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:23.291007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:23.295211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:23.297358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6712af81-9ef8-4fa7-80ee-7c4605de8a2e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1334 microversion: 2.47 time: 0.315491 Jul 18 13:20:23.298877 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2357/4571] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:22 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:23.307334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:23.313983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:23.339093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:23.342606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:23.347576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:23.350900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.191696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:24.206584 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00f25243-50bd-4e22-9057-5ae65963d92b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1454 microversion: 2.1 time: 0.906228 Jul 18 13:20:24.216106 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2358/4572] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:23 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1454 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:24.329572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:24.330122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:24.363166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.364218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.368285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.369072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.587208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:24.613760 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fb78cc95-1433-4df2-aa1b-fc653325a15f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 1.952831 Jul 18 13:20:24.619714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2215/4573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:22 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:24.650913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:24.665261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:24.669260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:24.692207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:24.709325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.711275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.712118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.712581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:24.714723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.715333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd639505-148c-48d0-8aa1-871506f5b90b tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1334 microversion: 2.47 time: 0.392235 Jul 18 13:20:24.716998 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2359/4574] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:24 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1334 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:24.796348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'flavor' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:20:24.832923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'shelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state shelved_offloaded Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 14 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: {"shelve": {}} Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'shelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state shelved_offloaded Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'shelve': {}}} Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 18 13:20:24.840457 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state shelved_offloaded Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state shelved_offloaded Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:24.848850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'shelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state shelved_offloaded {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:24.851396 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-738efcfb-9790-4dc2-bc39-440b0603b8c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 155 microversion: 2.1 time: 0.227165 Jul 18 13:20:24.858828 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2216/4575] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:20:24 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 155 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:20:24.866824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:24.867468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:24.879828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.881297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:24.882525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:24.883619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:25.372092 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73945a56-1071-4dd7-bdc6-c10238f8eb93 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.510334 Jul 18 13:20:25.379067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2360/4576] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:20:24 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:20:25.390791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:25.391448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:25.413966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:25.418678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:25.423874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:25.424363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:25.643460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:25.644372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:25.690742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:25.696320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:25.698074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:25.700319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:26.455075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:26.478658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b48eac0-6e2b-47c1-a76f-e34d60f4d932 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.842025 Jul 18 13:20:26.480463 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2361/4577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:25 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:26.504559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:26.512966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:26.531159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:26.532213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:26.533969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:26.535799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:26.589345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:26.606741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c50e139-5f49-420b-854c-8e00d4ad0c70 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1462 microversion: 2.1 time: 1.222024 Jul 18 13:20:26.607691 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2217/4578] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:25 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1462 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:27.086661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:27.121165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:27.124731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:27.131445 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ceb2da14-6265-4a05-85bd-d814ed8c91ad tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1355 microversion: 2.47 time: 0.647894 Jul 18 13:20:27.134662 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2362/4579] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:26 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1355 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:27.161633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:27.163773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:27.179406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:27.186884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:27.189875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.190696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.195596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.196507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.425564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:27.426701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:27.427861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:27.428525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:27.429128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:27.518009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:27.518811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:27.557948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.559073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.560055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.560555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.689089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:27.729561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.730137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.731099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.732119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.736695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:27.853663 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0c10441b-c411-470a-a782-92eaf3011042 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "POST /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6/action" status: 202 len: 1077 microversion: 2.47 time: 0.697548 Jul 18 13:20:27.860936 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2218/4580] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:20:27 2022] POST /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6/action => generated 1077 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 13:20:27.877340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:27.877991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:27.895115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.896935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.898382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:27.900617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:27.955199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:28.223380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:28.252137 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-83c2826a-4318-4f22-b6e6-ac64b00db372 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.744219 Jul 18 13:20:28.259237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2363/4581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:27 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:28.296879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:28.314241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:28.362448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:28.371347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:28.375379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:28.383985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:28.826825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:28.884934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:28.896851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:28.902952 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bebd658d-0028-4ec3-88b8-73128904cb77 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.639991 Jul 18 13:20:28.905948 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2364/4582] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:28 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:28.998227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:29.052128 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45d2ad39-118f-444b-bee7-65f13a1bf119 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1462 microversion: 2.1 time: 1.187159 Jul 18 13:20:29.057080 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2219/4583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:27 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1462 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:29.283651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:29.286019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:29.319177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:29.327285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:29.328753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:29.336176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:29.441367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:29.927719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:29.928668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:29.952975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:29.953986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:29.956941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:29.957820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:30.410841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:30.440971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74b4ce1d-4ff0-4a84-a260-c3525b2fc59d tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 1.166101 Jul 18 13:20:30.443088 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2365/4584] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:29 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:30.452774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:30.454592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:30.478252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:30.480151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:30.483098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:30.484263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:31.021755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:31.055408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:31.063115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:31.066035 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a1ce276-d7ea-4e38-a443-4bf99c5e8e71 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 1.142636 Jul 18 13:20:31.067423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2220/4585] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:29 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:31.156724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:31.175893 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7a05b0e-fce8-4f03-bf8d-aef2af907081 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.730608 Jul 18 13:20:31.177766 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2366/4586] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:30 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:31.489975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:31.494065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:31.514927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:31.521112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:31.533186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:31.534185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:32.101297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:32.103409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:32.118791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:32.119968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:32.123206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:32.124005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:32.213718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:32.236293 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-99655765-9c43-49a2-a113-76a61816af3a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.769313 Jul 18 13:20:32.248807 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2221/4587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:31 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:32.269332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:32.278029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:32.300213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:32.301645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:32.303855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:32.306027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:32.443741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:32.485070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:32.491870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:32.493130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c71f8556-57bd-4180-afc8-4987d3b97b58 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.403280 Jul 18 13:20:32.493716 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2367/4588] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:32 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:32.551563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:32.564337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15a414ca-cd6c-41b7-bfa8-3140d8a7e511 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.315442 Jul 18 13:20:32.565497 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2222/4589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:32 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:33.271110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:33.272013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:33.306941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:33.312368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:33.315875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:33.318780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:33.517621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:33.519095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:33.544967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:33.557362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:33.562541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:33.563963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:34.025314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:34.058376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:34.061046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:34.063496 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c67fce7-30df-426b-9c40-7667f4c0b48e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.553757 Jul 18 13:20:34.081714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2223/4590] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:33 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:34.089015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:34.090976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:34.100738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:34.101997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:34.103637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:34.104620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:34.193894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:34.205817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8f9b4b8-1f74-40eb-a727-8b79d392a70c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.942859 Jul 18 13:20:34.208809 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2368/4591] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:33 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:34.543100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:34.579123 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2366f6f9-8295-42b8-8850-0dc0030ce39a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.494059 Jul 18 13:20:34.582218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2224/4592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:34 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:35.090096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:35.091480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:35.112807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.114096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.116059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.118822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.255820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:35.257990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:35.298337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.299220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.300828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.305443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.403202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:35.416653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:35.421085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:35.425350 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d070294-2f7f-4ec9-b401-f187f4d1996a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.339763 Jul 18 13:20:35.436692 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2369/4593] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:35 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:35.610627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:35.611573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:35.625316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.628761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.633757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.634636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.693213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:35.710959 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7dbc73df-8790-481f-b688-0c23a999b76c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1500 microversion: 2.1 time: 0.478452 Jul 18 13:20:35.711653 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2225/4594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:35 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1500 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:35.748979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc5058e-82d1-4ffc-9996-9909a5da8001"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:35.760499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:35.777111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.780404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.781530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.783499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.857688 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Cannot 'attach_volume' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state rescued Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/os-volume_attachments HTTP/1.1 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 74 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: {"volumeAttachment": {"volumeId": "5fc5058e-82d1-4ffc-9996-9909a5da8001"}} Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'attach_volume' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state rescued Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': '759af7c7-2105-449b-aaa8-597abc961e94', 'body': {'volumeAttachment': {'volumeId': '5fc5058e-82d1-4ffc-9996-9909a5da8001'}}} Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 759af7c7-2105-449b-aaa8-597abc961e94 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 13:20:35.871790 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state rescued Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state rescued Jul 18 13:20:35.880672 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:20:35.893027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 409 to user: Cannot 'attach_volume' instance 759af7c7-2105-449b-aaa8-597abc961e94 while it is in vm_state rescued {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:20:35.894337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b1696761-998d-4906-8074-a7a161b8c9fe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.153720 Jul 18 13:20:35.895485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2226/4595] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:20:35 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/os-volume_attachments => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:20:35.905959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:35.908100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:35.924238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.924855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:35.925754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:35.926442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:36.188978 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-86939e4e-ff39-4e96-b341-fc3bc7712b7f tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action" status: 202 len: 0 microversion: 2.1 time: 0.284201 Jul 18 13:20:36.192555 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2227/4596] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:20:35 2022] POST /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:20:36.195651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:36.212334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:36.213955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5471d417-36ad-460c-b761-facba7c47428 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.608896 Jul 18 13:20:36.214341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:36.216209 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2370/4597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:35 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:36.253214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:36.254492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:36.257840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:36.259731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:36.451304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:36.457937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:36.521391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:36.522844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:36.527173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:36.537267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:36.572169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:36.594201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dad4e400-d4b4-4346-9987-b69d95b474b9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1508 microversion: 2.1 time: 0.394591 Jul 18 13:20:36.613690 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2228/4598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:36 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:36.987250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:37.033189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:37.042070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:37.054998 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5bb05ead-7603-499d-bdb4-c11224fb0228 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.608834 Jul 18 13:20:37.057904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2371/4599] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:36 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:37.247767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:37.249214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:37.269511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:37.279539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:37.280713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:37.284537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:37.956236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:37.997997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-070b02a8-5b56-4a9c-ba8b-1c94366ef847 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.756459 Jul 18 13:20:38.027019 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2372/4600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:37 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:38.043744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:38.044794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:38.053965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:38.054856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:38.056126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:38.057095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:38.322141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1266721398", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "bd7da7a8-4041-4e20-b59b-ac21400cf46c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:38.553379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] validate_networks() for [('bd7da7a8-4041-4e20-b59b-ac21400cf46c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:20:38.585647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:38.656294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8112132e-c8ed-4069-8554-e2811bc3d673 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1508 microversion: 2.1 time: 0.619100 Jul 18 13:20:38.681617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2373/4601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:38 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1508 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:38.708564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:38.711987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:38.756037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:38.757107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:38.764135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:38.771905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:39.151485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:39.174521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:39.177278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:39.180466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff7d653b-55fd-4ddc-949f-b2425824d514 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.495591 Jul 18 13:20:39.181263 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2374/4602] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:38 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:39.206271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:39.209072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:39.228056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:39.229031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:39.231149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:39.234179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:39.991833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:40.018646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e12b3a7d-382c-4aa5-bc9d-f45dbfcbe2a6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.827779 Jul 18 13:20:40.022286 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2375/4603] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:39 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:40.047544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:40.051476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:40.085641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:40.091855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:40.093478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:40.096758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:40.704058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:40.741729 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b103a10d-896e-4e5e-8d3b-4934c156479e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1508 microversion: 2.1 time: 0.717336 Jul 18 13:20:40.744190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2376/4604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:40 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:40.795588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:40.796499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:40.817283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:40.819505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:40.821016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:40.821923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:41.515759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:41.534953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:41.541715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:41.549887 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf168a41-4ec0-4eef-b83b-998d5b490c4a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.793758 Jul 18 13:20:41.553570 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2377/4605] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:40 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:41.570808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:41.572121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:41.590687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:41.591159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:41.596626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:41.598671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:41.931782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:41.932343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:41.932847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:41.934010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:41.934678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:41.972506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:41.972970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:41.975803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:41.976281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:42.047684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:42.066739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for user fc656fa63ca14979915c5b2061147b05 and project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:42.135154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:20:42.156894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:20:42.309077 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-002a32c2-5936-43f8-b046-32eac6e4ae6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.124266 Jul 18 13:20:42.309752 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2229/4606] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:20:42.330352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:42.330979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:42.353881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:42.354682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:42.354825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:42.356023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:42.359231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:42.374095 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb48399b-e0f2-4112-81eb-b5066e42aa4f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 0.816680 Jul 18 13:20:42.389353 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2378/4607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:41 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:42.575778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:42.577619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:42.603596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:42.608498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:42.619916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:42.625655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:42.881729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:42.905815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:42.908656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:42.910995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d41ca380-bcc1-4a6a-b213-c26e4512c0af tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.341713 Jul 18 13:20:42.912604 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2379/4608] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:42 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:42.921292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-207528829", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "bd7da7a8-4041-4e20-b59b-ac21400cf46c"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:43.032214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] validate_networks() for [('bd7da7a8-4041-4e20-b59b-ac21400cf46c', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:20:43.497502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:43.525883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4a32e1f7-b148-4798-9581-c7e504cccb10 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1508 microversion: 2.1 time: 1.214606 Jul 18 13:20:43.527603 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2230/4609] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:42 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1508 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:43.562071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:43.567046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:43.588275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:43.593193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:43.594386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:43.604982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:44.464888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:44.465369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:44.465957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:44.466434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:44.467033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:44.488110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:44.488585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:44.489427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:44.494329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:44.554350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:44.572937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for user fc656fa63ca14979915c5b2061147b05 and project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:44.615459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:20:44.621083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:20:44.780170 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e5ab8df-c92d-40e3-9082-3d2968a1297b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.865422 Jul 18 13:20:44.781188 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2380/4610] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:20:44.816250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:44.820510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:44.857720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:44.864603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:44.873338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:44.874731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:45.093709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:45.113375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:45.147244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:45.153029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:45.164551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79021a50-e3c5-46d1-b99d-5ed2522b26b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.360984 Jul 18 13:20:45.174636 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2381/4611] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:44 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:45.177135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cbc1a0d3-7106-4269-9bbb-051881280e36 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.628229 Jul 18 13:20:45.209490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2231/4612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:43 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:45.227345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:45.236876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:45.250508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-35400562", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "451", "networks": [{"uuid": "bd7da7a8-4041-4e20-b59b-ac21400cf46c"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:45.315508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:45.321682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:45.322787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:45.326817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:45.469925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:45.503442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] validate_networks() for [('bd7da7a8-4041-4e20-b59b-ac21400cf46c', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:20:47.509459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:47.527271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49107577-648a-4682-a1d7-88bdb7533d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1514 microversion: 2.1 time: 2.356560 Jul 18 13:20:47.549910 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2382/4613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:45 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1514 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:47.567830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:47.568619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:47.594286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:47.600883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:47.611585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:47.612716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:47.614897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:47.824957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:20:47.826539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:20:47.827412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:20:47.828402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:20:47.829343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:20:47.832682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:47.880115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:47.880657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:47.881795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:47.891235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:48.016019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:48.053337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Getting quotas for user fc656fa63ca14979915c5b2061147b05 and project 05caf126524c41e69d3b72a5df4a5cc4. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:48.106531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:20:48.108773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:20:48.261828 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a0a6793-cac4-400b-a132-bd2af5a228e6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.050035 Jul 18 13:20:48.262572 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2232/4614] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:20:48.287884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:48.316976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:48.358201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:48.360320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:48.363548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:48.365939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:48.401758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:48.425747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:48.428521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:48.434066 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13c3b300-e4e5-491b-9ffc-373c082c371e tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.878653 Jul 18 13:20:48.450242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2383/4615] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:47 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:48.457347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8a50823-948c-46d2-a429-2e862f711785 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:48.460590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8a50823-948c-46d2-a429-2e862f711785 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:48.905487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8a50823-948c-46d2-a429-2e862f711785 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:48.919398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8a50823-948c-46d2-a429-2e862f711785 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1219 microversion: 2.1 time: 0.467266 Jul 18 13:20:48.927205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2384/4616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:48 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1219 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:49.462647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:49.463708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:49.531446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:49.547865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:49.547865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:49.552945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:49.996882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:50.011333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:50.034964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:50.036481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f35e4d0-d151-4c51-957f-bcb5bb88149c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.772688 Jul 18 13:20:50.041020 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2233/4617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:48 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:50.044927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:50.062488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3095320f-9c0a-4898-85da-567de1f1bf1d tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.611604 Jul 18 13:20:50.077584 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2385/4618] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:49 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:50.077902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:50.077902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:50.098220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:50.101605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:50.104532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:50.105569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:51.062968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:51.064455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:51.129035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:51.133303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:51.145938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:51.161646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:51.389814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:51.441589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d93f40d-0a69-45a6-ab46-f6e089470d31 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1223 microversion: 2.1 time: 1.391761 Jul 18 13:20:51.447530 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2234/4619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:50 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1223 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:51.488395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:51.489046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:51.552921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:51.553869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:51.556233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:51.567806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:52.584447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:52.619657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:52.625461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:52.656762 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8fc6646d-38ad-492b-9ba4-fcf9c68540f0 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 1.203844 Jul 18 13:20:52.678362 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2235/4620] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:51 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:52.695224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:52.708238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:52.732360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:52.733933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:52.737095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:52.741235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:52.806433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:52.822869 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b42a172c-96e4-4e7a-8b47-44816b4451d0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.763459 Jul 18 13:20:52.826744 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2386/4621] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:51 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:52.970108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1c60ed9-dbce-440c-b370-cb25303890ba tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: .version_select at 0x7f96d7a72280>, body: {"keypair": {"name": "tempest-keypair-2087719207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3zfaVbxbXziP6GKALPk1ucS1e+S9ib91EMaPwbhtlB1ij9GLG70ysXsOiafhP8LjEFnY9eg/E7J7DJkBbSA03E1A/AH7Qwg15bmDf/QH6pyjUEGNmOal5HwImSRODR/A=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:53.022978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a1c60ed9-dbce-440c-b370-cb25303890ba tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for project 2b9675106f9a4d549d136ba2597511d2. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:20:53.056312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a1c60ed9-dbce-440c-b370-cb25303890ba tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for user 0f5208cdf4ea47eea1b961b15e3c0ea8 and project 2b9675106f9a4d549d136ba2597511d2. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:20:53.150591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1c60ed9-dbce-440c-b370-cb25303890ba tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182723 Jul 18 13:20:53.152893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2387/4622] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:20:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:20:53.533439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b269b2f6-0a40-4453-abd8-a58843f0a762", "device": "/dev/sdb"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:20:53.535762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:53.585588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:53.589038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:53.590617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:53.591693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:54.190755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:54.198473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:54.237541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-be728d92-7c9e-466c-b3ef-ca016746ec58 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1277 microversion: 2.1 time: 1.557019 Jul 18 13:20:54.238753 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2236/4623] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:52 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1277 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:54.257794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:54.261514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:54.291450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:54.293072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:54.294556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:54.295340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:54.429983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff0e9751-b28e-44cb-9598-51a06b6eb6bd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "POST /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903813 Jul 18 13:20:54.433927 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2388/4624] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:20:53 2022] POST /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:20:54.444690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:54.448769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:54.468038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:54.469730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:54.475191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:54.475980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:54.527479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:55.045828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:55.079196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:55.080220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:55.081995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8e2fb75-89dd-4c09-90d1-1a99b0d723b5 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1364 microversion: 2.47 time: 0.841749 Jul 18 13:20:55.082628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2237/4625] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:54 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1364 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:20:55.271314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:55.272457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:55.295291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:55.298026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:55.300362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:55.309241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:55.847549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:55.876321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0919b06-7bce-499f-964e-489adbb71c1a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.440387 Jul 18 13:20:55.894959 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2389/4626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:20:56.108059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:56.108782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:56.128478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:56.130269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:56.131623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:56.134547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:56.528387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:56.559317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48f3c320-6bc0-4e7a-8cf7-72a606668298 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 1.287283 Jul 18 13:20:56.560182 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2238/4627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:55 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:56.906110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:56.907871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:56.923853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:56.926927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:56.930941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:56.934732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:57.764019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:57.784751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:57.793273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:57.795007 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-860f4687-7baf-45d5-aad7-09d67d7bb7c3 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1370 microversion: 2.47 time: 1.692318 Jul 18 13:20:57.802519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2390/4628] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:56 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1370 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:57.809296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:57.819419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:57.828677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:57.830775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:57.835782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:57.836572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:57.929767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:57.941279 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-575bfb7f-99dd-4714-ab6f-c7fac939f4e6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.039487 Jul 18 13:20:57.959173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2239/4629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:56 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:20:58.818362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:58.819693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:58.825499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:58.829530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:20:58.857448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:58.858506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:58.859988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:58.861183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:59.309990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:59.334635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:59.342021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:59.343442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b7e44bf2-f628-4c4d-8790-7cb64cd675f9 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1370 microversion: 2.47 time: 0.529856 Jul 18 13:20:59.348544 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2240/4630] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:20:58 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:20:59.356863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:20:59.357491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:20:59.372689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:59.373244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:59.375132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:20:59.375580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:20:59.439762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:20:59.471383 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-009ef11d-b1af-4a9b-bc8b-fe0d2678ae1d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 1.664839 Jul 18 13:20:59.472279 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2391/4631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:57 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:00.338200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:00.356751 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f746080-d6f2-45a9-9e40-86de5c80c50e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.003220 Jul 18 13:21:00.360362 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2241/4632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:20:59 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:00.378365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:00.379071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:00.403631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.404142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:00.404995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.405477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:00.502897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:00.505648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:00.531909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.539477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:00.540896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.544082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:00.794626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:00.822019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:00.830134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:00.836905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-947f2aea-5df4-4364-b7de-d49a67756338 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1355 microversion: 2.47 time: 0.458572 Jul 18 13:21:00.838079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2392/4633] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:00 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1355 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:00.865503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:00.882953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:00.888849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Searching by: {'deleted': False, 'project_id': '991e702e2842490fab9dbb00b86001db'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:00.906514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.907339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:00.917556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:00.918651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:01.230732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:01.409849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:01.424552 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe4e1cae-a465-4b7f-b0f6-67fdbf384334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.931737 Jul 18 13:21:01.425620 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2242/4634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:00 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:01.442681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:01.443341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:01.456115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:01.456641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:01.457443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:01.457889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:01.566127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:01.595655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:01.596792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:01.633061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:01.635134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:02.137655 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-956d615f-640d-4298-b745-3e4930da828a tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 1.279190 Jul 18 13:21:02.140420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2393/4635] 10.222.0.88 () {60 vars in 1186 bytes} [Mon Jul 18 13:21:00 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:02.174616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:02.175298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:02.185084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.192504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:02.193570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.194180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:02.302080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:02.539623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-373e01f2-bb23-4209-913a-4a281b46fc59 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 204 len: 0 microversion: 2.47 time: 0.368126 Jul 18 13:21:02.544513 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2394/4636] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:21:02 2022] DELETE /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 13:21:02.589648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:02.595470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:02.633447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.634300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:02.637907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.640673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:02.761545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:02.776978 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a97aedf-1d67-42e5-b179-ce2c0070da27 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.338650 Jul 18 13:21:02.779211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2243/4637] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:01 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:02.791351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:02.793172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:02.806497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.808578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:02.810341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:02.811477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:03.218975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:03.243319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:03.257647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:03.260138 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf6f2352-30ae-4211-ba44-72394f2cb92f tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1361 microversion: 2.47 time: 0.478761 Jul 18 13:21:03.264667 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2244/4638] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:02 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:03.507351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5b5e87b0-a6d7-4024-a441-f82717740a3e req-41aeef6d-42a5-4088-9f0c-9d5150e50d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82587966-5169-4593-b24a-616511801ff9", "tag": "68296034-8094-482a-b141-ac6f71cd4d72"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:03.544289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5b5e87b0-a6d7-4024-a441-f82717740a3e req-41aeef6d-42a5-4088-9f0c-9d5150e50d0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:03.551881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5b5e87b0-a6d7-4024-a441-f82717740a3e req-41aeef6d-42a5-4088-9f0c-9d5150e50d0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:03.590238 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5b5e87b0-a6d7-4024-a441-f82717740a3e req-41aeef6d-42a5-4088-9f0c-9d5150e50d0e service nova] Creating event network-changed:68296034-8094-482a-b141-ac6f71cd4d72 for instance 82587966-5169-4593-b24a-616511801ff9 on n-h1-850003-3 Jul 18 13:21:03.621192 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5b5e87b0-a6d7-4024-a441-f82717740a3e req-41aeef6d-42a5-4088-9f0c-9d5150e50d0e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352190 Jul 18 13:21:03.633612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2245/4639] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:03.811064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:03.815259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:03.849243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:03.849969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:03.853443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:03.855370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:04.332332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:04.341646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73a015ae-15a6-4378-a5de-2eeb9301ae7d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 1.793478 Jul 18 13:21:04.354837 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2395/4640] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:02 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:04.365739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:04.366391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:04.405034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:04.405625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:04.406503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:04.407097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:04.930759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:04.954389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:04.963034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:04.972081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f8e9182-648d-48fd-a794-e0b54c844db2 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1361 microversion: 2.47 time: 0.612887 Jul 18 13:21:04.986258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2396/4641] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:04 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1361 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:05.163802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: .version_select at 0x7f96d79ad790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1431611411", "policies": ["affinity"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:05.299726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:05.317759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:05.321703 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d82c89ca-9bc3-4a34-9a00-d0aca4ea7d8c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.515706 Jul 18 13:21:05.323659 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2246/4642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:03 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:05.359303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:05.372154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:05.372797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:05.406556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:05.408464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:05.412815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:05.416993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:05.567158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:05.584500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:05.647522 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7709e6f7-45f8-406d-9e0b-02538e3bbef1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.665377 Jul 18 13:21:05.649163 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2397/4643] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 18 13:21:04 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:05.667886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: .version_select at 0x7f96e99bea60>, body: {"server_group": {"name": "tempest-server-group-1355851590", "policies": ["affinity"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:05.716194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:05.745514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:05.881509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:05.899573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:05.924930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:05.926685 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7849d03-3530-4795-abf4-3f1010e830de tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.267991 Jul 18 13:21:05.933605 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2398/4644] 10.222.0.88 () {60 vars in 1172 bytes} [Mon Jul 18 13:21:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:21:05.950820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: .version_select at 0x7f96d79ad4c0>, body: {"server_group": {"name": "tempest-server-group-1355851590", "policies": ["affinity"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:06.035268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:06.073035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:06.277697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:06.299409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:06.366117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a548ed54-b0ef-4ded-b3fc-d298e3f67b76 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.420850 Jul 18 13:21:06.367920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2399/4645] 10.222.0.88 () {60 vars in 1172 bytes} [Mon Jul 18 13:21:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:06.394420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-139c4db8-c7f3-4728-b719-2558a54948d7 req-5126e64f-c092-4edd-a536-442c29795f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1387465e-12cb-436e-ab4d-0b502a5dfa11", "tag": "0e0a4bfe-bbc1-4c77-b63c-2803b98ee210"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:06.431841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-139c4db8-c7f3-4728-b719-2558a54948d7 req-5126e64f-c092-4edd-a536-442c29795f92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:06.433257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-139c4db8-c7f3-4728-b719-2558a54948d7 req-5126e64f-c092-4edd-a536-442c29795f92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:06.447526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-139c4db8-c7f3-4728-b719-2558a54948d7 req-5126e64f-c092-4edd-a536-442c29795f92 service nova] Creating event network-changed:0e0a4bfe-bbc1-4c77-b63c-2803b98ee210 for instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 on n-h2-850003-3 Jul 18 13:21:06.454939 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-139c4db8-c7f3-4728-b719-2558a54948d7 req-5126e64f-c092-4edd-a536-442c29795f92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084151 Jul 18 13:21:06.456623 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2400/4646] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:06.463305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:06.465219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:06.474600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:06.475871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:06.477153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:06.478019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:06.501114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:06.675699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:06.707242 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a7d02493-d046-4b67-8f8f-7a6fd262129b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 1.342275 Jul 18 13:21:06.718382 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2247/4647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:05 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:06.730643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:06.731326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:06.754828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:06.755921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:06.757635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:06.758755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:07.193879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:07.222724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:07.224826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:07.230394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-22206341-696d-4e63-961d-c32a8931e263 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 200 len: 1361 microversion: 2.47 time: 0.772052 Jul 18 13:21:07.247708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2401/4648] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:06 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 1361 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:07.270841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0ed6c7d-40b0-4155-9ca6-27d88ec65557 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:07.353457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0ed6c7d-40b0-4155-9ca6-27d88ec65557 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/a391a17f-cae9-4750-86f7-12535e2225e6" status: 204 len: 0 microversion: 2.1 time: 0.102945 Jul 18 13:21:07.361542 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2402/4649] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:07 2022] DELETE /compute/v2.1/os-server-groups/a391a17f-cae9-4750-86f7-12535e2225e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:07.388855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c9601153-0f44-447b-ae71-1483e13ea836 req-cbbc5ab1-eff5-45e9-b6ca-4c596c240ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de865d61-8593-4a65-aca8-faf5b065709a", "tag": "7a54f2cb-b764-47ad-9831-1d2005f646dc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:07.438238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c9601153-0f44-447b-ae71-1483e13ea836 req-cbbc5ab1-eff5-45e9-b6ca-4c596c240ecc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:07.448353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c9601153-0f44-447b-ae71-1483e13ea836 req-cbbc5ab1-eff5-45e9-b6ca-4c596c240ecc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:07.522012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c9601153-0f44-447b-ae71-1483e13ea836 req-cbbc5ab1-eff5-45e9-b6ca-4c596c240ecc service nova] Creating event network-changed:7a54f2cb-b764-47ad-9831-1d2005f646dc for instance de865d61-8593-4a65-aca8-faf5b065709a on n-h1-850003-3 Jul 18 13:21:07.536834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c9601153-0f44-447b-ae71-1483e13ea836 req-cbbc5ab1-eff5-45e9-b6ca-4c596c240ecc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172971 Jul 18 13:21:07.546385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2403/4650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:07.561845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a51c2026-e25e-4b78-9559-b6bd5b53490f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:07.609611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a51c2026-e25e-4b78-9559-b6bd5b53490f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.060972 Jul 18 13:21:07.611183 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2404/4651] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:07 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:07.627006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2472d0e-4919-49a6-b4e5-c7e05070e019 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:07.706268 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2472d0e-4919-49a6-b4e5-c7e05070e019 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/36447aa8-28d6-4616-bb12-5f31667f09a0" status: 204 len: 0 microversion: 2.1 time: 0.085350 Jul 18 13:21:07.707642 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2405/4652] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:07 2022] DELETE /compute/v2.1/os-server-groups/36447aa8-28d6-4616-bb12-5f31667f09a0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:21:07.733043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4368c6e9-c04f-4db4-8a3a-9abcb2c2849d tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:07.756791 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4368c6e9-c04f-4db4-8a3a-9abcb2c2849d tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042293 Jul 18 13:21:07.765869 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2406/4653] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:21:07.776368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:07.781402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:07.800381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:07.802670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:07.804708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:07.809219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.105142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:08.116864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3bf0ceb-d4ce-41a2-8e4e-af684ca9f863 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 1.396676 Jul 18 13:21:08.124134 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2248/4654] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:06 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:08.129519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: .version_select at 0x7f96e4258310>, body: {"server_group": {"name": "tempest-server-group-58955095", "policies": ["affinity"]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:08.179620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:08.197358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:08.304211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:08.326561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:08.368557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-608044c7-62b1-459b-92e1-e347af472d37 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.242852 Jul 18 13:21:08.369189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2249/4655] 10.222.0.88 () {60 vars in 1172 bytes} [Mon Jul 18 13:21:08 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:08.390089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:08.391258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 6df46599-e095-4dd2-8308-68a55085ded6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:08.404891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:08.405669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.406676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:08.411055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.451708 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] HTTP exception thrown: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Request method failure captured: Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 HTTP/1.1 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V4PMiUsHqNhBKEf9DibYg1UTKigo0_GihC13dxOo7mxAetp4AnwlUCFAK4lpbAF3EuL1OcbhhBi58C8Oj3kmUszE_28o3WR5nIrWUvDWOo6afpCjH6tYc7xDTtdCXUEX04mIRPjUpSd2sbvRAPLeVHJOrJxqBzoH3cWKUjVoaBpVTQ Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 991e702e2842490fab9dbb00b86001db Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerShowV247Test-627214824 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/991e702e2842490fab9dbb00b86001db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/991e702e2842490fab9dbb00b86001db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_991e702e2842490fab9dbb00b86001db", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/991e702e2842490fab9dbb00b86001db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerShowV247Test-627214824 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 991e702e2842490fab9dbb00b86001db Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerShowV247Test-627214824 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerShowV247Test-627214824-project Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 094f4f1f1b0d44e4aabcbd38bef6fab7 Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerShowV247Test-627214824-project Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '6df46599-e095-4dd2-8308-68a55085ded6'} Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:08.453946 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. Jul 18 13:21:08.460249 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:08.462251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Returning 404 to user: Instance 6df46599-e095-4dd2-8308-68a55085ded6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:08.467808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad058f4a-4fbe-475c-9311-72d784577b93 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6" status: 404 len: 111 microversion: 2.47 time: 0.094665 Jul 18 13:21:08.468663 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2250/4656] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:08 2022] GET /compute/v2.1/servers/6df46599-e095-4dd2-8308-68a55085ded6 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:08.476432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d29031cd-614c-412b-9ad3-35f6defe888f req-907d6deb-ff97-46c2-8653-f04e428dc8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "name": "network-vif-plugged", "status": "completed", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:08.505140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d29031cd-614c-412b-9ad3-35f6defe888f req-907d6deb-ff97-46c2-8653-f04e428dc8b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:08.506228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d29031cd-614c-412b-9ad3-35f6defe888f req-907d6deb-ff97-46c2-8653-f04e428dc8b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.532676 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d29031cd-614c-412b-9ad3-35f6defe888f req-907d6deb-ff97-46c2-8653-f04e428dc8b7 service nova] Creating event network-vif-plugged:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:21:08.546471 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d29031cd-614c-412b-9ad3-35f6defe888f req-907d6deb-ff97-46c2-8653-f04e428dc8b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076143 Jul 18 13:21:08.554607 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2251/4657] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:08.560768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:08.563432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8cd69735-b66f-4ce7-9725-932b2f96d1bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:08.589785 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-285b886f-87a1-4f43-a04a-2919db9a25f6 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.821930 Jul 18 13:21:08.602320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2407/4658] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:07 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:08.622030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:08.633516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:08.641381 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8cd69735-b66f-4ce7-9725-932b2f96d1bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/b3cd6f09-1df5-486f-bd70-79445f04efd6" status: 204 len: 0 microversion: 2.1 time: 0.085176 Jul 18 13:21:08.642809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2252/4659] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:08 2022] DELETE /compute/v2.1/os-server-groups/b3cd6f09-1df5-486f-bd70-79445f04efd6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:08.651519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36c9cbc8-9de0-40df-bf11-d1088d4a01af tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:08.678338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:08.681402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.696793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:08.697418 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36c9cbc8-9de0-40df-bf11-d1088d4a01af tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.046061 Jul 18 13:21:08.698726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:08.705451 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2253/4660] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:08.712971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: .version_select at 0x7f96d79f7040>, body: {"server_group": {"name": "tempest-server-group-101782928", "policies": ["anti-affinity"]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:08.784407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:08.843572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:08.888631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:08.968818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:09.060331 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4122bd2-0d16-4590-b3d5-766c2cfc7249 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "DELETE /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 204 len: 0 microversion: 2.47 time: 0.445301 Jul 18 13:21:09.061734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2408/4661] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:21:08 2022] DELETE /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:21:09.077465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:09.078620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:09.110122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.110841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:09.118031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.118699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:09.130673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:09.159221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:09.204575 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a07ff941-0000-48cc-a15f-c9395e20ee92 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.497784 Jul 18 13:21:09.205319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2254/4662] 10.222.0.88 () {60 vars in 1172 bytes} [Mon Jul 18 13:21:08 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:09.242693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:09.243862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:09.263561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.264332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:09.265483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.269736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:09.480234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:09.494433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:09.496691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:09.499721 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0872098e-4a5a-43f7-902c-fc24ccaa6c9c tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 200 len: 1362 microversion: 2.47 time: 0.431028 Jul 18 13:21:09.502686 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2409/4663] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:09 2022] GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:21:09.514922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff7a8874-f7aa-4ef8-a14e-91d97fbe462c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:09.585786 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff7a8874-f7aa-4ef8-a14e-91d97fbe462c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/13460ad1-5e71-49bc-87d3-a809824a015f" status: 204 len: 0 microversion: 2.1 time: 0.081615 Jul 18 13:21:09.587622 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2410/4664] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:09 2022] DELETE /compute/v2.1/os-server-groups/13460ad1-5e71-49bc-87d3-a809824a015f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:09.600176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b385210c-7da8-47af-ac0b-32c1439ceb86 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:09.649084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b385210c-7da8-47af-ac0b-32c1439ceb86 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.054484 Jul 18 13:21:09.654804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2411/4665] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:09.660101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:09.660731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:09.698054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.708097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:09.710292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:09.711624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:10.083688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:10.098102 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb18c524-64f1-4dd5-bec5-9a982da690e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.436943 Jul 18 13:21:10.099548 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2412/4666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:09 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:10.115303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-591089792", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "04b20fe6-f622-41da-a5f0-6bf5d672ad08"}]}, "os:scheduler_hints": {"group": "0bb36600-ab53-4ad1-91e8-42c0078daaa1"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:10.212079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] validate_networks() for [('04b20fe6-f622-41da-a5f0-6bf5d672ad08', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:21:11.092611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:11.633878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:11.667700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e2b6758f-b4d5-4625-a3e3-64b6a085b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1520 microversion: 2.1 time: 2.440008 Jul 18 13:21:11.671848 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2255/4667] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:09 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1520 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:11.703261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:11.705099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:11.731666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:11.734057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:11.735157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:11.738443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:11.797166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:11.797812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:11.798408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:11.798923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:11.799762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:11.829181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=39 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:11.834356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:11.835341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:11.837439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:11.839269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:11.907841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:11.910777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:11.924217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:11.930209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:11.938363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:11.942770 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9b0eb1d-6513-4508-9ae6-f14413ba7fee tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 200 len: 1362 microversion: 2.47 time: 0.263712 Jul 18 13:21:11.945516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2256/4668] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:11 2022] GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:11.945849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:21:11.949797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:21:12.045271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131366) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 13:21:12.079500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:12.109858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_group_members'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:12.131686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_group_members'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:12.159452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-731549244", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "ddee1f3a-d5d6-4ef5-a4c7-1495588b0b28"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:12.302439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_group_members'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:12.328344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Getting quotas for user 65d1d3ce66fd42a0a1295819dccb1192 and project eed46daacc484f02bccfacc17f76ea95. Resources: {'server_group_members'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:12.363112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] validate_networks() for [('ddee1f3a-d5d6-4ef5-a4c7-1495588b0b28', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:21:12.482772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2de27ecb-3d23-4a91-9601-c5abcc41bfc1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375582 Jul 18 13:21:12.492291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2413/4669] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:21:12.504729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:12.508002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:12.529796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:12.530810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:12.531856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:12.532447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:12.980815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:13.006974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3547adfd-dc16-4cf8-ab3f-af822cc31fb4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.510015 Jul 18 13:21:13.011498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2414/4670] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:12 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:13.044556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1831176054", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f82a65d-903a-41e8-bd40-22fcc2558dbb"}], "security_groups": [{"name": "tempest-securitygroup--379744965"}], "key_name": "tempest-keypair-2087719207", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:13.515822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] validate_networks() for [('6f82a65d-903a-41e8-bd40-22fcc2558dbb', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:21:14.375497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:14.376780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:14.377829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:14.378675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:14.379490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:14.407618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:14.408886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:14.412068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:14.412903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:14.437816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Getting quotas for project 26facd0b41a7472398c1e66f1428e82d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:14.444797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Getting quotas for user fd68e26c2931419fbbed938d430d2c43 and project 26facd0b41a7472398c1e66f1428e82d. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:14.480836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:21:14.487511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:21:14.633047 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd9fd3b1-38dc-407a-96ca-0106ef09e3b5 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685702 Jul 18 13:21:14.648689 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2257/4671] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:21:14.671583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:14.673242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:14.691725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:14.692436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:14.693844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:14.694518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.154103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:15.169746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4d6bfdfe-c5f1-48d9-b5b7-5621cec6ce82 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1208 microversion: 2.1 time: 0.519421 Jul 18 13:21:15.172285 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2258/4672] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:14 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1208 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:15.196969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:15.198175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:15.208745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.209587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.210549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.211003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.264154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:15.265014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:15.265158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:15.265549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:15.268487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:15.310861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.311676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.312687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.313381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.375079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:15.394848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Getting quotas for user 0f5208cdf4ea47eea1b961b15e3c0ea8 and project 2b9675106f9a4d549d136ba2597511d2. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:15.455344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:21:15.468152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:21:15.644718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c5432509-2411-49e5-92dd-03a8cd6dc1a1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.627709 Jul 18 13:21:15.656555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2415/4673] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 2644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:21:15.671011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:15.673722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:15.737874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.741983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.749432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.751639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.955379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:15.957442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:15.960776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lazy-loading 'fault' on Instance uuid 27d6503f-af53-4fa0-bfa7-326345a2589c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:16.389443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:16.415991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:16.429226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '094f4f1f1b0d44e4aabcbd38bef6fab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991e702e2842490fab9dbb00b86001db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:16.430557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-891d18da-56ac-4115-aa09-8bf6d234d6fd tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 200 len: 1367 microversion: 2.47 time: 0.772498 Jul 18 13:21:16.431152 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2416/4674] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:15 2022] GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:16.462879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:16.463603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:16.501922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:16.502888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:16.503577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:16.504102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:16.854586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:16.866714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91bd065f-9844-4574-91c2-b255eb95e2f0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.432710 Jul 18 13:21:16.868064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2417/4675] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:16 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:16.892365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:16.895360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:16.912263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:16.913834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:16.916034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:16.917184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:17.655431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:17.665708 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-373a4380-fb49-4023-b60b-418976bf89db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1276 microversion: 2.1 time: 0.796256 Jul 18 13:21:17.667242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2418/4676] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:16 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1276 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:17.672237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:17.673120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:17.680896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:17.681550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:17.683559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:17.684598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:17.973697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:18.005018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2c7ae9e-4b5f-4e76-8d0e-f3596111caf9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 2.829404 Jul 18 13:21:18.005703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2259/4677] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:15 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:18.016531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:18.021995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:18.048236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.048865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.049845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.050866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.056395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:18.076009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:18.086249 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12723009-7bb0-45fa-bcb5-f36b1f6de8cf tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1298 microversion: 2.1 time: 0.417526 Jul 18 13:21:18.099091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2419/4678] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:17 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1298 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:18.110798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d36b63fb-36f1-47b6-a9fe-967a5d16b8bc req-f83f9ba5-f48d-4d84-8214-2f88b0e6bc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82587966-5169-4593-b24a-616511801ff9", "name": "network-vif-plugged", "status": "completed", "tag": "68296034-8094-482a-b141-ac6f71cd4d72"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:18.137047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d36b63fb-36f1-47b6-a9fe-967a5d16b8bc req-f83f9ba5-f48d-4d84-8214-2f88b0e6bc2e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.137418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d36b63fb-36f1-47b6-a9fe-967a5d16b8bc req-f83f9ba5-f48d-4d84-8214-2f88b0e6bc2e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.188526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d36b63fb-36f1-47b6-a9fe-967a5d16b8bc req-f83f9ba5-f48d-4d84-8214-2f88b0e6bc2e service nova] Creating event network-vif-plugged:68296034-8094-482a-b141-ac6f71cd4d72 for instance 82587966-5169-4593-b24a-616511801ff9 on n-h1-850003-3 Jul 18 13:21:18.198828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d36b63fb-36f1-47b6-a9fe-967a5d16b8bc req-f83f9ba5-f48d-4d84-8214-2f88b0e6bc2e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097493 Jul 18 13:21:18.200129 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2420/4679] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:18.210647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:18.216698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] [instance: 27d6503f-af53-4fa0-bfa7-326345a2589c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:18.234079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.236081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.239051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.247500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.287551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] HTTP exception thrown: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Request method failure captured: Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c HTTP/1.1 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V4PMiUsHqNhBKEf9DibYg1UTKigo0_GihC13dxOo7mxAetp4AnwlUCFAK4lpbAF3EuL1OcbhhBi58C8Oj3kmUszE_28o3WR5nIrWUvDWOo6afpCjH6tYc7xDTtdCXUEX04mIRPjUpSd2sbvRAPLeVHJOrJxqBzoH3cWKUjVoaBpVTQ Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 991e702e2842490fab9dbb00b86001db Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerShowV247Test-627214824 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/991e702e2842490fab9dbb00b86001db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/991e702e2842490fab9dbb00b86001db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_991e702e2842490fab9dbb00b86001db", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/991e702e2842490fab9dbb00b86001db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerShowV247Test-627214824 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 991e702e2842490fab9dbb00b86001db Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerShowV247Test-627214824 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerShowV247Test-627214824-project Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 094f4f1f1b0d44e4aabcbd38bef6fab7 Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerShowV247Test-627214824-project Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '27d6503f-af53-4fa0-bfa7-326345a2589c'} Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:18.289903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. Jul 18 13:21:18.295271 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:18.301451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] Returning 404 to user: Instance 27d6503f-af53-4fa0-bfa7-326345a2589c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:18.305059 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c65e7b29-57b8-4297-8b61-a8b82520d368 tempest-ServerShowV247Test-627214824 tempest-ServerShowV247Test-627214824-project] 10.222.0.88 "GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c" status: 404 len: 111 microversion: 2.47 time: 0.103477 Jul 18 13:21:18.323377 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2421/4680] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:18 2022] GET /compute/v2.1/servers/27d6503f-af53-4fa0-bfa7-326345a2589c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:18.346034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:18.347330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:18.371013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.375394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.378125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.381840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.456254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:18.464594 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09cb4098-4cb5-4fd9-bba7-48c8ef829870 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1270 microversion: 2.1 time: 0.452345 Jul 18 13:21:18.472210 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2260/4681] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:18 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1270 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:18.493930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:18.496002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:18.529275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.529835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:18.531967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:18.544812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.263622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:19.303358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6ca70f9-c124-4b5b-9527-fc64bfdf1b87 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.975323 Jul 18 13:21:19.305409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2422/4682] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:18 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:19.321629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:19.324829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:19.335603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.336297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.337204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.337663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.520196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:19.530987 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38590ae4-8d26-4d56-aa15-acfa6c6b0024 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1282 microversion: 2.1 time: 0.223231 Jul 18 13:21:19.550382 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2423/4683] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:19 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:19.569595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:19.575401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:19.599853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.600845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.604147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.606967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.881496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:19.904272 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88356701-db3f-4f4f-b03e-ebe1b4d5a0e6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1304 microversion: 2.1 time: 0.349476 Jul 18 13:21:19.914751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2424/4684] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:19 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1304 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:19.919762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:19.920910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:19.943997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.944788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.946295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:19.946635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:19.954762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:20.004131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:20.050929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72eb81b9-00e8-4635-8c72-fc32453473c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.560078 Jul 18 13:21:20.052431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2261/4685] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:18 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:20.126051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:20.177947 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8332c0c8-f405-4696-a871-6fc5287ae848 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1270 microversion: 2.1 time: 0.264866 Jul 18 13:21:20.178258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2425/4686] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:19 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:20.309710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-80dc2e04-beb9-449a-8956-50c455497887 req-a8a33287-4de2-411b-8595-b4ae460e3a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1387465e-12cb-436e-ab4d-0b502a5dfa11", "name": "network-vif-plugged", "status": "completed", "tag": "0e0a4bfe-bbc1-4c77-b63c-2803b98ee210"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:20.339168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-80dc2e04-beb9-449a-8956-50c455497887 req-a8a33287-4de2-411b-8595-b4ae460e3a7d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.342648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-80dc2e04-beb9-449a-8956-50c455497887 req-a8a33287-4de2-411b-8595-b4ae460e3a7d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.381162 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-80dc2e04-beb9-449a-8956-50c455497887 req-a8a33287-4de2-411b-8595-b4ae460e3a7d service nova] Creating event network-vif-plugged:0e0a4bfe-bbc1-4c77-b63c-2803b98ee210 for instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 on n-h2-850003-3 Jul 18 13:21:20.399242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-80dc2e04-beb9-449a-8956-50c455497887 req-a8a33287-4de2-411b-8595-b4ae460e3a7d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093986 Jul 18 13:21:20.399970 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2426/4687] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:21:20.413149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:20.413886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:20.436090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.436549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.437362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.438106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.502180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:20.502861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:20.527112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.527570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.528390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.528836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.879343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:20.888753 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6225a867-a8d2-4781-8a59-a574f0eb5e4b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1319 microversion: 2.1 time: 0.484064 Jul 18 13:21:20.889650 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2427/4688] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:20 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:20.903367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:20.904113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:20.915160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.915530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:20.917150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:20.917599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:21.234057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:21.249781 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83271c2e-4f21-4ba6-b888-dda6cad54395 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.141604 Jul 18 13:21:21.257241 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2262/4689] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:20 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:21.271539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:21.275021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:21.286579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:21.288273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:21.289664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:21.290553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:21.568018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:21.580223 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71aa2410-a295-4dc0-bbd4-9e26749db81c tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 0.689751 Jul 18 13:21:21.584099 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2428/4690] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:20 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:21.724515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-724768853", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:21.852066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:21.901257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d1de1f8-cf02-42d2-b9a5-c3a77aa7a95e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1304 microversion: 2.1 time: 0.633473 Jul 18 13:21:21.906042 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2263/4691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:21 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1304 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:21.922797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] validate_networks() for [('faea3be6-4c6d-4918-a729-e3b197cfa663', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:21:21.934383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:21.937806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:21.959390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:21.960150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:21.966950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:21.967781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:23.670910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:23.700764 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37c52b8a-79cb-4dff-bfed-45f1ca2037da tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 1.765696 Jul 18 13:21:23.701808 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2264/4692] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:21 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:23.707863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd2cfc61-c777-4185-84bd-d4b14089a965 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:23.756176 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-bd2cfc61-c777-4185-84bd-d4b14089a965 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd2cfc61-c777-4185-84bd-d4b14089a965 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/515b364c-ad31-4c31-b4da-b7c668c46bca/action HTTP/1.1 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 15 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: {"os-stop": {}} Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '515b364c-ad31-4c31-b4da-b7c668c46bca', 'body': {'os-stop': {}}} Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:23.811989 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd2cfc61-c777-4185-84bd-d4b14089a965 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 515b364c-ad31-4c31-b4da-b7c668c46bca has no mapping to a cell. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd2cfc61-c777-4185-84bd-d4b14089a965 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/515b364c-ad31-4c31-b4da-b7c668c46bca/action" status: 404 len: 117 microversion: 2.1 time: 0.110141 Jul 18 13:21:23.820137 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2265/4693] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:23 2022] POST /compute/v2.1/servers/515b364c-ad31-4c31-b4da-b7c668c46bca/action => generated 117 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:23.826481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:23.826481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:23.835359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:23.835822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:23.836635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:23.837086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.153294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:24.154483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:24.155153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:24.155744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:24.156565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:24.176075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.178444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.179548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.180171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.235728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Getting quotas for project 6217e8d7b8c0473bbe4c4bc82527236f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:24.248630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Getting quotas for user fa24af38a37f4e938842018775fe8704 and project 6217e8d7b8c0473bbe4c4bc82527236f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:24.283249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:21:24.287425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:21:24.359200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f98370e-091b-4387-9f4b-f1fef5888e3f tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.772869 Jul 18 13:21:24.360204 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2429/4694] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:21:24.377679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a188648d-3f19-4696-bf12-af2ff6df5de5 req-03910d59-2d57-4375-a60e-8475cd957127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de865d61-8593-4a65-aca8-faf5b065709a", "name": "network-vif-plugged", "status": "completed", "tag": "7a54f2cb-b764-47ad-9831-1d2005f646dc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:24.388064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a188648d-3f19-4696-bf12-af2ff6df5de5 req-03910d59-2d57-4375-a60e-8475cd957127 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.388915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a188648d-3f19-4696-bf12-af2ff6df5de5 req-03910d59-2d57-4375-a60e-8475cd957127 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.403222 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a188648d-3f19-4696-bf12-af2ff6df5de5 req-03910d59-2d57-4375-a60e-8475cd957127 service nova] Creating event network-vif-plugged:7a54f2cb-b764-47ad-9831-1d2005f646dc for instance de865d61-8593-4a65-aca8-faf5b065709a on n-h1-850003-3 Jul 18 13:21:24.413730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a188648d-3f19-4696-bf12-af2ff6df5de5 req-03910d59-2d57-4375-a60e-8475cd957127 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046770 Jul 18 13:21:24.419911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2430/4695] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:24.424424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:24.433968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:24.434725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:24.452810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.454081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.463598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=22 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:24.478220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.479904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.537712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:24.587755 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd6f4211-88e4-4a6c-ac1c-acc20bfbc06a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1510 microversion: 2.1 time: 0.769762 Jul 18 13:21:24.590038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2266/4696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:23 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1510 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:24.621065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:24.621955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:24.643469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.647703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:24.652235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:24.653231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:25.400951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:25.415151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d667ce5-668c-48e2-9b0f-83c44b365e82 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 0.992263 Jul 18 13:21:25.426972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2431/4697] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:24 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:25.464190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1503adc5-32cf-47e2-8e3b-99debc196517 req-5da95ba4-7f7c-48a7-b50d-23ce162f0ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe43e43-b254-4d70-8136-03a806b52f36", "tag": "1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:25.522651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1503adc5-32cf-47e2-8e3b-99debc196517 req-5da95ba4-7f7c-48a7-b50d-23ce162f0ed6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:25.523792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1503adc5-32cf-47e2-8e3b-99debc196517 req-5da95ba4-7f7c-48a7-b50d-23ce162f0ed6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:25.566811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1503adc5-32cf-47e2-8e3b-99debc196517 req-5da95ba4-7f7c-48a7-b50d-23ce162f0ed6 service nova] Creating event network-changed:1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a for instance cbe43e43-b254-4d70-8136-03a806b52f36 on n-h2-850003-3 Jul 18 13:21:25.582358 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1503adc5-32cf-47e2-8e3b-99debc196517 req-5da95ba4-7f7c-48a7-b50d-23ce162f0ed6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141690 Jul 18 13:21:25.584703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2432/4698] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:25.598487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:25.599388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:25.601170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:25.618137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:25.620810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:25.623040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:25.624177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:25.624776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc2bc28e-35cf-4b03-bf9b-6784d8b7b962 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 1.026188 Jul 18 13:21:25.625748 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2267/4699] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:24 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:26.042229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:26.055339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca1eb385-441b-4241-997b-b2589a6dc50a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.468118 Jul 18 13:21:26.072379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2433/4700] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:25 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:26.083665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:26.084600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:26.095972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.097034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.098333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.099206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.232226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-373533290", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:26.243026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:26.254010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23098004-0ae2-4967-b245-f6d111cb6d17 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1227 microversion: 2.1 time: 0.179714 Jul 18 13:21:26.256162 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2434/4701] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:26 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1227 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:26.263839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:26.264720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:26.280187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.281046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.282593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.287777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.425180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:26.426128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:26.426971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:26.437616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:26.438644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:26.453367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.454077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.455238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.455887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.488080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Getting quotas for project a9a384f1f22c4426800d842c921e3ad0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:21:26.495461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Getting quotas for user c9b5e50d93854df6b0185287e7316876 and project a9a384f1f22c4426800d842c921e3ad0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:21:26.520914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:21:26.523333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:21:26.614567 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-afbd9719-9a99-47a8-96b6-3ce83a98738e tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.984723 Jul 18 13:21:26.628245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2268/4702] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:21:26.662278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:26.663709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:26.677124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.677586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.678418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.679083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.896768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:26.920680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4eb55034-8c60-4505-b0d5-240561bbdc5b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1512 microversion: 2.1 time: 0.662117 Jul 18 13:21:26.924728 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2435/4703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:26 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:26.942586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:26.944496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:26.954882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:26.973570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.975303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:26.977193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:26.978201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:27.151864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:27.160133 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c822bec9-6418-4714-bd8e-a7f0b4f57bb1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 0.521180 Jul 18 13:21:27.160753 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2269/4704] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:26 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:27.178072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:27.178730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:27.213363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:27.220767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:27.229703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:27.233812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:28.358010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:28.374965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bed534b-6dfd-4eab-a8b5-75f03e0325f2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 1.213109 Jul 18 13:21:28.378742 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2270/4705] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:27 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:28.391207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:28.404262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:28.420782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:28.438961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:28.446750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:28.452449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:28.600607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:28.635925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13da15af-d8da-420c-bcf1-d36388017d7d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 1.702177 Jul 18 13:21:28.640197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2436/4706] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:26 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:28.665841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:28.672792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:28.713714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:28.714865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:28.722941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:28.723649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:29.184698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:29.207106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:29.210931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:29.215143 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e52f2e7-7d0b-4cd8-951d-8c0a98420f4c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1273 microversion: 2.57 time: 0.834111 Jul 18 13:21:29.216726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2271/4707] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:28 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1273 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:29.226377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:29.227903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:29.250443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:29.253965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:29.259117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:29.260856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.006476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.022661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c571d60f-a05c-4f14-8365-27a472fb7db6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 1.375756 Jul 18 13:21:30.024147 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2437/4708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:28 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:30.033702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:30.035331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:30.047994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.049232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.050918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.052984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.247266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.272672 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aef7e39e-2fdc-43ff-8c02-6430959382b8 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1281 microversion: 2.1 time: 0.246095 Jul 18 13:21:30.274971 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2438/4709] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:30 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:30.285362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4c0402ac-d25d-43a9-8e51-c2ed475bc487 req-17b685b8-5613-4991-bd68-a1eaa4dbdbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:30.305894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4c0402ac-d25d-43a9-8e51-c2ed475bc487 req-17b685b8-5613-4991-bd68-a1eaa4dbdbcd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.307468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4c0402ac-d25d-43a9-8e51-c2ed475bc487 req-17b685b8-5613-4991-bd68-a1eaa4dbdbcd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.335441 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4c0402ac-d25d-43a9-8e51-c2ed475bc487 req-17b685b8-5613-4991-bd68-a1eaa4dbdbcd service nova] Creating event network-changed:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:21:30.353155 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4c0402ac-d25d-43a9-8e51-c2ed475bc487 req-17b685b8-5613-4991-bd68-a1eaa4dbdbcd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075590 Jul 18 13:21:30.356632 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2439/4710] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:30.376145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:30.378534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:30.394826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.395536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.397116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.398004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.536525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.572767 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc2b680b-38c9-48c8-883a-9ecbe619693d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1512 microversion: 2.1 time: 1.352457 Jul 18 13:21:30.599225 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2272/4711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:29 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1512 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:30.621053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:30.624913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b8de2d81-92f8-473b-bf31-30b29bad5a7c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:30.655185 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/b8de2d81-92f8-473b-bf31-30b29bad5a7c/action HTTP/1.1 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 15 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: {"suspend": {}} Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b8de2d81-92f8-473b-bf31-30b29bad5a7c', 'body': {'suspend': {}}} Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:30.656796 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:30.663443 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:30.663443 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:30.663443 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. Jul 18 13:21:30.663443 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:30.663443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b8de2d81-92f8-473b-bf31-30b29bad5a7c could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:30.664507 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ce3616d-6521-4c6b-9c8c-abdc8ee51007 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/b8de2d81-92f8-473b-bf31-30b29bad5a7c/action" status: 404 len: 111 microversion: 2.1 time: 0.055058 Jul 18 13:21:30.666741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2273/4712] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:30 2022] POST /compute/v2.1/servers/b8de2d81-92f8-473b-bf31-30b29bad5a7c/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:30.676418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:30.677052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:30.696681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.707552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.708777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.709507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.796036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.809643 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9b0f3b9-44ce-4c7d-abd8-099605737fbd tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 0.450541 Jul 18 13:21:30.810753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2440/4713] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:30 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:30.826360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:30.827970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:30.842899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.844774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.847068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:30.848194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:30.940216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.958080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.963002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:30.965773 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7154b1b1-3e36-445d-adaf-5b472cec3ccf tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1335 microversion: 2.57 time: 0.151802 Jul 18 13:21:30.977772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2441/4714] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:30 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1335 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:30.989767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:31.008027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.010025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:31.040598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.042213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.045812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.046685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.231688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:31.368356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.370039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.380683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.381487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.401123 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-345ffd80-e542-47d9-9319-23843fc27755 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 0.732303 Jul 18 13:21:31.402211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2274/4715] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:30 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:31.420300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:31.423615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:31.438724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.441181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.443611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.443840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.598719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5ff67cd-5b47-4aad-a008-d2136e371334 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.630023 Jul 18 13:21:31.606216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2442/4716] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 13:21:30 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:31.613189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:31.617206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:31.634358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.635897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.636591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.637550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.831243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.844116 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a1961ea-d77f-46bd-a0eb-2f5c303b878c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.439893 Jul 18 13:21:31.862255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2275/4717] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:31 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:31.873067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.883347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:31.886224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:31.893333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a76d7dbb-3903-4b3e-a499-dd7f721835bc tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.290339 Jul 18 13:21:31.894726 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2443/4718] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:31 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:31.903689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:31.908255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.908992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.909533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:31.910819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1266721398', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:31.917787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.918931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.919878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.920498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:31.921582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:31.922173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.216342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:32.231912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:32.385128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.396436 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf4a6a11-4471-41d9-bcb5-dec564723189 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.532093 Jul 18 13:21:32.397709 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2276/4719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:31 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:32.418546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:32.419276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:32.428385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.429085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.430110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.430816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.436370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.449944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.450773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.627018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2146241a-88da-4c66-bf71-4bbb085c90cf tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1266721398" status: 200 len: 1515 microversion: 2.1 time: 0.730603 Jul 18 13:21:32.636040 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2444/4720] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:21:31 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1266721398 => generated 1515 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:32.636040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:32.636040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:32.643011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.643641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.646662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.646662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.675793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.685252 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33548723-f396-4e36-a0bf-560dd8d8cdf0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 0.285952 Jul 18 13:21:32.686263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2277/4721] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:32 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:32.691607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:32.692652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:32.710437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.711439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.713046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.713983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.823948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.839381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.845161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.847864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d62a15b-87bf-4ec0-aaa5-2c8ca305e85f tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1335 microversion: 2.57 time: 0.159744 Jul 18 13:21:32.849389 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2278/4722] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:32 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:32.877377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-46a974b0-3eb8-4a86-82f6-c1491c1e7e07 req-0e2837e5-207b-4430-bb43-6c2dbe1302d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe43e43-b254-4d70-8136-03a806b52f36", "name": "network-vif-plugged", "status": "completed", "tag": "1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:32.878001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:32.888179 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f606234-b34a-4a5c-9947-df43cba2b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.258953 Jul 18 13:21:32.890537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2445/4723] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:32 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:32.900503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:32.901622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:32.904877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46a974b0-3eb8-4a86-82f6-c1491c1e7e07 req-0e2837e5-207b-4430-bb43-6c2dbe1302d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.905745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46a974b0-3eb8-4a86-82f6-c1491c1e7e07 req-0e2837e5-207b-4430-bb43-6c2dbe1302d5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.914990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.916745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.917601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.918052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.939486 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-46a974b0-3eb8-4a86-82f6-c1491c1e7e07 req-0e2837e5-207b-4430-bb43-6c2dbe1302d5 service nova] Creating event network-vif-plugged:1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a for instance cbe43e43-b254-4d70-8136-03a806b52f36 on n-h2-850003-3 Jul 18 13:21:32.947622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-46a974b0-3eb8-4a86-82f6-c1491c1e7e07 req-0e2837e5-207b-4430-bb43-6c2dbe1302d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086331 Jul 18 13:21:32.948847 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2279/4724] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:32.962336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3819d9bd-f35b-4ed2-8fba-d7a20ca8260e req-58ab5b09-91bf-4bd2-a840-e35667692f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33984b82-2bc7-4766-9469-f3a0736e5cd7", "tag": "bb184207-d431-41c9-8df4-69b9b42a6a0c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:32.972829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3819d9bd-f35b-4ed2-8fba-d7a20ca8260e req-58ab5b09-91bf-4bd2-a840-e35667692f46 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:32.973276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3819d9bd-f35b-4ed2-8fba-d7a20ca8260e req-58ab5b09-91bf-4bd2-a840-e35667692f46 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:32.979735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:32.997717 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3819d9bd-f35b-4ed2-8fba-d7a20ca8260e req-58ab5b09-91bf-4bd2-a840-e35667692f46 service nova] Creating event network-changed:bb184207-d431-41c9-8df4-69b9b42a6a0c for instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 on n-h2-850003-3 Jul 18 13:21:33.009831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3819d9bd-f35b-4ed2-8fba-d7a20ca8260e req-58ab5b09-91bf-4bd2-a840-e35667692f46 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056984 Jul 18 13:21:33.011842 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2280/4725] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:33.025436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:33.033707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:33.036231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:33.058506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.059854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.061464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.066777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.138055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:33.149809 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd4fc322-e6ee-4cd9-a560-cade1c22da3b tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 0.257342 Jul 18 13:21:33.151706 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2446/4726] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:32 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:33.157605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:33.160107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:33.168189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.171319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.172950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.174118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.246135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'flavor' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:33.267924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:33.417229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13597640-ef13-4bfd-ab3d-97e249e35899 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.263580 Jul 18 13:21:33.420967 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2447/4727] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:33 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:21:33.423125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:33.437611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:33.438342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:33.440670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.441866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.453766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.454574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.455963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.472617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.729639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:33.744960 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e6a8029-7275-44d0-a1bf-43e3ffe3bb37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.322183 Jul 18 13:21:33.756890 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2448/4728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:33 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:33.756890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:33.757707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:33.762072 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-529df057-0899-4003-ab04-4f09de7d8d25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.747646 Jul 18 13:21:33.763606 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2281/4729] 10.222.0.88 () {58 vars in 1172 bytes} [Mon Jul 18 13:21:33 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:33.772945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:33.774775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:33.776870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.777534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.781356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.782517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.791090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.792707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:33.794565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:33.796634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.083039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.098734 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-126e6fc1-0817-4782-87fa-c6bc3b064203 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1515 microversion: 2.1 time: 0.350108 Jul 18 13:21:34.102643 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2449/4730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:33 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:34.115749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:34.117040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:34.128208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.129268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.130963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.132050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.374498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.409441 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c76c9ced-7d1f-40a7-854f-7343d12cb221 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.642349 Jul 18 13:21:34.422705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2282/4731] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:33 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:34.429862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:34.444523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.445288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.servers [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Removing options 'limit' from query {{(pid=131367) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 13:21:34.447210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:34.457329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:34.469151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.471405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.473430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.474608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.584913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.599468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.599468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.705242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.718013 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e00a6d58-ae7d-4291-9176-c9fb8ed7f44c tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 0.612012 Jul 18 13:21:34.728784 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2450/4732] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:34 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:34.747050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:34.750557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:34.767533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.768330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.772826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.773623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.916432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.925602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.929359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:34.932899 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bbe56b2c-0b71-4fe7-a84b-dfbc92bed7b2 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1335 microversion: 2.57 time: 0.199815 Jul 18 13:21:34.934524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2451/4733] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:34 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:34.964324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:34.965638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:34.977275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.977740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:34.979369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:34.979998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.223672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:35.241146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8d7f5d9b-1510-495d-ada4-33c9050777db tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1324 microversion: 2.1 time: 0.304701 Jul 18 13:21:35.242608 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2452/4734] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:34 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:35.260739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:35.264761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:35.288068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.288068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.288068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.288068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.316410 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b40c43e5-9f11-4978-a64e-eff5d84bc2a8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.891245 Jul 18 13:21:35.318091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2283/4735] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 13:21:34 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:35.328662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:35.330650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:35.345550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.346802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.348551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.349583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.605972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:35.628656 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-116d757a-06d7-4574-8cd5-ab5b6c9a0023 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.384015 Jul 18 13:21:35.629451 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2453/4736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:35 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:35.649629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:35.656903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:35.658556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:35.666737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.667790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.669167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:35.670180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:35.885927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:36.030117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9baff18-0c0b-4a1c-b6b0-5bfaa91a12f5 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.387028 Jul 18 13:21:36.031467 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2454/4737] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:35 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:36.038128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:36.039499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:36.054241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.055381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.057280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.058600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.097251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.116549 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a93d3ee-330c-4d51-bb3b-098bbe7deed2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1498 microversion: 2.1 time: 0.796701 Jul 18 13:21:36.123944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2284/4738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:35 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1498 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:36.150889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:36.151993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:36.172184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.173420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.175256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.175987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.453759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.469709 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00ebf260-66ea-417f-9cf5-8ed9cfcfc90c tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.436397 Jul 18 13:21:36.488744 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2455/4739] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:36 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:36.499832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:36.501799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:36.517311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.518945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.521046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.522596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.678595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.698575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.701744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.704138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0344a43b-dcac-4a55-909c-25cf198f380d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1356 microversion: 2.57 time: 0.213410 Jul 18 13:21:36.718199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2456/4740] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:36 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1356 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:36.718199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:36.736492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:36.736492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.servers [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Removing options 'limit' from query {{(pid=131366) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 13:21:36.736492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:36.738474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.739258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.740747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.741519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:36.855268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:36.952527 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c41e153-50f4-45b1-9f46-9df2084372ec tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.244323 Jul 18 13:21:36.958642 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2457/4741] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 18 13:21:36 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:36.971030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:36.972492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:36.998068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:36.998960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.000789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.001572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.011467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:37.056700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'flavor' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:37.092738 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'suspend' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state suspended Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 15 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: {"suspend": {}} Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'suspend' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state suspended Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'suspend': {}}} Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state suspended. Cannot suspend while the instance is in this state. Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 18 13:21:37.095734 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state suspended Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state suspended Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'suspend' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state suspended {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1c317b03-0f5f-43d3-b18c-dace9cf8c569 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 148 microversion: 2.1 time: 0.137598 Jul 18 13:21:37.110597 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2458/4742] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:36 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 148 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:21:37.123809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-33845dd1-a80c-4450-ac7d-db86d3983dcc req-37906d16-0145-40fb-a475-5a127e467366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac573e14-f299-4757-b98c-1722fa9d243f", "tag": "5c6e9a15-8393-46f1-a489-6fe951db98e8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:37.143871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-33845dd1-a80c-4450-ac7d-db86d3983dcc req-37906d16-0145-40fb-a475-5a127e467366 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.144912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-33845dd1-a80c-4450-ac7d-db86d3983dcc req-37906d16-0145-40fb-a475-5a127e467366 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.173914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-33845dd1-a80c-4450-ac7d-db86d3983dcc req-37906d16-0145-40fb-a475-5a127e467366 service nova] Creating event network-changed:5c6e9a15-8393-46f1-a489-6fe951db98e8 for instance ac573e14-f299-4757-b98c-1722fa9d243f on n-h1-850003-3 Jul 18 13:21:37.185186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-33845dd1-a80c-4450-ac7d-db86d3983dcc req-37906d16-0145-40fb-a475-5a127e467366 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082929 Jul 18 13:21:37.188562 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2459/4743] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:37.197053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:37.203589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:37.205402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:37.221414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.222254 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-53281f91-1237-4754-a06e-a502c409c2f1 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 1.095860 Jul 18 13:21:37.222745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.223283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2285/4744] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:36 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:37.225159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.226228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.248822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3cab24b2-7d22-487f-8dda-1c8977d445bb req-94fddb9c-61ee-4bb4-8237-f903f0676603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33984b82-2bc7-4766-9469-f3a0736e5cd7", "name": "network-vif-plugged", "status": "completed", "tag": "bb184207-d431-41c9-8df4-69b9b42a6a0c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:37.270700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3cab24b2-7d22-487f-8dda-1c8977d445bb req-94fddb9c-61ee-4bb4-8237-f903f0676603 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.271455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3cab24b2-7d22-487f-8dda-1c8977d445bb req-94fddb9c-61ee-4bb4-8237-f903f0676603 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.304398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3cab24b2-7d22-487f-8dda-1c8977d445bb req-94fddb9c-61ee-4bb4-8237-f903f0676603 service nova] Creating event network-vif-plugged:bb184207-d431-41c9-8df4-69b9b42a6a0c for instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 on n-h2-850003-3 Jul 18 13:21:37.326027 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3cab24b2-7d22-487f-8dda-1c8977d445bb req-94fddb9c-61ee-4bb4-8237-f903f0676603 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096064 Jul 18 13:21:37.347704 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2286/4745] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:37.363845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:37.372343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:37.401041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.403600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.411305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.426233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.710835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:37.726426 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da284d3e-8776-4b14-a7ad-27ecad3d01bc tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1521 microversion: 2.1 time: 0.534257 Jul 18 13:21:37.728550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2460/4746] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:37 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:37.740731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:37.744261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:37.758422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.760405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.761864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:37.762890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:37.930326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:21:37.931622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:21:37.932360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:21:37.932764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:21:37.933228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:21:38.079388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.093272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.094581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.103379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.103548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.192484 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-54df87a0-3f5a-4159-bda6-a4fc292f8824 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "POST /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525/action" status: 202 len: 1137 microversion: 2.57 time: 0.461636 Jul 18 13:21:38.206128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2461/4747] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 18 13:21:37 2022] POST /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525/action => generated 1137 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 13:21:38.218369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.225973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.228235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:38.233595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.237633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.238556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.241372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.242238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.284158 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c69af24-4ade-487b-af4c-a9ba5759a5f8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.933000 Jul 18 13:21:38.287998 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2287/4748] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:37 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:38.335986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:38.342885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.345243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:38.378644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.379336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.381035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.387219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.433121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03cde4d4-0da2-4150-8dba-6b0d0ff03a98 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.224132 Jul 18 13:21:38.435544 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2462/4749] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers => generated 1009 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:38.452137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.453098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.467048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.468485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.469497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.470124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.557080 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85ec7503-4770-43c1-a04d-4dc2f2d526d6 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 202 len: 0 microversion: 2.1 time: 0.257701 Jul 18 13:21:38.558370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2288/4750] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:38 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:21:38.569941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.571515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.584577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.585140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.586776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.587273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.669759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] HTTP exception thrown: Action 999 not found Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Request method failure captured: Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36/os-instance-actions/999 HTTP/1.1 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5GHXBSuDAqs2-J2NyB0jH7sQZrv0bdm5uQ1mk3vGUBSQMsqBc5txH-IWB5KxP0SHU-96IZGsEUzKTDqCNFDqZ5Ggl3PgshROjFYigcFBbc187jKIAWJjP0FSFk7-T_jeiuhr8d-WQ-VL5DKZyPglex0cAiTyRp6WqEk6Og46WNVWc Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26facd0b41a7472398c1e66f1428e82d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fd68e26c2931419fbbed938d430d2c43 Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: exception: Action 999 not found Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': 'cbe43e43-b254-4d70-8136-03a806b52f36', 'id': '999'} Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 18 13:21:38.682098 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:38.693522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Returning 404 to user: Action 999 not found {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:38.693522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42fda0a9-e116-4ca9-bab8-738ed5640a45 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.124532 Jul 18 13:21:38.693522 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2289/4751] 10.222.0.88 () {58 vars in 1307 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:21:38.698095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.699095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.733187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.733832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.735619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.735619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.737609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.761139 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96a8e97e-c951-42cd-86fb-def9c744a9ed tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.325065 Jul 18 13:21:38.780009 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2463/4752] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:38.794811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.796791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:38.809941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.811600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.813308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.814193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.851939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.875698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.878998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.881109 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f79bac2a-5fec-4d76-818a-68d6222dd7e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.192752 Jul 18 13:21:38.894307 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2290/4753] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:38.902138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:38.910105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:38.915935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:38.938655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.939228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:38.940225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:38.940852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.164002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:39.171195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:39.189657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be8998f4-b177-4778-aa02-7e328eba2363 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1312 microversion: 2.1 time: 0.406009 Jul 18 13:21:39.207664 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2464/4754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:39.207664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.207664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:39.212158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.213700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.215001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.215733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.303996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3be1afc-9507-48f2-a71c-eafdf3c6a643 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.407529 Jul 18 13:21:39.317207 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2291/4755] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:21:38 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:39.328365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '.version_select at 0x7f96e4c4a040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.330895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: fb9ad746-0a79-4b68-a486-fcb2651d4a48] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:39.343613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] HTTP exception thrown: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Request method failure captured: Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/fb9ad746-0a79-4b68-a486-fcb2651d4a48/os-instance-actions HTTP/1.1 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5GHXBSuDAqs2-J2NyB0jH7sQZrv0bdm5uQ1mk3vGUBSQMsqBc5txH-IWB5KxP0SHU-96IZGsEUzKTDqCNFDqZ5Ggl3PgshROjFYigcFBbc187jKIAWJjP0FSFk7-T_jeiuhr8d-WQ-VL5DKZyPglex0cAiTyRp6WqEk6Og46WNVWc Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26facd0b41a7472398c1e66f1428e82d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fd68e26c2931419fbbed938d430d2c43 Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': 'fb9ad746-0a79-4b68-a486-fcb2651d4a48'} Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:39.346051 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Returning 404 to user: Instance fb9ad746-0a79-4b68-a486-fcb2651d4a48 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a69af43-0b11-4599-a658-d0b827cc86a6 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/fb9ad746-0a79-4b68-a486-fcb2651d4a48/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030334 Jul 18 13:21:39.357690 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2292/4756] 10.222.0.88 () {58 vars in 1295 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers/fb9ad746-0a79-4b68-a486-fcb2651d4a48/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:39.360846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.361590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:39.374817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.375671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.377765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.378563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.517309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:39.543174 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ccf8b73a-f09c-46aa-b757-abafa116a24e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1504 microversion: 2.1 time: 0.349913 Jul 18 13:21:39.559091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2465/4757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:39.574332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.584904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:39.586208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.servers [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Removing options 'limit' from query {{(pid=131366) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 13:21:39.588518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:39.599630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.601613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.604771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.605965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.657507 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0235d36-b728-4133-8036-46d4844415f4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.095680 Jul 18 13:21:39.666458 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2466/4758] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:39.683408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:39.687865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.688955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:39.699840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.700779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.702366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.703140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.712685 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17dd52a4-4ae2-447c-8938-04f2b525cb20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.359394 Jul 18 13:21:39.718655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2293/4759] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:39.728809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ec69b965-9e81-42db-b995-3d1d63bd32c1 req-79ca2d11-dc75-4211-b367-764c448b2f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "name": "network-vif-plugged", "status": "completed", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:39.749064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ec69b965-9e81-42db-b995-3d1d63bd32c1 req-79ca2d11-dc75-4211-b367-764c448b2f03 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.749966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ec69b965-9e81-42db-b995-3d1d63bd32c1 req-79ca2d11-dc75-4211-b367-764c448b2f03 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.761073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:39.773325 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ec69b965-9e81-42db-b995-3d1d63bd32c1 req-79ca2d11-dc75-4211-b367-764c448b2f03 service nova] Creating event network-vif-plugged:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:21:39.783466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ec69b965-9e81-42db-b995-3d1d63bd32c1 req-79ca2d11-dc75-4211-b367-764c448b2f03 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061947 Jul 18 13:21:39.792660 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2294/4760] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:39.813857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.821474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:39.823963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1266721398', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:21:39.839352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.843879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.845732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:39.846746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:39.959050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1da9dc2-d6b1-4a2c-bc5e-e4040fa28666 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 204 len: 0 microversion: 2.1 time: 0.281047 Jul 18 13:21:39.961875 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2467/4761] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:21:39 2022] DELETE /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:39.975250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:39.976800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.002182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.004002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.007175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.008306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.072817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:21:40.217791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7fa3423-cd71-40a0-bbb5-58b3fa7793a7 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1266721398" status: 200 len: 346 microversion: 2.1 time: 0.412241 Jul 18 13:21:40.218930 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2295/4762] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1266721398 => generated 346 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:40.228983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:40.230475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.245649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.247987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.248407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.248980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.306508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.317327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-708cf3bd-3965-43b4-9645-ab92b9847f12 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.348830 Jul 18 13:21:40.319091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2468/4763] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:39 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:40.326486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:40.327898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.339087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.340012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.341147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.341598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.384364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.403385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.407452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.409517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9aff85f2-a638-4061-837f-2407b01b39a9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.189196 Jul 18 13:21:40.411604 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2296/4764] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:40 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:40.422529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:40.426588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.440257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.441063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.442519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.443330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.599268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.613768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-486f49f3-c2c0-4716-841c-ac61889305df tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1527 microversion: 2.1 time: 0.292390 Jul 18 13:21:40.615244 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2469/4765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:40 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1527 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:40.624451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59172586-98f8-4e90-b337-ffabc7f68d1a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:40.637758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59172586-98f8-4e90-b337-ffabc7f68d1a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.638567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59172586-98f8-4e90-b337-ffabc7f68d1a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.688283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59172586-98f8-4e90-b337-ffabc7f68d1a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:21:40.716216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:40.720579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:40.733869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e69bf364-6fed-420e-b794-6ba98e39e343 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1498 microversion: 2.1 time: 0.320389 Jul 18 13:21:40.740332 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2297/4766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:40 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:40.752246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:40.752246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.763287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.764076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.765478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.766273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.794278 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59172586-98f8-4e90-b337-ffabc7f68d1a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "POST /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.177194 Jul 18 13:21:40.798376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2470/4767] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:40 2022] POST /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:21:40.805673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:40.808391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:40.818689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.819558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.820825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:40.822114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:40.827176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:41.177028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.194539 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37cecc42-79fd-42a5-9af0-9f0e8df8d23f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1504 microversion: 2.1 time: 0.457155 Jul 18 13:21:41.196914 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2298/4768] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:40 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:41.207079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19b6d9f4-4563-40a3-abfb-3b68aa9ee3c3 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.218357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.244290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c08a363-2f2d-44e8-88b9-3fcb7fe65d08 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.442801 Jul 18 13:21:41.248292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_groups [None req-19b6d9f4-4563-40a3-abfb-3b68aa9ee3c3 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Querying cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) for 1 instances {{(pid=131367) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 13:21:41.249708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f4-4563-40a3-abfb-3b68aa9ee3c3 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.250549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f4-4563-40a3-abfb-3b68aa9ee3c3 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.250839 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2471/4769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:40 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:41.261482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.263050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:41.275477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.276775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.278705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.279652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.334999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19b6d9f4-4563-40a3-abfb-3b68aa9ee3c3 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1" status: 200 len: 222 microversion: 2.1 time: 0.135840 Jul 18 13:21:41.336336 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2299/4770] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:21:41 2022] GET /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1 => generated 222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:41.363124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.363946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:41.378674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.379751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.384077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.384077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.458278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:41.633351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-913a94a2-cc22-4c5b-a4ae-9b216b47f8bb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 204 len: 0 microversion: 2.1 time: 0.284247 Jul 18 13:21:41.642940 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2300/4771] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:21:41 2022] DELETE /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:41.655479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.656961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:41.669569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.670122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.671387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.672425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.677849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.694920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9473159a-7302-4d05-be2b-23caf2dda5b4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.441723 Jul 18 13:21:41.696750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2472/4772] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:41 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:41.706206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.726259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:41.748645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.749734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.751134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.751861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.928424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.947493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.950931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:41.954762 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d84050e0-7c45-4edb-95e4-c0699326ab1a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.255381 Jul 18 13:21:41.956776 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2473/4773] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:41 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:41.969058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:41.970276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:41.982105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.984259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:41.986068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:41.987154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.033172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:42.049092 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ad4c07f-9f5f-4725-b252-a9aacf8abb08 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.403964 Jul 18 13:21:42.056997 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2301/4774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:41 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:42.067354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:42.069525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:42.091425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.094769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.094769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.095458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.401159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:42.412915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c11b7a7-142f-4e8f-8ff9-1525d827a0ad tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1527 microversion: 2.1 time: 0.453726 Jul 18 13:21:42.417884 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2474/4775] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:41 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1527 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:42.426024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:42.428253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:42.438485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=29 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:42.447536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.448624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.451075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.451905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.802844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:42.821474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20ae8899-cf86-49e3-86f8-76c63cfc0e9d tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1504 microversion: 2.1 time: 0.404894 Jul 18 13:21:42.823271 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2475/4776] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:42 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:42.849816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:42.861665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:42.874782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.876076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:42.877916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:42.879328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.055599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.083990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-793c8ba9-33bc-444b-adb5-1d8b74cf48b0 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1504 microversion: 2.1 time: 1.024637 Jul 18 13:21:43.085281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2302/4777] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:42 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1504 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:43.098625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.100193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.114698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.115493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.116975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.117997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.176348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.199743 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-855c37fa-605c-49dc-b1a1-7dfe639cc0be tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.356524 Jul 18 13:21:43.200860 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2476/4778] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:42 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:43.209867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.211430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.232114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.233177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.234740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.235775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.286524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lazy-loading 'services' on Instance uuid 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:43.411989 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c40ddc8-e1f2-47b2-b17b-31c6bd9b8f6f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a/os-volume_attachments/b269b2f6-0a40-4453-abd8-a58843f0a762" status: 202 len: 0 microversion: 2.1 time: 0.322415 Jul 18 13:21:43.413111 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2303/4779] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:21:43 2022] DELETE /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a/os-volume_attachments/b269b2f6-0a40-4453-abd8-a58843f0a762 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:21:43.432335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.433567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.463555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.465752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.468000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.471309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.496932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.517493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1072773e-56d2-4fe6-a9f1-f8d43c913146 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.314568 Jul 18 13:21:43.536294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2477/4780] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:43 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:43.557815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.560042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.575165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:43.583403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.584326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.585906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.586960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.621045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.641859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.646235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.649088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d742156-e9a3-4bdf-9ace-04d45b61c5e7 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.233912 Jul 18 13:21:43.650807 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2304/4781] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:43 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:43.674467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.676096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.688246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.689562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.691399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.692277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.871129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.885570 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34bfeaac-b65a-41bf-be9c-e85a9f53d1cb tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.345436 Jul 18 13:21:43.889250 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2478/4782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:43 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:43.901639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:43.903001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:43.920985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.921810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.923326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:43.924138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:43.954284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:43.971668 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c617f56-cc18-4f55-ba7b-74b07e5a863f tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1527 microversion: 2.1 time: 0.306695 Jul 18 13:21:43.972561 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2305/4783] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:43 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1527 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:44.112371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:44.113408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:44.123500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.124190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.125595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.126142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.131539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.142134 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f55006cf-4fec-4446-88f4-339030578fa1 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1504 microversion: 2.1 time: 0.246326 Jul 18 13:21:44.142926 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2479/4784] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:43 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:44.223432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:44.224252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:44.234389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.235137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.236184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.236863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.357874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.370652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2078f58-536c-4c3f-9c2a-4ec6053cfe96 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1504 microversion: 2.1 time: 0.264913 Jul 18 13:21:44.372003 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2306/4785] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:44.507408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.520052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9e4f1d9-73da-4897-a7b2-2887d3cbc173 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1371 microversion: 2.1 time: 0.302320 Jul 18 13:21:44.520759 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2480/4786] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:44.550233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:44.551464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:44.560732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:44.569346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.570214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.572477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.573560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.685908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:44.692808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:44.697196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.697657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.698782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.699465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.813667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.826998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.830378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.832433 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f84d2ea6-2cbc-4526-aa0c-787391e2b005 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.152170 Jul 18 13:21:44.833045 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2481/4787] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:44.847215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:44.872523 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32be71ae-bbeb-4fac-a529-faea339e13da tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.330851 Jul 18 13:21:44.874219 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2307/4788] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:44.914773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:44.917396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:44.927868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.928981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:44.930085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:44.931367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.009314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:45.013564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:45.031790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.034748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.036773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.039855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.180692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:45.192890 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c39f78f-d64b-45ce-a469-c57c140eb3a0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.286854 Jul 18 13:21:45.207024 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2482/4789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:45.217540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:45.218524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:45.229998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.231343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.233475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.234394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.508056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:45.530253 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7be6c2d-ffc9-4588-937d-f7c3a2724911 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.321010 Jul 18 13:21:45.539162 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2483/4790] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:45 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:45.549015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-deb76feb-d6f5-4d5b-8c36-75b7008d5015 req-5ac66d86-2b86-4a96-979e-70c7abe0d3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac573e14-f299-4757-b98c-1722fa9d243f", "name": "network-vif-plugged", "status": "completed", "tag": "5c6e9a15-8393-46f1-a489-6fe951db98e8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:45.567238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-deb76feb-d6f5-4d5b-8c36-75b7008d5015 req-5ac66d86-2b86-4a96-979e-70c7abe0d3ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.568225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-deb76feb-d6f5-4d5b-8c36-75b7008d5015 req-5ac66d86-2b86-4a96-979e-70c7abe0d3ea service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.595040 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-deb76feb-d6f5-4d5b-8c36-75b7008d5015 req-5ac66d86-2b86-4a96-979e-70c7abe0d3ea service nova] Creating event network-vif-plugged:5c6e9a15-8393-46f1-a489-6fe951db98e8 for instance ac573e14-f299-4757-b98c-1722fa9d243f on n-h1-850003-3 Jul 18 13:21:45.607001 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-deb76feb-d6f5-4d5b-8c36-75b7008d5015 req-5ac66d86-2b86-4a96-979e-70c7abe0d3ea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065379 Jul 18 13:21:45.608308 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2484/4791] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:45.622475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:45.622475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:45.634468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.635483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.636992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:45.637838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:45.970220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:45.984296 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1f944d54-7023-4a51-adbd-8583fd6917bc tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1504 microversion: 2.1 time: 0.374082 Jul 18 13:21:45.985427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2485/4792] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:45 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:46.006476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.009239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:46.027989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.028819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.031464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.032427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.147297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.163620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8524a308-8c81-443d-bf48-b384918ff1c2 tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1527 microversion: 2.1 time: 1.169339 Jul 18 13:21:46.164891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2308/4793] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:44 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1527 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:46.187611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.188995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:46.203375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.204818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.206831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.207588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.342415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.354088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-444137f8-82b4-404c-bae1-0277b4697f83 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1565 microversion: 2.1 time: 0.355154 Jul 18 13:21:46.357657 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2486/4794] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:45 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1565 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:46.368263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.370368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:46.391701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.392657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.394485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.395017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.532255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.551608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.555229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.558273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5fca51b-13ad-4363-aaf3-1a3a81096d3c tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.200307 Jul 18 13:21:46.565468 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2487/4795] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:46 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:46.574129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.575731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:46.588513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.589755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.591256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.592300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.623100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:46.776758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.802479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bb3753c-e50a-4ff1-bb41-9f283caa9759 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.627738 Jul 18 13:21:46.803988 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2309/4796] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:46 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:46.813503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.815019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:46.836266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.837110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.838565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:46.847637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:46.951563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:46.967538 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8bcc062b-51d1-4281-aecb-bba0157d1f25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.405079 Jul 18 13:21:46.969514 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2488/4797] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:46 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:46.990217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:46.991196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:47.015582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.016344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.018895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.019117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.212902 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5b39435-a7ea-468e-8715-54b4f34ebb35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240332 Jul 18 13:21:47.214523 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2489/4798] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:21:46 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:47.226497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:47.227426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: d28f8922-f065-473f-a1c5-ffe39e85e736] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:47.253211 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/d28f8922-f065-473f-a1c5-ffe39e85e736/action HTTP/1.1 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 15 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: {"unpause": {}} Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd28f8922-f065-473f-a1c5-ffe39e85e736', 'body': {'unpause': {}}} Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:47.256971 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:47.266071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:47.266071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:47.266071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. Jul 18 13:21:47.266071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:47.268525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance d28f8922-f065-473f-a1c5-ffe39e85e736 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:47.269770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-905e2be3-6eda-4284-b3c0-4e9adcb12338 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/d28f8922-f065-473f-a1c5-ffe39e85e736/action" status: 404 len: 111 microversion: 2.1 time: 0.053205 Jul 18 13:21:47.277810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2490/4799] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:47 2022] POST /compute/v2.1/servers/d28f8922-f065-473f-a1c5-ffe39e85e736/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:47.287877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:47.289497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:47.306026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.307471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.309833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.311683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.450771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:47.473196 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-245a26b0-52c2-4d7e-9033-7def9d11ce82 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1323 microversion: 2.1 time: 0.666950 Jul 18 13:21:47.477712 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2310/4800] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:46 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1323 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:47.517365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:47.520506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:47.559571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.566284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.570084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.577864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.664895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:47.688760 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3a29916-d3ba-4ef3-ae5f-5865212867fb tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1462 microversion: 2.1 time: 0.407418 Jul 18 13:21:47.692724 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2491/4801] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:47 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1462 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:47.708076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:47.710313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:47.733908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.734624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.739418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.741632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.867852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd68e26c2931419fbbed938d430d2c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26facd0b41a7472398c1e66f1428e82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:47.887275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5d3b50a-efbd-44f8-97c3-3b927c7f30ec tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 200 len: 1309 microversion: 2.1 time: 0.407261 Jul 18 13:21:47.903210 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2311/4802] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:47 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:47.912637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-db3a6a5f-8aae-4b46-9937-ed3c4077b19e req-5845aa03-2c98-4b43-858b-f50ff8ee90b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe43e43-b254-4d70-8136-03a806b52f36", "name": "network-vif-deleted", "tag": "1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:47.929093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-db3a6a5f-8aae-4b46-9937-ed3c4077b19e req-5845aa03-2c98-4b43-858b-f50ff8ee90b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:47.929899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-db3a6a5f-8aae-4b46-9937-ed3c4077b19e req-5845aa03-2c98-4b43-858b-f50ff8ee90b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:47.955300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-db3a6a5f-8aae-4b46-9937-ed3c4077b19e req-5845aa03-2c98-4b43-858b-f50ff8ee90b2 service nova] Creating event network-vif-deleted:1b20bce3-3e42-42e5-a2fa-97c3d3dbd39a for instance cbe43e43-b254-4d70-8136-03a806b52f36 on n-h2-850003-3 Jul 18 13:21:47.979271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-db3a6a5f-8aae-4b46-9937-ed3c4077b19e req-5845aa03-2c98-4b43-858b-f50ff8ee90b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073507 Jul 18 13:21:47.980496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2312/4803] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:48.001994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:48.003632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:48.024779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.024779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.025233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.028288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.047590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:48.205984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.221508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.223203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.225337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61c1c651-18f2-42c7-9f41-11f9d58c4da9 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.236519 Jul 18 13:21:48.240719 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2313/4804] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:47 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:48.240719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:48.240719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:48.243914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.244779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.246275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.246790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.361077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.394973 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64e0b956-bf03-4747-9177-b313ab9e0d1f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.693402 Jul 18 13:21:48.395944 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2492/4805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:47 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:48.427571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:48.428765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:48.450813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.451627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.453119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.453905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.515178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.532018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e22168e2-02c6-4f72-89dc-ebfc7c2c57d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.302816 Jul 18 13:21:48.533251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2314/4806] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:48 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:48.541461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:48.542419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:48.556734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.558186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.560126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.561233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.843494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.864238 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79de4bca-21a0-4a17-8f82-a88e98137033 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.439177 Jul 18 13:21:48.866383 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2493/4807] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:48 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:48.879106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:48.880916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:48.896867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.897863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.899456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.900190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:48.947190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:48.975954 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8031bd36-25e6-41f6-ad42-d635f0a09d61 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1519 microversion: 2.1 time: 0.440355 Jul 18 13:21:48.979356 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2315/4808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:48 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1519 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:48.994352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:48.998595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:48.999487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.001065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.002585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lazy-loading 'fault' on Instance uuid 33984b82-2bc7-4766-9469-f3a0736e5cd7 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:49.008854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.009851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.011012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.011586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.058532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'unpause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 15 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: {"unpause": {}} Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'unpause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'unpause': {}}} Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state active. Cannot unpause while the instance is in this state. Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.063971 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'unpause' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8136dda2-002d-44af-93a5-3edc3a7af6c0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 145 microversion: 2.1 time: 0.084558 Jul 18 13:21:49.076813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2316/4809] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:48 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 145 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:21:49.087707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.089205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] [instance: cbe43e43-b254-4d70-8136-03a806b52f36] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.109975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.110942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.112445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.113315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.145286 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] HTTP exception thrown: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Request method failure captured: Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 HTTP/1.1 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5GHXBSuDAqs2-J2NyB0jH7sQZrv0bdm5uQ1mk3vGUBSQMsqBc5txH-IWB5KxP0SHU-96IZGsEUzKTDqCNFDqZ5Ggl3PgshROjFYigcFBbc187jKIAWJjP0FSFk7-T_jeiuhr8d-WQ-VL5DKZyPglex0cAiTyRp6WqEk6Og46WNVWc Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26facd0b41a7472398c1e66f1428e82d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26facd0b41a7472398c1e66f1428e82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 26facd0b41a7472398c1e66f1428e82d Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-364311296 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fd68e26c2931419fbbed938d430d2c43 Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-364311296-project Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'cbe43e43-b254-4d70-8136-03a806b52f36'} Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.149900 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] Returning 404 to user: Instance cbe43e43-b254-4d70-8136-03a806b52f36 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:49.157492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82b486ab-d3b7-4faf-a819-84f0401dc33a tempest-InstanceActionsNegativeTestJSON-364311296 tempest-InstanceActionsNegativeTestJSON-364311296-project] 10.222.0.88 "GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36" status: 404 len: 111 microversion: 2.1 time: 0.076139 Jul 18 13:21:49.181157 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2317/4810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/cbe43e43-b254-4d70-8136-03a806b52f36 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:49.190011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d1d3ce66fd42a0a1295819dccb1192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed46daacc484f02bccfacc17f76ea95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:49.204543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.208785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.228434 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6c34de6-140a-4641-9d4c-7a8352fdc372 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 200 len: 1302 microversion: 2.1 time: 0.355273 Jul 18 13:21:49.242179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2494/4811] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:48 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 1302 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:49.249650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-251e3b7b-7577-4040-97ea-102109e0c679 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1025814505", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-251e3b7b-7577-4040-97ea-102109e0c679 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 243 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1025814505", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1025814505', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'faea3be6-4c6d-4918-a729-e3b197cfa663'}]}}} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:49.264185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.272572 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.281110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.282471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.284194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.285367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.291029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-251e3b7b-7577-4040-97ea-102109e0c679 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:49.293214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-251e3b7b-7577-4040-97ea-102109e0c679 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.059921 Jul 18 13:21:49.302676 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2495/4812] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:49 2022] POST /compute/v2.1/servers => generated 175 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:49.311269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.315094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.328307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.329273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.330870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.331872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.457800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:49.480624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:49.485855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:49.488354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c93e4f3d-8f68-4eba-9f3e-d0240b228e91 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.191638 Jul 18 13:21:49.493026 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2496/4813] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:49.505696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.509277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: 89598c48-85a5-449a-9eea-05a492c8e9fc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.520755 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] HTTP exception thrown: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/89598c48-85a5-449a-9eea-05a492c8e9fc/metadata HTTP/1.1 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '89598c48-85a5-449a-9eea-05a492c8e9fc'} Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.532029 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 404 to user: Instance 89598c48-85a5-449a-9eea-05a492c8e9fc could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7aebe052-eee6-4629-905e-d9999925feef tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/89598c48-85a5-449a-9eea-05a492c8e9fc/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037983 Jul 18 13:21:49.544892 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2497/4814] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/89598c48-85a5-449a-9eea-05a492c8e9fc/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:49.575258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.577194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.597620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.599584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.601186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.602208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.652685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=18 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:49.751455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:49.771428 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf3dc93d-7c49-47ae-aad0-afc9e0de78cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.595513 Jul 18 13:21:49.773380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2318/4815] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:49.782255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4fe1af56-4971-454a-b2fb-304c2f675913 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771007023", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4fe1af56-4971-454a-b2fb-304c2f675913 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 498 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771007023", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-771007023', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'faea3be6-4c6d-4918-a729-e3b197cfa663'}]}}} Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:21:49.786531 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:49.790519 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:49.798692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4fe1af56-4971-454a-b2fb-304c2f675913 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:49.799991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4fe1af56-4971-454a-b2fb-304c2f675913 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022874 Jul 18 13:21:49.800815 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2319/4816] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:49 2022] POST /compute/v2.1/servers => generated 687 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:49.821549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:49.823833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:49.840271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.841092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.842613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:49.843460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:49.965095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:50.252686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:50.266289 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d50fa919-1359-4e0e-8839-173f06207e52 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.461344 Jul 18 13:21:50.280228 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2320/4817] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:50.285910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf3ceaa0-2d16-4f57-a5f6-b56dfab06c6d tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1550052276", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf3ceaa0-2d16-4f57-a5f6-b56dfab06c6d tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 500 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1550052276", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1550052276', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'faea3be6-4c6d-4918-a729-e3b197cfa663'}]}}} Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:21:50.289407 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf3ceaa0-2d16-4f57-a5f6-b56dfab06c6d tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:50.293115 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf3ceaa0-2d16-4f57-a5f6-b56dfab06c6d tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009546 Jul 18 13:21:50.300870 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2321/4818] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:50 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:50.305759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1a6d6db6-a39c-4b87-9be3-1a62f9576ac9 req-c1a2b017-e532-48e1-9231-5946d04afa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33984b82-2bc7-4766-9469-f3a0736e5cd7", "name": "network-vif-deleted", "tag": "bb184207-d431-41c9-8df4-69b9b42a6a0c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:50.318412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a6d6db6-a39c-4b87-9be3-1a62f9576ac9 req-c1a2b017-e532-48e1-9231-5946d04afa5b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.319307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1a6d6db6-a39c-4b87-9be3-1a62f9576ac9 req-c1a2b017-e532-48e1-9231-5946d04afa5b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.333724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-1a6d6db6-a39c-4b87-9be3-1a62f9576ac9 req-c1a2b017-e532-48e1-9231-5946d04afa5b service nova] Creating event network-vif-deleted:bb184207-d431-41c9-8df4-69b9b42a6a0c for instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 on n-h2-850003-3 Jul 18 13:21:50.340055 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1a6d6db6-a39c-4b87-9be3-1a62f9576ac9 req-c1a2b017-e532-48e1-9231-5946d04afa5b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037694 Jul 18 13:21:50.341327 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2322/4819] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:50.347747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:50.348723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:50.356856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.357929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.359274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.360078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.390885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 HTTP/1.1 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '33984b82-2bc7-4766-9469-f3a0736e5cd7'} Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.394840 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:50.400124 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.405894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:50.414128 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a68662e3-c435-4a20-97fd-024861c0b165 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 404 len: 111 microversion: 2.1 time: 0.064215 Jul 18 13:21:50.415174 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2323/4820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:50 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:50.421917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:50.434559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:50.439453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 1b7bd066-c70f-4c4f-9272-c3515a773b4d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:50.451511 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca529131-2802-408d-b0f8-3c3368a00910 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.885501 Jul 18 13:21:50.463802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/1b7bd066-c70f-4c4f-9272-c3515a773b4d/action HTTP/1.1 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 18 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: {"unshelve": null} Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1b7bd066-c70f-4c4f-9272-c3515a773b4d', 'body': {'unshelve': None}} Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.466313 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.470466 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.470466 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:50.470466 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:50.470466 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. Jul 18 13:21:50.470466 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.470792 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2498/4821] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:49 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:50.475756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f26323d4-6a57-4d09-9136-83894a61a47b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1669338529", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:50.476469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 1b7bd066-c70f-4c4f-9272-c3515a773b4d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:50.477681 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51ad61a0-e692-4fbe-ac39-abda48b8c95e tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/1b7bd066-c70f-4c4f-9272-c3515a773b4d/action" status: 404 len: 111 microversion: 2.1 time: 0.060965 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f26323d4-6a57-4d09-9136-83894a61a47b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 754 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1669338529", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1669338529', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'faea3be6-4c6d-4918-a729-e3b197cfa663'}]}}} Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:50.481689 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:50.487307 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:50.497878 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.497878 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.498235 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2324/4822] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:50 2022] POST /compute/v2.1/servers/1b7bd066-c70f-4c4f-9272-c3515a773b4d/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:50.498399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f26323d4-6a57-4d09-9136-83894a61a47b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:50.498399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f26323d4-6a57-4d09-9136-83894a61a47b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.025081 Jul 18 13:21:50.501405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2499/4823] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:21:50 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 18 13:21:50.510863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:50.518937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4f168e6b-4518-4a0d-ad0d-e462c37a8c46 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:50.529880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:50.561225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.562712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.564702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.567086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.594764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_groups [None req-4f168e6b-4518-4a0d-ad0d-e462c37a8c46 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Querying cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) for 1 instances {{(pid=131367) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 13:21:50.595740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f168e6b-4518-4a0d-ad0d-e462c37a8c46 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.596201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4f168e6b-4518-4a0d-ad0d-e462c37a8c46 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.624858 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4f168e6b-4518-4a0d-ad0d-e462c37a8c46 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.138672 Jul 18 13:21:50.629632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2325/4824] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:21:50 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:50.653471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:50.655022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:50.681100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.682320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.683953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:50.684969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:50.856801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:50.883265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:50.885772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:50.888320 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ae63295-8dec-4e37-b2f7-e6ac7d02e9f0 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.252396 Jul 18 13:21:50.906777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2326/4825] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:50 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:50.927838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bccf87d3-395c-4569-b2f8-c68e159ab3b9 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-100073957", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bccf87d3-395c-4569-b2f8-c68e159ab3b9 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 1265 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-100073957", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faea3be6-4c6d-4918-a729-e3b197cfa663"}]}} Jul 18 13:21:50.934040 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-100073957', 'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'faea3be6-4c6d-4918-a729-e3b197cfa663'}]}}} Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.940280 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:50.942526 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:50.945885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 13:21:50.945885 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:50.945885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bccf87d3-395c-4569-b2f8-c68e159ab3b9 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:50.945885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bccf87d3-395c-4569-b2f8-c68e159ab3b9 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.036266 Jul 18 13:21:50.966698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2327/4826] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 18 13:21:50 2022] POST /compute/v2.1/servers => generated 2221 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 18 13:21:50.973231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a23d4f4-64ba-4006-b498-7f43991d5222 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.002816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:51.013198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_groups [None req-5a23d4f4-64ba-4006-b498-7f43991d5222 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Querying cell e6953118-0e33-49b1-a435-fe09456f4bf3(cell1) for 1 instances {{(pid=131367) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 13:21:51.014285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a23d4f4-64ba-4006-b498-7f43991d5222 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.015002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a23d4f4-64ba-4006-b498-7f43991d5222 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.025487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:51.045933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a23d4f4-64ba-4006-b498-7f43991d5222 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1" status: 200 len: 184 microversion: 2.1 time: 0.077293 Jul 18 13:21:51.046980 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2328/4827] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:21:50 2022] GET /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1 => generated 184 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:51.053506 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39db94ac-144d-4a73-a68a-db0e3d8d15cb tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.549802 Jul 18 13:21:51.056060 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2500/4828] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:50 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:51.071449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.072255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: f6bcfba3-6812-4966-9b8a-da37a3f4e762] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.089598 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] HTTP exception thrown: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/f6bcfba3-6812-4966-9b8a-da37a3f4e762/metadata/test2 HTTP/1.1 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': 'f6bcfba3-6812-4966-9b8a-da37a3f4e762', 'id': 'test2'} Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.092366 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 404 to user: Instance f6bcfba3-6812-4966-9b8a-da37a3f4e762 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48bef034-bc82-4529-a782-5d1d0cc578b3 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/f6bcfba3-6812-4966-9b8a-da37a3f4e762/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.046629 Jul 18 13:21:51.103600 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2329/4829] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 13:21:51 2022] GET /compute/v2.1/servers/f6bcfba3-6812-4966-9b8a-da37a3f4e762/metadata/test2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:51.120052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.120939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.133266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.134499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.135493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.135930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.157273 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 HTTP/1.1 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '33984b82-2bc7-4766-9469-f3a0736e5cd7'} Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:51.159324 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c6117af2-ee3d-4e13-9bab-88816abd274f tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 404 len: 111 microversion: 2.1 time: 0.056812 Jul 18 13:21:51.171460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2330/4830] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:21:51 2022] DELETE /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:51.174120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.178184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.187608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.188446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.189646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.190539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.289430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-75754988-a6e4-448e-a404-b7bbe9ca0c25 req-86ff5640-b2c1-48be-a7d2-a59ec0ba6d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:51.310977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75754988-a6e4-448e-a404-b7bbe9ca0c25 req-86ff5640-b2c1-48be-a7d2-a59ec0ba6d42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.311810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75754988-a6e4-448e-a404-b7bbe9ca0c25 req-86ff5640-b2c1-48be-a7d2-a59ec0ba6d42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.343046 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-75754988-a6e4-448e-a404-b7bbe9ca0c25 req-86ff5640-b2c1-48be-a7d2-a59ec0ba6d42 service nova] Creating event network-changed:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:21:51.353845 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-75754988-a6e4-448e-a404-b7bbe9ca0c25 req-86ff5640-b2c1-48be-a7d2-a59ec0ba6d42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295573 Jul 18 13:21:51.355761 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2501/4831] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:51.384297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.385328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.407401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.410009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.412472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.413417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.488955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:51.698431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20e31595-e09d-4046-bc93-1f272fb7a54b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 204 len: 0 microversion: 2.1 time: 0.337169 Jul 18 13:21:51.706363 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2502/4832] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:21:51 2022] DELETE /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:51.718187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.719897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] [instance: 33984b82-2bc7-4766-9469-f3a0736e5cd7] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.731273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.732099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.733134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.733755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.757100 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 HTTP/1.1 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '33984b82-2bc7-4766-9469-f3a0736e5cd7'} Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:51.761528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. Jul 18 13:21:51.767794 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:51.770424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance 33984b82-2bc7-4766-9469-f3a0736e5cd7 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:51.781581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8351ae04-acbd-41c9-b667-1049c39471b4 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7" status: 404 len: 111 microversion: 2.1 time: 0.069143 Jul 18 13:21:51.784272 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2503/4833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:51 2022] GET /compute/v2.1/servers/33984b82-2bc7-4766-9469-f3a0736e5cd7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:51.810167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.825547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.825724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:51.835000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.836344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.839063 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c0b9e53b-92b6-4d0b-886a-e8866eaa6ae8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.671143 Jul 18 13:21:51.839357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.840223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.841305 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2331/4834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:51 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:51.860193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:51.864674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:51.889259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.890815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:51.892418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:51.893503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.168491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:52.185462 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ce806a92-706b-4f02-9b3a-4d9a681eb32f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.398508 Jul 18 13:21:52.187628 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2504/4835] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:51 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:52.196121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a449aacb-831b-4cf8-9fee-ea93a1c12e26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.209311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a449aacb-831b-4cf8-9fee-ea93a1c12e26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a449aacb-831b-4cf8-9fee-ea93a1c12e26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-server-groups/13460ad1-5e71-49bc-87d3-a809824a015f HTTP/1.1 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '13460ad1-5e71-49bc-87d3-a809824a015f'} Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.214717 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a449aacb-831b-4cf8-9fee-ea93a1c12e26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance group 13460ad1-5e71-49bc-87d3-a809824a015f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a449aacb-831b-4cf8-9fee-ea93a1c12e26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/13460ad1-5e71-49bc-87d3-a809824a015f" status: 404 len: 117 microversion: 2.1 time: 0.028556 Jul 18 13:21:52.223305 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2505/4836] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:52 2022] DELETE /compute/v2.1/os-server-groups/13460ad1-5e71-49bc-87d3-a809824a015f => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:52.230036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:52.231062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:52.245270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.246210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.247310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.247841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.304610 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Cannot 'unshelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action HTTP/1.1 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 18 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: {"unshelve": null} Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'unshelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'unshelve': None}} Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e in vm_state active. Cannot unshelve while the instance is in this state. Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:52.307068 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 409 to user: Cannot 'unshelve' instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e while it is in vm_state active {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-170b4e33-518c-47dd-a67d-6a793e0843d8 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action" status: 409 len: 146 microversion: 2.1 time: 0.088150 Jul 18 13:21:52.313386 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2506/4837] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:21:52 2022] POST /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e/action => generated 146 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:21:52.319792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.320613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:52.328441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.328914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.329727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.330213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.464471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:52.483302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:52.488777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:52.491681 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd90f202-e4d5-4500-8734-a0a8aff3be70 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.178778 Jul 18 13:21:52.493758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2507/4838] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:52 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:52.501705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e26c43ed-6401-4f23-b6d4-172ceb098d88 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.512568 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e26c43ed-6401-4f23-b6d4-172ceb098d88 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e26c43ed-6401-4f23-b6d4-172ceb098d88 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-server-groups/b3cd6f09-1df5-486f-bd70-79445f04efd6 HTTP/1.1 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b3cd6f09-1df5-486f-bd70-79445f04efd6'} Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.514520 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. Jul 18 13:21:52.519835 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.521918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e26c43ed-6401-4f23-b6d4-172ceb098d88 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance group b3cd6f09-1df5-486f-bd70-79445f04efd6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:52.523517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e26c43ed-6401-4f23-b6d4-172ceb098d88 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/b3cd6f09-1df5-486f-bd70-79445f04efd6" status: 404 len: 117 microversion: 2.1 time: 0.028297 Jul 18 13:21:52.528652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2508/4839] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:52 2022] DELETE /compute/v2.1/os-server-groups/b3cd6f09-1df5-486f-bd70-79445f04efd6 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:52.533939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.534905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:52.544319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.545283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.546656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.547575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.820319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:52.837126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-674c88d0-e37e-4e31-8b08-9de7d56dc328 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.306921 Jul 18 13:21:52.838504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2509/4840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:52 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:52.847191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905cdf0e-e197-40fb-8ab9-01015cab9046 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.880033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-905cdf0e-e197-40fb-8ab9-01015cab9046 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905cdf0e-e197-40fb-8ab9-01015cab9046 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-server-groups/36447aa8-28d6-4616-bb12-5f31667f09a0 HTTP/1.1 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '36447aa8-28d6-4616-bb12-5f31667f09a0'} Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.882719 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-905cdf0e-e197-40fb-8ab9-01015cab9046 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance group 36447aa8-28d6-4616-bb12-5f31667f09a0 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:52.891973 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-905cdf0e-e197-40fb-8ab9-01015cab9046 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/36447aa8-28d6-4616-bb12-5f31667f09a0" status: 404 len: 117 microversion: 2.1 time: 0.044724 Jul 18 13:21:52.896746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2510/4841] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:52 2022] DELETE /compute/v2.1/os-server-groups/36447aa8-28d6-4616-bb12-5f31667f09a0 => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:52.907269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:52.908192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:52.938367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.956175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:52.959336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:52.960595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.096068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:53.112355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07c37e18-04e1-4b2e-a296-22b54d08d808 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1525 microversion: 2.1 time: 1.269253 Jul 18 13:21:53.127045 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2332/4842] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:51 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1525 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:53.142001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3f2b1ae-9734-4a23-9155-098985540c26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:53.176432 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e3f2b1ae-9734-4a23-9155-098985540c26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] HTTP exception thrown: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3f2b1ae-9734-4a23-9155-098985540c26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Request method failure captured: Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-server-groups/a391a17f-cae9-4750-86f7-12535e2225e6 HTTP/1.1 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V5AuKf8v_MDFTReDnICmRvZ6bOZZYN0OpSImwOlqxjVf-0a9Sr0hQaar-0MH1dWEDyjV9kkEBmXa5u-9on36F07C9lutC-izhSjXSe_zSMILr9DOSqXLt0GIW7EKlC2gRUqjBOr8hHFQBamDMtoBrFUrMtkGdqtOPiW9iXvTGOkzUo Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eed46daacc484f02bccfacc17f76ea95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eed46daacc484f02bccfacc17f76ea95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eed46daacc484f02bccfacc17f76ea95 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerGroupTestJSON-1442145854 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 65d1d3ce66fd42a0a1295819dccb1192 Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerGroupTestJSON-1442145854-project Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a391a17f-cae9-4750-86f7-12535e2225e6'} Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.179353 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3f2b1ae-9734-4a23-9155-098985540c26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Returning 404 to user: Instance group a391a17f-cae9-4750-86f7-12535e2225e6 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3f2b1ae-9734-4a23-9155-098985540c26 tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/a391a17f-cae9-4750-86f7-12535e2225e6" status: 404 len: 117 microversion: 2.1 time: 0.052445 Jul 18 13:21:53.186140 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2333/4843] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:53 2022] DELETE /compute/v2.1/os-server-groups/a391a17f-cae9-4750-86f7-12535e2225e6 => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:53.193844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bbb537c-9809-47a3-99a7-1852d392551b tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:53.257699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bbb537c-9809-47a3-99a7-1852d392551b tempest-ServerGroupTestJSON-1442145854 tempest-ServerGroupTestJSON-1442145854-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1" status: 204 len: 0 microversion: 2.1 time: 0.070392 Jul 18 13:21:53.265693 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2334/4844] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:21:53 2022] DELETE /compute/v2.1/os-server-groups/0bb36600-ab53-4ad1-91e8-42c0078daaa1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:53.275320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:53.277420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:53.290423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.292081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.294804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.295804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.405912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:53.433883 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8474e5d-befd-4db7-802c-317ae9ca6f40 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.534671 Jul 18 13:21:53.436186 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2511/4845] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:52 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:53.457107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1545931051_updated"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:53.459728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 06a1c201-98c3-493f-ab8e-9141a22b18cd] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:53.475541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/servers/06a1c201-98c3-493f-ab8e-9141a22b18cd HTTP/1.1 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 81 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1545931051_updated"}} Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '06a1c201-98c3-493f-ab8e-9141a22b18cd', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1545931051_updated'}}} Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 13:21:53.479543 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. Jul 18 13:21:53.491397 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:53.496057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 06a1c201-98c3-493f-ab8e-9141a22b18cd could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:53.497518 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3c5a8be-9cd8-46d0-8f19-0d030030ed4c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "PUT /compute/v2.1/servers/06a1c201-98c3-493f-ab8e-9141a22b18cd" status: 404 len: 111 microversion: 2.1 time: 0.046765 Jul 18 13:21:53.499173 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2512/4846] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:21:53 2022] PUT /compute/v2.1/servers/06a1c201-98c3-493f-ab8e-9141a22b18cd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:53.517103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:53.518445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:53.533609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.534779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.536393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.537357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.543717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:53.880715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:53.895199 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6dd5b723-cc2c-4bad-90d6-9422939f2265 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.389666 Jul 18 13:21:53.897379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2513/4847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:53 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:53.904440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:53.906768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:53.923965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.926829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:53.929375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:53.930909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.077992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.095006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.098500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.101053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c61895c7-4eda-4493-949a-73a7733ba0fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.202797 Jul 18 13:21:54.102862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2514/4848] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:53 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:54.111607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.112927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.126969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.127900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.129448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.130434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.280116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.293462 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad6447f2-7df5-4d95-a514-87ff64df4963 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 1.025565 Jul 18 13:21:54.294592 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2335/4849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:53 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:54.306647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.308455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.323356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.324186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.325702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.326784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.375585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:21:54.377421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.388727 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0da8545-22ad-4fd2-96c9-c4ce56f4b56b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.284167 Jul 18 13:21:54.390354 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2515/4850] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:54.395246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.398232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.408942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.410872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.411883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.412448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.525980 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-640161bd-a2f9-4ffd-b7cc-23d33bf1e3d3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 204 len: 0 microversion: 2.1 time: 0.228910 Jul 18 13:21:54.527543 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2336/4851] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:21:54 2022] DELETE /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:21:54.537702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7324a4bd-3b8c-4505-84a7-f6b22961b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7324a4bd-3b8c-4505-84a7-f6b22961b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: request: PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e HTTP/1.1 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 280 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.543668 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7324a4bd-3b8c-4505-84a7-f6b22961b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:54.547216 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7324a4bd-3b8c-4505-84a7-f6b22961b83b tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 400 len: 619 microversion: 2.1 time: 0.016920 Jul 18 13:21:54.548886 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2337/4852] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 18 13:21:54 2022] PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:54.558179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.559045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.568382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.568861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.569950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.570487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.615418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.631548 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5a88c72-3853-49cd-b446-1e490fdc8fd0 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1525 microversion: 2.1 time: 0.239758 Jul 18 13:21:54.632735 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2516/4853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:54 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1525 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:54.640533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.641607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.652619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.653551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.655221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.655962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.848573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:54.864348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dad2c631-fcb0-47fa-aa38-52b3cfd11bac tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.228863 Jul 18 13:21:54.865647 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2517/4854] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:54.888805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:54.889451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:54.897158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.897616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:54.898708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:54.899748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.093725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.106572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bec70634-da2e-4f47-aae2-aa48a7c9dff2 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.223686 Jul 18 13:21:55.114093 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2518/4855] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:54 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:55.129562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:55.131427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:55.143683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.144216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.145201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.145764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.268142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.282190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.284078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.285675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f18d431-0f95-4bc0-819d-5343b1ef02e4 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.163231 Jul 18 13:21:55.286441 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2519/4856] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:55 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:21:55.292503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e1ba89b-a587-4df7-8b7a-da395055b34c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e1ba89b-a587-4df7-8b7a-da395055b34c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e HTTP/1.1 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 24 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": ""}} Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e', 'body': {'server': {'name': ''}}} Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi '' Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:21:55.296817 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e1ba89b-a587-4df7-8b7a-da395055b34c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e1ba89b-a587-4df7-8b7a-da395055b34c tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 400 len: 108 microversion: 2.1 time: 0.011055 Jul 18 13:21:55.307032 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2520/4857] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:21:55 2022] PUT /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:21:55.314750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:55.317563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:55.325175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.325884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.326972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.327618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.362641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.380231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c7b770ff-3efb-44f7-9b4a-ab43394d9a77 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1514 microversion: 2.1 time: 0.830403 Jul 18 13:21:55.386410 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2338/4858] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:54 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1514 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:55.395124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:55.396621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:55.407768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.408928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.410331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.411021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.589591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.605948 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0395d9b2-8377-47ce-9a2a-2eac409bdbd0 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1507 microversion: 2.1 time: 0.295865 Jul 18 13:21:55.614251 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2521/4859] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:55 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:55.657898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:55.659961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:55.672266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.673060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.674462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:55.675220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:55.978825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:55.995317 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-132cccf8-ef17-4981-8e6d-9e7593887b09 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1525 microversion: 2.1 time: 0.344318 Jul 18 13:21:55.996646 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2522/4860] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:55 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1525 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:21:56.346023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:56.347245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:56.382507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:56.383148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:56.400407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:56.401166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:56.472250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:56.542836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1efd9e3d-9aa1-4e7d-9903-66f62a69958c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 1.150167 Jul 18 13:21:56.550702 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2339/4861] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:55 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:56.585624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:56.587077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:56.617575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:56.619138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:56.620770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:56.621468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:56.721466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:56.899658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:56.948575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:56.962588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:56.965767 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-542946bb-c8aa-49f4-94f3-6e27a681201d tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.626535 Jul 18 13:21:56.979893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2523/4862] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:56 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:57.008161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3281afd7-dfc9-4892-9e7a-fa5ec97c043b req-2a8b01d3-2045-4def-949c-75f597e71cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac573e14-f299-4757-b98c-1722fa9d243f", "name": "network-vif-deleted", "tag": "5c6e9a15-8393-46f1-a489-6fe951db98e8"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:21:57.048214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3281afd7-dfc9-4892-9e7a-fa5ec97c043b req-2a8b01d3-2045-4def-949c-75f597e71cc0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.049437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3281afd7-dfc9-4892-9e7a-fa5ec97c043b req-2a8b01d3-2045-4def-949c-75f597e71cc0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:57.096298 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3281afd7-dfc9-4892-9e7a-fa5ec97c043b req-2a8b01d3-2045-4def-949c-75f597e71cc0 service nova] Creating event network-vif-deleted:5c6e9a15-8393-46f1-a489-6fe951db98e8 for instance ac573e14-f299-4757-b98c-1722fa9d243f on n-h1-850003-3 Jul 18 13:21:57.126850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3281afd7-dfc9-4892-9e7a-fa5ec97c043b req-2a8b01d3-2045-4def-949c-75f597e71cc0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144628 Jul 18 13:21:57.128189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2524/4863] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:21:57.141535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:57.142650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:57.174050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.174934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:57.176490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.177227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:57.297220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.298605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:57.299233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lazy-loading 'fault' on Instance uuid ac573e14-f299-4757-b98c-1722fa9d243f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:21:57.415911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:57.421220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa24af38a37f4e938842018775fe8704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217e8d7b8c0473bbe4c4bc82527236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:57.442916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a2b04c9-0df1-41df-b298-f40bd8c9ee5b tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1514 microversion: 2.1 time: 0.888960 Jul 18 13:21:57.443881 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2340/4864] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:56 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1514 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:57.459621 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f64f5da-7b2b-4cc2-a83d-a3687409a527 tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 200 len: 1313 microversion: 2.1 time: 0.321547 Jul 18 13:21:57.471075 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2525/4865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:57 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:57.580475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:57.585880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:57.606663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.607868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:57.609739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:57.610486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.004898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:58.005812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:58.023744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:21:58.029576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.030217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.031180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.031784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.070531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:58.100974 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8a34927-53b6-4b78-95d0-c6992f8f836f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 0.524698 Jul 18 13:21:58.103362 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2341/4866] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:57 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:58.321401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:58.357868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:58.375487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:58.387263 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34930a31-8f92-4e6a-bc39-b99e4e193474 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.380497 Jul 18 13:21:58.389900 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2526/4867] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:57 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:21:58.473466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:58.484316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:58.486103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] [instance: ac573e14-f299-4757-b98c-1722fa9d243f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:58.488915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:58.507343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.513195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.520182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.521743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.522781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.523326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.527979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:58.544523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:58.567227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] HTTP exception thrown: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Request method failure captured: Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f HTTP/1.1 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5QsfFWlOevzPHJZRTUI4i1Gf_vpbD6BWd6koed8Kpqmw_VuUADTsrQ60Oi91tnig9r_Sd1N6u8dY3cldo9a5zbJBAcfNHfVIMj78MnV5a1cA9Z54Ddl8GTfT-WNkHFwluCM59sU3YEl7YAadWGZHDeyC_4BZU8E-D3hMnxEyoO4-I Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6217e8d7b8c0473bbe4c4bc82527236f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6217e8d7b8c0473bbe4c4bc82527236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 6217e8d7b8c0473bbe4c4bc82527236f Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-908282161 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: fa24af38a37f4e938842018775fe8704 Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-908282161-project Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ac573e14-f299-4757-b98c-1722fa9d243f'} Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:58.569222 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] Returning 404 to user: Instance ac573e14-f299-4757-b98c-1722fa9d243f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53a7235a-a185-430a-bd1e-0c4f761eb63b tempest-ServerMetadataNegativeTestJSON-908282161 tempest-ServerMetadataNegativeTestJSON-908282161-project] 10.222.0.88 "GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f" status: 404 len: 111 microversion: 2.1 time: 0.094613 Jul 18 13:21:58.582338 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2527/4868] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:58 2022] GET /compute/v2.1/servers/ac573e14-f299-4757-b98c-1722fa9d243f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:21:59.060873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:59.094042 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f98c202-34a5-44b1-abd2-a6dec81019b6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1514 microversion: 2.1 time: 0.627528 Jul 18 13:21:59.095039 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2342/4869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:58 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1514 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:21:59.134939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:59.143161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:59.185002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:59.185833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:59.187383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:59.194761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:59.411277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:21:59.412403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:21:59.441891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:59.443180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:59.452714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:21:59.453616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:21:59.944651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:59.982938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:59.985048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:21:59.986588 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fffdc46-01f4-421f-b532-d6099020c531 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.580392 Jul 18 13:21:59.999404 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2343/4870] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:21:59 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:00.114300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:00.135453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:00.137600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:00.145302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e87615ea-1b29-43f6-9d9f-7c5f24c9c638 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 1.015821 Jul 18 13:22:00.153866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:00.161041 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2528/4871] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:21:59 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:00.163445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:00.165005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:00.166627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:00.196429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-648e1a67-8d6e-47d1-8266-7556271394f2 req-b7f2a504-1ace-4b6e-8720-58ceca2f1532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a", "name": "network-vif-deleted", "tag": "1680a25b-8a7c-487c-a72b-4e0f1e9d6a93"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:00.232498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-648e1a67-8d6e-47d1-8266-7556271394f2 req-b7f2a504-1ace-4b6e-8720-58ceca2f1532 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:00.237058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-648e1a67-8d6e-47d1-8266-7556271394f2 req-b7f2a504-1ace-4b6e-8720-58ceca2f1532 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:00.270243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-648e1a67-8d6e-47d1-8266-7556271394f2 req-b7f2a504-1ace-4b6e-8720-58ceca2f1532 service nova] Creating event network-vif-deleted:1680a25b-8a7c-487c-a72b-4e0f1e9d6a93 for instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a on n-h1-850003-3 Jul 18 13:22:00.284721 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-648e1a67-8d6e-47d1-8266-7556271394f2 req-b7f2a504-1ace-4b6e-8720-58ceca2f1532 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094716 Jul 18 13:22:00.287148 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2529/4872] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:00.410843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:00.441855 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8675097e-5057-4425-ba3b-1ee28b6f4e9f tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 200 len: 1472 microversion: 2.1 time: 0.316787 Jul 18 13:22:00.442705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2344/4873] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:00 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:01.018641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:01.020547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:01.042014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.044375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.046348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.047625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.173724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:01.176394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:01.244868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.245841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.259400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.260139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.412309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:01.465158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:01.477916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:01.491046 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a83ba90c-9c0c-44a3-a44c-1d5f30f7a791 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.480407 Jul 18 13:22:01.499960 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2530/4874] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:01 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:01.521665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:01.527839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:01.563930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.566551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.568164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:01.569016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:01.685781 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] HTTP exception thrown: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Request method failure captured: Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a HTTP/1.1 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1azavtGkZVgeisX5uw14PQM1j3cLcDyF-9AtrdI3KBGPIgGpQIVH2CADbIGHo1VAf6Z6jl549HMW6NzmXvDMJMj1NwGHx2qF5Qov2MNtMgrjDUes73Mbqi4wfbFjBZCd5hWAvcCev1HhDLNKN3rTEs4_ocYgCZeHOBIb08MaQYWno Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a3cb301c1df8416fbfa30433dc1b8cfe Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a3cb301c1df8416fbfa30433dc1b8cfe", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a3cb301c1df8416fbfa30433dc1b8cfe Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesSnapshotTestJSON-1133961259-project Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 15fc70a08b8742b39cc0fbdf62ccd8ba Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesSnapshotTestJSON-1133961259-project Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a'} Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:01.701002 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Returning 404 to user: Instance 3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:01.709764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee177521-4217-441f-8894-9555771387b0 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a" status: 404 len: 111 microversion: 2.1 time: 0.203974 Jul 18 13:22:01.716079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2531/4875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:01 2022] GET /compute/v2.1/servers/3dd7d3dc-0a50-40bb-9ab1-7f9cbc4a8c6a => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:02.371037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:02.415907 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f96b755-5aa8-4d97-844e-483871f193b9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1522 microversion: 2.1 time: 1.250315 Jul 18 13:22:02.418476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2345/4876] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:01 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1522 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:02.535101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:02.537283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:02.566931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:02.568182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:02.572799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:02.574311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:02.865817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:02.898797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:02.902694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:02.908669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b942ec49-8ca2-4a2e-84d7-644311b67d84 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.379653 Jul 18 13:22:02.915311 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2532/4877] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:02 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:03.445818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:03.451248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:03.489403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:03.492292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:03.498601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:03.501407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:03.954214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:03.958366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:04.000344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:04.001824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:04.004716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:04.009440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:04.124513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:04.248367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:04.277967 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8d98f96-1dd3-4eb6-a920-d9c86844839f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1499 microversion: 2.1 time: 0.843221 Jul 18 13:22:04.279528 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2346/4878] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:03 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1499 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:04.301979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:04.328877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:04.330489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:04.355124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:04.355533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:04.356644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:04.357227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:04.500500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:04.542209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:04.591783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:04.594083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:04.606141 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6ce8e37-9588-4478-94a1-6060cbc4d878 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.661308 Jul 18 13:22:04.611244 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2533/4879] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:03 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:04.632415 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b84337da-1e8e-4052-93df-a8d2cc153cc4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.336905 Jul 18 13:22:04.636015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2347/4880] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Jul 18 13:22:04 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:22:04.653910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ee5cd23-caf4-4499-9ac8-bef907bbc12b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:04.696223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ee5cd23-caf4-4499-9ac8-bef907bbc12b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:04.711092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ee5cd23-caf4-4499-9ac8-bef907bbc12b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:04.801966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ee5cd23-caf4-4499-9ac8-bef907bbc12b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Going to try to start instance {{(pid=131366) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 13:22:04.977058 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ee5cd23-caf4-4499-9ac8-bef907bbc12b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "POST /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.332957 Jul 18 13:22:04.982315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2534/4881] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:22:04 2022] POST /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:22:05.031703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:05.033990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:05.072968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:05.083392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:05.085006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:05.090333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:05.654327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:05.656767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:05.693402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:05.703683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:05.704915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:05.705764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:05.909636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:05.935481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:05.937379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:05.938993 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e7ce9a5-ed26-4bb0-9d54-0f056d655c9a tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.299625 Jul 18 13:22:05.941068 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2535/4882] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:05 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:06.504075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:06.525363 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a889889-e22f-4013-a5b0-4ca36297c35f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1508 microversion: 2.1 time: 1.539307 Jul 18 13:22:06.541553 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2348/4883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:04 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1508 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:06.971245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:06.972538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:07.021646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:07.023293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:07.026053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:07.027136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:07.237524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:07.259370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:07.263270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:07.266249 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa6b4d0f-a358-48b8-b8e1-22f62c0d5195 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.300483 Jul 18 13:22:07.268091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2536/4884] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:06 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:07.559673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:07.561229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:07.570990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:07.572482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:07.573499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:07.574291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.096553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:08.096553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:08.121591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.126534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.127890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.128594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.197718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f HTTP/1.1 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b6a0647e-a1ad-4143-ac29-c9104449da1f'} Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:08.201204 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e7cae897-a18c-4c14-af8b-121c762fe82a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 404 len: 111 microversion: 2.1 time: 0.113143 Jul 18 13:22:08.216345 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2537/4885] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:22:08 2022] DELETE /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:22:08.222714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:08.226437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: b6a0647e-a1ad-4143-ac29-c9104449da1f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:08.249428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:08.259873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.261576 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f4fd1fd-4f82-4aa0-98e9-60d69b67ef59 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1508 microversion: 2.1 time: 0.707548 Jul 18 13:22:08.265915 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2349/4886] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:07 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1508 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:08.298258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.300731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:08.302313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:08.305917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.311152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.313449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.314618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.316344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.317490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.381760 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f HTTP/1.1 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b6a0647e-a1ad-4143-ac29-c9104449da1f'} Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:08.388381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:08.400851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance b6a0647e-a1ad-4143-ac29-c9104449da1f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:08.409679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8ba80f4-a5fb-4ea5-b33d-771d2c2d9c75 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f" status: 404 len: 111 microversion: 2.1 time: 0.187572 Jul 18 13:22:08.409679 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2538/4887] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:08 2022] GET /compute/v2.1/servers/b6a0647e-a1ad-4143-ac29-c9104449da1f => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:08.424907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:08.425986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:08.452892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.454279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.456469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.458872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.574125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:22:08.739573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:08.776831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:08.780883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:08.783043 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-efa16dbf-326c-4518-8532-9a299498cb56 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.488442 Jul 18 13:22:08.788557 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2350/4888] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:08 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:08.915934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6301e52b-852c-4fcd-a3f4-d43e6ce2850a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 204 len: 0 microversion: 2.1 time: 0.502832 Jul 18 13:22:08.930247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:08.931700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:08.931960 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2539/4889] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:22:08 2022] DELETE /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:22:08.951873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.956624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:08.957968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:08.959100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:09.295313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:09.296151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:09.326831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:09.327622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:09.328574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:09.329363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:09.681519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:09.724023 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83b20d45-469d-4d17-9c5c-95cd28b5b355 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.799873 Jul 18 13:22:09.727960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2351/4890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:08 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:09.825260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:09.827536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:09.884593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:09.892877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:09.894377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:09.902671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.033904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:10.049438 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72d079f0-d090-4629-9801-2db1d8264f5d tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1512 microversion: 2.1 time: 0.758579 Jul 18 13:22:10.075569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2540/4891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:09 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1512 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:10.080676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:10.090290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:10.093280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.servers [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Removing options 'limit' from query {{(pid=131366) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 13:22:10.096033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:10.097930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.103663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.104959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.107441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.109583 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ada196b-f14c-4d18-be17-4636c4114f6a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.032682 Jul 18 13:22:10.111818 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2541/4892] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 13:22:10 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:22:10.137154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:10.138520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:10.162369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.163488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.165950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.170536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.314028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:10.350432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:10.364423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:10.377291 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f77cb33-e322-4ff1-89ac-8db8d90d7a89 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.558504 Jul 18 13:22:10.384737 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2352/4893] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:09 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:10.764773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:10.765984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:10.786085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.789930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:10.791522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:10.792212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.294623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:11.325641 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b488831-2114-4273-9ebf-186febb268e9 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1512 microversion: 2.1 time: 1.204639 Jul 18 13:22:11.327142 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2542/4894] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:10 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1512 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:11.355157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:11.356689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:11.381621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.382956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.384947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.386137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.579501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:11.631649 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1e21535c-1729-4277-98a9-9b1a829ec3c9 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.877618 Jul 18 13:22:11.640711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2353/4895] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:10 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:11.663451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:11.669595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:11.700460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.703828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.709555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.711341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.829235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:11.845126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45439a43-2567-4b2b-b279-e4400dde6671 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1512 microversion: 2.1 time: 0.493940 Jul 18 13:22:11.846627 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2543/4896] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:11 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:11.873926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:11.875894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:11.887452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.888220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:11.892325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:11.893452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:12.053681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:12.091744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:12.103313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:12.106018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7793e04-d748-4a5a-baf9-077c85074473 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1365 microversion: 2.57 time: 0.463145 Jul 18 13:22:12.107437 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2354/4897] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:11 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:12.707929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:12.709173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:12.713900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:12.733156 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a821f796-80af-4c51-a75c-afbe72111ba8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1510 microversion: 2.1 time: 0.869755 Jul 18 13:22:12.735064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2544/4898] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:11 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1510 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:12.736935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:12.737475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:12.738333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:12.738814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:12.777654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:12.798072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:12.802883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:13.068302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:13.079513 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f4bdcfa-8a7a-4e99-9ec2-29e815bd1f3a tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1513 microversion: 2.1 time: 0.397416 Jul 18 13:22:13.080780 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2355/4899] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:12 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:13.134815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:13.135454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:13.147850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.149571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.150454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.160400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.166421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.168047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.170060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.171285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.290883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:13.386053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:13.412220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-109fa14d-ccc7-4dd8-a569-e5de99f37af0 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.659647 Jul 18 13:22:13.414769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:13.425554 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2545/4900] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Jul 18 13:22:12 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:22:13.431377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:13.435464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:13.435805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:13.437071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:13.438835 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5239e996-c42f-4487-8c9f-038720444d24 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1383 microversion: 2.57 time: 0.310081 Jul 18 13:22:13.449032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.450413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.452165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.453258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.456601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2356/4901] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:13 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1383 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:13.735419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c916cdd8-4b7f-4042-8edf-ce2dc6c2ecee req-f903f613-d0b3-4d0a-90ed-a1f249f2ad37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c560b28-a546-4fe1-881c-3f49fcf4ef9e", "name": "network-vif-deleted", "tag": "fd21200a-1aae-4990-ad03-a8e9536757ea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:13.753822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c916cdd8-4b7f-4042-8edf-ce2dc6c2ecee req-f903f613-d0b3-4d0a-90ed-a1f249f2ad37 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:13.772884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c916cdd8-4b7f-4042-8edf-ce2dc6c2ecee req-f903f613-d0b3-4d0a-90ed-a1f249f2ad37 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:13.805116 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c916cdd8-4b7f-4042-8edf-ce2dc6c2ecee req-f903f613-d0b3-4d0a-90ed-a1f249f2ad37 service nova] Creating event network-vif-deleted:fd21200a-1aae-4990-ad03-a8e9536757ea for instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e on n-h1-850003-3 Jul 18 13:22:13.812964 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c916cdd8-4b7f-4042-8edf-ce2dc6c2ecee req-f903f613-d0b3-4d0a-90ed-a1f249f2ad37 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080796 Jul 18 13:22:13.814328 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2357/4902] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:13.992611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.024474 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e620963e-821e-4619-ba88-da736fc9fa90 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1512 microversion: 2.1 time: 0.594600 Jul 18 13:22:14.048541 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2546/4903] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:13 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1512 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:14.060520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:14.062265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:14.106658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:14.108950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:14.123355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.126326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.132197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.134796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.136201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.145016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.148967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.151544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.227887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.229424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.230518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'fault' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:22:14.379071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:14.643119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.671806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91c039a1-949d-432a-a349-e489ab0588d4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1512 microversion: 2.1 time: 0.623879 Jul 18 13:22:14.686201 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2358/4904] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:14 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:14.687027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:14.687898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:14.705230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.717361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.723790 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-43490984-9e0d-4582-810c-83a8c61956ee tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1307 microversion: 2.1 time: 0.622724 Jul 18 13:22:14.724999 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2547/4905] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:14 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1307 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:14.725683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.727873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.728788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.751138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:14.756046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:14.774960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.775428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.776561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:14.777025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:14.908774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.926055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.930739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:14.933132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72647831-3f41-4ff6-b210-2964e51459ee tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1371 microversion: 2.57 time: 0.257699 Jul 18 13:22:14.938805 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2359/4906] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:14 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:15.352386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:15.357665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:15.370343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b5b603a-9d63-42dc-a6e1-4f1abcfb93ab tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1510 microversion: 2.1 time: 0.637366 Jul 18 13:22:15.387773 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2548/4907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:14 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:15.415753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:15.428375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:15.429471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:15.447555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.448238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.458778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.459423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.511259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:15.647867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:15.689323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.691034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.764670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:15.765815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:15.788324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.796116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.797461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.798073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.944282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:15.946829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:15.950596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lazy-loading 'fault' on Instance uuid 0c560b28-a546-4fe1-881c-3f49fcf4ef9e {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:22:16.222443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f88e94c8-8ed3-475a-8a7a-5fa3eba5dee3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.811688 Jul 18 13:22:16.224829 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2360/4908] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:22:15 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:16.241337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:16.249766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:16.278893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d12219a1a404bf9aa04ab46c58a49de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ed162730994114a93957c285daea13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:16.290823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:16.296672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:16.300001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:16.302041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:16.327961 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-92361e43-5674-43e9-a3a4-080708935571 tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 200 len: 1307 microversion: 2.1 time: 0.569078 Jul 18 13:22:16.346241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2549/4909] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:15 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 1307 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:16.379475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:16.417083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:16.427957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:16.733954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:16.793036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:16.817800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:16.828103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe5182b8-34b4-4eb5-9d39-dc422da0db4b tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1371 microversion: 2.57 time: 0.598686 Jul 18 13:22:16.844535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2361/4910] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:16 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1371 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:16.915620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:16.918981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:16.927056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:16.931562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.084678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:17.182513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2073f280-5810-441a-a7d8-76e5a5482e0b tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.824624 Jul 18 13:22:17.183121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2550/4911] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 18 13:22:16 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:17.201921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:17.209153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:17.216242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131367) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:17.232322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.232989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.236779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.237243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.367474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:17.369199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] [instance: 0c560b28-a546-4fe1-881c-3f49fcf4ef9e] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:17.388189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.388842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.391801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.402988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.488151 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] HTTP exception thrown: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Request method failure captured: Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e HTTP/1.1 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V0iWw4u6i-O42MeLjP3hjg_sFurTredF7Jw89gXVaUVi2YkKWMrKod8y53YsBAhsbUyOQC7OJZl5aWyvo9QM7e_MAhgGcuL0UOVMwvbgCRoxbtgx9rv2qQY_8HF56Sjuob8enmygyAW4MgQmqpOmQF05709_gzNlFnHFefOXk545dU Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f3ed162730994114a93957c285daea13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f3ed162730994114a93957c285daea13", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f3ed162730994114a93957c285daea13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f3ed162730994114a93957c285daea13 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-460944371 Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4d12219a1a404bf9aa04ab46c58a49de Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-460944371-project Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0c560b28-a546-4fe1-881c-3f49fcf4ef9e'} Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:17.490277 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] Returning 404 to user: Instance 0c560b28-a546-4fe1-881c-3f49fcf4ef9e could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61453f67-a90e-40da-9a1a-5ccbf28f5e7f tempest-ServersNegativeTestJSON-460944371 tempest-ServersNegativeTestJSON-460944371-project] 10.222.0.88 "GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e" status: 404 len: 111 microversion: 2.1 time: 0.131528 Jul 18 13:22:17.496815 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2551/4912] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:17 2022] GET /compute/v2.1/servers/0c560b28-a546-4fe1-881c-3f49fcf4ef9e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:17.557922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.multi_cell_list [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:17.743558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac885904-d70f-422a-ba39-67cb5f22ba73 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.545971 Jul 18 13:22:17.745577 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2362/4913] 10.222.0.88 () {58 vars in 1211 bytes} [Mon Jul 18 13:22:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:17.756763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:17.767026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:17.767957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:17.788553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.790090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.792157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:17.793352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:17.857609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1001731476", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "ca7bed02-6d6a-4123-8719-58a0a0debff6"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:17.993714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] validate_networks() for [('ca7bed02-6d6a-4123-8719-58a0a0debff6', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:22:18.015044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:18.098497 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80316f10-2221-4649-a72f-b1d5c870d7c4 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.345497 Jul 18 13:22:18.099775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2552/4914] 10.222.0.88 () {58 vars in 1195 bytes} [Mon Jul 18 13:22:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:18.105547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:18.106544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:18.113787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.114716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.115715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.116343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.394785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:18.421202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:18.433376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:18.435637 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b730fa4c-41bf-4277-9e5c-792058d10cf3 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1371 microversion: 2.57 time: 0.334369 Jul 18 13:22:18.436713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2553/4915] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:18 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:18.469081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:18.482023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:18.483217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': '1266721398', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:18.495907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.501617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.503594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.505544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.653469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:18.734029 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9eda7c7d-cc34-4a76-965d-c07e0884f8a2 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=1266721398" status: 200 len: 346 microversion: 2.1 time: 0.279073 Jul 18 13:22:18.735104 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2554/4916] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 18 13:22:18 2022] GET /compute/v2.1/servers?name=1266721398 => generated 346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:18.759644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:18.769213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:18.769910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:18.777195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.777665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.778649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:18.779290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:18.934952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:19.072483 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b6ed2a7-aad8-4644-acd8-d27e75908ffa tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.328808 Jul 18 13:22:19.082255 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2555/4917] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Jul 18 13:22:18 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:19.105846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:19.126763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:19.129520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-126672139', 'deleted': False, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 13:22:19.142285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.143162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.146266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.149009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.325276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 13:22:19.359278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:22:19.360039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:22:19.360379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:22:19.361214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:22:19.361895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:22:19.387633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.394790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.396633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.397575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.429952 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-722ef21e-b13f-4873-839d-d0913716c748 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-126672139" status: 200 len: 346 microversion: 2.1 time: 0.339389 Jul 18 13:22:19.439805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2556/4918] 10.222.0.88 () {58 vars in 1227 bytes} [Mon Jul 18 13:22:19 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-126672139 => generated 346 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:19.449891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:19.451274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:19.463979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.465177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.467319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.468293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.472386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Getting quotas for project a3cb301c1df8416fbfa30433dc1b8cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:22:19.488745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Getting quotas for user 15fc70a08b8742b39cc0fbdf62ccd8ba and project a3cb301c1df8416fbfa30433dc1b8cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:22:19.536499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:22:19.537979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:22:19.545009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:22:19.685456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9750e370-b3fc-4b12-8289-23c27ea722cd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838486 Jul 18 13:22:19.694593 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2363/4919] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:22:19.708498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:19.714615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:19.737911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.737911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.737911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:19.739183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:19.849245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fd89980-d4d2-4591-b2f4-563cef37d907 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 204 len: 0 microversion: 2.1 time: 0.406857 Jul 18 13:22:19.852329 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2557/4920] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:22:19 2022] DELETE /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:22:19.873949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-167f57cd-5cb2-49d7-b5d4-01b443a8a1c6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:19.879344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-167f57cd-5cb2-49d7-b5d4-01b443a8a1c6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:20.198295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-167f57cd-5cb2-49d7-b5d4-01b443a8a1c6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:20.222254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-167f57cd-5cb2-49d7-b5d4-01b443a8a1c6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1219 microversion: 2.1 time: 0.364441 Jul 18 13:22:20.223381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2558/4921] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:19 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:20.249006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:20.249545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:20.258327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:20.258948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:20.260403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:20.261357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:20.508434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:20.535884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:20.541693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:20.550794 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c295496e-9b4f-42ec-a764-94464d72ac64 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1356 microversion: 2.57 time: 0.852703 Jul 18 13:22:20.555290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2364/4922] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:19 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1356 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:20.598575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:20.599261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:20.602570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:20.626782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:20.627375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:20.633348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:20.639191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:21.066094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:21.095157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6218c7d-5b0e-4d22-8985-8abedd6fc863 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1516 microversion: 2.1 time: 0.870048 Jul 18 13:22:21.118926 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2559/4923] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:20 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1516 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:21.248543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:21.255511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:21.292382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:21.295681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:21.301620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:21.306140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:21.421390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:22:21.518222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:21.543703 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a4e119c-9060-4913-b5fd-9fee9fdcdfc7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1271 microversion: 2.1 time: 0.303681 Jul 18 13:22:21.575277 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2560/4924] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:21 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1271 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:21.656350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c91c5e4-54e5-49c3-a858-1d037b365329 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 204 len: 0 microversion: 2.57 time: 1.058998 Jul 18 13:22:21.660918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2365/4925] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:22:20 2022] DELETE /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:22:21.675959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:21.676915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:21.710018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:21.711277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:21.719826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:21.723255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:21.967661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:21.989254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:21.991427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:21.993133 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8caf182f-2e3b-4a8b-8fe7-e473d70726fc tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1362 microversion: 2.57 time: 0.324870 Jul 18 13:22:21.994136 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2561/4926] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:21 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:22:22.133241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:22.134558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:22.170023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:22.170539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:22.171856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:22.172619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:22.579902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:22.580950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:22.633362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:22.635705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:22.643870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:22.657515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:23.008020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:23.041256 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e3c653d-475a-463b-9eca-1531dfe056fd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1277 microversion: 2.1 time: 0.465910 Jul 18 13:22:23.055366 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2562/4927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:22 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1277 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:23.067486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:23.068266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:23.081157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:23.087746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:23.088479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:23.088940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:23.115640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:23.236625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:23.253364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:23.290519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:23.295170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07b04005-079d-4e64-93c0-3ce0c9503742 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1516 microversion: 2.1 time: 1.171364 Jul 18 13:22:23.300005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:23.300646 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2366/4928] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:22 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1516 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:23.303292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e2f15960-7fbc-4468-957c-ac1e25068451 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1362 microversion: 2.57 time: 0.251275 Jul 18 13:22:23.315208 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2563/4929] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:23 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:24.073842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:24.074942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:24.100316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.101117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:24.102118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.102763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:24.314327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:24.315647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:24.332661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.333464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:24.334458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.335208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:24.757698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:24.776813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82b23110-6175-4300-b434-cb5fb583caf3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1516 microversion: 2.1 time: 0.467140 Jul 18 13:22:24.777983 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2564/4930] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:24 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:24.786323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:24.786972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:24.822187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.822882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:24.824752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:24.825449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:25.008169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:25.030987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:25.036565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9b5e50d93854df6b0185287e7316876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a384f1f22c4426800d842c921e3ad0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:25.041548 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75174e77-d424-44cf-bba3-d40539db1229 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 200 len: 1362 microversion: 2.57 time: 0.262478 Jul 18 13:22:25.054075 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2565/4931] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:24 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:22:25.112272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:25.130973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a74154b-5052-4b0b-94e6-a77c17bffb52 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1277 microversion: 2.1 time: 1.065649 Jul 18 13:22:25.138380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2367/4932] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:24 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1277 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:25.801275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:25.801275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:25.825577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:25.826410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:25.831176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:25.832896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.096076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-30d9e0b2-0f16-49e2-bdd9-19bb3aa4b067 req-d77f8839-3a0f-43cf-9f87-b90f30c0b2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1387465e-12cb-436e-ab4d-0b502a5dfa11", "name": "network-vif-unplugged", "status": "completed", "tag": "0e0a4bfe-bbc1-4c77-b63c-2803b98ee210"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:26.116435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-30d9e0b2-0f16-49e2-bdd9-19bb3aa4b067 req-d77f8839-3a0f-43cf-9f87-b90f30c0b2c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:26.118711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-30d9e0b2-0f16-49e2-bdd9-19bb3aa4b067 req-d77f8839-3a0f-43cf-9f87-b90f30c0b2c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.134334 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-30d9e0b2-0f16-49e2-bdd9-19bb3aa4b067 req-d77f8839-3a0f-43cf-9f87-b90f30c0b2c2 service nova] Creating event network-vif-unplugged:0e0a4bfe-bbc1-4c77-b63c-2803b98ee210 for instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 on n-h2-850003-3 Jul 18 13:22:26.144559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-30d9e0b2-0f16-49e2-bdd9-19bb3aa4b067 req-d77f8839-3a0f-43cf-9f87-b90f30c0b2c2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.560290 Jul 18 13:22:26.146084 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2566/4933] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:22:26.161649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:26.162726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] [instance: 1802f0c8-0211-4cef-9430-c30d2a221525] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:26.171842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:26.172597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.173624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:26.174245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.192355 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] HTTP exception thrown: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Request method failure captured: Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 HTTP/1.1 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V5TWVSWIo_4-Jjnj9eWk0lgEsUn4zqnlqmZt7t8IazVk-q1OWKhH-2-x9024d3HUuEK1xXgQ1r-gAzDroCYWUxFbyRNHbvz5QDHg2XKpCmg_h3c9ic419yh-vYbvAzLh60ef67fByoDkGfdg40lBFDA1agDQkXcDOEmGFtHt-SNslo Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.57 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a9a384f1f22c4426800d842c921e3ad0 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerShowV257Test-1734110376 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a9a384f1f22c4426800d842c921e3ad0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9a384f1f22c4426800d842c921e3ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a9a384f1f22c4426800d842c921e3ad0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9a384f1f22c4426800d842c921e3ad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerShowV257Test-1734110376 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a9a384f1f22c4426800d842c921e3ad0 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerShowV257Test-1734110376 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerShowV257Test-1734110376-project Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: c9b5e50d93854df6b0185287e7316876 Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerShowV257Test-1734110376-project Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1802f0c8-0211-4cef-9430-c30d2a221525'} Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:26.195480 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. Jul 18 13:22:26.199900 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:22:26.202218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] Returning 404 to user: Instance 1802f0c8-0211-4cef-9430-c30d2a221525 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:26.203486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65fac2d7-4825-4d02-aec9-845818bcb419 tempest-ServerShowV257Test-1734110376 tempest-ServerShowV257Test-1734110376-project] 10.222.0.88 "GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525" status: 404 len: 111 microversion: 2.57 time: 0.055874 Jul 18 13:22:26.207251 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2567/4934] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:22:26 2022] GET /compute/v2.1/servers/1802f0c8-0211-4cef-9430-c30d2a221525 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:22:26.240302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:26.242678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:26.283990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:26.285217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.289627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:26.291647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:26.593584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:26.606694 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1fde1f38-018e-49bb-b43d-3db34d3c895f tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1516 microversion: 2.1 time: 0.814805 Jul 18 13:22:26.613976 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2368/4935] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:25 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1516 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:26.724154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:26.758833 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60bc26a4-2a68-4eb6-aaba-fa52d31eafac tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 0.549105 Jul 18 13:22:26.761705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2568/4936] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:26 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:27.634356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:27.635476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:27.676970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:27.678199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:27.685228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:27.688383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:27.692378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-49a59360-481f-4b91-95ad-4ff83de9123b req-501ef8aa-d7e7-43b1-9850-408b080cb99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1387465e-12cb-436e-ab4d-0b502a5dfa11", "name": "network-vif-deleted", "tag": "0e0a4bfe-bbc1-4c77-b63c-2803b98ee210"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:27.712528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-49a59360-481f-4b91-95ad-4ff83de9123b req-501ef8aa-d7e7-43b1-9850-408b080cb99b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:27.713299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-49a59360-481f-4b91-95ad-4ff83de9123b req-501ef8aa-d7e7-43b1-9850-408b080cb99b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:27.747727 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-49a59360-481f-4b91-95ad-4ff83de9123b req-501ef8aa-d7e7-43b1-9850-408b080cb99b service nova] Creating event network-vif-deleted:0e0a4bfe-bbc1-4c77-b63c-2803b98ee210 for instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 on n-h2-850003-3 Jul 18 13:22:27.756702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-49a59360-481f-4b91-95ad-4ff83de9123b req-501ef8aa-d7e7-43b1-9850-408b080cb99b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068471 Jul 18 13:22:27.757388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2569/4937] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:22:27.783111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:27.784312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:27.810272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:27.821118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:27.822039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:27.824876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:27.826020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:28.512786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:28.566970 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a510de9e-b6ff-4e45-9de1-42f8678af29e tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 200 len: 1474 microversion: 2.1 time: 0.939897 Jul 18 13:22:28.567811 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2369/4938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:27 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 1474 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:28.743464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:28.764418 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23a3d872-13aa-4385-bc73-9298cc242ef4 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 0.988026 Jul 18 13:22:28.782267 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2570/4939] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:27 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:29.602498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:29.604615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 1387465e-12cb-436e-ab4d-0b502a5dfa11] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:29.616860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:29.617960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:29.621612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.622529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.623948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.624709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.647400 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] HTTP exception thrown: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Request method failure captured: Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 HTTP/1.1 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V4jKKdPQKdTrcr2JtMcDEyF0S1q_J3kYmJGQx_t872ABTPpXyMB2SgrpysbXAanGXVSE5qsrnMWSe8z3W3mKbxSQHgxtgDoHjadoh4blJDe5SsffedhDfge1TE4BcmkXKYS7XQjVW9VKp9-rHI4YhneUWCWCwzxUF5j6HvIswz6BtY Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_05caf126524c41e69d3b72a5df4a5cc4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fc656fa63ca14979915c5b2061147b05 Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '1387465e-12cb-436e-ab4d-0b502a5dfa11'} Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:29.650970 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:29.656217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Returning 404 to user: Instance 1387465e-12cb-436e-ab4d-0b502a5dfa11 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:29.656902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f57132c4-c098-4e94-9ae4-d7b4eba55c25 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11" status: 404 len: 111 microversion: 2.1 time: 0.062315 Jul 18 13:22:29.658381 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2370/4940] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:29 2022] GET /compute/v2.1/servers/1387465e-12cb-436e-ab4d-0b502a5dfa11 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:29.670135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:29.671036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:29.674293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:29.688268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.688882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.690129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.691122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.738691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:22:29.796546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:29.796779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:29.809568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.810452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.816476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.817010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.903391 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1149163e-73fe-4f9d-b1ca-c8ce28688057 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 204 len: 0 microversion: 2.1 time: 0.238858 Jul 18 13:22:29.905284 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2571/4941] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:22:29 2022] DELETE /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:22:29.917290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:29.917995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:29.931582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.932356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:29.933610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:29.934407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:30.151311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:30.162623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1ae43d5-a5b2-44b9-a48a-36b2e91c36d8 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1518 microversion: 2.1 time: 0.252791 Jul 18 13:22:30.175191 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2572/4942] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:29 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:30.921765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:30.950653 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80ced00e-7bdf-4763-97d3-926f86979898 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 1.157982 Jul 18 13:22:30.967349 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2371/4943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:29 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:31.182904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:31.184171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:31.187492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:31.209442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:31.209823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:31.212223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:31.213202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:31.535498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:31.571806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52d5be26-c5ea-4de7-9495-702a267cba8a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1518 microversion: 2.1 time: 0.391484 Jul 18 13:22:31.571806 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2573/4944] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:31 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1518 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:31.984226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:31.985247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:32.004076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:32.004896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:32.006576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:32.007984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:32.603858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:32.606945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:32.635031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:32.638046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:32.644634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:32.646973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:33.046720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:33.061064 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 200 len: 1518 microversion: 2.1 time: 0.465738 Jul 18 13:22:33.061925 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2574/4945] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:32 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 1518 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:33.063174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:33.064301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b79fd722-5ea9-463a-9ac9-bf8fc43d334c tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001410 Jul 18 13:22:33.065184 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2575/4946] 10.222.0.88 () {56 vars in 885 bytes} [Mon Jul 18 13:22:33 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 13:22:33.079975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f7aeeeb5-0ed4-4efb-945b-0382fe537d1d req-c45dab58-5d40-4ec5-ad2a-1048b08ba30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de865d61-8593-4a65-aca8-faf5b065709a", "name": "network-vif-deleted", "tag": "7a54f2cb-b764-47ad-9831-1d2005f646dc"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:33.095300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f7aeeeb5-0ed4-4efb-945b-0382fe537d1d req-c45dab58-5d40-4ec5-ad2a-1048b08ba30b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:33.096026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f7aeeeb5-0ed4-4efb-945b-0382fe537d1d req-c45dab58-5d40-4ec5-ad2a-1048b08ba30b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:33.112017 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f7aeeeb5-0ed4-4efb-945b-0382fe537d1d req-c45dab58-5d40-4ec5-ad2a-1048b08ba30b service nova] Creating event network-vif-deleted:7a54f2cb-b764-47ad-9831-1d2005f646dc for instance de865d61-8593-4a65-aca8-faf5b065709a on n-h1-850003-3 Jul 18 13:22:33.119811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f7aeeeb5-0ed4-4efb-945b-0382fe537d1d req-c45dab58-5d40-4ec5-ad2a-1048b08ba30b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053021 Jul 18 13:22:33.120923 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2576/4947] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:33.305942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:33.309338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:33.326461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ddb1d451-a504-4faf-aeeb-c44f65584334 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 1.353454 Jul 18 13:22:33.347021 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2372/4948] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:31 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:33.725008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-447ae78a-a2e4-46b3-b3ec-abdeb833054b req-e0f79a73-101b-49d9-a3ca-7208764554d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92285a-f4a5-4038-b73a-83276df73f9b", "tag": "1efd7bc5-682e-4ddc-b66c-948348b61bf0"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:33.750333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-447ae78a-a2e4-46b3-b3ec-abdeb833054b req-e0f79a73-101b-49d9-a3ca-7208764554d0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:33.751493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-447ae78a-a2e4-46b3-b3ec-abdeb833054b req-e0f79a73-101b-49d9-a3ca-7208764554d0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:33.772860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-447ae78a-a2e4-46b3-b3ec-abdeb833054b req-e0f79a73-101b-49d9-a3ca-7208764554d0 service nova] Creating event network-changed:1efd7bc5-682e-4ddc-b66c-948348b61bf0 for instance ad92285a-f4a5-4038-b73a-83276df73f9b on n-h1-850003-3 Jul 18 13:22:33.781164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-447ae78a-a2e4-46b3-b3ec-abdeb833054b req-e0f79a73-101b-49d9-a3ca-7208764554d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065254 Jul 18 13:22:33.782114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2577/4949] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:34.080579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:34.083977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: de865d61-8593-4a65-aca8-faf5b065709a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:34.103721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.105035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.106738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.107906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.149483 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] HTTP exception thrown: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Request method failure captured: Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a HTTP/1.1 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V4jKKdPQKdTrcr2JtMcDEyF0S1q_J3kYmJGQx_t872ABTPpXyMB2SgrpysbXAanGXVSE5qsrnMWSe8z3W3mKbxSQHgxtgDoHjadoh4blJDe5SsffedhDfge1TE4BcmkXKYS7XQjVW9VKp9-rHI4YhneUWCWCwzxUF5j6HvIswz6BtY Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_05caf126524c41e69d3b72a5df4a5cc4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fc656fa63ca14979915c5b2061147b05 Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'de865d61-8593-4a65-aca8-faf5b065709a'} Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:34.152463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. Jul 18 13:22:34.161909 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:34.165385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Returning 404 to user: Instance de865d61-8593-4a65-aca8-faf5b065709a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:34.166103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-116ec6bf-a4d9-4540-853d-7303a22c4255 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a" status: 404 len: 111 microversion: 2.1 time: 0.090123 Jul 18 13:22:34.167229 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2373/4950] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:34 2022] GET /compute/v2.1/servers/de865d61-8593-4a65-aca8-faf5b065709a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:34.185682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:34.186447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:34.196015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.197287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.198196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.198702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.267526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:22:34.361018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:34.362256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:34.388810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.402764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.404733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.405468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.439892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd1a459c-498a-4677-937e-035ec6990c3a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "DELETE /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 204 len: 0 microversion: 2.1 time: 0.266499 Jul 18 13:22:34.442293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2578/4951] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:22:34 2022] DELETE /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:22:34.456462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:34.457455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:34.469769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.472297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.475535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:34.478805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:34.735069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:34.745578 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9145ae10-34a0-49b4-ba58-62199f089f38 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 0.391260 Jul 18 13:22:34.749990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2374/4952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:34 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:35.252509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:35.262886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08b49472-036b-4f10-a785-a5c0bfa94eb3 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1518 microversion: 2.1 time: 0.814679 Jul 18 13:22:35.273421 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2579/4953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:34 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1518 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:35.780685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:35.786617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:35.810031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:35.811702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:35.815560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:35.818618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:35.863694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Action: 'create', calling method: .version_select at 0x7f96e4ed5790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:35.917089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Getting quotas for project 5bd6521b949d440b9c21eafab3cd34a8. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:22:35.936007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Getting quotas for user 05a0baf4108a4708a4ae843344959193 and project 5bd6521b949d440b9c21eafab3cd34a8. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:22:36.088049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Getting quotas for project 5bd6521b949d440b9c21eafab3cd34a8. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:22:36.099400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Getting quotas for user 05a0baf4108a4708a4ae843344959193 and project 5bd6521b949d440b9c21eafab3cd34a8. Resources: {'server_groups'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:22:36.127317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79cde83b-6d2b-43c9-973f-c7908c79f37d tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.628383 Jul 18 13:22:36.129365 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2375/4954] 10.222.0.88 () {62 vars in 1213 bytes} [Mon Jul 18 13:22:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:22:36.145693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af02321c-5b0e-42d4-9c11-cf98b6f14fe2 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:36.199672 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af02321c-5b0e-42d4-9c11-cf98b6f14fe2 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.061473 Jul 18 13:22:36.201469 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2376/4955] 10.222.0.88 () {60 vars in 1192 bytes} [Mon Jul 18 13:22:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:22:36.220638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33f7db75-e49c-4df1-84dd-22faee0091e9 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:36.255140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33f7db75-e49c-4df1-84dd-22faee0091e9 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b" status: 200 len: 235 microversion: 2.64 time: 0.040624 Jul 18 13:22:36.256580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2377/4956] 10.222.0.88 () {60 vars in 1303 bytes} [Mon Jul 18 13:22:36 2022] GET /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b => generated 235 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:22:36.269386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dfe76d05-e7d5-4a25-b702-79661b5b3441 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:36.334476 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dfe76d05-e7d5-4a25-b702-79661b5b3441 tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b" status: 204 len: 0 microversion: 2.64 time: 0.071444 Jul 18 13:22:36.338528 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2378/4957] 10.222.0.88 () {60 vars in 1306 bytes} [Mon Jul 18 13:22:36 2022] DELETE /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 13:22:36.359435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:36.360980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:36.385743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:36.389699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:36.390769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:36.391408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:37.089700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:37.100718 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e10fca6a-0416-42c7-a05c-321dc7c8d841 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1518 microversion: 2.1 time: 0.758265 Jul 18 13:22:37.101324 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2379/4958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:36 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1518 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:37.115732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52f1d035-810d-4d15-8a9f-be5364b02bda tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:37.154706 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-52f1d035-810d-4d15-8a9f-be5364b02bda tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] HTTP exception thrown: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52f1d035-810d-4d15-8a9f-be5364b02bda tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Request method failure captured: Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b HTTP/1.1 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V6bu1FNGYr7qgfD7JaWmrPp0CAtNri428RQqecEv1lmLIh4_WmOiDCOYFL0oPFbCL-UwnejQZTN0WaimCBm2I8bmh4wgf2bIVcQSJDs_sQB_9j5wv3kDahIjkjiL0mLLmJp-SzM1lQF1AuFkHHnxlXGduftY_yHYSngWQD00QRbK8Q Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.64 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 5bd6521b949d440b9c21eafab3cd34a8 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerGroup264TestJSON-1950430129 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5bd6521b949d440b9c21eafab3cd34a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5bd6521b949d440b9c21eafab3cd34a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5bd6521b949d440b9c21eafab3cd34a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5bd6521b949d440b9c21eafab3cd34a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerGroup264TestJSON-1950430129 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 5bd6521b949d440b9c21eafab3cd34a8 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1950430129 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerGroup264TestJSON-1950430129-project Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 05a0baf4108a4708a4ae843344959193 Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerGroup264TestJSON-1950430129-project Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'f7472068-5a34-4277-b487-52d49fe6695b'} Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:37.160371 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52f1d035-810d-4d15-8a9f-be5364b02bda tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] Returning 404 to user: Instance group f7472068-5a34-4277-b487-52d49fe6695b could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:37.165590 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52f1d035-810d-4d15-8a9f-be5364b02bda tempest-ServerGroup264TestJSON-1950430129 tempest-ServerGroup264TestJSON-1950430129-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b" status: 404 len: 117 microversion: 2.64 time: 0.054759 Jul 18 13:22:37.174237 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2380/4959] 10.222.0.88 () {60 vars in 1306 bytes} [Mon Jul 18 13:22:37 2022] DELETE /compute/v2.1/os-server-groups/f7472068-5a34-4277-b487-52d49fe6695b => generated 117 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:22:37.880001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97ce3c54-31d8-4828-83f4-1fdb97e2be0a tempest-ExtensionsTest-712204654 tempest-ExtensionsTest-712204654-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:37.891010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97ce3c54-31d8-4828-83f4-1fdb97e2be0a tempest-ExtensionsTest-712204654 tempest-ExtensionsTest-712204654-project] 10.222.0.88 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.360134 Jul 18 13:22:37.895513 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2381/4960] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 13:22:37 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:22:37.919332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba26e600-bf95-4a3d-b3d7-c6da62a320fe tempest-ExtensionsTest-712204654 tempest-ExtensionsTest-712204654-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:37.923154 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba26e600-bf95-4a3d-b3d7-c6da62a320fe tempest-ExtensionsTest-712204654 tempest-ExtensionsTest-712204654-project] 10.222.0.88 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019364 Jul 18 13:22:37.939866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2382/4961] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 13:22:37 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:22:38.140291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:38.141094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:38.207468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:38.216302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:38.218871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:38.226840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:38.382275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:38.409503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a0fbaaa-c2b8-466b-9543-ca6bd8396beb tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 2.637169 Jul 18 13:22:38.436609 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2580/4962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:35 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:39.109849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:39.125126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-691d29af-7b71-401f-a4aa-c52084e33fae tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1518 microversion: 2.1 time: 1.003468 Jul 18 13:22:39.132169 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2383/4963] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:38 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1518 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:39.440517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:39.441541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:39.456681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:39.457449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:39.458445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:39.459509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:39.504024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:40.153081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:40.155516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:40.175987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:40.177210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:40.181283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:40.183195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:40.385602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:40.419680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e64dbec5-4893-4e34-85e1-e262590a3eb1 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 0.977968 Jul 18 13:22:40.421314 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2581/4964] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:39 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:40.432578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-151742ee-b534-4331-a8c3-269de9741d22 req-a300c837-82b0-4d6f-b75b-3b07e033f234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82587966-5169-4593-b24a-616511801ff9", "name": "network-vif-deleted", "tag": "68296034-8094-482a-b141-ac6f71cd4d72"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:40.477873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-151742ee-b534-4331-a8c3-269de9741d22 req-a300c837-82b0-4d6f-b75b-3b07e033f234 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:40.478967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-151742ee-b534-4331-a8c3-269de9741d22 req-a300c837-82b0-4d6f-b75b-3b07e033f234 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:40.556842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-151742ee-b534-4331-a8c3-269de9741d22 req-a300c837-82b0-4d6f-b75b-3b07e033f234 service nova] Creating event network-vif-deleted:68296034-8094-482a-b141-ac6f71cd4d72 for instance 82587966-5169-4593-b24a-616511801ff9 on n-h1-850003-3 Jul 18 13:22:40.597163 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-151742ee-b534-4331-a8c3-269de9741d22 req-a300c837-82b0-4d6f-b75b-3b07e033f234 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173340 Jul 18 13:22:40.598609 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2582/4965] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:40.676861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc656fa63ca14979915c5b2061147b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05caf126524c41e69d3b72a5df4a5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:40.732003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e6c4403-dbf6-47fd-b659-3f9155deb981 tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 200 len: 1476 microversion: 2.1 time: 0.591870 Jul 18 13:22:40.746189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2384/4966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:40 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:41.451854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:41.457274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:41.483689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:41.484464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:41.485069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:41.492108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:41.766625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:41.767487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] [instance: 82587966-5169-4593-b24a-616511801ff9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:41.779057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:41.790069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:41.793642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:41.801072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:41.844223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] HTTP exception thrown: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Request method failure captured: Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 HTTP/1.1 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V4jKKdPQKdTrcr2JtMcDEyF0S1q_J3kYmJGQx_t872ABTPpXyMB2SgrpysbXAanGXVSE5qsrnMWSe8z3W3mKbxSQHgxtgDoHjadoh4blJDe5SsffedhDfge1TE4BcmkXKYS7XQjVW9VKp9-rHI4YhneUWCWCwzxUF5j6HvIswz6BtY Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_05caf126524c41e69d3b72a5df4a5cc4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/05caf126524c41e69d3b72a5df4a5cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 05caf126524c41e69d3b72a5df4a5cc4 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-422790447 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fc656fa63ca14979915c5b2061147b05 Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ListServerFiltersTestJSON-422790447-project Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '82587966-5169-4593-b24a-616511801ff9'} Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:22:41.851522 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] Returning 404 to user: Instance 82587966-5169-4593-b24a-616511801ff9 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2977ef4-8510-4745-9fe0-e629f3a9f22a tempest-ListServerFiltersTestJSON-422790447 tempest-ListServerFiltersTestJSON-422790447-project] 10.222.0.88 "GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9" status: 404 len: 111 microversion: 2.1 time: 0.092270 Jul 18 13:22:41.856454 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2385/4967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:41 2022] GET /compute/v2.1/servers/82587966-5169-4593-b24a-616511801ff9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:22:43.594702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:43.616740 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b7ba23b5-1e87-4ecc-b60d-98b3dc09faf3 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 2.165553 Jul 18 13:22:43.624678 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2583/4968] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:41 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:44.330088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-90337715", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:44.498839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] validate_networks() for [('c452aeea-1658-4d55-8746-e23496193d28', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:22:44.643897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:44.644619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:44.676347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:44.677382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:44.679378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:44.680127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:45.918114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:45.950245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88798e1e-90d7-4362-a2a4-752e1de58494 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 1.314921 Jul 18 13:22:45.961216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2584/4969] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:44 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:45.982919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ab95b6b-0fb5-463e-83ad-48bd3886c9c2"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:45.985717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:46.024116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:46.025763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:46.027571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:46.034120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:46.115345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:46.866494 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98c3d040-2c12-4ba5-8308-34451b81418c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895841 Jul 18 13:22:46.869119 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2585/4970] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:22:45 2022] POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:46.983598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:46.998304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:47.032585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:47.033356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:47.054924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:47.055804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:48.061381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:22:48.063113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:22:48.068251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:22:48.069672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:22:48.071389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:22:48.128608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:48.129956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:48.133003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:48.137972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:48.199799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:48.208891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56a9700f-c242-4090-9b5f-3c34f1eacf28 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 1.234323 Jul 18 13:22:48.220058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Getting quotas for project 0a95ce8db3824a759145745200be6d95. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:22:48.220177 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2586/4971] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:46 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:48.238636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Getting quotas for user d643dcff9fc94fae8d68e9a58cb95f52 and project 0a95ce8db3824a759145745200be6d95. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:22:48.268810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:22:48.275690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:22:48.434234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f998b12a-2fc8-4819-8652-62e5e161ec96 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.787346 Jul 18 13:22:48.446623 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2386/4972] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:22:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:22:48.449827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:48.450662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:48.721663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:48.732009 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1221 microversion: 2.1 time: 0.286744 Jul 18 13:22:48.740582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2587/4973] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:48 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1221 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:48.771832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-580266ba-38a4-406b-9577-dda911e1e47a req-af592704-93b9-4d64-8c87-1ff650e136e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92285a-f4a5-4038-b73a-83276df73f9b", "name": "network-vif-plugged", "status": "completed", "tag": "1efd7bc5-682e-4ddc-b66c-948348b61bf0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:48.824330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:48.825324 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-167a6e77-a8ee-42dd-87f2-31098cfa1040 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001411 Jul 18 13:22:48.825691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2588/4974] 10.222.0.88 () {56 vars in 885 bytes} [Mon Jul 18 13:22:48 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 13:22:48.832056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-580266ba-38a4-406b-9577-dda911e1e47a req-af592704-93b9-4d64-8c87-1ff650e136e9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:48.835783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-580266ba-38a4-406b-9577-dda911e1e47a req-af592704-93b9-4d64-8c87-1ff650e136e9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:48.886046 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-580266ba-38a4-406b-9577-dda911e1e47a req-af592704-93b9-4d64-8c87-1ff650e136e9 service nova] Creating event network-vif-plugged:1efd7bc5-682e-4ddc-b66c-948348b61bf0 for instance ad92285a-f4a5-4038-b73a-83276df73f9b on n-h1-850003-3 Jul 18 13:22:48.915361 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-580266ba-38a4-406b-9577-dda911e1e47a req-af592704-93b9-4d64-8c87-1ff650e136e9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148066 Jul 18 13:22:48.917634 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2387/4975] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:49.230003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:49.230677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:49.251610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:49.252226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:49.253161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:49.260760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:49.773371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ce96697-00dd-4b2a-a901-b4835fc9089c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:49.781340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ce96697-00dd-4b2a-a901-b4835fc9089c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:49.816511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:49.876719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1fbce94e-091e-4378-8ec9-c6c2821222a7 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1319 microversion: 2.1 time: 0.648861 Jul 18 13:22:49.881945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2589/4976] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:49 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:50.076072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ce96697-00dd-4b2a-a901-b4835fc9089c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:50.109658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ce96697-00dd-4b2a-a901-b4835fc9089c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1221 microversion: 2.1 time: 0.340982 Jul 18 13:22:50.143346 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2388/4977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:49 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1221 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:22:50.911949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:50.913556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:50.963464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:50.969128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:50.971622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:50.976749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:50.982520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:51.527203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8baad851-a2b4-45aa-97e1-66669f9db45a tempest-ComputeTenantNetworksTest-1479280439 tempest-ComputeTenantNetworksTest-1479280439-project] Calling method '.version_select at 0x7f96e4146310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:52.226253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:52.237598 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1464dd9a-1c6e-4096-bd94-205e259859d6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1509 microversion: 2.1 time: 1.333245 Jul 18 13:22:52.258315 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2389/4978] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:50 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1509 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:52.271094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:52.272326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:52.296269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:52.296808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:52.297689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:52.298168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:52.752445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:52.768610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-35148796-d740-400c-8903-47c8d636befb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1279 microversion: 2.1 time: 0.509001 Jul 18 13:22:52.776092 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2390/4979] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:52 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1279 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:52.784505 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8baad851-a2b4-45aa-97e1-66669f9db45a tempest-ComputeTenantNetworksTest-1479280439 tempest-ComputeTenantNetworksTest-1479280439-project] 10.222.0.88 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 2.435325 Jul 18 13:22:52.786375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2590/4980] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 13:22:50 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:52.797794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f5a9c21-da78-4b5d-961f-abf01a36379c tempest-ComputeTenantNetworksTest-1479280439 tempest-ComputeTenantNetworksTest-1479280439-project] Calling method '.version_select at 0x7f96e4146670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:52.798058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a8a5665-1235-4f71-b22b-eca73773c864", "device": "/dev/sdb"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:52.799022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:52.833448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:52.843002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:52.844707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:52.845963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:53.576611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f5a9c21-da78-4b5d-961f-abf01a36379c tempest-ComputeTenantNetworksTest-1479280439 tempest-ComputeTenantNetworksTest-1479280439-project] 10.222.0.88 "GET /compute/v2.1/os-tenant-networks/6924db3a-0219-452e-a09f-2bb608e72de8" status: 200 len: 140 microversion: 2.1 time: 0.782195 Jul 18 13:22:53.577976 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2591/4981] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 13:22:52 2022] GET /compute/v2.1/os-tenant-networks/6924db3a-0219-452e-a09f-2bb608e72de8 => generated 140 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:53.608080 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5e1215c4-151e-465e-8c50-2a4748af1d60 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "POST /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829985 Jul 18 13:22:53.620381 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2391/4982] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:22:52 2022] POST /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:22:53.788671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:53.790634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:53.807289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:53.810287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:53.812037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:53.812856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:54.090959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:54.115162 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-807d9861-4df8-479a-aef1-1670b1486c24 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1279 microversion: 2.1 time: 0.327415 Jul 18 13:22:54.120775 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2592/4983] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:53 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:55.139544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:55.140467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:55.163941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:55.164790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:55.174398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:55.175074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:56.313444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:56.355919 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6d36d7c-3101-4471-9d65-cbc2e9519aa8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1279 microversion: 2.1 time: 1.219097 Jul 18 13:22:56.379571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2392/4984] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:55 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1279 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:57.385664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:57.386999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:57.403337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:57.404692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:57.407187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:57.414989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:58.089329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:58.106360 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4db975d-674c-4f6f-9bfd-40fd05a4c7c2 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.723280 Jul 18 13:22:58.109005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2593/4985] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:57 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:22:59.125024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:22:59.125655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:22:59.128837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:59.136986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:59.137233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:59.137839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:22:59.156309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:22:59.267552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:22:59.719609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64dd0855-1e05-4083-8956-f8688899a30b tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Action: 'create', calling method: .version_select at 0x7f96e9a72ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-987482724", "metadata": {"Type": "work"}}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:22:59.805426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:22:59.829704 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d982fd61-f912-414c-afaa-8385de0f18f6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.708545 Jul 18 13:22:59.841334 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2393/4986] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:22:59 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:00.852314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:00.854322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:00.877575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:00.883823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:00.884812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:00.886329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:00.887256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:01.693900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:01.719561 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a3de25c5-73ad-407e-a3ce-e6f08567c2bc tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.874049 Jul 18 13:23:01.736923 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2394/4987] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:00 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:01.979720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-933dcbf0-7d6b-4ebe-b7fe-1c75de85b78b req-b56a7a9f-dbd2-47bf-a8da-6c1d5e0d0fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:02.011628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-933dcbf0-7d6b-4ebe-b7fe-1c75de85b78b req-b56a7a9f-dbd2-47bf-a8da-6c1d5e0d0fc0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:02.017836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-933dcbf0-7d6b-4ebe-b7fe-1c75de85b78b req-b56a7a9f-dbd2-47bf-a8da-6c1d5e0d0fc0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:02.071915 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-933dcbf0-7d6b-4ebe-b7fe-1c75de85b78b req-b56a7a9f-dbd2-47bf-a8da-6c1d5e0d0fc0 service nova] Creating event network-changed:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:23:02.125349 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-933dcbf0-7d6b-4ebe-b7fe-1c75de85b78b req-b56a7a9f-dbd2-47bf-a8da-6c1d5e0d0fc0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154135 Jul 18 13:23:02.129945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2395/4988] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:23:02.770044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:02.774835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:02.818355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:02.831525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:02.832957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:02.837695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:03.285302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:03.317479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7845f00c-6fb9-4814-938a-d7c248074f5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.579247 Jul 18 13:23:03.330720 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2396/4989] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:02 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:04.339773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:04.340770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:04.368128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:04.368934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:04.369971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:04.370942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:04.374985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:05.373242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:05.396330 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5e91da43-46e5-4608-b1d4-86ea18b95f83 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 1.052306 Jul 18 13:23:05.397460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2397/4990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:04 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:06.293216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-152295888", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": "none"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:06.493787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:23:06.502966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:23:06.504465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:23:06.505364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:23:06.507075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:23:06.540452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:06.545400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:06.546908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:06.547567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:06.609884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Getting quotas for project 7af62c6e35324e298557e815b03cc5b1. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:06.653969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Getting quotas for user 1f4ccb889e804f8ba002844f25523ec9 and project 7af62c6e35324e298557e815b03cc5b1. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:06.676540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:23:06.680158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:23:06.800087 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da0f022e-f049-4240-a820-467468be3069 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.733434 Jul 18 13:23:06.808231 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2398/4991] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:23:06.813912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:06.814878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:06.840213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:06.840987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:06.842001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:06.842639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:07.399221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:07.885876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:07.895435 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d051e78d-e016-4e6f-b84a-9a7a9d8b7b5f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 1.085651 Jul 18 13:23:07.908591 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2399/4992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:06 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:07.922057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:07.926336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:08.103320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:08.120388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:08.133891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:08.142088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:08.146132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27d1d39f-723a-4f5f-bad8-43052d6cb646 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1277 microversion: 2.54 time: 0.235609 Jul 18 13:23:08.151183 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2400/4993] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:07 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:08.931757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:08.934012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:08.973630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:08.976179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:08.983052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:08.984841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:09.938854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:09.997890 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79f8346c-0be1-42f5-831c-56b0cd487259 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 1.067605 Jul 18 13:23:10.002046 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2401/4994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:08 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:10.043953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:10.045646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:10.071570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:10.072023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:10.072830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:10.073271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:10.299523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:10.314518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:10.316115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:10.320661 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f50da033-ccc1-4dcb-af01-579a4241a3a0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1347 microversion: 2.54 time: 0.298095 Jul 18 13:23:10.326469 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2402/4995] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:10 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1347 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:10.587088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64dd0855-1e05-4083-8956-f8688899a30b tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 11.329374 Jul 18 13:23:10.593615 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2594/4996] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 13:22:59 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 11336 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 13:23:10.600119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8a58e3f-0dd1-4034-8135-792f8728d5a9 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96d7abf160>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:10.718127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8a58e3f-0dd1-4034-8135-792f8728d5a9 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.122272 Jul 18 13:23:10.723433 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2403/4997] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:10 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:11.029022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:11.029964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:11.044326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:11.044976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:11.048228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:11.049255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:11.343165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:11.343813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:11.373173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:11.377662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:11.378786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:11.379800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:11.647688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:11.669405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:11.675230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:11.680316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f592372-ca07-4ede-8ebe-a9153a01a61f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1335 microversion: 2.54 time: 0.342535 Jul 18 13:23:11.684713 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2404/4998] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:11 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1335 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:11.733954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d741a44-bd5b-430c-9374-3f845249b24f tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96d77a8940>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:11.904899 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d741a44-bd5b-430c-9374-3f845249b24f tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.177399 Jul 18 13:23:11.906202 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2405/4999] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:11 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:23:11.946463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:11.975363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cdd98c87-4857-42c2-b11e-69005b1d3d20 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.948297 Jul 18 13:23:11.978457 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2595/5000] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:11 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:12.721035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:12.721746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:12.741763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:12.747220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:12.752556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:12.762480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:12.917940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d93979f2-2bd5-4332-bbb6-695d6a1f5c47 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96e9b063a0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.226709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:13.237612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d93979f2-2bd5-4332-bbb6-695d6a1f5c47 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.324435 Jul 18 13:23:13.239315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2596/5001] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:12 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:23:13.254225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.255039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:13.259577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:13.268515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:13.271275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1335 microversion: 2.54 time: 0.555214 Jul 18 13:23:13.275247 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2406/5002] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:12 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1335 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:13.279981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:13.284430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:13.286945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:13.287844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:13.616797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:13.627397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.385222 Jul 18 13:23:13.644647 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2597/5003] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:13 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:13.819134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.821131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002908 Jul 18 13:23:13.821698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2407/5004] 10.222.0.88 () {56 vars in 885 bytes} [Mon Jul 18 13:23:13 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 13:23:13.830628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.832264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002783 Jul 18 13:23:13.835617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2598/5005] 10.222.0.88 () {54 vars in 1034 bytes} [Mon Jul 18 13:23:13 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 18 13:23:13.843617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.845344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f54a44b-1348-48b2-832c-4ff9ff561389 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jul 18 13:23:13.846297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2408/5006] 10.222.0.88 () {54 vars in 1040 bytes} [Mon Jul 18 13:23:13 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:13.859068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:13.860315 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15329f65-fddd-4246-b476-c3ab7fe94ff5 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001589 Jul 18 13:23:13.861406 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2599/5007] 10.222.0.88 () {56 vars in 885 bytes} [Mon Jul 18 13:23:13 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 13:23:14.253729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26615dae-f561-4e10-92b7-30412b94059c tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96d7abf820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:14.292673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:14.294588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:14.315441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:14.326659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:14.338417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:14.339994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:14.459588 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26615dae-f561-4e10-92b7-30412b94059c tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 353 microversion: 2.1 time: 0.209917 Jul 18 13:23:14.460717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2409/5008] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:14 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:14.486692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48ec8d05-52a5-48b8-a46c-f32d12eebc19 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96d790a4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:14.652316 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48ec8d05-52a5-48b8-a46c-f32d12eebc19 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 353 microversion: 2.1 time: 0.183222 Jul 18 13:23:14.654254 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2410/5009] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:14 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:14.663470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:14.665717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:14.676958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:14.678820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:14.685056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:14.686068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:14.774026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:14.789819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:14.791936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:14.793510 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-596334f3-d5cb-4650-9c96-f00a4e136d63 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1356 microversion: 2.54 time: 0.505797 Jul 18 13:23:14.801456 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2600/5010] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:14 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1356 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:23:14.821531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b0d188e-237e-4a6a-b89a-69c3bbcbab32 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96e46fa9d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:15.000721 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b0d188e-237e-4a6a-b89a-69c3bbcbab32 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 202 len: 0 microversion: 2.1 time: 0.196596 Jul 18 13:23:15.003357 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2601/5011] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:23:14 2022] DELETE /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:23:15.045155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b99d3b6c-41de-47ba-945e-acd1eef457fc tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Action: 'create', calling method: .version_select at 0x7f96e46faaf0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-219336594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmbfrQqxXjD+Ltg5sdD6u1t/dcdoDZ0+4Y0VJW2aMKlLcZhVGE//3oSFBNekhasbolVIaV+pcpQ20IOqXsiybysU4Ca5DIMNpjvKHg/gLpGTn/oFa/eDy8eCIwvN4wquA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:15.112578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b99d3b6c-41de-47ba-945e-acd1eef457fc tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Getting quotas for project 7af62c6e35324e298557e815b03cc5b1. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:15.121837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b99d3b6c-41de-47ba-945e-acd1eef457fc tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Getting quotas for user 1f4ccb889e804f8ba002844f25523ec9 and project 7af62c6e35324e298557e815b03cc5b1. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:15.172098 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b99d3b6c-41de-47ba-945e-acd1eef457fc tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.164748 Jul 18 13:23:15.178012 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2602/5012] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 13:23:15 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 13:23:15.210379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ad2e13a1-83ba-4e3e-b519-35e0a7b80c13 req-76ce9f83-03bc-4728-a150-a7d5c40608b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "name": "network-vif-plugged", "status": "completed", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:15.245623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ad2e13a1-83ba-4e3e-b519-35e0a7b80c13 req-76ce9f83-03bc-4728-a150-a7d5c40608b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.256923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ad2e13a1-83ba-4e3e-b519-35e0a7b80c13 req-76ce9f83-03bc-4728-a150-a7d5c40608b2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.295682 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ad2e13a1-83ba-4e3e-b519-35e0a7b80c13 req-76ce9f83-03bc-4728-a150-a7d5c40608b2 service nova] Creating event network-vif-plugged:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:23:15.305823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ad2e13a1-83ba-4e3e-b519-35e0a7b80c13 req-76ce9f83-03bc-4728-a150-a7d5c40608b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126163 Jul 18 13:23:15.310946 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2603/5013] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:15.327764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1cf7829b-21fc-478a-922a-cbd07e8c1d48 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96e9ae55e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:15.437276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1cf7829b-21fc-478a-922a-cbd07e8c1d48 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.124932 Jul 18 13:23:15.443152 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2604/5014] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:15 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:15.448609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-219336594", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:15.450986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:15.471264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.475913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.476995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.490956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.513453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:15.527033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3d5a48f7-bd6f-43ae-8d05-0c9839034c61 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1321 microversion: 2.1 time: 0.870668 Jul 18 13:23:15.538005 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2411/5015] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:14 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1321 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:15.541223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:15.542360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:15.559578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.560126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.564994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.565976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.640955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'flavor' on Instance uuid 40554a05-109e-43f5-a1f8-da040e18915f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:23:15.649578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:23:15.650243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:23:15.650907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:23:15.651491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:23:15.652555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:23:15.835743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:15.849707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.851045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.852935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.853683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.897476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f6dec70-b1f7-4e7a-b84a-e99f25d63cff tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "POST /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be/action" status: 202 len: 1138 microversion: 2.54 time: 0.452950 Jul 18 13:23:15.900752 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2605/5016] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 18 13:23:15 2022] POST /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be/action => generated 1138 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 13:23:15.916463 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42a49c02-03ab-44a9-a1cc-88a18579b7dd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/action" status: 200 len: 32 microversion: 2.1 time: 0.379095 Jul 18 13:23:15.928998 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2412/5017] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:23:15 2022] POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:23:15.948855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:15.950000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:15.963146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.970644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:15.972389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:15.976104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:16.320556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:16.343628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:16.354417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:16.356964 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d038280f-f4a6-4940-a134-cb563a6267f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.420933 Jul 18 13:23:16.363290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2413/5018] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:15 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:16.373039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:16.382906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:16.387060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-306563446", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b1645d03-05d9-405f-b377-5c30cea9f1e4"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:16.396960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:16.401139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:16.403665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:16.407386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:16.566990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] validate_networks() for [('b1645d03-05d9-405f-b377-5c30cea9f1e4', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:23:16.572260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:17.619366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:23:17.619930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:23:17.620324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:23:17.622763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:23:17.623243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:23:17.645193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:17.645649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:17.650730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:17.651333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:17.708877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Getting quotas for project 02a882973cdd48cab4f08ac8cc21e122. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:17.741509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:17.754655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Getting quotas for user 167cb3277432463498fb7826533ba0da and project 02a882973cdd48cab4f08ac8cc21e122. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:17.792430 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6421f1dc-8bec-4995-9221-1fec23cef099 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.420028 Jul 18 13:23:17.794714 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2414/5019] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:16 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:17.831818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-753b8948-b2ef-4dc9-bf94-1d26d13d85be tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96d7519040>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:17.852364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:23:17.859066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:23:18.037933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-753b8948-b2ef-4dc9-bf94-1d26d13d85be tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.225657 Jul 18 13:23:18.041103 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-398148e5-38e4-4563-bfe0-d58f9f437407 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136333 Jul 18 13:23:18.047525 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2415/5020] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:17 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:18.051455 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2606/5021] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:23:18.065837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:18.074910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:18.106493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:18.108055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:18.118114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.120085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:18.121598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.125084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.131159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:18.134061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:18.136179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:18.139966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.143873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:18.348196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:18.371975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:18.377044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:18.379319 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b00e375-74ec-49cd-90d2-534789656a8c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.324000 Jul 18 13:23:18.387185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2607/5022] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:18 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:18.415621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d8a8ea0-a62c-4980-9a43-bac92cc587a0 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:18.416547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d8a8ea0-a62c-4980-9a43-bac92cc587a0 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:18.624720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d8a8ea0-a62c-4980-9a43-bac92cc587a0 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:18.644796 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d8a8ea0-a62c-4980-9a43-bac92cc587a0 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1215 microversion: 2.1 time: 0.255223 Jul 18 13:23:18.657897 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2608/5023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:18 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:18.819701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:18.820500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:18.840918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.841538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:18.867059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:18.867917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:19.193804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:19.212347 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9651ffa-c7df-46ed-9637-cd280d897e7c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1516 microversion: 2.1 time: 1.162531 Jul 18 13:23:19.214889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2416/5024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:18 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1516 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:19.236081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19899d7d-3d66-43dd-a304-7c78a552d630 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96e9accd30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:19.483784 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19899d7d-3d66-43dd-a304-7c78a552d630 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 200 len: 352 microversion: 2.1 time: 0.265520 Jul 18 13:23:19.484440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2417/5025] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:19 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:19.500770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:19.505750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:19.537958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:19.539616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:19.545626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:19.554192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:19.668183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lazy-loading 'flavor' on Instance uuid 10e11bb9-4af9-40c6-bef5-647319818997 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:23:19.815126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:19.836424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4e24fdf-be8e-44a0-8dd9-b77fb77d01b3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.018022 Jul 18 13:23:19.838292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2609/5026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:18 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:19.851543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:19.852910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:19.867988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:19.868448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:19.869244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:19.869688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:19.942010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-18a5fcf2-8e88-473f-b6e5-bbe9c044d1ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action" status: 200 len: 32 microversion: 2.1 time: 0.453830 Jul 18 13:23:19.945675 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2418/5027] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:23:19 2022] POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:23:20.118124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:20.139265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:20.147264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:20.155353 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5428a58d-0d4e-4532-98de-3c6ff7d79962 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.314251 Jul 18 13:23:20.160778 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2610/5028] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:19 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:20.195161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:20.199116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:20.292694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:20.297031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:20.301386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:20.301942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:20.516948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-215098175", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "85161566-2e6c-404b-b349-5506da54aa18"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:20.582808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:20.611979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7d3e885-2d86-43e2-b3b3-ad16550532ed tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1211 microversion: 2.1 time: 0.449639 Jul 18 13:23:20.625641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2611/5029] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:20 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1211 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:20.633116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:20.633745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:20.701038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:20.701512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:20.702381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:20.702834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:20.711819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] validate_networks() for [('85161566-2e6c-404b-b349-5506da54aa18', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:23:21.196070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:21.214198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0aa0b134-e729-47e9-9d62-9ab085845bb0 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.587389 Jul 18 13:23:21.216149 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2612/5030] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:20 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:21.232983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2356de1f-0c33-4bda-a780-9eccecbd23c6 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Calling method '.version_select at 0x7f96e4700940>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:21.338469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2356de1f-0c33-4bda-a780-9eccecbd23c6 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] HTTP exception thrown: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2356de1f-0c33-4bda-a780-9eccecbd23c6 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Request method failure captured: Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 HTTP/1.1 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V6z1d40aJjgKIUo4ncCtQTlsKBxc9MhRm5tZJr_raSpA4AlJiY-8uLFRFBcXbxt4VhN7MVv6Cw5LV6KHqrBt4pytNEe-17WWnlb4_pt0e71F_5hAoKMbbrfvPcBHNuvud3jsV8siOJtl9IDKodolBdAlIp0ebf5OXhKeTwV1TFS4uU Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: e42c424f3b9240e2ab03dae60b660b02 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesGetTestJSON-25810672 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e42c424f3b9240e2ab03dae60b660b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e42c424f3b9240e2ab03dae60b660b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e42c424f3b9240e2ab03dae60b660b02", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e42c424f3b9240e2ab03dae60b660b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesGetTestJSON-25810672 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: e42c424f3b9240e2ab03dae60b660b02 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesGetTestJSON-25810672 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesGetTestJSON-25810672-project Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 378230b03b4245f59d8ecb2a0ae9dc20 Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesGetTestJSON-25810672-project Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: exception: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '1f97d9ee-fbde-4b53-acb6-33d4d885f0d4'} Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. (HTTP 404) (Request-ID: req-b83c8ddd-638d-4120-9c59-9d9580915d17) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:23:21.343436 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. Jul 18 13:23:21.351106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:21.358425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2356de1f-0c33-4bda-a780-9eccecbd23c6 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] Returning 404 to user: Volume 1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:21.359445 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2356de1f-0c33-4bda-a780-9eccecbd23c6 tempest-VolumesGetTestJSON-25810672 tempest-VolumesGetTestJSON-25810672-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4" status: 404 len: 109 microversion: 2.1 time: 0.136424 Jul 18 13:23:21.362038 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2613/5031] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:23:21 2022] GET /compute/v2.1/os-volumes/1f97d9ee-fbde-4b53-acb6-33d4d885f0d4 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:23:21.385564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:21.392372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:21.429049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:21.431413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:21.440348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:21.441722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:22.724759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:22.778167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9642efc-76c9-47ae-b54f-68fc61eb2250 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.413110 Jul 18 13:23:22.779154 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2614/5032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:21 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:22.820003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:22.821883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:22.852794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:22.856621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:22.872032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:22.873202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:23.668833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:23.678170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:23.701183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:23.710541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58cc961a-723e-4904-8e6b-6d08da5f6e86 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.929852 Jul 18 13:23:23.712070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2615/5033] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:22 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:23.717676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:23.726281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:23.744324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:23.747759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:23.748864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:23.749475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:23.929677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:23.946347 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0f00d36-4bc7-4822-9a40-e44b9972bb80 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1273 microversion: 2.1 time: 0.232824 Jul 18 13:23:23.947528 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2616/5034] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:23 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:23.954557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:23.956170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:23.970279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:23.970799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:23.971923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:23.980866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.344700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:23:24.345476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:23:24.346002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:23:24.364921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:23:24.365540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:23:24.388603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:24.454759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.457828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.462297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.465673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.747902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Getting quotas for project b519b4665afa41beb8c4f942dae4cebf. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:24.762437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Getting quotas for user 5cb6fbe4f7b24c5aada163256cef253d and project b519b4665afa41beb8c4f942dae4cebf. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:24.812471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:23:24.816219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:23:24.869732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b121ab5c-9a5f-4b98-8b50-df541fbd59a2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.920985 Jul 18 13:23:24.871258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2419/5035] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:23:24.876976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:24.878981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:24.886428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.887304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.888396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.889084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.889525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:24.904330 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b85e76d-91d8-4106-b475-2245da2a788d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.954942 Jul 18 13:23:24.913043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2617/5036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:23 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:24.917457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:24.924877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:24.928933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:24.946953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.948695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:24.951738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:24.953305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:25.015909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:25.175966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:25.185811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:25.191046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:25.203051 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1e5bf2e0-ef7a-4be8-ae3b-e7f6769409d0 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.288729 Jul 18 13:23:25.230792 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2618/5037] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:24 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:25.247381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-271f9533-8c74-4099-9aed-82aacbf9dc75 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:25.250202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-271f9533-8c74-4099-9aed-82aacbf9dc75 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:25.482461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-271f9533-8c74-4099-9aed-82aacbf9dc75 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:25.529715 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-271f9533-8c74-4099-9aed-82aacbf9dc75 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1227 microversion: 2.1 time: 0.281474 Jul 18 13:23:25.532454 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2619/5038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:25 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1227 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:25.562373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:25.564061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:25.623257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:25.624364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:25.625865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:25.626701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:26.025284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:26.063741 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-28286b0f-6b17-477c-a048-2feb44c69a37 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.190892 Jul 18 13:23:26.082712 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2420/5039] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:24 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:26.128441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:26.129369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:26.165782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:26.166576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:26.168094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:26.171182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:26.780875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:26.824971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34d9e21c-cf6d-4d59-beaa-e4604a176e2e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 1.284547 Jul 18 13:23:26.835342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2620/5040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:25 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:26.871741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:26.881762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:26.927927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:26.929828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:26.930979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:26.931560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.233641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.246187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.262413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.263979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93c78355-df03-4aa1-82a7-6be39ff12c7b tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.412391 Jul 18 13:23:27.266993 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2621/5041] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:26 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:27.283048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:27.284010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:27.306089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.306864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.310218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.314395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.323346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.345440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9717c7eb-6e45-4690-8493-42c31c4cd6f9 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 1.261143 Jul 18 13:23:27.351272 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2421/5042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:26 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:27.372996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:27.383550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:27.434009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.439086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.442343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.443847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.671092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:27.700854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.759182 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23097977-9be2-4547-84a8-e260ddea8324 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1287 microversion: 2.1 time: 0.464709 Jul 18 13:23:27.763540 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2622/5043] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:27 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1287 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:27.871322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:27.880396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:27.894734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:27.915145 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19f9eb7b-d85c-4cdf-94aa-8be2330a18f9 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 0.557395 Jul 18 13:23:27.929535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2422/5044] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:27 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:27.942578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.944048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:27.948350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:27.955251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:28.301070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:28.301735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:28.317342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:28.318394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:28.319338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:28.320026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:28.760181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:28.774478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:28.776203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:28.783297 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3a7d70f-f076-4ff3-b843-43bd60c5a0f1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.486566 Jul 18 13:23:28.788576 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2423/5045] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:28 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:23:28.804733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:28.805920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:28.816222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:28.818727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:28.819726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:28.821544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:29.099667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:29.144704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4fd33ab2-66e3-469c-8398-bad267a5f8dd tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 1.294509 Jul 18 13:23:29.149145 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2623/5046] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:27 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:29.169700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:29.170839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:29.226557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:29.227479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:29.228861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:29.229670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:29.805019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:29.819302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a904129-d5b1-4592-b782-f8b66bb0d2b4 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1285 microversion: 2.1 time: 0.668639 Jul 18 13:23:29.819945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2624/5047] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:29 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1285 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:30.152912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:30.171766 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-12d2a05b-de9a-42c0-b35f-2de042bca163 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 1.381497 Jul 18 13:23:30.175726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2424/5048] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:28 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:30.216738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:30.220259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:30.265493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.266343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:30.267869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.268662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:30.550604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:30.551280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:30.562821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.570638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:30.571843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.572502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:30.634187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:30.654932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:30.656887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:30.663313 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cdbc29a-d7fc-4ebe-95a5-91962b36bdd9 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.486091 Jul 18 13:23:30.682585 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2425/5049] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:30 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:30.692680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:30.693510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:30.711289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.712487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:30.713485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:30.714162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:31.075449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:31.101809 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad763062-e16b-4581-a2d6-a6d8693eb5ef tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.280146 Jul 18 13:23:31.112302 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2625/5050] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:29 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:31.120957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c68d6077-398f-4cfa-a5b7-e99c50aac324 req-340fa9b7-9b23-4b96-8b10-e38faf6c9ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6", "tag": "036e2e58-b09d-44f1-aa26-2865176b7786"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:31.174882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c68d6077-398f-4cfa-a5b7-e99c50aac324 req-340fa9b7-9b23-4b96-8b10-e38faf6c9ade service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:31.177801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c68d6077-398f-4cfa-a5b7-e99c50aac324 req-340fa9b7-9b23-4b96-8b10-e38faf6c9ade service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:31.208220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c68d6077-398f-4cfa-a5b7-e99c50aac324 req-340fa9b7-9b23-4b96-8b10-e38faf6c9ade service nova] Creating event network-changed:036e2e58-b09d-44f1-aa26-2865176b7786 for instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 on n-h2-850003-3 Jul 18 13:23:31.218394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:31.239931 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c68d6077-398f-4cfa-a5b7-e99c50aac324 req-340fa9b7-9b23-4b96-8b10-e38faf6c9ade service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125089 Jul 18 13:23:31.241254 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2626/5051] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:31.251312 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0dbe2852-2e29-46e8-b48e-55a228354467 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 0.563297 Jul 18 13:23:31.252126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:31.257592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:31.258371 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2426/5052] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:30 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:31.283359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:31.284369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:31.285753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:31.286539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:31.287090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:31.291090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:31.320221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:31.334055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:31.343276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:31.344104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.225383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:32.243742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-221e9b29-5867-40b8-a186-c53e82f63d4b tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 1.000829 Jul 18 13:23:32.250252 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2627/5053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:31 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:32.280892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:32.283116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:32.300848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.304190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.305862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.308056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.417645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:32.451558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61831c17-4ac4-4c90-8f16-c211a1e02232 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 1.191863 Jul 18 13:23:32.452307 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2427/5054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:31 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:32.467568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:32.468629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:32.480119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.481239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.483939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.484887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.581597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:32.616669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:32.626844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:32.634101 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36b81f1a-7511-45fc-90e7-a5285bbe3e47 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.380267 Jul 18 13:23:32.636806 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2628/5055] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:32 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:32.678269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:32.688609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:32.725255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.726888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:32.734790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:32.735833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:33.049466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:33.078235 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-976241dd-240f-4d35-8a92-2ab61367e465 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 0.616345 Jul 18 13:23:33.084572 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2428/5056] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:32 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:33.275015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:33.277101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:33.320665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:33.323484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:33.324932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:33.336412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.308353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:34.328001 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-180c927b-1ecb-4412-8fb1-118ba6730feb tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 1.667221 Jul 18 13:23:34.335044 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2629/5057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:32 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:34.349542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:34.351200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:34.376140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.378866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.385071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.387006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.539343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:34.560852 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88454dad-2dc9-4a9a-a3d1-bd3414f9beb9 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 1.294172 Jul 18 13:23:34.586294 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2429/5058] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:33 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:34.607184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:34.609246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:34.627693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.628102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.629365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.634310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.666966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:34.776218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:34.792542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:34.806865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:34.808459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:34.817893 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e30526f-87c7-4311-b056-3578d42d8d6e tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.228958 Jul 18 13:23:34.818893 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2430/5059] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:34 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:34.840500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:34.845836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:34.870233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.871219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:34.872386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:34.872980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:35.299559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:35.325806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b2d2fca6-9028-4987-a231-f5d07c101c9d tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.988223 Jul 18 13:23:35.327811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2630/5060] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:34 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:35.353000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:35.357313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:35.385494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:35.388049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:35.390685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:35.395808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:35.505234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:35.772385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:35.792606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9861363-308b-4d5b-80ef-f30e9a4f9ba7 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 0.968778 Jul 18 13:23:35.796681 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2431/5061] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:34 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:35.818435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:35.820327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:35.842064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:35.842994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:35.844728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:35.845382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.228482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:36.232170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:36.241390 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2e5bcaff-35fd-4e71-a125-9f4f2cd49042 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.442931 Jul 18 13:23:36.260768 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2432/5062] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:35 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:36.266480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:36.267275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:36.271432 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ee99ac3-f194-4e61-8603-b144a89f1488 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 0.924826 Jul 18 13:23:36.276888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.279770 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2631/5063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:35 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:36.280299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.281272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.282678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.345954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:36.347245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:36.366922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.367573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.375830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.376849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.515232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:36.539621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:36.552046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:36.554808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d31c06db-fb49-4a20-808c-014266db4f6c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.291994 Jul 18 13:23:36.556726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2433/5064] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:36 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:36.828420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:36.830355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:36.853298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.854312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:36.855744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:36.857204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:37.328734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:37.354777 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ee89c4d-f181-43af-bd0c-2dd867a67ee1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 1.010696 Jul 18 13:23:37.356218 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2632/5065] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:36 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:37.382691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d911ee74-9699-43c8-83f9-f4d5ef08b35c req-d299d591-ee5b-4723-b80b-adc7672f6d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74c665a-386f-428e-968e-5e6a80f47379", "tag": "39cb0a5f-0af0-4194-a784-a84588ad079b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:37.402658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:37.408433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d911ee74-9699-43c8-83f9-f4d5ef08b35c req-d299d591-ee5b-4723-b80b-adc7672f6d41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:37.409593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d911ee74-9699-43c8-83f9-f4d5ef08b35c req-d299d591-ee5b-4723-b80b-adc7672f6d41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:37.479076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d911ee74-9699-43c8-83f9-f4d5ef08b35c req-d299d591-ee5b-4723-b80b-adc7672f6d41 service nova] Creating event network-changed:39cb0a5f-0af0-4194-a784-a84588ad079b for instance c74c665a-386f-428e-968e-5e6a80f47379 on n-h1-850003-3 Jul 18 13:23:37.491121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d911ee74-9699-43c8-83f9-f4d5ef08b35c req-d299d591-ee5b-4723-b80b-adc7672f6d41 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120582 Jul 18 13:23:37.493609 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2633/5066] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:37.501363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:37.511317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:37.534892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:37.537308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:37.539467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:37.540636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.166232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.177308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da18c8e5-6c88-4f88-8d93-a7883120414f tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.680057 Jul 18 13:23:38.180074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2634/5067] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:37 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:38.189960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:38.192599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:38.202812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.204310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.205313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.205968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.384747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.403476 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7730f20-d01e-4c5e-a380-908e15e1e925 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 1.581508 Jul 18 13:23:38.404655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2434/5068] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:36 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:38.411246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:38.412230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:38.426098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.427092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.428761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.429669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.564865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.581927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.584519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.596574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48ebea1e-a8b1-4ce1-ac63-a90c98638162 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.190170 Jul 18 13:23:38.598412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2435/5069] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:38 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:38.607141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6026b7e6-e88d-4a3b-ae10-96d86d72c29d req-fd8c7adf-9dd7-4696-bea1-335a7941c5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6", "name": "network-vif-plugged", "status": "completed", "tag": "036e2e58-b09d-44f1-aa26-2865176b7786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:38.624537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6026b7e6-e88d-4a3b-ae10-96d86d72c29d req-fd8c7adf-9dd7-4696-bea1-335a7941c5e1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.626495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6026b7e6-e88d-4a3b-ae10-96d86d72c29d req-fd8c7adf-9dd7-4696-bea1-335a7941c5e1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.652607 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6026b7e6-e88d-4a3b-ae10-96d86d72c29d req-fd8c7adf-9dd7-4696-bea1-335a7941c5e1 service nova] Creating event network-vif-plugged:036e2e58-b09d-44f1-aa26-2865176b7786 for instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 on n-h2-850003-3 Jul 18 13:23:38.701823 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6026b7e6-e88d-4a3b-ae10-96d86d72c29d req-fd8c7adf-9dd7-4696-bea1-335a7941c5e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100368 Jul 18 13:23:38.715813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2436/5070] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:38.733499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:38.740884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:38.759643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.761136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.762767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:38.764026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:38.800784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:38.874916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:38.907847 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8db0d723-afe7-45c4-a973-0f1d7f5fa156 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 0.726007 Jul 18 13:23:38.908896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2635/5071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:38 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:39.196913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:39.197722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:39.206811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.208177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.209194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.209873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.363412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:39.392558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f521863-a05a-474b-8f33-f598503987c1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.673554 Jul 18 13:23:39.406238 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2437/5072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:38 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:39.438948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:39.451700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:39.471475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.472374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.474686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.475372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.755741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:39.819130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3cd96c2-c9ae-497b-9b69-4aca5ea61592 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.619069 Jul 18 13:23:39.821915 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2636/5073] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:39 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:39.843814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:39.845185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:39.870807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.871968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.873656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:39.874845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:39.929842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:39.967321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.007102 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e2c5957f-f02f-4ad4-8e40-eaab40945a35 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1736 microversion: 2.1 time: 0.574718 Jul 18 13:23:40.023892 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2438/5074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:39 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1736 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:40.029706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:40.031224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:40.084224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.098309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.099166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:40.108587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.112773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.113460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:40.129036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.134676 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8ba9d8d-1600-4a65-bc01-c71d522a2606 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.309387 Jul 18 13:23:40.151931 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2637/5075] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:39 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:40.403368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.415952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-620b46b5-5508-4e30-95a2-c16761fdb15c tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1315 microversion: 2.1 time: 0.405718 Jul 18 13:23:40.417170 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2439/5076] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:40 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:40.422916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:40.424287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:40.433729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.434732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:40.436191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.436898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:40.524570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7e178a20-6be6-41b7-be26-d3befc96757e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: .version_select at 0x7f96e45ef8b0>, body: {"keypair": {"name": "tempest-keypair-369016907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/U0SeVKQEgQZwYV5/IGgBFWWG8ICfqYzi2VgdwBeFBBRD/gCZHQSKyfn17mI+nIq6xEEoXKvcsw9oCRxeOYBPunLdss6lZgP1YXXXT19zOZenGCtAm2pAE1BLg9CLY+Q=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:40.553439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7e178a20-6be6-41b7-be26-d3befc96757e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for project eeb53b4c90074ccf8d023140962e116f. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:40.566168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7e178a20-6be6-41b7-be26-d3befc96757e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for user e1ff464f79ed4f948b6f2d7f3261f5be and project eeb53b4c90074ccf8d023140962e116f. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:40.611805 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7e178a20-6be6-41b7-be26-d3befc96757e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.342210 Jul 18 13:23:40.614452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2638/5077] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 13:23:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 13:23:40.770633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:40.792872 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d47a92c-604c-4718-983a-6704d193901c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.373987 Jul 18 13:23:40.795000 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2440/5078] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:40 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:40.870231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:40.873201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:40.887916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.889379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:40.890742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:40.891459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.036293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:41.041234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:41.063615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.064352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.065669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.086679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.431151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:41.468219 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5787bae-abec-4964-9bb0-5cd3efc4ca79 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.614785 Jul 18 13:23:41.472356 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2639/5079] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:40 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:41.499180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:41.502089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:41.540113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.542181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.547756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.550214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.744553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:41.810800 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-02af4192-d9d7-463b-9690-5bb9b86223fb tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1716 microversion: 2.1 time: 0.771989 Jul 18 13:23:41.818664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2441/5080] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:41 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1716 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:41.829127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:41.829765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:41.864947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.866259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.868878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.870034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.892062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:41.901868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:41.918511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:41.920290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36acede1-c0c7-4ace-94bf-35a6356c3de1 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1407 microversion: 2.54 time: 0.443536 Jul 18 13:23:41.934327 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2640/5081] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:41 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:41.960711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:41.962487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:41.971821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.972346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:41.974270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:41.974793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.388247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:42.416450 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbb38fbc-5462-49fa-af83-c862b79f2523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.480288 Jul 18 13:23:42.431747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2641/5082] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:41 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:42.442920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:42.443827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:42.467184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.467660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.468655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.475045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.497929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:42.520592 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a70234b-38e2-4e01-97a8-d1899d7b8c3e tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1503 microversion: 2.1 time: 0.699149 Jul 18 13:23:42.521860 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2442/5083] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:41 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1503 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:42.536677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:42.539734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:42.556334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.558103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.560253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.561853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.777963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Cannot 'detach_volume' instance 40554a05-109e-43f5-a1f8-da040e18915f while it is in vm_state rescued Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments/3ab95b6b-0fb5-463e-83ad-48bd3886c9c2 HTTP/1.1 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'detach_volume' instance 40554a05-109e-43f5-a1f8-da040e18915f while it is in vm_state rescued Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '40554a05-109e-43f5-a1f8-da040e18915f', 'id': '3ab95b6b-0fb5-463e-83ad-48bd3886c9c2'} Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40554a05-109e-43f5-a1f8-da040e18915f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 40554a05-109e-43f5-a1f8-da040e18915f while it is in vm_state rescued Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:42.781832 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 40554a05-109e-43f5-a1f8-da040e18915f while it is in vm_state rescued Jul 18 13:23:42.789603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:42.793453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 409 to user: Cannot 'detach_volume' instance 40554a05-109e-43f5-a1f8-da040e18915f while it is in vm_state rescued {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:42.795045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd324b45-8fc0-4120-a5cd-5891202db582 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments/3ab95b6b-0fb5-463e-83ad-48bd3886c9c2" status: 409 len: 152 microversion: 2.1 time: 0.358639 Jul 18 13:23:42.802589 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2642/5084] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:23:42 2022] DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments/3ab95b6b-0fb5-463e-83ad-48bd3886c9c2 => generated 152 bytes in 369 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:23:42.817831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:42.825392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:42.844129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.845654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:42.849235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:42.849774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.121647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9366aa8-756d-406c-b22c-cb7ad4167566 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.317578 Jul 18 13:23:43.125608 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2643/5085] 10.222.0.88 () {58 vars in 1295 bytes} [Mon Jul 18 13:23:42 2022] DELETE /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6/os-server-password => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:23:43.138650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:43.144172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:43.151895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:43.161847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.168557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.169653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.178681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.196610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-056cff1b-3ee0-4de3-b9f7-5091ff897c30 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.657659 Jul 18 13:23:43.198306 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2443/5086] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:42 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:43.214482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:43.216089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:43.235562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.236890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.239157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.241171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.450109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:43.454914 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d7a4b98-b118-44bb-a1a6-3d81210a0d33 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/action" status: 202 len: 0 microversion: 2.1 time: 0.325265 Jul 18 13:23:43.464422 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2644/5087] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:23:43 2022] POST /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:23:43.487808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:43.492478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:43.494788 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa71bd31-67db-43ca-8b61-adc90980dd9d tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1425 microversion: 2.54 time: 0.294409 Jul 18 13:23:43.496270 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2444/5088] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:43 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1425 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:43.506687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:43.516890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:43.518893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:43.525396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:43.538787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.543397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.546023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.546881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.561371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.562881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.565609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.566780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.649406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e2bfa8dd-bad0-4db0-8afa-51118e6b87da tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.174475 Jul 18 13:23:43.663935 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2645/5089] 10.222.0.88 () {58 vars in 1292 bytes} [Mon Jul 18 13:23:43 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6/os-server-password => generated 16 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:23:43.682063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:43.685014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:43.704988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.704988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:43.715868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:43.716826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.112808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:44.141505 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff0cffd3-6835-4c1d-892b-b5e0dccc55bd tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.642738 Jul 18 13:23:44.149192 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2445/5090] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:43 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:44.171022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:44.174066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:44.208617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.209949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.211633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.212897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.319224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:23:44.467937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:44.510763 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5771fdad-45a4-4419-b3c8-9ed606e2a171 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1724 microversion: 2.1 time: 0.843298 Jul 18 13:23:44.522825 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2646/5091] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:43 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1724 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:44.535184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:44.535915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:44.564895 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80ad6d29-bb87-43e3-8bb9-a1cd38b70dc3 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 204 len: 0 microversion: 2.1 time: 0.412873 Jul 18 13:23:44.566283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.569699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.572373 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2446/5092] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:23:44 2022] DELETE /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:23:44.572947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.576284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.584711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:44.586475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:44.601256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.604403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.606260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:44.608407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:44.830663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lazy-loading 'services' on Instance uuid ad92285a-f4a5-4038-b73a-83276df73f9b {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:23:45.078954 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5730f451-e188-490f-bda1-b7d10c131b04 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b/os-volume_attachments/5a8a5665-1235-4f71-b22b-eca73773c864" status: 202 len: 0 microversion: 2.1 time: 0.560776 Jul 18 13:23:45.079994 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2647/5093] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:23:44 2022] DELETE /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b/os-volume_attachments/5a8a5665-1235-4f71-b22b-eca73773c864 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:23:45.091096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:45.097535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:45.110427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.112295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.114295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.115102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.115372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.151907 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7facbb2-26ae-4e94-9058-199a14ac37e5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.576079 Jul 18 13:23:45.180700 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2447/5094] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:44 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:45.208668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:45.212044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:45.232116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.233170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.235466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.236611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.375734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.398490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.402981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.408702 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-faee3978-57e8-46b3-ab9f-066c88482eba tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1413 microversion: 2.54 time: 0.323587 Jul 18 13:23:45.411516 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2648/5095] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:45 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1413 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:45.421877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:45.424045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:45.436653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.437879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.439970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.441034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.555218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.569204 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c48129a2-6452-4f48-b23e-7ed27af6d093 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1509 microversion: 2.1 time: 0.386931 Jul 18 13:23:45.571873 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2448/5096] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:45 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:45.580463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:45.581903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:45.594591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.595673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.597068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:45.599230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:45.864461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.882372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-431879b1-ac40-4348-a883-4bd123385c20 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1724 microversion: 2.1 time: 0.307549 Jul 18 13:23:45.883766 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2449/5097] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:45 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:45.892097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:45.907055 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-efc928b8-9205-4f65-90d0-f16f55902d5e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.493046 Jul 18 13:23:45.907865 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2649/5098] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:45 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:46.209827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:46.211129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:46.236930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.236930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.237422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.238104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.447779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:46.478438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:46.494141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.495600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.497218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.498324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.804118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:46.823351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5111af3d-c521-469d-96ce-ccf7933e05f2 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.622429 Jul 18 13:23:46.825141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2450/5099] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:46 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:46.846569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:46.850034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:46.856215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:46.861011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.862247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.863333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.864343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.890059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:46.893820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:46.898435 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1d1061cf-4dc6-40d4-bf59-ef1f2bbe146f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1413 microversion: 2.54 time: 0.460383 Jul 18 13:23:46.899540 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2650/5100] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:46 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1413 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:46.921592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0270e9a7-cec9-4ecd-b553-a62350e1dd44 req-25e0968f-1a38-418d-b8da-1710d5ba25cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c665a-386f-428e-968e-5e6a80f47379", "name": "network-vif-plugged", "status": "completed", "tag": "39cb0a5f-0af0-4194-a784-a84588ad079b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:46.960718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0270e9a7-cec9-4ecd-b553-a62350e1dd44 req-25e0968f-1a38-418d-b8da-1710d5ba25cf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:46.961555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0270e9a7-cec9-4ecd-b553-a62350e1dd44 req-25e0968f-1a38-418d-b8da-1710d5ba25cf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:46.982512 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0270e9a7-cec9-4ecd-b553-a62350e1dd44 req-25e0968f-1a38-418d-b8da-1710d5ba25cf service nova] Creating event network-vif-plugged:39cb0a5f-0af0-4194-a784-a84588ad079b for instance c74c665a-386f-428e-968e-5e6a80f47379 on n-h1-850003-3 Jul 18 13:23:46.996277 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0270e9a7-cec9-4ecd-b553-a62350e1dd44 req-25e0968f-1a38-418d-b8da-1710d5ba25cf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094504 Jul 18 13:23:46.997421 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2651/5101] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:47.039830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:47.043125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:47.054852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:47.056309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:47.058011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:47.058977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:47.447159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:47.451750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:47.476326 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba49eb3c-0bc5-434c-b749-638fe8bc2a4a tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1509 microversion: 2.1 time: 0.648555 Jul 18 13:23:47.489711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71fec54b-1ab5-426c-b384-056c3fed74f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1724 microversion: 2.1 time: 0.473904 Jul 18 13:23:47.490034 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2451/5102] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:46 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:47.503368 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2652/5103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:46 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:47.503744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:47.505740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:47.530542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:47.531384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:47.532396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:47.534718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:47.538139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1080941799", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9e14db0-4b8e-4177-8196-d5ce8429df44"}], "security_groups": [{"name": "tempest-securitygroup--1916207755"}], "key_name": "tempest-keypair-369016907", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:47.580600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:47.930698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] validate_networks() for [('e9e14db0-4b8e-4177-8196-d5ce8429df44', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:23:48.330874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:48.345970 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-435645d1-9e5d-41d4-a410-ac68caea1cb3 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.853544 Jul 18 13:23:48.354645 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2452/5104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:47 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:48.365088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:48.365715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:48.393048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.393967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.396522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.399304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.888668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:48.891495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:23:48.892196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:23:48.892898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:23:48.893407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:23:48.894410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:23:48.904339 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a81499d0-06df-47db-bcc5-65b7b6979c72 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1327 microversion: 2.1 time: 0.546822 Jul 18 13:23:48.906008 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2453/5105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:48 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1327 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:48.932984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:48.934876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:48.940729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.941645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.946049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.951389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.979354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.981480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.983904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:48.988145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:48.998285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:49.029082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for project eeb53b4c90074ccf8d023140962e116f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:23:49.047274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for user e1ff464f79ed4f948b6f2d7f3261f5be and project eeb53b4c90074ccf8d023140962e116f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:23:49.088401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:23:49.092625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:23:49.121585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.132216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.134732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.136512 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-43d489e7-dc35-47e1-aed0-94dfb3857f3c tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1398 microversion: 2.54 time: 0.228637 Jul 18 13:23:49.137550 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2454/5106] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:48 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1398 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:49.142814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.143887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:49.154106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.155035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.156234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.156856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.228448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e20d77b7-eeb9-4121-8c09-bc7dc056b2c4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.722534 Jul 18 13:23:49.229400 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2653/5107] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:23:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:23:49.238199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.239062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.240027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lazy-loading 'fault' on Instance uuid c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:23:49.252672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.257940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:49.272812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.274318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.275278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.276006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.390238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167cb3277432463498fb7826533ba0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a882973cdd48cab4f08ac8cc21e122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.412415 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ff3e956-5050-46d2-8deb-441ca21cef72 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 200 len: 1305 microversion: 2.1 time: 0.273180 Jul 18 13:23:49.418663 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2455/5108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:49 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:49.446331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2d0f2087-fc07-4a56-ad05-7bc804c02972 req-2a535734-e2a8-4c32-b533-f7068d3f8a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6", "name": "network-vif-deleted", "tag": "036e2e58-b09d-44f1-aa26-2865176b7786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:49.476750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2d0f2087-fc07-4a56-ad05-7bc804c02972 req-2a535734-e2a8-4c32-b533-f7068d3f8a2d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.477416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2d0f2087-fc07-4a56-ad05-7bc804c02972 req-2a535734-e2a8-4c32-b533-f7068d3f8a2d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.513190 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2d0f2087-fc07-4a56-ad05-7bc804c02972 req-2a535734-e2a8-4c32-b533-f7068d3f8a2d service nova] Creating event network-vif-deleted:036e2e58-b09d-44f1-aa26-2865176b7786 for instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 on n-h2-850003-3 Jul 18 13:23:49.527533 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2d0f2087-fc07-4a56-ad05-7bc804c02972 req-2a535734-e2a8-4c32-b533-f7068d3f8a2d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102008 Jul 18 13:23:49.529602 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2456/5109] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:49.545342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5fc4df4-6c35-4041-9fac-76f551ce0dfd tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '.version_select at 0x7f96e4618b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.581575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.599889 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2d9b110-b5a4-4e04-89a1-148036dd245e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1724 microversion: 2.1 time: 0.369356 Jul 18 13:23:49.602338 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2654/5110] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:49 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:49.608495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.609462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:49.630117 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5fc4df4-6c35-4041-9fac-76f551ce0dfd tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-219336594" status: 204 len: 0 microversion: 2.54 time: 0.092965 Jul 18 13:23:49.640327 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2457/5111] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-219336594 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:23:49.671825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.672595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:49.685981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:49.709883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.710596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.711465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.711917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.763489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.794684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.803904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:49.805503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e43416a-768a-437d-a25f-3d6650925c60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1281 microversion: 2.20 time: 0.201486 Jul 18 13:23:49.806212 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2655/5112] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:49 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:49.824516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:49.827656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:49.870222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.870825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:49.877957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:49.885031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.077908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:23:50.170899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:50.201675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42cd647a-ba83-419f-81c1-d83c2c452523 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.559762 Jul 18 13:23:50.209333 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2458/5113] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:49 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:50.221505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:50.241187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:50.275296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.276013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.277261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.277971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.281945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1fa2ff79-186f-4db2-b9eb-ab883551138f tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "DELETE /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 204 len: 0 microversion: 2.54 time: 0.473266 Jul 18 13:23:50.283452 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2656/5114] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:23:49 2022] DELETE /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:23:50.307217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:50.309025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:50.321352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.322846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.324099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.325048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.526694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:50.567746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:50.571161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:50.574340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6650f39-1f45-44af-89a4-5b9c47a8a31a tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1404 microversion: 2.54 time: 0.282652 Jul 18 13:23:50.575391 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2657/5115] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:50 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1404 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:50.608746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:50.610250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] [instance: c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:50.648410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.649802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.651568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.655315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.689894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] HTTP exception thrown: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Request method failure captured: Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 HTTP/1.1 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V7DuSGcCnvVpeSVW4xjS1Ai1iD8KRHUG_fpWItsjT7QL2sOKJ5FYNo0Z7aWmG3LNBao03jekcIWuO-raLfz_fuals35HzCjTkETih_SDskL62V2zF2RxHkuJHlKbw8_fBH8tdXqjeiuf0ah-v-DpVxMrM3JFLPRve6csZJWrWqrP0Y Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 02a882973cdd48cab4f08ac8cc21e122 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerPasswordTestJSON-1081915883 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/02a882973cdd48cab4f08ac8cc21e122"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02a882973cdd48cab4f08ac8cc21e122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_02a882973cdd48cab4f08ac8cc21e122", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02a882973cdd48cab4f08ac8cc21e122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerPasswordTestJSON-1081915883 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 02a882973cdd48cab4f08ac8cc21e122 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1081915883 Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerPasswordTestJSON-1081915883-project Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 167cb3277432463498fb7826533ba0da Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerPasswordTestJSON-1081915883-project Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6'} Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:50.693883 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. Jul 18 13:23:50.701528 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:50.704838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] Returning 404 to user: Instance c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:50.706744 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-943d5739-d8a9-467a-abd8-6cb07bf7a1c1 tempest-ServerPasswordTestJSON-1081915883 tempest-ServerPasswordTestJSON-1081915883-project] 10.222.0.88 "GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6" status: 404 len: 111 microversion: 2.1 time: 0.106239 Jul 18 13:23:50.708516 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2658/5116] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:50 2022] GET /compute/v2.1/servers/c9a984f9-17ff-4e9e-967d-6a56eb3e3dd6 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:23:50.721324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:50.724098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:50.741413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.742683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.744416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.745479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.771407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:50.790900 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-742cb923-a2b9-44cf-aac2-24191d56db08 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1528 microversion: 2.1 time: 0.572841 Jul 18 13:23:50.790900 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2459/5117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:50 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1528 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:50.817935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:50.819233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:50.832568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.832568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:50.832568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:50.833380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.207985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.228098 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-083e5d58-8a9c-4a4e-b13c-8c72d2f2bc28 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1528 microversion: 2.1 time: 0.414358 Jul 18 13:23:51.236619 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2460/5118] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:50 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:51.250223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:51.252211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:51.269481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.270745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.272571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.273620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.396235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.413658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa55f4b5-cc5e-47b8-b865-04d52129e3f6 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1730 microversion: 2.1 time: 0.702690 Jul 18 13:23:51.415264 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2659/5119] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:50 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1730 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:51.420528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.425039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:51.426759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:51.440512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.441399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.443600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.444417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.448173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.459281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.461819 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9414eb8f-41a0-4bf6-bea8-bcb5135ed2d5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1333 microversion: 2.20 time: 0.223510 Jul 18 13:23:51.463003 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2461/5120] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:51 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1333 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:51.807662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:51.819225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abb8fefb-7536-4981-8f9f-d01ac418cc02 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.402050 Jul 18 13:23:51.823917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2660/5121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:51 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:51.841518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:51.842005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:51.863336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.865529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:51.866421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:51.866866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.154602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:52.154602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:52.161639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.162099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.163394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.163897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.187852 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] HTTP exception thrown: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Request method failure captured: Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 HTTP/1.1 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V7GaQ7EhzcTDXpxquVknxOd4NxEOM2tY-rCq_Al3l65wCohWqVh3f9X4QkQMJAHKZ1f2aexWk3M8WQXuNBqMw3C0ChWQEwwApGTK8w5-ji9EXbMJgxGuQU7eorpGRit5ig7sdlyhtsGgAQENLOGqE8BISFKU1A8LOY3P6mDkc3jq6g Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 321d198b2e7247f388a4a8b6237dda12 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_321d198b2e7247f388a4a8b6237dda12", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 321d198b2e7247f388a4a8b6237dda12 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1023346548-project Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e59d68bef0ae4fd0a6d08af106eb30bb Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548-project Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'c74c665a-386f-428e-968e-5e6a80f47379'} Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:23:52.190386 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Returning 404 to user: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ed1c3a3-187e-4227-9593-e3612f5067de tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 404 len: 111 microversion: 2.1 time: 0.728108 Jul 18 13:23:52.205571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2462/5122] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:23:51 2022] DELETE /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 111 bytes in 736 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:23:52.212345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:52.212345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:52.219437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.219984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.220807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.221508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.277476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9ec5ef2-2d62-4357-bdc7-61fa5cd9b112 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440099 Jul 18 13:23:52.278197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2661/5123] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:23:51 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-interface => generated 284 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:52.295850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:52.296972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:52.330096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.330907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.332833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.333641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.408436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.427400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.435800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f4ccb889e804f8ba002844f25523ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af62c6e35324e298557e815b03cc5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.437585 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-61a2230d-e43e-4ebe-8629-b4cfbe66c016 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 200 len: 1404 microversion: 2.54 time: 0.236357 Jul 18 13:23:52.445577 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2463/5124] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:52 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 1404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:52.495581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:52.496908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:52.510328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.511305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.512838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.514116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.644614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.659733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.662105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:52.668068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1f19be7-8267-458e-b59c-53902ed6eb47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1339 microversion: 2.20 time: 0.185539 Jul 18 13:23:52.669127 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2464/5125] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:52 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:52.844660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:52.845769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:52.887006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.888338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:52.894717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:52.896600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.018830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:53.043053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e0d2dc1-c327-4f69-9ba9-92433c95c397 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1528 microversion: 2.1 time: 0.753582 Jul 18 13:23:53.044110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2662/5126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:52 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1528 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:53.063538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Action: 'update', calling method: >, body: {"server": {"name": "c74c665a-386f-428e-968e-5e6a80f47379_new"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:53.065221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:53.074357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.075373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.076511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.077230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.113350 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] HTTP exception thrown: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Request method failure captured: Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: request: PUT /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 HTTP/1.1 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 64 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V7GaQ7EhzcTDXpxquVknxOd4NxEOM2tY-rCq_Al3l65wCohWqVh3f9X4QkQMJAHKZ1f2aexWk3M8WQXuNBqMw3C0ChWQEwwApGTK8w5-ji9EXbMJgxGuQU7eorpGRit5ig7sdlyhtsGgAQENLOGqE8BISFKU1A8LOY3P6mDkc3jq6g Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 321d198b2e7247f388a4a8b6237dda12 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_321d198b2e7247f388a4a8b6237dda12", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/321d198b2e7247f388a4a8b6237dda12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 321d198b2e7247f388a4a8b6237dda12 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548 Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1023346548-project Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e59d68bef0ae4fd0a6d08af106eb30bb Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1023346548-project Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: {"server": {"name": "c74c665a-386f-428e-968e-5e6a80f47379_new"}} Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c74c665a-386f-428e-968e-5e6a80f47379', 'body': {'server': {'name': 'c74c665a-386f-428e-968e-5e6a80f47379_new'}}} Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 13:23:53.115935 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:53.125551 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.131961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] Returning 404 to user: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:53.132270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe4d547d-b4e8-45e0-8717-1c820dd1228d tempest-ServersNegativeTestMultiTenantJSON-1023346548 tempest-ServersNegativeTestMultiTenantJSON-1023346548-project] 10.222.0.88 "PUT /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 404 len: 111 microversion: 2.1 time: 0.071307 Jul 18 13:23:53.137945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2663/5127] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:23:53 2022] PUT /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:23:53.146253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:53.147876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:53.157854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.159223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.160681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.161576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.209486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:23:53.294277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:53.317846 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51ee8182-1dcb-48ff-a079-e8c03e86a589 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.479656 Jul 18 13:23:53.319498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2465/5128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:52 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:53.321837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:53.344455 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-504e562d-235b-4368-9b22-10f2e7ec4bd1 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 204 len: 0 microversion: 2.1 time: 0.203139 Jul 18 13:23:53.344455 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2664/5129] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:23:53 2022] DELETE /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:23:53.361942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:53.365666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:53.382659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.383808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.385162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.385986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.462871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:53.464019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] [instance: 311e1d41-2d3f-4098-8ee6-0512d42242be] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:53.489712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.490506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.491318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.491951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.539242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] HTTP exception thrown: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Request method failure captured: Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be HTTP/1.1 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V650J8UKQzA_a_mrYDqsYnwgRHocK_RICwWxVdSCvpJt_kU5H1D57mLe0WNb0gKlkHLS4fheECbRpZ8uEDtkPNZRVw12_g0lEU45tAvXkGfAgasrG_pTgHwxREd5fINPxHGKbwyd1fgG-tq_61lvXLp6QONrddVXTA30H0G4GUCz_A Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.54 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 7af62c6e35324e298557e815b03cc5b1 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerShowV254Test-1802313369 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7af62c6e35324e298557e815b03cc5b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7af62c6e35324e298557e815b03cc5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7af62c6e35324e298557e815b03cc5b1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7af62c6e35324e298557e815b03cc5b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerShowV254Test-1802313369 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 7af62c6e35324e298557e815b03cc5b1 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerShowV254Test-1802313369 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerShowV254Test-1802313369-project Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1f4ccb889e804f8ba002844f25523ec9 Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerShowV254Test-1802313369-project Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '311e1d41-2d3f-4098-8ee6-0512d42242be'} Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:53.543234 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. Jul 18 13:23:53.548508 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:53.549741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] Returning 404 to user: Instance 311e1d41-2d3f-4098-8ee6-0512d42242be could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:53.552698 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dfc1efa3-0aaa-426b-ad6f-bb3ddbaf3937 tempest-ServerShowV254Test-1802313369 tempest-ServerShowV254Test-1802313369-project] 10.222.0.88 "GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be" status: 404 len: 111 microversion: 2.54 time: 0.096212 Jul 18 13:23:53.554635 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2665/5130] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:53 2022] GET /compute/v2.1/servers/311e1d41-2d3f-4098-8ee6-0512d42242be => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:23:53.702964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:53.709022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:53.736077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.739420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:53.744861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:53.748370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:54.103963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:54.152958 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6cb278eb-daea-44dd-9b2c-add086ba0714 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1534 microversion: 2.1 time: 0.799529 Jul 18 13:23:54.154876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2466/5131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:53 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1534 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:54.355008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:54.357921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:54.401528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:54.402343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:54.403702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:54.404454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:55.146076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:55.200229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:55.203207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:55.204995 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99f92c3a-4879-4bfe-8c14-1c0751a4c318 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 1.510469 Jul 18 13:23:55.230446 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2666/5132] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:53 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:55.248504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:55.250598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:55.268578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:55.270265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:55.271187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:55.274200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:55.278503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:55.289972 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a05c3f85-473d-4ac4-bce3-3ec7e9fb5e31 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.949825 Jul 18 13:23:55.291427 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2467/5133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:54 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:56.133932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:56.143541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e199fe2b-ff05-4380-9856-9c3b053ecaec tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1534 microversion: 2.1 time: 0.909577 Jul 18 13:23:56.155276 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2667/5134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:55 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1534 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:56.242767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:56.244360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:56.275613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:56.276435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:56.278141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:56.287545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:56.317218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:56.317936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:56.333692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:56.334743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:56.335649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:56.336104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:57.745517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:57.780406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe5e65d1-dd14-4cbc-8817-ab6294e856a6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 1.461578 Jul 18 13:23:57.800408 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2668/5135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:56 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:57.817403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:57.824117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:57.848153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:57.850642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:57.858478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:57.859804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:57.921916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:57.922877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:57.923680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lazy-loading 'fault' on Instance uuid c74c665a-386f-428e-968e-5e6a80f47379 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:23:58.085724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb6fbe4f7b24c5aada163256cef253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b519b4665afa41beb8c4f942dae4cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:58.131976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e223d9f0-39ca-4fb8-84de-a8140b596ad5 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 200 len: 1317 microversion: 2.1 time: 0.322832 Jul 18 13:23:58.141904 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2669/5136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:57 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:23:58.158407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-8239d309-639a-47bb-a36a-d338befad8d3 req-3512a819-b739-4f2a-b86e-0c86bd3f4521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c665a-386f-428e-968e-5e6a80f47379", "name": "network-vif-deleted", "tag": "39cb0a5f-0af0-4194-a784-a84588ad079b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:58.208262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8239d309-639a-47bb-a36a-d338befad8d3 req-3512a819-b739-4f2a-b86e-0c86bd3f4521 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.209486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-8239d309-639a-47bb-a36a-d338befad8d3 req-3512a819-b739-4f2a-b86e-0c86bd3f4521 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.225646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:58.256276 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-8239d309-639a-47bb-a36a-d338befad8d3 req-3512a819-b739-4f2a-b86e-0c86bd3f4521 service nova] Creating event network-vif-deleted:39cb0a5f-0af0-4194-a784-a84588ad079b for instance c74c665a-386f-428e-968e-5e6a80f47379 on n-h1-850003-3 Jul 18 13:23:58.277727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:58.289807 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-8239d309-639a-47bb-a36a-d338befad8d3 req-3512a819-b739-4f2a-b86e-0c86bd3f4521 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145283 Jul 18 13:23:58.296117 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2670/5137] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:58.319698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:58.325006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:58.331143 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-818b2601-a314-47d6-87ab-ce450890e344 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 2.097554 Jul 18 13:23:58.331376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-660d9f19-c318-4eb1-8159-58d08e22609c req-560084de-6bcf-4667-9421-4ef6fd2002c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:23:58.336061 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2468/5138] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:56 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:23:58.383144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-660d9f19-c318-4eb1-8159-58d08e22609c req-560084de-6bcf-4667-9421-4ef6fd2002c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.385240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-660d9f19-c318-4eb1-8159-58d08e22609c req-560084de-6bcf-4667-9421-4ef6fd2002c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.443965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:58.445470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:58.475481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-660d9f19-c318-4eb1-8159-58d08e22609c req-560084de-6bcf-4667-9421-4ef6fd2002c3 service nova] Creating event network-changed:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:23:58.483851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.484654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.486184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.487042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.505545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-660d9f19-c318-4eb1-8159-58d08e22609c req-560084de-6bcf-4667-9421-4ef6fd2002c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205835 Jul 18 13:23:58.507320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2671/5139] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:23:58.660375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:23:58.807975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:58.809276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:58.821395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:58.864598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.872386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.875064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:58.891439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:58.959996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e79ba31c-edb0-4139-91e0-23d59d6ec721 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 204 len: 0 microversion: 2.1 time: 0.527812 Jul 18 13:23:58.972204 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2469/5140] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:23:58 2022] DELETE /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:23:58.998435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:59.001242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:59.013930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:59.044568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.056014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:59.058091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.068490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:59.665618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:23:59.685873 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7145a26f-1c86-4126-b41c-adef5b3f67f7 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1522 microversion: 2.1 time: 0.886458 Jul 18 13:23:59.690625 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2672/5141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:58 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:23:59.724203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:59.725246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] [instance: c74c665a-386f-428e-968e-5e6a80f47379] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:59.757956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.758749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:59.760096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.760803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:59.809112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:23:59.871825 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] HTTP exception thrown: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Request method failure captured: Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 HTTP/1.1 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V6v8j8DT5KQtdRCcD-MsvEZVpQS5SnwsB62aNOq4FTKCZ5LupDqqKTnizZS10brpdW_VWyhLuAETWf98CchYc7JNafWvoxEWvzxufAHFk1F9kzOO4hJI1oKWZk6dtB2Gzh_0uLzkou1RaF_jSVuLmnnhL-oIxtauetu1gohbm5fufs Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: b519b4665afa41beb8c4f942dae4cebf Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1547872550 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b519b4665afa41beb8c4f942dae4cebf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b519b4665afa41beb8c4f942dae4cebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b519b4665afa41beb8c4f942dae4cebf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b519b4665afa41beb8c4f942dae4cebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1547872550 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: b519b4665afa41beb8c4f942dae4cebf Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1547872550 Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1547872550-project Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 5cb6fbe4f7b24c5aada163256cef253d Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1547872550-project Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c74c665a-386f-428e-968e-5e6a80f47379'} Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:59.875210 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] Returning 404 to user: Instance c74c665a-386f-428e-968e-5e6a80f47379 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:23:59.881048 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c1384e3-dcf2-4d06-bbe6-bc542aec5764 tempest-ServersNegativeTestMultiTenantJSON-1547872550 tempest-ServersNegativeTestMultiTenantJSON-1547872550-project] 10.222.0.88 "GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379" status: 404 len: 111 microversion: 2.1 time: 0.181915 Jul 18 13:23:59.890950 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2673/5142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:59 2022] GET /compute/v2.1/servers/c74c665a-386f-428e-968e-5e6a80f47379 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:23:59.913740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:23:59.914874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:23:59.939737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.940528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:23:59.942072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:23:59.942887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:00.621722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:00.655856 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2379daf-40ab-476c-b1f9-81af797aaedd tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1515 microversion: 2.1 time: 1.678346 Jul 18 13:24:00.676481 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2470/5143] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:23:58 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1515 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:00.724962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4e92247d-70e9-4766-a076-2b7e9ca5e361 req-d7a74ceb-1817-4014-9fdf-5af3d27961a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:00.772388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4e92247d-70e9-4766-a076-2b7e9ca5e361 req-d7a74ceb-1817-4014-9fdf-5af3d27961a8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:00.776063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4e92247d-70e9-4766-a076-2b7e9ca5e361 req-d7a74ceb-1817-4014-9fdf-5af3d27961a8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:00.842635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4e92247d-70e9-4766-a076-2b7e9ca5e361 req-d7a74ceb-1817-4014-9fdf-5af3d27961a8 service nova] Creating event network-changed:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h2-850003-3 Jul 18 13:24:00.863687 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4e92247d-70e9-4766-a076-2b7e9ca5e361 req-d7a74ceb-1817-4014-9fdf-5af3d27961a8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180636 Jul 18 13:24:00.865974 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2471/5144] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:00.879428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9d2e063c-b6ba-4fb0-aa85-086be56d2ed1 req-d4de4744-e225-4a07-a3a2-3d047d6a4ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:00.916573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9d2e063c-b6ba-4fb0-aa85-086be56d2ed1 req-d4de4744-e225-4a07-a3a2-3d047d6a4ad2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:00.917665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9d2e063c-b6ba-4fb0-aa85-086be56d2ed1 req-d4de4744-e225-4a07-a3a2-3d047d6a4ad2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:00.952163 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9d2e063c-b6ba-4fb0-aa85-086be56d2ed1 req-d4de4744-e225-4a07-a3a2-3d047d6a4ad2 service nova] Creating event network-changed:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:24:00.964182 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9d2e063c-b6ba-4fb0-aa85-086be56d2ed1 req-d4de4744-e225-4a07-a3a2-3d047d6a4ad2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092923 Jul 18 13:24:00.966247 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2472/5145] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:00.979301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:00.981892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:01.001253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:01.002664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:01.004490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:01.006872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:01.833314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:01.873527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-934f3ef6-a2cb-45db-80bb-d71f442ef09e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1502 microversion: 2.1 time: 0.900828 Jul 18 13:24:01.877917 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2473/5146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:00 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1502 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:01.903258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:01.904654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:01.915963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:01.917370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:01.919262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:01.920212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:02.447188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:02.486565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:02.490778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:02.493577 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d8e6af81-fe07-4921-8363-7f5c12176dd3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 2.600926 Jul 18 13:24:02.517785 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2674/5147] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:23:59 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:24:02.528709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8db5a551-ab37-4989-b408-5044bf47ae8b tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'create', calling method: .version_select at 0x7f96d7a21160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-779953573", "description": "tempest-description-1330331245"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:03.142637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:03.182743 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-539e6a8b-fd54-4f3b-92b3-275c7a125b93 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1515 microversion: 2.1 time: 1.299461 Jul 18 13:24:03.184544 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2474/5148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:01 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1515 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:03.274555 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8db5a551-ab37-4989-b408-5044bf47ae8b tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.752524 Jul 18 13:24:03.294920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-779953573"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:03.295907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2675/5149] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 18 13:24:02 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:03.297243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:03.316904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:03.318300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:03.323990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:03.325221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:03.530036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:03.532017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:03.563624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:03.571899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:03.573826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:03.575134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:03.971859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Adding security group a29cd917-dbcb-4435-ba50-3aa782ef7775 to port a284bd2c-a67b-4ba9-86de-5fa825d08cff Jul 18 13:24:04.302328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:04.332484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:04.344557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:04.347777 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d561a02-73a4-4f24-b790-84e6ea0fa26f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 0.824122 Jul 18 13:24:04.349077 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2676/5150] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:03 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:24:04.371112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:04.372594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:04.397648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:04.398590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:04.400092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:04.401056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:05.102711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:05.123532 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8beaa06-cc54-468a-bca4-388a2eaa91e6 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1515 microversion: 2.1 time: 0.760549 Jul 18 13:24:05.138251 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2677/5151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:04 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1515 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:05.381333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:05.383427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:05.397865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:05.400214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:05.402342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:05.403422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:06.549479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:06.598056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:06.609231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:06.613453 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dad1dd6d-2f7a-41a3-831c-34b7945fd0a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 1.247587 Jul 18 13:24:06.618573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2678/5152] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:05 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:24:06.639634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6afaed79-f3db-4754-8ced-70c9a932e397 req-39ffaa93-301a-4762-8b77-062f4124ac63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92285a-f4a5-4038-b73a-83276df73f9b", "name": "network-vif-deleted", "tag": "1efd7bc5-682e-4ddc-b66c-948348b61bf0"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:06.678025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6afaed79-f3db-4754-8ced-70c9a932e397 req-39ffaa93-301a-4762-8b77-062f4124ac63 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:06.680734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6afaed79-f3db-4754-8ced-70c9a932e397 req-39ffaa93-301a-4762-8b77-062f4124ac63 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:06.718036 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6afaed79-f3db-4754-8ced-70c9a932e397 req-39ffaa93-301a-4762-8b77-062f4124ac63 service nova] Creating event network-vif-deleted:1efd7bc5-682e-4ddc-b66c-948348b61bf0 for instance ad92285a-f4a5-4038-b73a-83276df73f9b on n-h1-850003-3 Jul 18 13:24:06.730109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6afaed79-f3db-4754-8ced-70c9a932e397 req-39ffaa93-301a-4762-8b77-062f4124ac63 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109296 Jul 18 13:24:06.743036 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2679/5153] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:06.750798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:06.752252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:06.768381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:06.769195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:06.771315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:06.775310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:06.880357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:06.885749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:06.886986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lazy-loading 'fault' on Instance uuid ad92285a-f4a5-4038-b73a-83276df73f9b {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:24:07.100380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15fc70a08b8742b39cc0fbdf62ccd8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cb301c1df8416fbfa30433dc1b8cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:07.107782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2f972b8-2687-4eaa-9df9-0c3fa01f768a tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 200 len: 1309 microversion: 2.1 time: 0.362954 Jul 18 13:24:07.111804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2680/5154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:06 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:07.649066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:07.660796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:07.672064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:07.672612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:07.679543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:07.685238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:08.002745 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-164e7904-ac5f-446b-987c-866e5145960f tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action" status: 202 len: 0 microversion: 2.1 time: 4.714463 Jul 18 13:24:08.010852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2475/5155] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:03 2022] POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action => generated 0 bytes in 4725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:24:08.039876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-779953573"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:08.048540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:08.100854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:08.104315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:08.105396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:08.106049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:08.388450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:08.414330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:08.424070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:08.430036 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-234c7d8e-f002-4c63-bcbe-a06abac4b466 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 0.787374 Jul 18 13:24:08.436700 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2681/5156] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:07 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:24:08.456009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:08.459193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] [instance: ad92285a-f4a5-4038-b73a-83276df73f9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:08.497039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:08.499882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:08.502901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:08.506950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:08.563842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] HTTP exception thrown: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Request method failure captured: Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b HTTP/1.1 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V1azavtGkZVgeisX5uw14PQM1j3cLcDyF-9AtrdI3KBGPIgGpQIVH2CADbIGHo1VAf6Z6jl549HMW6NzmXvDMJMj1NwGHx2qF5Qov2MNtMgrjDUes73Mbqi4wfbFjBZCd5hWAvcCev1HhDLNKN3rTEs4_ocYgCZeHOBIb08MaQYWno Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a3cb301c1df8416fbfa30433dc1b8cfe Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a3cb301c1df8416fbfa30433dc1b8cfe", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a3cb301c1df8416fbfa30433dc1b8cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a3cb301c1df8416fbfa30433dc1b8cfe Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1133961259 Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesSnapshotTestJSON-1133961259-project Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 15fc70a08b8742b39cc0fbdf62ccd8ba Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesSnapshotTestJSON-1133961259-project Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ad92285a-f4a5-4038-b73a-83276df73f9b'} Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:08.568106 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. Jul 18 13:24:08.577128 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:08.581758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] Returning 404 to user: Instance ad92285a-f4a5-4038-b73a-83276df73f9b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:24:08.585887 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16e225b5-8572-47d4-ab30-d6d3b7a10c91 tempest-VolumesSnapshotTestJSON-1133961259 tempest-VolumesSnapshotTestJSON-1133961259-project] 10.222.0.88 "GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b" status: 404 len: 111 microversion: 2.1 time: 0.147292 Jul 18 13:24:08.593343 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2682/5157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:08 2022] GET /compute/v2.1/servers/ad92285a-f4a5-4038-b73a-83276df73f9b => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:24:08.689499 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Removing security group a29cd917-dbcb-4435-ba50-3aa782ef7775 from port a284bd2c-a67b-4ba9-86de-5fa825d08cff Jul 18 13:24:09.471696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:09.476144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:09.501434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:09.504679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:09.515427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:09.516596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:10.015698 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b9c5608-e433-4cbc-b5ac-6e971ef00389 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action" status: 202 len: 0 microversion: 2.1 time: 1.998732 Jul 18 13:24:10.017165 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2476/5158] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:08 2022] POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action => generated 0 bytes in 2002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:24:10.031918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a3c2892c-56e5-45f9-93c3-f73eda4f9941 req-0f68fd5c-827b-4128-b3aa-0724b248235c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:10.064607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a3c2892c-56e5-45f9-93c3-f73eda4f9941 req-0f68fd5c-827b-4128-b3aa-0724b248235c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:10.067233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a3c2892c-56e5-45f9-93c3-f73eda4f9941 req-0f68fd5c-827b-4128-b3aa-0724b248235c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:10.114023 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a3c2892c-56e5-45f9-93c3-f73eda4f9941 req-0f68fd5c-827b-4128-b3aa-0724b248235c service nova] Creating event network-changed:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:24:10.126792 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a3c2892c-56e5-45f9-93c3-f73eda4f9941 req-0f68fd5c-827b-4128-b3aa-0724b248235c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106879 Jul 18 13:24:10.128815 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2477/5159] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:10.159403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fadede4-f00c-453d-b6aa-7659755d6fc1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'create', calling method: .version_select at 0x7f96d748cd30>, body: {"pool": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:11.055627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:11.085454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:11.087930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:11.101164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3cddcde-9e52-4212-84e4-6fc159cbbb04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 1.639122 Jul 18 13:24:11.114242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2683/5160] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:09 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:24:11.575770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a98d528b-b63e-4bf5-b971-a3c2ad5157a8 req-b0c5dc3e-c474-41f2-bc81-e23cdd81f90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "name": "network-vif-plugged", "status": "completed", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:11.634253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a98d528b-b63e-4bf5-b971-a3c2ad5157a8 req-b0c5dc3e-c474-41f2-bc81-e23cdd81f90c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:11.662299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a98d528b-b63e-4bf5-b971-a3c2ad5157a8 req-b0c5dc3e-c474-41f2-bc81-e23cdd81f90c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:11.751850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a98d528b-b63e-4bf5-b971-a3c2ad5157a8 req-b0c5dc3e-c474-41f2-bc81-e23cdd81f90c service nova] Creating event network-vif-plugged:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h2-850003-3 Jul 18 13:24:11.777374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a98d528b-b63e-4bf5-b971-a3c2ad5157a8 req-b0c5dc3e-c474-41f2-bc81-e23cdd81f90c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215733 Jul 18 13:24:11.787292 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2684/5161] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:12.132294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:12.135132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:12.187222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:12.188748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:12.193248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:12.194949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:12.797441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:12.808336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:12.810532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:12.812509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e93e979f-1ef4-4a5f-92f2-2fabe3beff7d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 0.691537 Jul 18 13:24:12.813192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2685/5162] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:12 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:24:12.829437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a50f086b-7246-41fb-95fa-a86e8c3cb479 req-6d3256d8-4334-473c-83c9-5b52903c1794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:12.852566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a50f086b-7246-41fb-95fa-a86e8c3cb479 req-6d3256d8-4334-473c-83c9-5b52903c1794 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:12.853584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a50f086b-7246-41fb-95fa-a86e8c3cb479 req-6d3256d8-4334-473c-83c9-5b52903c1794 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:12.879634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a50f086b-7246-41fb-95fa-a86e8c3cb479 req-6d3256d8-4334-473c-83c9-5b52903c1794 service nova] Creating event network-changed:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:24:12.888850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a50f086b-7246-41fb-95fa-a86e8c3cb479 req-6d3256d8-4334-473c-83c9-5b52903c1794 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072391 Jul 18 13:24:12.890649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2686/5163] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:13.860386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:13.868471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:13.895027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:13.895896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:13.897015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:13.897667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:14.497797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:14.517619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:14.521149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:14.523915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f69525d-46b7-4348-b2d1-90d2eb5236ed tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1407 microversion: 2.20 time: 0.680827 Jul 18 13:24:14.525066 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2687/5164] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:13 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1407 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:24:15.564751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:15.569823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:15.594244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:15.595534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:15.597991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:15.599066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:15.884723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:15.899522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:15.902018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:15.904607 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b21b8f88-1008-4296-b59f-82e93ae0f423 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1597 microversion: 2.20 time: 0.350076 Jul 18 13:24:15.905988 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2688/5165] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:24:15 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1597 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:24:15.938241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:15.939586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:15.964483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:15.965836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:15.973851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:15.975820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:16.040958 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7fadede4-f00c-453d-b6aa-7659755d6fc1 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.909415 Jul 18 13:24:16.042628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2478/5166] 10.222.0.88 () {60 vars in 1169 bytes} [Mon Jul 18 13:24:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:16.066293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.185"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:16.074596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:16.097454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:16.098489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:16.100273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:16.101610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:16.214723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Acquired lock "refresh_cache-10e11bb9-4af9-40c6-bef5-647319818997" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:24:16.297327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dc8eb7ff-5290-48bc-9133-6e089ed218c3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.365301 Jul 18 13:24:16.298823 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2689/5167] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:24:15 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:24:19.474536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-aa53d09e-176b-4c55-8aff-9e042e743c1c req-f0b9b34c-bd91-4bf0-bdc2-50492ffd3e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:19.515299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa53d09e-176b-4c55-8aff-9e042e743c1c req-f0b9b34c-bd91-4bf0-bdc2-50492ffd3e6c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:19.516022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-aa53d09e-176b-4c55-8aff-9e042e743c1c req-f0b9b34c-bd91-4bf0-bdc2-50492ffd3e6c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:19.597273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-aa53d09e-176b-4c55-8aff-9e042e743c1c req-f0b9b34c-bd91-4bf0-bdc2-50492ffd3e6c service nova] Creating event network-changed:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h2-850003-3 Jul 18 13:24:19.623814 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-aa53d09e-176b-4c55-8aff-9e042e743c1c req-f0b9b34c-bd91-4bf0-bdc2-50492ffd3e6c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154204 Jul 18 13:24:19.625440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2690/5168] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:23.256827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Building network info cache for instance {{(pid=131367) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:24:23.291461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-418c2aad-bc0e-4da9-980d-df809c10fe9d req-90870e16-413e-461f-a663-907b34477aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:23.335701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-418c2aad-bc0e-4da9-980d-df809c10fe9d req-90870e16-413e-461f-a663-907b34477aa0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:23.336530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-418c2aad-bc0e-4da9-980d-df809c10fe9d req-90870e16-413e-461f-a663-907b34477aa0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:23.405589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-418c2aad-bc0e-4da9-980d-df809c10fe9d req-90870e16-413e-461f-a663-907b34477aa0 service nova] Creating event network-changed:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:24:23.437117 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-418c2aad-bc0e-4da9-980d-df809c10fe9d req-90870e16-413e-461f-a663-907b34477aa0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154045 Jul 18 13:24:23.444199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2691/5169] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:26.095289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:26.970773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Updating instance_info_cache with network_info: [{"id": "a284bd2c-a67b-4ba9-86de-5fa825d08cff", "address": "fa:16:3e:0e:05:dc", "network": {"id": "c452aeea-1658-4d55-8746-e23496193d28", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1710624618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a95ce8db3824a759145745200be6d95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa284bd2c-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131367) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:24:27.001272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Releasing lock "refresh_cache-10e11bb9-4af9-40c6-bef5-647319818997" {{(pid=131367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:24:27.009481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ac72dd3e-86f8-41d4-b13a-35214632d4a8 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action" status: 202 len: 0 microversion: 2.1 time: 10.954087 Jul 18 13:24:27.015810 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2479/5170] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:16 2022] POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action => generated 0 bytes in 10963 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 13:24:27.027482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.185"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:29.012866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:29.042635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=58 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:29.101855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:29.102723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:29.103842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:29.105396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:29.136781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=89 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:30.392665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Acquired lock "refresh_cache-10e11bb9-4af9-40c6-bef5-647319818997" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 13:24:34.367347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Building network info cache for instance {{(pid=131366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 13:24:34.390822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5d9256bb-7b36-4ece-85ba-8f0d28b90b13 req-f0c4c183-6c95-406a-b510-2b7831ed6913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:34.513097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5d9256bb-7b36-4ece-85ba-8f0d28b90b13 req-f0c4c183-6c95-406a-b510-2b7831ed6913 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:34.517227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5d9256bb-7b36-4ece-85ba-8f0d28b90b13 req-f0c4c183-6c95-406a-b510-2b7831ed6913 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:34.597377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:34.641175 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5d9256bb-7b36-4ece-85ba-8f0d28b90b13 req-f0c4c183-6c95-406a-b510-2b7831ed6913 service nova] Creating event network-changed:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:24:34.710466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5d9256bb-7b36-4ece-85ba-8f0d28b90b13 req-f0c4c183-6c95-406a-b510-2b7831ed6913 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331541 Jul 18 13:24:34.718246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2480/5171] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:37.518620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Updating instance_info_cache with network_info: [{"id": "a284bd2c-a67b-4ba9-86de-5fa825d08cff", "address": "fa:16:3e:0e:05:dc", "network": {"id": "c452aeea-1658-4d55-8746-e23496193d28", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1710624618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a95ce8db3824a759145745200be6d95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa284bd2c-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 13:24:37.545348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Releasing lock "refresh_cache-10e11bb9-4af9-40c6-bef5-647319818997" {{(pid=131366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 13:24:37.549628 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-47001562-a8de-45cd-a26e-01e639656642 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action" status: 202 len: 0 microversion: 2.1 time: 10.528900 Jul 18 13:24:37.567667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fde29edc-ed1b-4166-8e85-19a9f8d2d2bb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '.version_select at 0x7f96d7a26430>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:37.571112 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2692/5172] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:27 2022] POST /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997/action => generated 0 bytes in 10552 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 13:24:39.853727 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fde29edc-ed1b-4166-8e85-19a9f8d2d2bb tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/1b2841c1-455b-443c-93f8-d8f643994726" status: 202 len: 0 microversion: 2.1 time: 2.293780 Jul 18 13:24:39.860673 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2481/5173] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:24:37 2022] DELETE /compute/v2.1/os-floating-ips/1b2841c1-455b-443c-93f8-d8f643994726 => generated 0 bytes in 2302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:24:39.868374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73ce31b2-bceb-4c49-90d3-63b42dd877d6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '.version_select at 0x7f96e417d310>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:39.879578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:40.614095 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73ce31b2-bceb-4c49-90d3-63b42dd877d6 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a29cd917-dbcb-4435-ba50-3aa782ef7775" status: 202 len: 0 microversion: 2.1 time: 0.750519 Jul 18 13:24:40.615563 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2693/5174] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 13:24:39 2022] DELETE /compute/v2.1/os-security-groups/a29cd917-dbcb-4435-ba50-3aa782ef7775 => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:24:40.633299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:40.636272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:40.664303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:40.665677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:40.667716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:40.669068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:40.788147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:24:40.944306 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-694d4d62-1bb9-4006-8ed5-7c59c36c8c22 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "DELETE /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 204 len: 0 microversion: 2.1 time: 0.315567 Jul 18 13:24:40.946884 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2482/5175] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:24:40 2022] DELETE /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:24:40.962255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:40.965110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:40.980759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:40.980759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:40.980759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:40.981214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:41.248685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:41.264930 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de9bd22c-ed12-42ec-b8c9-94695787038e tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1508 microversion: 2.1 time: 0.313098 Jul 18 13:24:41.271195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2694/5176] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:40 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:42.296125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:42.299254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:42.315777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:42.316680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:42.318509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:42.320305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:43.131570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:43.160583 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1eb37957-c62d-4c72-915a-7395e04d138a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1508 microversion: 2.1 time: 0.873369 Jul 18 13:24:43.162623 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2483/5177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:42 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1508 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:44.187024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:44.190110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:44.219053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:44.220066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:44.223767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:44.224972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:45.206587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:45.209633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:45.266075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:45.268226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:45.273531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:45.276552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:45.324739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:45.337461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ed814b4-81d9-4279-a7d8-4f472479161c tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1508 microversion: 2.1 time: 1.160200 Jul 18 13:24:45.338999 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2695/5178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:44 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1508 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:24:45.484728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'services' on Instance uuid 40554a05-109e-43f5-a1f8-da040e18915f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:24:45.687127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fecccbc-26d2-43d1-a389-905b7ab8cd07 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments/3ab95b6b-0fb5-463e-83ad-48bd3886c9c2" status: 202 len: 0 microversion: 2.1 time: 0.496502 Jul 18 13:24:45.689849 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2484/5179] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:24:45 2022] DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments/3ab95b6b-0fb5-463e-83ad-48bd3886c9c2 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:24:45.698410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:45.699927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:45.714192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:45.714757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:45.715701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:45.716147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:45.805268 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c52bfa6-3433-4b29-9452-121edceef01c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110227 Jul 18 13:24:45.807105 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2696/5180] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:45 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:46.358119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:46.358886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:46.381229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:46.384790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:46.387189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:46.387958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:46.730353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:46.757541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc5499df-2f67-4dfd-a9d6-f52354f918ae tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1466 microversion: 2.1 time: 0.403991 Jul 18 13:24:46.763719 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2485/5181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:46 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1466 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:24:46.828608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:46.829189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9a9886c9-f7e3-4969-a595-6bbfe283b3bc req-d5d39beb-34b4-45d5-8405-67fb129789aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e11bb9-4af9-40c6-bef5-647319818997", "name": "network-vif-deleted", "tag": "a284bd2c-a67b-4ba9-86de-5fa825d08cff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:46.844288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:46.884291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:46.887856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:46.890176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9a9886c9-f7e3-4969-a595-6bbfe283b3bc req-d5d39beb-34b4-45d5-8405-67fb129789aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:46.891167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:46.891542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9a9886c9-f7e3-4969-a595-6bbfe283b3bc req-d5d39beb-34b4-45d5-8405-67fb129789aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:46.893143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:46.922221 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9a9886c9-f7e3-4969-a595-6bbfe283b3bc req-d5d39beb-34b4-45d5-8405-67fb129789aa service nova] Creating event network-vif-deleted:a284bd2c-a67b-4ba9-86de-5fa825d08cff for instance 10e11bb9-4af9-40c6-bef5-647319818997 on n-h2-850003-3 Jul 18 13:24:46.940675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9a9886c9-f7e3-4969-a595-6bbfe283b3bc req-d5d39beb-34b4-45d5-8405-67fb129789aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132684 Jul 18 13:24:46.957856 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2697/5182] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:46.996409 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd38039c-2b38-4a26-b9cc-651534a6a10a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181389 Jul 18 13:24:46.997733 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2486/5183] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:46 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:47.797308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:47.798928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:47.847309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:47.858697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:47.865267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:47.873596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:48.021360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:48.026476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:48.062605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:48.065174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:48.069594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:48.074066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:48.129753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:48.131646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:48.132550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lazy-loading 'fault' on Instance uuid 10e11bb9-4af9-40c6-bef5-647319818997 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:24:48.181367 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6735af6-4ade-4ab2-a217-c18679c5475b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171754 Jul 18 13:24:48.194905 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2487/5184] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:48 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:48.306062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd643dcff9fc94fae8d68e9a58cb95f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a95ce8db3824a759145745200be6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:48.337169 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0378c521-724b-4331-b721-1e97342b9a52 tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 200 len: 1311 microversion: 2.1 time: 0.548628 Jul 18 13:24:48.342795 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2698/5185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:47 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 1311 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:24:49.210078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:49.212566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:49.236489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:49.239109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:49.244835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:49.245505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:49.363171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:49.364391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] [instance: 10e11bb9-4af9-40c6-bef5-647319818997] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:49.380946 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8b12b694-169e-4883-9265-9b813a41ec48 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180429 Jul 18 13:24:49.384446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:49.386646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:49.387385 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2488/5186] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:49 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:49.393262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:49.394068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:49.424530 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] HTTP exception thrown: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Request method failure captured: Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 HTTP/1.1 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V6jZmiDIj4UdU32_wE_4j8lW8arD7qr8PFpJx-cM2vRjS2WM9dTOwk4xFkB5KN7N4d5U6oMim2JsivYLsnbe-pYCu1c3CtMIBajbUXG5BMr0tpHQqcGXUDb_INUvf6VeDQzID_5HhTMQSAzEGM-o95FGf2QtwenRTC7S8qXNiFIMfY Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0a95ce8db3824a759145745200be6d95 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1066951844 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0a95ce8db3824a759145745200be6d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0a95ce8db3824a759145745200be6d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0a95ce8db3824a759145745200be6d95", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0a95ce8db3824a759145745200be6d95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1066951844 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0a95ce8db3824a759145745200be6d95 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1066951844 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueTestJSONUnderV235-1066951844-project Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: d643dcff9fc94fae8d68e9a58cb95f52 Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1066951844-project Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '10e11bb9-4af9-40c6-bef5-647319818997'} Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:49.426181 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] Returning 404 to user: Instance 10e11bb9-4af9-40c6-bef5-647319818997 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:24:49.434546 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56977166-a3b0-408c-8991-7ae4b1481c5a tempest-ServerRescueTestJSONUnderV235-1066951844 tempest-ServerRescueTestJSONUnderV235-1066951844-project] 10.222.0.88 "GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997" status: 404 len: 111 microversion: 2.1 time: 0.069412 Jul 18 13:24:49.438375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2699/5187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:49 2022] GET /compute/v2.1/servers/10e11bb9-4af9-40c6-bef5-647319818997 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:24:50.401029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:50.403375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:50.426209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:50.426948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:50.427951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:50.428630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:50.543547 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45376687-c0d6-4444-b69f-b2624a7e0ae3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147610 Jul 18 13:24:50.549127 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2489/5188] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:50 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:51.561152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:51.563649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:51.614590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:51.619494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:51.622385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:51.624032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:51.763672 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c248ed22-82ec-4406-8a6d-f21d96483ea3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210821 Jul 18 13:24:51.771648 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2700/5189] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:51 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:52.779651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:52.781257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:52.799932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:52.810641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:52.815200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:52.820625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:52.944298 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3339502-ce79-42ec-9b93-5c0227ee41fd tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168885 Jul 18 13:24:52.948928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2490/5190] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:52 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:53.958993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:53.963165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:54.015270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:54.020051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:54.024303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:54.028586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:54.192820 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6dc6bc0d-154f-4c08-ba01-4f376d466f88 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.237624 Jul 18 13:24:54.197224 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2701/5191] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:53 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:24:55.209172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:55.211055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:55.243819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:55.244691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:55.246855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:55.254953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:55.392757 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f795b310-88db-4ef6-bfe8-1f9be22908f0 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178897 Jul 18 13:24:55.403477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2491/5192] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:55 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:24:56.419923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:56.420893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:56.441205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:56.441964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:56.443067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:56.443531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.422761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f729bf1-84c6-4524-a96b-29ed77b27b5b tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 1.008571 Jul 18 13:24:57.425126 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2702/5193] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:24:56 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f/os-volume_attachments => generated 25 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:24:57.530384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:57.533083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:57.543306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:24:57.546137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.547291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.549453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.550538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.583188 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Cannot 'reboot' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action HTTP/1.1 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 28 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: {"reboot": {"type": "HARD"}} Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: exception: Cannot 'reboot' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a7e3f93c-c3f1-41a7-bddd-b09fa7303659', 'body': {'reboot': {'type': 'HARD'}}} Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:24:57.585161 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 409 to user: Cannot 'reboot' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:24:57.597384 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3ad2c24-ace3-4c12-8c20-e6b1b1e96b9a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action" status: 409 len: 145 microversion: 2.1 time: 0.063775 Jul 18 13:24:57.604386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2492/5194] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:57 2022] POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action => generated 145 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:24:57.613324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:24:57.618035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:57.632134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.633045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.634646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.635441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.706938 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Cannot 'rebuild' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action HTTP/1.1 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 65 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: exception: Cannot 'rebuild' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a7e3f93c-c3f1-41a7-bddd-b09fa7303659', 'body': {'rebuild': {'imageRef': 'df1d514c-8a50-4216-9a84-c81f6f685344'}}} Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:24:57.708383 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued Jul 18 13:24:57.720538 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:24:57.723970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 409 to user: Cannot 'rebuild' instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 while it is in vm_state rescued {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:24:57.734123 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21e3bcec-b387-481a-bd11-00e8d48c42fa tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action" status: 409 len: 146 microversion: 2.1 time: 0.127256 Jul 18 13:24:57.738448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2703/5195] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:24:57 2022] POST /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 13:24:57.750039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:57.750613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:57.775834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.777899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.779574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:57.780339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:57.882066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:24:58.250083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-473483cd-2d56-42b6-85ab-824528b25240 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 204 len: 0 microversion: 2.1 time: 0.500973 Jul 18 13:24:58.251457 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2493/5196] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:24:57 2022] DELETE /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:24:58.265080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:24:58.266855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:24:58.296404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:58.297060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:58.298481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:24:58.299701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:24:58.932439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:24:58.972432 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0fd943a-a104-44bf-9e6a-66ac024a8e49 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1690 microversion: 2.1 time: 0.712538 Jul 18 13:24:58.974203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2704/5197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:58 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1690 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:00.007420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:00.009181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:00.024659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:00.025641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:00.027131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:00.027986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:00.354898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:00.358885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:00.377188 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4c0fc10-3bd5-4c78-8b4b-708379031728 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1690 microversion: 2.1 time: 0.376863 Jul 18 13:25:00.393835 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2494/5198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:24:59 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1690 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:01.414381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:01.415809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:01.427485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:01.428623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:01.430208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:01.431244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:01.439923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=66,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:01.655139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:01.665888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b04d4cd-cd5d-48e8-8f8f-4fcf68e75de2 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1690 microversion: 2.1 time: 0.255510 Jul 18 13:25:01.666705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2705/5199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:01 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:02.690197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:02.692270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:02.709678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:02.710981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:02.712761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:02.713875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:02.995205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:03.021155 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5bfbd3c1-9493-498a-be27-f0549b33ed77 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1690 microversion: 2.1 time: 0.338585 Jul 18 13:25:03.024113 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2495/5200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:02 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1690 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:04.053315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:04.055276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:04.068942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:04.077451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:04.078738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:04.080483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:04.495695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:04.511987 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4ff8bdd2-af2c-4679-8fbf-3d4c16d5a60a tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1690 microversion: 2.1 time: 0.463566 Jul 18 13:25:04.526183 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2706/5201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:04 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1690 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:05.225795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8ae97c47-7566-4cc4-979d-de1a17f92b00 req-b8b2b299-8c6a-4189-844a-988b1b77e057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40554a05-109e-43f5-a1f8-da040e18915f", "name": "network-vif-deleted", "tag": "48d61612-ef2b-4b6c-b8e7-3584bf8a5f26"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:05.243281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8ae97c47-7566-4cc4-979d-de1a17f92b00 req-b8b2b299-8c6a-4189-844a-988b1b77e057 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:05.243946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8ae97c47-7566-4cc4-979d-de1a17f92b00 req-b8b2b299-8c6a-4189-844a-988b1b77e057 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:05.265271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8ae97c47-7566-4cc4-979d-de1a17f92b00 req-b8b2b299-8c6a-4189-844a-988b1b77e057 service nova] Creating event network-vif-deleted:48d61612-ef2b-4b6c-b8e7-3584bf8a5f26 for instance 40554a05-109e-43f5-a1f8-da040e18915f on n-h2-850003-3 Jul 18 13:25:05.287543 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8ae97c47-7566-4cc4-979d-de1a17f92b00 req-b8b2b299-8c6a-4189-844a-988b1b77e057 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071270 Jul 18 13:25:05.299080 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2496/5202] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:25:05.534211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:05.535702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:05.556664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:05.558068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:05.561215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:05.565801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:05.787258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:05.787787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:05.789090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lazy-loading 'fault' on Instance uuid 40554a05-109e-43f5-a1f8-da040e18915f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:25:05.981208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:05.992972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c2f3580-25f4-4fc2-bb5f-dccb3ff29100 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 200 len: 1336 microversion: 2.1 time: 0.464478 Jul 18 13:25:05.993615 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2707/5203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:05 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 1336 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:25:07.018636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:07.019409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 40554a05-109e-43f5-a1f8-da040e18915f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:07.041676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:07.054525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:07.059494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:07.064808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:07.141396 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f HTTP/1.1 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '40554a05-109e-43f5-a1f8-da040e18915f'} Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.158168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. Jul 18 13:25:07.163056 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.191282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 404 to user: Instance 40554a05-109e-43f5-a1f8-da040e18915f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:07.194473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0141a4bf-5fbf-43d3-b580-554121673301 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f" status: 404 len: 111 microversion: 2.1 time: 0.181572 Jul 18 13:25:07.199718 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2708/5204] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:07 2022] GET /compute/v2.1/servers/40554a05-109e-43f5-a1f8-da040e18915f => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:25:07.224006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6fe81e26-a0c0-44a6-9f68-ed04225d240e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '.version_select at 0x7f96e4c3c820>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:07.305353 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6fe81e26-a0c0-44a6-9f68-ed04225d240e tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087719207" status: 202 len: 0 microversion: 2.1 time: 0.098496 Jul 18 13:25:07.320760 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2709/5205] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087719207 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:25:07.695963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c76895b-6ae7-4c24-974a-804ab8f977d0 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Action: 'create', calling method: .version_select at 0x7f96e9acc280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-879471561", "metadata": {"Type": "work"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c76895b-6ae7-4c24-974a-804ab8f977d0 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 121 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-879471561", "metadata": {"Type": "work"}}} Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-879471561', 'metadata': {'Type': 'work'}}}} Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:25:07.702662 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 13:25:07.709107 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.713619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c76895b-6ae7-4c24-974a-804ab8f977d0 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:07.713619 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c76895b-6ae7-4c24-974a-804ab8f977d0 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.144296 Jul 18 13:25:07.714469 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2497/5206] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 13:25:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 13:25:07.727958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f3f7b07-9a3f-4a4a-a17f-f4d18b69376a tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Action: 'create', calling method: .version_select at 0x7f96e99d55e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-976467589", "metadata": {"Type": "work"}}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f3f7b07-9a3f-4a4a-a17f-f4d18b69376a tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 119 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-976467589", "metadata": {"Type": "work"}}} Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-976467589', 'metadata': {'Type': 'work'}}}} Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi '0' Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:25:07.731842 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f3f7b07-9a3f-4a4a-a17f-f4d18b69376a tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:07.737937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f3f7b07-9a3f-4a4a-a17f-f4d18b69376a tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014633 Jul 18 13:25:07.738887 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2710/5207] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 13:25:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:25:07.750415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a355bf8d-8726-46bd-85e0-85b15b8c1958 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Action: 'create', calling method: .version_select at 0x7f96e4e0c160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-518102254", "metadata": {"Type": "work"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a355bf8d-8726-46bd-85e0-85b15b8c1958 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 118 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-518102254", "metadata": {"Type": "work"}}} Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-518102254', 'metadata': {'Type': 'work'}}}} Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise error Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi '' Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 13:25:07.754142 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 13:25:07.760171 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.762954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a355bf8d-8726-46bd-85e0-85b15b8c1958 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:07.764033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a355bf8d-8726-46bd-85e0-85b15b8c1958 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020456 Jul 18 13:25:07.765204 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2498/5208] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 13:25:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:25:07.775788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dfd1551-08f0-4480-baef-504dcaff79ec tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Calling method '.version_select at 0x7f96e416a9d0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:07.835394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-4dfd1551-08f0-4480-baef-504dcaff79ec tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] HTTP exception thrown: Volume tempest-invalid-622680087 could not be found. Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dfd1551-08f0-4480-baef-504dcaff79ec tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-622680087 HTTP/1.1 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: exception: Volume tempest-invalid-622680087 could not be found. Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'tempest-invalid-622680087'} Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-622680087 could not be found. (HTTP 404) (Request-ID: req-bd24b577-b330-4a60-9889-2d8c89f57b14) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:07.840903 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-622680087 could not be found. Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-622680087 could not be found. Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-622680087 could not be found. Jul 18 13:25:07.845627 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:07.852521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dfd1551-08f0-4480-baef-504dcaff79ec tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 404 to user: Volume tempest-invalid-622680087 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:07.854463 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4dfd1551-08f0-4480-baef-504dcaff79ec tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-622680087" status: 404 len: 98 microversion: 2.1 time: 0.082657 Jul 18 13:25:07.857412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2711/5209] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 13:25:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-622680087 => generated 98 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 13:25:07.872769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5c95f42-7a62-4161-bd83-d887e0e73ef1 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004496 Jul 18 13:25:07.873326 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2499/5210] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 13:25:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 13:25:07.887949 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a15f972-d8f8-4efd-b407-60bd738a2f05 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004992 Jul 18 13:25:07.889243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2712/5211] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 13:25:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 13:25:07.901093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fec1c9a-5d7b-4445-aa1a-679c3fbed29c tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Calling method '.version_select at 0x7f96d7ab9c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:08.025698 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-7fec1c9a-5d7b-4445-aa1a-679c3fbed29c tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] HTTP exception thrown: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fec1c9a-5d7b-4445-aa1a-679c3fbed29c tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/os-volumes/8ed86e24-4d7d-4f2a-a504-8452cbd9310c HTTP/1.1 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: method: Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: exception: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '8ed86e24-4d7d-4f2a-a504-8452cbd9310c'} Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. (HTTP 404) (Request-ID: req-48c632e8-245c-448d-bb3a-14338d6a5f70) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:25:08.030326 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.035483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fec1c9a-5d7b-4445-aa1a-679c3fbed29c tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 404 to user: Volume 8ed86e24-4d7d-4f2a-a504-8452cbd9310c could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:08.044637 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7fec1c9a-5d7b-4445-aa1a-679c3fbed29c tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/8ed86e24-4d7d-4f2a-a504-8452cbd9310c" status: 404 len: 109 microversion: 2.1 time: 0.144256 Jul 18 13:25:08.048826 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2500/5212] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:25:07 2022] DELETE /compute/v2.1/os-volumes/8ed86e24-4d7d-4f2a-a504-8452cbd9310c => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:25:08.061389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f767c7cb-46f2-47d1-a331-8ba6b4deece6 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Calling method '.version_select at 0x7f96e4576160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:08.182205 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f767c7cb-46f2-47d1-a331-8ba6b4deece6 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] HTTP exception thrown: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f767c7cb-46f2-47d1-a331-8ba6b4deece6 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Request method failure captured: Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/os-volumes/e2861406-b85c-4926-b617-fa291111c651 HTTP/1.1 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V8y-DXODEkwq8uiGJQPhhT2ZV2PFy84Kb_mCcfMEhVsLcw6c5Prf10yp0zBCRQjURVAJ08hD7L8ArHT_aS8N099sMFf16Q3SNDNiz8JY_98sGqV8zvRU23C3eZ1OLnlDJ5cbnaodm7EFQFy2Z8fm-nKHJMKpLA_Di-FL6IGihEjfIo Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_54d3d759e263443eaa10b8f538c8e950", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/54d3d759e263443eaa10b8f538c8e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 54d3d759e263443eaa10b8f538c8e950 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesNegativeTest-657440437 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 16c1b9ea695343e38fbf7602174b8ff4 Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesNegativeTest-657440437-project Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: method: Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: exception: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e2861406-b85c-4926-b617-fa291111c651'} Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. (HTTP 404) (Request-ID: req-a69a61d8-f30e-4232-a68d-401db003ee6a) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 13:25:08.184239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f767c7cb-46f2-47d1-a331-8ba6b4deece6 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] Returning 404 to user: Volume e2861406-b85c-4926-b617-fa291111c651 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f767c7cb-46f2-47d1-a331-8ba6b4deece6 tempest-VolumesNegativeTest-657440437 tempest-VolumesNegativeTest-657440437-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/e2861406-b85c-4926-b617-fa291111c651" status: 404 len: 109 microversion: 2.1 time: 0.130078 Jul 18 13:25:08.194110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2713/5213] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:25:08 2022] GET /compute/v2.1/os-volumes/e2861406-b85c-4926-b617-fa291111c651 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:25:14.024888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:14.025836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:14.044466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:14.045125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:14.046589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:14.048643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:14.115273 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f610f2d-16da-4b7e-80dd-c62bcd47f8a1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/ips" status: 200 len: 150 microversion: 2.20 time: 0.095869 Jul 18 13:25:14.125372 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2501/5214] 10.222.0.88 () {60 vars in 1288 bytes} [Mon Jul 18 13:25:14 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/ips => generated 150 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:25:18.042090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=21 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:18.045275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:18.072316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:18.074297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:18.108510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:18.109172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:18.114728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:18.115429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:18.215222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lazy-loading 'flavor' on Instance uuid e92559b4-dcfc-4706-96ac-d109395e2c13 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:25:18.730309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e43d7cb9-7554-40d8-a2f3-044d966ef54d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/action" status: 202 len: 0 microversion: 2.20 time: 0.690829 Jul 18 13:25:18.732371 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2714/5215] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:25:18 2022] POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:25:18.743266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:18.744724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:18.757025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:18.758523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:18.759775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:18.760808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:19.046400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:19.056746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:19.074427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:19.075886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-954d1aa7-1d40-4204-8331-f3586ffaeaa8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.338968 Jul 18 13:25:19.077014 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2502/5216] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:18 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:25:19.732575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:19.733596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:19.759244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:19.760476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:19.764644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:19.769807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:19.832145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:25:20.034997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03d6ad0c-f90d-48ed-b313-6727790f4fbe tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 204 len: 0 microversion: 2.1 time: 0.312936 Jul 18 13:25:20.045070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2715/5217] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:25:19 2022] DELETE /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:25:20.054666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:20.055846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:20.106978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:20.117533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:20.118892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:20.123059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:20.125219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:20.126997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:20.147159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:20.147625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:20.159717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:20.159717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:20.664398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:20.689041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:20.697816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:20.708338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4397f67e-737f-4d31-acd9-ad22ed58da04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.612623 Jul 18 13:25:20.714470 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2716/5218] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:20 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:21.225552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:21.247672 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ca74d06-9fb3-4b90-ada2-21b69e753975 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1508 microversion: 2.1 time: 1.201232 Jul 18 13:25:21.248263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2503/5219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:20 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1508 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:21.739220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:21.740976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:21.763491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:21.769666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:21.772880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:21.776507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:22.269993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:22.270869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:22.295135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:22.295634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:22.301426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:22.302619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:22.542449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:22.583407 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e73dce4-4fb2-4839-bc6d-7caae55125b8 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 200 len: 1466 microversion: 2.1 time: 0.320715 Jul 18 13:25:22.586450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2504/5220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:22 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 1466 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:22.604543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:22.610849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7f43e817-0a6e-4424-8207-1fb544cc2e86 req-5195fa0a-1698-4a42-9946-a2fc763dcc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e3f93c-c3f1-41a7-bddd-b09fa7303659", "name": "network-vif-deleted", "tag": "0ba9a6e8-cc19-43ce-9dbd-290a629b318b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:22.628766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:22.637201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:22.646037 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b3ead903-4e51-4104-93a5-7f747cae33a5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.912016 Jul 18 13:25:22.651031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7f43e817-0a6e-4424-8207-1fb544cc2e86 req-5195fa0a-1698-4a42-9946-a2fc763dcc2a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:22.652653 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2717/5221] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:21 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:22.656535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7f43e817-0a6e-4424-8207-1fb544cc2e86 req-5195fa0a-1698-4a42-9946-a2fc763dcc2a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:22.704159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7f43e817-0a6e-4424-8207-1fb544cc2e86 req-5195fa0a-1698-4a42-9946-a2fc763dcc2a service nova] Creating event network-vif-deleted:0ba9a6e8-cc19-43ce-9dbd-290a629b318b for instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 on n-h2-850003-3 Jul 18 13:25:22.730189 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7f43e817-0a6e-4424-8207-1fb544cc2e86 req-5195fa0a-1698-4a42-9946-a2fc763dcc2a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141725 Jul 18 13:25:22.730913 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2505/5222] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:25:23.604823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:23.605737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: a7e3f93c-c3f1-41a7-bddd-b09fa7303659] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:23.614252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.614842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.615706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.616325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.633059 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 HTTP/1.1 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a7e3f93c-c3f1-41a7-bddd-b09fa7303659'} Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:23.634973 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 404 to user: Instance a7e3f93c-c3f1-41a7-bddd-b09fa7303659 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:23.639214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa46488f-7e8f-4234-b893-eca8c4c66b00 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659" status: 404 len: 111 microversion: 2.1 time: 0.036890 Jul 18 13:25:23.647315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:23.648199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:23.653770 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2718/5223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:23 2022] GET /compute/v2.1/servers/a7e3f93c-c3f1-41a7-bddd-b09fa7303659 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:25:23.655425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.655885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.657279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.657716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.673612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:23.674808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:23.683075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.683812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.685482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.686166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.701338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:25:23.887482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c414c00-108b-48d8-a727-8fd7c97c5219 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "DELETE /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 204 len: 0 microversion: 2.1 time: 0.241864 Jul 18 13:25:23.890529 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2506/5224] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:25:23 2022] DELETE /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:25:23.910846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:23.912546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:23.924385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.926025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.927774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:23.928775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:23.935856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:23.950399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:23.954761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:23.957199 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd585f24-25b8-4b69-9609-c17795ffc794 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.287918 Jul 18 13:25:23.959543 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2719/5225] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:23 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:25:24.138200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:24.148066 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0799f685-06c2-435c-be97-714528a10d8c tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.249414 Jul 18 13:25:24.149033 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2507/5226] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:23 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:24.985402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:24.987234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:25.004323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:25.005999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:25.007995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:25.010109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:25.171581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:25.172389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:25.190391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:25.190852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:25.191656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:25.192091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:25.291088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:25.304179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:25.306689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:25.308959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b9f9105-8ce6-4118-95f0-4bf79f53548c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.330094 Jul 18 13:25:25.309977 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2720/5227] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:24 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:25:25.430468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:25.445925 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04e7e38a-75f6-4745-8af2-417c8be434f3 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.284815 Jul 18 13:25:25.455949 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2508/5228] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:25 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:25:26.330535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:26.332102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:26.352543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:26.353014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:26.354539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:26.355565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:26.476531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:26.479910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:26.488980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:26.490962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:26.492082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:26.492709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:26.635594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:26.652427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:26.656035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:26.658376 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c924d043-d96f-4f0b-836a-1aef91dadc0f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.333819 Jul 18 13:25:26.670934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2721/5229] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:26 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:26.880984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:26.898248 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-420a184a-94d3-430f-9541-baf69088ddb1 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1520 microversion: 2.1 time: 0.436103 Jul 18 13:25:26.900945 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2509/5230] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:26 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:25:27.681899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:27.683047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:27.757584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:27.758670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:27.760578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:27.761584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:27.930843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:27.931920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:27.964577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:27.971548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:27.974171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:27.979944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:27.981665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:28.255732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5208cdf4ea47eea1b961b15e3c0ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9675106f9a4d549d136ba2597511d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:28.281329 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7896f160-f41c-4bee-bfa0-906b8db44d50 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 200 len: 1478 microversion: 2.1 time: 0.365900 Jul 18 13:25:28.285765 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2510/5231] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:27 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 1478 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:25:28.319560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bb170d99-b3c2-4625-9d43-bc76c67635ad req-3c2b63f2-f050-4c79-b572-01b4dd636f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759af7c7-2105-449b-aaa8-597abc961e94", "name": "network-vif-deleted", "tag": "c5c50f1b-a2e5-4119-925f-58946459f701"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:28.339402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb170d99-b3c2-4625-9d43-bc76c67635ad req-3c2b63f2-f050-4c79-b572-01b4dd636f31 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:28.340712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb170d99-b3c2-4625-9d43-bc76c67635ad req-3c2b63f2-f050-4c79-b572-01b4dd636f31 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:28.357206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bb170d99-b3c2-4625-9d43-bc76c67635ad req-3c2b63f2-f050-4c79-b572-01b4dd636f31 service nova] Creating event network-vif-deleted:c5c50f1b-a2e5-4119-925f-58946459f701 for instance 759af7c7-2105-449b-aaa8-597abc961e94 on n-h1-850003-3 Jul 18 13:25:28.365665 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bb170d99-b3c2-4625-9d43-bc76c67635ad req-3c2b63f2-f050-4c79-b572-01b4dd636f31 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077139 Jul 18 13:25:28.370505 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2511/5232] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:25:28.519836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:28.537842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:28.548362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:28.550714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-11f0ef6e-5989-478a-8e87-23ef50a486cb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.875936 Jul 18 13:25:28.551746 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2722/5233] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:27 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:29.310263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:29.311045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] [instance: 759af7c7-2105-449b-aaa8-597abc961e94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:29.319851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:29.320806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:29.321884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:29.322900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:29.350085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] HTTP exception thrown: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Request method failure captured: Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 HTTP/1.1 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V2kIfoHQqrfLfM4-VwBS-tDBzqJ1EaMz6qQo9gvPKIp8U1Xt2CjOzjx51yPhn8FCoCEN3Gq7irEBkoEHs551HHyTYhRllxTVZG4jVS_kLMBrR9X22Bo1WaQtAh1b36rjjs_UClpV-iFMr3Na1jVZW57J-Dq4M_fzKEiV3E5_qSGb4Q Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2b9675106f9a4d549d136ba2597511d2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2b9675106f9a4d549d136ba2597511d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2b9675106f9a4d549d136ba2597511d2 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1037157814 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0f5208cdf4ea47eea1b961b15e3c0ea8 Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1037157814-project Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '759af7c7-2105-449b-aaa8-597abc961e94'} Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:29.353502 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. Jul 18 13:25:29.360144 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:25:29.362917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] Returning 404 to user: Instance 759af7c7-2105-449b-aaa8-597abc961e94 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:25:29.364378 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5fcd03a0-46fe-491d-bf3f-40dc216f5051 tempest-ServerRescueNegativeTestJSON-1037157814 tempest-ServerRescueNegativeTestJSON-1037157814-project] 10.222.0.88 "GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94" status: 404 len: 111 microversion: 2.1 time: 0.060784 Jul 18 13:25:29.370555 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2512/5234] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:25:29 2022] GET /compute/v2.1/servers/759af7c7-2105-449b-aaa8-597abc961e94 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:25:29.584984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:29.586266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:29.601101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:29.602580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:29.605327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:29.606946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:30.100066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:30.114315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:30.128155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:30.130611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d895dcab-be26-4888-99a1-795d1d279dcc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.549668 Jul 18 13:25:30.136204 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2723/5235] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:29 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:31.155433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:31.156121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:31.172692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:31.173225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:31.174266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:31.174878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:31.733237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:31.762068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:31.768534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:31.771285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8ed8231-8937-45bd-9ef8-593a92e641a8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.619993 Jul 18 13:25:31.774373 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2513/5236] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:31 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:32.796159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:32.799009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:32.812372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:32.813174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:32.816027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:32.818603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:33.402494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:33.421270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:33.423241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:33.424498 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1890132-8ddb-4458-b1cb-bd3fc44e6e84 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.632939 Jul 18 13:25:33.447821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2724/5237] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:32 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:25:34.457009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:34.460035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:34.502040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:34.503309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:34.513251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:34.516880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:34.534970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:35.483440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:35.509786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:35.513205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:35.518877 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-903d954c-7edf-4b4f-baaf-4edc53e21d9a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1743 microversion: 2.20 time: 1.075853 Jul 18 13:25:35.523242 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2514/5238] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:34 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1743 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:36.541601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:36.542376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:36.560172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:36.561126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:36.565194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:36.565886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:37.196464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:37.225687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:37.232454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:37.239738 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9224f81-e33b-4387-bc45-2d72f27fe685 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1743 microversion: 2.20 time: 0.700835 Jul 18 13:25:37.264211 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2725/5239] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:36 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1743 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:38.271875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:38.272762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:38.291458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:38.291915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:38.292712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:38.305287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:39.032467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0b554755-e7fc-4c6d-b5dc-892360f0a06f req-918bedc8-3c24-4d99-8911-e97ee1a6c4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "name": "network-vif-plugged", "status": "completed", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:25:39.060054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b554755-e7fc-4c6d-b5dc-892360f0a06f req-918bedc8-3c24-4d99-8911-e97ee1a6c4a1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:39.064510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b554755-e7fc-4c6d-b5dc-892360f0a06f req-918bedc8-3c24-4d99-8911-e97ee1a6c4a1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:39.098563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:39.118311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:39.120601 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0b554755-e7fc-4c6d-b5dc-892360f0a06f req-918bedc8-3c24-4d99-8911-e97ee1a6c4a1 service nova] Creating event network-vif-plugged:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h2-850003-3 Jul 18 13:25:39.130667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:39.134777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6699ff00-ba43-499c-98dc-c586fd396823 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.869303 Jul 18 13:25:39.138814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2515/5240] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:38 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:39.139549 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0b554755-e7fc-4c6d-b5dc-892360f0a06f req-918bedc8-3c24-4d99-8911-e97ee1a6c4a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124511 Jul 18 13:25:39.141979 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2726/5241] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:25:40.171222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:40.173710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:40.191554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:40.192209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:40.195188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:40.195705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:40.677218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:40.692327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:40.695571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:40.697667 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b7cc94c5-996c-43b9-b934-69e5418b2a07 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.531889 Jul 18 13:25:40.713745 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2516/5242] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:40 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:41.720490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:41.722038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:41.748664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:41.751818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:41.755754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:41.761014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:42.146596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:42.196396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:42.205452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:42.208992 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-358fafb9-2136-4032-8adc-4b79c09f71f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.493047 Jul 18 13:25:42.246991 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2727/5243] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:41 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:43.249464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:43.250704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:43.265222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:43.272195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:43.273647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:43.275334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:44.032931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:44.070058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:44.071915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:44.073198 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9032462-c689-404b-b29e-a6cdd4b8ea1f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.829185 Jul 18 13:25:44.073809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2517/5244] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:43 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:25:45.113449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:45.114352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:45.127852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:45.138842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:45.139919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:45.140505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:45.145809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:45.765859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:45.783619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:45.797680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:45.800068 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50e9914a-415f-4ce7-8cd6-4774142180e9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.691464 Jul 18 13:25:45.804696 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2728/5245] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:45 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:46.847712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:46.848769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:46.927270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:46.927740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:46.934008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:46.938364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:47.720587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:47.739489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:47.745933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:47.754367 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd1d2ecd-1afa-45e4-9eee-aac83be39009 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.932447 Jul 18 13:25:47.758750 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2518/5246] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:46 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:48.781748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:48.783748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:48.804001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:48.837180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:48.838665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:48.844416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:48.845360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:49.668570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:49.677929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:49.679542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:49.691871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d89526a3-bc32-4c66-8b56-657afb7819c2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.921976 Jul 18 13:25:49.692488 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2729/5247] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:48 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:50.714286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:50.715865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:50.736264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:50.741009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:50.744501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:50.745394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:51.221307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:51.242863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:51.248960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:51.266476 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ddfdb21b-5952-43c0-bd0b-de822aa29763 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.558930 Jul 18 13:25:51.281614 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2519/5248] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:50 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:52.299189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:52.301073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:52.322929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:52.323749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:52.328196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:52.328984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:52.802217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:52.812843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:52.821391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:52.829503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4108e09-a2ec-4064-990f-deb112ca60f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.533591 Jul 18 13:25:52.833224 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2730/5249] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:52 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:53.550046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Calling method '.version_select at 0x7f96e4256ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:53.551173 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:25:53.551173 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:25:53.553903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:53.554398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:53.624925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:53.626708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:53.659839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:53.660946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:53.682721 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4eef4cfb-5b05-4165-8832-288e1a767487 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147 tempest-PortsAdminExtendedAttrsIpV6TestJSON-789510147-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.155459 Jul 18 13:25:53.684184 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2520/5250] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:25:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:25:53.854917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:53.854917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:53.873184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:53.877796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:53.879487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:53.895676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:54.611424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:54.626025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:54.628073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:54.632266 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aff183eb-9d03-48d0-ac6d-ad023d595e89 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.784777 Jul 18 13:25:54.643988 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2731/5251] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:53 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:55.652217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:55.652841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:55.671342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:55.672256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:55.673683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:55.674401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:57.062479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:57.105367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:57.109541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:57.113022 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4aca0ffe-8bf8-4a8d-8f4a-ababf76fc65f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 1.464935 Jul 18 13:25:57.129973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2521/5252] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:55 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:57.761689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f375cf8-8c7c-45bd-b412-a7a141db9a3e tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e4b84550>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:57.865186 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f375cf8-8c7c-45bd-b412-a7a141db9a3e tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1604d10a-097d-499c-a880-9223f13823a6" status: 200 len: 351 microversion: 2.1 time: 0.107019 Jul 18 13:25:57.865944 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2732/5253] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:25:57 2022] GET /compute/v2.1/os-volumes/1604d10a-097d-499c-a880-9223f13823a6 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:25:58.158003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:58.158538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:58.180157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=26 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:25:58.181779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:58.196141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:58.197218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:58.203940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:58.708892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:58.737656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:58.740161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:25:58.741777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-adfedd57-14e0-4790-8e75-21664aff4f73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.588681 Jul 18 13:25:58.743771 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2522/5254] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:58 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:25:59.765532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:25:59.766091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:25:59.794962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:59.795426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:25:59.796930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:25:59.797382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:00.787262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:00.806584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:00.809009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:00.824843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41bc54c7-8a06-436b-b769-a726f5ea2cfe tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 1.064747 Jul 18 13:26:00.832192 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2733/5255] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:25:59 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:01.860959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:01.861788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:01.891374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:01.891859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:01.892728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:01.893172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:02.227427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26206d85-6843-4c02-8b87-99ccda2c2814 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96d7a4cdc0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:02.480462 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26206d85-6843-4c02-8b87-99ccda2c2814 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/35ab3b43-37a4-4f48-92ba-847666d5c3a9" status: 200 len: 351 microversion: 2.1 time: 0.263560 Jul 18 13:26:02.481216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2734/5256] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:26:02 2022] GET /compute/v2.1/os-volumes/35ab3b43-37a4-4f48-92ba-847666d5c3a9 => generated 351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:02.787880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:02.816122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:02.820397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:02.823673 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca88e7a3-4371-4df4-aa19-71f66a272389 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.970144 Jul 18 13:26:02.838225 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2523/5257] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:01 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:03.862706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:03.864194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:03.885055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:03.886129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:03.887323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:03.890582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:04.617436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:04.638392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:04.644756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:04.669741 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57c41984-348d-47df-8f85-a2a880e212e1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.807196 Jul 18 13:26:04.720398 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2735/5258] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:03 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:05.710476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:05.711318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:05.727059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:05.737878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:05.739392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:05.742267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:05.747396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=60 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:06.580451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:06.620361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:06.625281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:06.640693 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ef08d68-ac5f-4e73-9df8-690bb63df3d7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.933764 Jul 18 13:26:06.649846 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2524/5259] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:05 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:06.848507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87694db5-942f-4c77-94a8-5d8253d8b39b tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96d7a4caf0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:07.016751 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87694db5-942f-4c77-94a8-5d8253d8b39b tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/52bc59d7-65c6-4f23-8de5-508ae937bb5d" status: 200 len: 350 microversion: 2.1 time: 0.172788 Jul 18 13:26:07.018211 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2736/5260] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 13:26:06 2022] GET /compute/v2.1/os-volumes/52bc59d7-65c6-4f23-8de5-508ae937bb5d => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:26:07.031426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96ac235f-a032-4642-927f-28dfe6fecee1 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96d7a264c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:07.266083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96ac235f-a032-4642-927f-28dfe6fecee1 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.240044 Jul 18 13:26:07.267032 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2525/5261] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 13:26:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:26:07.281383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7846f6eb-4a0a-41e5-a7d7-878566871023 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e455b5e0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:07.551224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7846f6eb-4a0a-41e5-a7d7-878566871023 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.274581 Jul 18 13:26:07.555051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2737/5262] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 13:26:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:07.581471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c932e13a-1e26-4d24-9451-21fd2450aa37 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e4594ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:07.689534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:07.690267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:07.722892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:07.724579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:07.726476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:07.729918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:07.946606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c932e13a-1e26-4d24-9451-21fd2450aa37 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.383482 Jul 18 13:26:07.948869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2526/5263] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 13:26:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:26:07.979757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e28ee8b0-70cb-42d6-bbed-d132eab41f77 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e490bb80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:08.261344 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e28ee8b0-70cb-42d6-bbed-d132eab41f77 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.302869 Jul 18 13:26:08.266708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2527/5264] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 13:26:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:08.280140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-68633817-1fe2-48a7-a589-e839c28c8b66 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e428b310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:08.299897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:08.324699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:08.326795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:08.329138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19644f6c-cdc6-4ae2-94a7-f19b9a288655 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1738 microversion: 2.20 time: 0.663144 Jul 18 13:26:08.346387 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2738/5265] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:07 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1738 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:08.438708 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-68633817-1fe2-48a7-a589-e839c28c8b66 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161515 Jul 18 13:26:08.447924 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2528/5266] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 13:26:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:08.460298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0ca8665-8e11-40ea-959c-a2cccc45596b tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e416ae50>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:08.671157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0ca8665-8e11-40ea-959c-a2cccc45596b tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.220553 Jul 18 13:26:08.673043 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2739/5267] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 13:26:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:26:08.685924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bcf15e5b-bce0-4176-a614-c92aba7846e2 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e9accee0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:08.885544 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bcf15e5b-bce0-4176-a614-c92aba7846e2 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.204565 Jul 18 13:26:08.887102 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2529/5268] 10.222.0.88 () {58 vars in 1187 bytes} [Mon Jul 18 13:26:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:08.906733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-680e9626-e9de-4b43-b1d2-002c383753e1 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] Calling method '.version_select at 0x7f96e42cff70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:09.111033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-680e9626-e9de-4b43-b1d2-002c383753e1 tempest-VolumesTestJSON-723761763 tempest-VolumesTestJSON-723761763-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.214772 Jul 18 13:26:09.111804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2740/5269] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 13:26:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:26:09.350963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:09.351856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:09.373658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:09.374125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:09.390214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:09.390214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:09.821584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:09.837759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:09.845955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:09.848067 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5f9d978-30d5-4d56-8447-a1c03309d26d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1720 microversion: 2.20 time: 0.501889 Jul 18 13:26:09.862076 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2530/5270] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:09 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1720 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:10.872890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:10.873631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:10.886183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:10.886663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:10.887479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:10.887924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:11.404582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:11.419698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:11.423499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:11.426921 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71d21392-099c-4e91-abd5-22bc802e88cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1720 microversion: 2.20 time: 0.561749 Jul 18 13:26:11.444603 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2741/5271] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:10 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1720 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:12.452929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:12.454979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:12.468917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:12.475182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:12.479187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:12.480198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:13.726614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dd495108-be56-4cb9-b184-f762a3900634 req-980cddbd-afa4-4b72-80d3-8b0f3ea11323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "name": "network-vif-unplugged", "status": "completed", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:26:13.746883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:13.761533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:13.764229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:13.800255 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffffd4db-0a36-421b-a51c-628acf79fc1b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1720 microversion: 2.20 time: 1.318869 Jul 18 13:26:13.804300 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2531/5272] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:12 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1720 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:13.835675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dd495108-be56-4cb9-b184-f762a3900634 req-980cddbd-afa4-4b72-80d3-8b0f3ea11323 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:13.836447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dd495108-be56-4cb9-b184-f762a3900634 req-980cddbd-afa4-4b72-80d3-8b0f3ea11323 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:13.943728 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dd495108-be56-4cb9-b184-f762a3900634 req-980cddbd-afa4-4b72-80d3-8b0f3ea11323 service nova] Creating event network-vif-unplugged:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h2-850003-3 Jul 18 13:26:13.977889 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dd495108-be56-4cb9-b184-f762a3900634 req-980cddbd-afa4-4b72-80d3-8b0f3ea11323 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.256493 Jul 18 13:26:13.982508 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2742/5273] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:14.829773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:14.830650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:14.860945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:14.862563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:14.868031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:14.868493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:15.865467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:15.879668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:15.881789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:15.894426 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0010ef2-ed03-4131-b52f-91732b18dd56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1723 microversion: 2.20 time: 1.067837 Jul 18 13:26:15.895573 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2532/5274] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:14 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1723 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:15.935114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4cd0818-47f3-4093-bc19-bbb402461800"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:26:15.940842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:15.961293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:15.961754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:15.969346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:15.969825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:16.071207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=49 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:16.855572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49379e1a-8474-48e1-aba0-15e27d89c278 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.929668 Jul 18 13:26:16.860381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2743/5275] 10.222.0.88 () {62 vars in 1363 bytes} [Mon Jul 18 13:26:15 2022] POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 188 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:26:17.215544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:26:17.216936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:17.245475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:17.247274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:17.250966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:17.252059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:18.850186 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-581fd46d-7997-4dc5-8957-696ab4ee9a10 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/action" status: 202 len: 0 microversion: 2.20 time: 1.641659 Jul 18 13:26:18.858322 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2533/5276] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:26:17 2022] POST /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/action => generated 0 bytes in 1651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:26:18.869848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:18.870783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:18.883988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=18 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:18.913894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:18.914427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:18.915312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:18.915788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:19.807075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:19.854890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:19.866726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:19.873840 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d82e12dc-038e-41fe-8b46-ee52608ef568 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1749 microversion: 2.20 time: 1.006509 Jul 18 13:26:19.894860 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2744/5277] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:18 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1749 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:20.915027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:20.917205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:20.948102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:20.949720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:20.960026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:20.960409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:21.555767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:21.588556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:21.598899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:21.605274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a1bc74a-cd77-413b-b5a9-4cce8ff8157d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1749 microversion: 2.20 time: 0.695629 Jul 18 13:26:21.608040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2534/5278] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:20 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1749 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:22.643536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:22.646554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:22.667273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:22.668051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:22.670974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:22.671765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:23.518594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:23.533475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:23.539584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:23.543167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2fd55303-0202-4fd8-a9c1-132ccd5aadde tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1749 microversion: 2.20 time: 0.907503 Jul 18 13:26:23.548610 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2745/5279] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:22 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1749 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:24.572548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:24.578765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:24.616245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:24.621337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:24.624917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:24.628066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:25.443234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:25.460715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:25.463284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:25.465172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2096dda1-f611-4ce0-a542-31c0242a1522 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 0.902988 Jul 18 13:26:25.467724 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2535/5280] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:24 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:26.505377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:26.523748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:26.551891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:26.558982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:26.561349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:26.572088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:27.472999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:27.511999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:27.522937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:27.525149 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa48107b-338a-4714-9bff-f4fd26004a87 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 1.035276 Jul 18 13:26:27.537784 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2746/5281] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:26 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:28.557157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:28.557838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:28.572731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=20 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:28.577749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:28.578622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:28.581377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:28.583098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:29.490684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:29.518940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:29.523691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:29.526956 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8cbec74-a8d0-4a3f-b75e-e4c65041db73 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 0.974054 Jul 18 13:26:29.533067 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2536/5282] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:28 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:26:30.561387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:30.583529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:30.621481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:30.622676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:30.623950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:30.623950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:32.024691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:32.049885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:32.057367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:32.061761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5054551-b1a9-4da9-a3b4-b5173cdf056b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 1.513857 Jul 18 13:26:32.075169 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2747/5283] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:30 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:33.096544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:33.098488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:33.119013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:33.119485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:33.120332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:33.120782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:34.219867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:34.241881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:34.247582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:34.248885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d518f0ea-437a-4967-9833-5885d152b32f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 1.158736 Jul 18 13:26:34.251830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2537/5284] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:33 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:35.271385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:35.272342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:35.287751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:35.289693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:35.290937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:35.291555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:36.012200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:36.037603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:36.041312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:36.043203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e769d6f4-b626-45fd-8b7c-80916a1f1d7b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1751 microversion: 2.20 time: 0.776758 Jul 18 13:26:36.050005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2748/5285] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:35 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1751 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:37.068884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:37.070365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:37.087539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:37.088290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:37.089271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:37.089923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:37.150517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:38.095382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:38.108681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:38.111165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:38.112393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8286d86-85ba-4708-944a-9b5e1f7557f2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.047663 Jul 18 13:26:38.126193 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2538/5286] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:37 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:39.136050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:39.137895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:39.157145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:39.162529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:39.165185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:39.167696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:39.496765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:39.525344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:39.527037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:39.544980 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe23f9be-66d1-4fb6-88e3-eba0e3bf3834 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.403303 Jul 18 13:26:39.555712 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2749/5287] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:39 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:40.572680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:40.574178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:40.583679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:40.584427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:40.585551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:40.586241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:41.607552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:41.623649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:41.641424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:41.643575 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cbe5af60-9339-4447-a2ca-2809129f5e95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.076644 Jul 18 13:26:41.656002 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2539/5288] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:40 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:42.566515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-28a4f570-4b4e-4d90-a53a-01e221e5d7e5 req-f4f31d92-047b-4318-8544-2c164bd6d9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:26:42.582282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-28a4f570-4b4e-4d90-a53a-01e221e5d7e5 req-f4f31d92-047b-4318-8544-2c164bd6d9c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:42.583096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-28a4f570-4b4e-4d90-a53a-01e221e5d7e5 req-f4f31d92-047b-4318-8544-2c164bd6d9c2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:42.599529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-28a4f570-4b4e-4d90-a53a-01e221e5d7e5 req-f4f31d92-047b-4318-8544-2c164bd6d9c2 service nova] Creating event network-changed:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h1-850003-3 Jul 18 13:26:42.612811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-28a4f570-4b4e-4d90-a53a-01e221e5d7e5 req-f4f31d92-047b-4318-8544-2c164bd6d9c2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.537371 Jul 18 13:26:42.616949 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2750/5289] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:26:42.663699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:42.666095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:42.685705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:42.690358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:42.692168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:42.693046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:43.270571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:43.286292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:43.297099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:43.298440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c79ffc9-3016-4027-ae1e-c0e30b32b1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.640357 Jul 18 13:26:43.299071 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2540/5290] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:42 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:26:44.330100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:44.331558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:44.364373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:44.364926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:44.365959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:44.366677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:45.485813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:45.504018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:45.511090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:45.513528 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f60e2b17-95bf-4033-b573-70d810133a66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.199935 Jul 18 13:26:45.517938 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2751/5291] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:44 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:26:46.538118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:46.538909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:46.558065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:46.562813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:46.564744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:46.571607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:48.985906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:49.019106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:49.020921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:49.035796 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4c725b4-f318-42cf-a2d3-7b1d39696120 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 2.502982 Jul 18 13:26:49.037391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2541/5292] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:46 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:50.071686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:50.072464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:50.107378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:50.112610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:50.123405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:50.126849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:50.127557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:50.219849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:26:51.515174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:51.541527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:51.550600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:51.552921 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-118d0793-cd4e-4b0c-8609-405ea2d7114e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.485776 Jul 18 13:26:51.560784 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2752/5293] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:50 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:52.582134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:52.583607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:52.599124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:52.601413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:52.605045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:52.608909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:53.248537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:53.265620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:53.276114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:53.280474 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fcf2100-7d81-49c7-80ce-81062faa6311 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.704193 Jul 18 13:26:53.289647 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2542/5294] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:52 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:54.309064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:54.310976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:54.330600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:54.331347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:54.332340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:54.336877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:56.474396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:56.489314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:56.492570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:56.495262 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45ce7213-7677-448b-8861-37e912df7751 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 2.190353 Jul 18 13:26:56.509248 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2753/5295] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:54 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:57.518874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:57.521191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:57.553318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:57.554648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:57.560423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:57.561816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:58.659349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:58.676581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:58.678176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:26:58.697211 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ee3abea-d8f4-42cd-b5be-27271eeddf90 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.184168 Jul 18 13:26:58.697813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2543/5296] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:57 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:26:59.717556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:26:59.718918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:26:59.735913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:59.742930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:26:59.744223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:26:59.744959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:00.242521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:00.254067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:00.265736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:00.267281 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db93af00-9669-4627-a462-8542f445beff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.554831 Jul 18 13:27:00.268380 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2754/5297] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:26:59 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:01.289684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:01.291191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:01.308104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:27:01.313568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:01.320382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:01.321682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:01.325227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:01.950795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:01.978041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:01.986910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:01.993141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1713915-6ff8-443b-badb-15978d53796f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.706174 Jul 18 13:27:01.994798 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2544/5298] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:01 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:03.015917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:03.016782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:03.047951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:03.048537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:03.049447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:03.049908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:03.675365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:03.686085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:03.686085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:03.686085 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-411d29c1-256c-4e98-9f7a-faca24a1da30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.676445 Jul 18 13:27:03.688596 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2755/5299] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:03 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:04.707753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:04.709212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:04.723635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:04.726921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:04.728155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:04.730105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:05.219737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:05.245071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:05.249028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:05.252269 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42dc28a7-f089-43b6-b95f-4cd486dcd431 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.549213 Jul 18 13:27:05.257985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2545/5300] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:04 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:06.283280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:06.284578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:06.308683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:06.312251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:06.315608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:06.316935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:06.637705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-514bed09-af84-441d-906f-bfd2f3b6bf2f tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-881530050", "availability_zone": "foo_zone"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:06.641040 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:06.641040 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:06.642558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.aggregate [None req-514bed09-af84-441d-906f-bfd2f3b6bf2f tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Generated uuid 3ef3e81a-16af-4963-990d-ec0d4a0ee3ea for aggregate {{(pid=131366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 13:27:06.667310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:06.678190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:06.690361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:06.696026 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5cf73853-307c-43cd-a113-bcbb3a27991d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.419335 Jul 18 13:27:06.698653 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2546/5301] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:06 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:27:06.724508 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-514bed09-af84-441d-906f-bfd2f3b6bf2f tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.837280 Jul 18 13:27:06.726245 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2756/5302] 10.222.0.88 () {60 vars in 1163 bytes} [Mon Jul 18 13:27:05 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:06.739437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ca8fbd7-566a-40fe-80c7-093514194b82 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:06.741432 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:06.741432 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:27:06.798275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ca8fbd7-566a-40fe-80c7-093514194b82 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.063335 Jul 18 13:27:06.800877 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2547/5303] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 13:27:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:06.811796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:06.813807 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:06.813807 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:06.815628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:06.816818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:06.819253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:06.820191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:06.946072 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ceaf79a-35d4-4067-b95c-522b1e787892 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138504 Jul 18 13:27:06.952150 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2757/5304] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 18 13:27:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:06.963780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a0d7576-f33b-469c-b6ce-b952ac7e125e tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:06.964907 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:06.964907 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:27:06.983234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a0d7576-f33b-469c-b6ce-b952ac7e125e tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.022314 Jul 18 13:27:06.987061 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2548/5305] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 18 13:27:06 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:27:07.003256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8618777e-d094-400d-a9da-b12979ffc9ba tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:07.020860 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:07.020860 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:07.066399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8618777e-d094-400d-a9da-b12979ffc9ba tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:07.068495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8618777e-d094-400d-a9da-b12979ffc9ba tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:07.721947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:07.724311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:07.744616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:07.746924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:07.752006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:07.754612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:07.762062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8618777e-d094-400d-a9da-b12979ffc9ba tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.767498 Jul 18 13:27:07.768525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2758/5306] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 13:27:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:07.776748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7955373c-0eeb-492c-8a1f-8ca4a2cc393f tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:07.777576 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:07.777576 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:07.801516 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7955373c-0eeb-492c-8a1f-8ca4a2cc393f tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.031676 Jul 18 13:27:07.802518 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2759/5307] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:27:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:07.810922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=54 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:27:07.813962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-721f5462-de2e-4195-acbf-7092d9049ad0 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1820660655", "availability_zone": "foo_zone"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:07.820049 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:07.820049 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:07.908336 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-721f5462-de2e-4195-acbf-7092d9049ad0 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.099565 Jul 18 13:27:07.917813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2760/5308] 10.222.0.88 () {60 vars in 1172 bytes} [Mon Jul 18 13:27:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:07.928111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81245bcd-fa76-4d13-9087-40792ba8625c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:07.930042 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:07.930042 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:07.968771 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81245bcd-fa76-4d13-9087-40792ba8625c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.048079 Jul 18 13:27:07.976139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2761/5309] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 13:27:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:07.983341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d75babdc-d4b7-43f5-b9f6-544c127c5507 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:07.985103 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:07.985103 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:08.004512 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d75babdc-d4b7-43f5-b9f6-544c127c5507 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.026774 Jul 18 13:27:08.011503 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2762/5310] 10.222.0.88 () {58 vars in 1151 bytes} [Mon Jul 18 13:27:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:08.023379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6d19ec0-acaf-4a4c-90a5-5caff51c0b2c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850003-3"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:08.025357 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:08.025357 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:08.069871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6d19ec0-acaf-4a4c-90a5-5caff51c0b2c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:08.076096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6d19ec0-acaf-4a4c-90a5-5caff51c0b2c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:08.323157 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6d19ec0-acaf-4a4c-90a5-5caff51c0b2c tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.310352 Jul 18 13:27:08.324190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2763/5311] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 13:27:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:27:08.335786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-204c1b7c-4bb4-41c7-ac76-9038f9fdec93 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:08.336906 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:08.336906 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:08.382804 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-204c1b7c-4bb4-41c7-ac76-9038f9fdec93 tempest-TestAggregatesBasicOps-1198063919 tempest-TestAggregatesBasicOps-1198063919-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.051674 Jul 18 13:27:08.384281 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2764/5312] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 13:27:08 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 13:27:08.404829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:08.423178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:08.427858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:08.431508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-871db044-320c-4ac4-9ee3-50b7da483d30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.714693 Jul 18 13:27:08.466396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2549/5313] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:07 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:09.452389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:09.453027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:09.470513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:09.478068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:09.479281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:09.484093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:09.857244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:09.878559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:09.880766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:09.882320 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-04e52ff8-7c6e-471a-a78b-bb3244384b65 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.436206 Jul 18 13:27:09.895035 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2765/5314] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:09 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:10.900895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:10.901589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:10.910755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:10.911486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:10.912485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:10.913123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:11.255701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:11.292979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:11.294639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:11.295901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce03e45b-f230-4d6c-8a33-efb575691fff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.398947 Jul 18 13:27:11.307766 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2550/5315] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:10 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:12.315156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:12.315763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:12.329139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:12.329621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:12.330807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:12.331556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:13.286546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:13.313536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:13.321970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:13.326994 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd7c0376-a84c-4157-8138-f182418964f4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.015792 Jul 18 13:27:13.336143 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2766/5316] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:12 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:14.356691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:14.358195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:14.367674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:14.369020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:14.378600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:14.379737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:14.848688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:14.876064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:14.878530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:14.883922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6234b52-5204-4daf-b805-4b8ec4086f8a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.532360 Jul 18 13:27:14.892963 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2551/5317] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:14 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:15.299167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-611ece68-f575-4768-a1bb-fddc51f1d629 req-eab24504-8aa1-4fcb-9c1c-d3bee89292b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "name": "network-vif-plugged", "status": "completed", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:27:15.310005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-611ece68-f575-4768-a1bb-fddc51f1d629 req-eab24504-8aa1-4fcb-9c1c-d3bee89292b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:15.310965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-611ece68-f575-4768-a1bb-fddc51f1d629 req-eab24504-8aa1-4fcb-9c1c-d3bee89292b8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:15.328747 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-611ece68-f575-4768-a1bb-fddc51f1d629 req-eab24504-8aa1-4fcb-9c1c-d3bee89292b8 service nova] Creating event network-vif-plugged:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h1-850003-3 Jul 18 13:27:15.335372 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-611ece68-f575-4768-a1bb-fddc51f1d629 req-eab24504-8aa1-4fcb-9c1c-d3bee89292b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042255 Jul 18 13:27:15.336988 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2767/5318] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:27:15.910831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:15.911501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:15.925446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:15.925914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:15.927206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:15.927706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:16.410542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:16.438031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:16.441496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:16.446286 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b0744cac-aff3-4fec-85fb-4f7f81d2e523 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 0.536928 Jul 18 13:27:16.447696 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2552/5319] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:15 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:17.472149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:27:17.478420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:17.483627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:17.498579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:17.503568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:17.504990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:17.505454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:19.132829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:19.150503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:19.153070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:19.154581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f094426b-a93f-47a9-b23b-dc8eaee208aa tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1807 microversion: 2.20 time: 1.686873 Jul 18 13:27:19.155574 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2768/5320] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:17 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1807 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:20.181712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:20.185458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:27:20.224504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:20.227356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:20.231440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:20.233481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:20.680254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:20.691724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:20.693276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:27:20.699797 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa0523aa-eeb1-4a59-b458-fbfe8473ccec tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1794 microversion: 2.20 time: 0.528499 Jul 18 13:27:20.705534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2553/5321] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:27:20 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1794 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:27:56.748982 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:27:56.748982 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 13:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:27:58.359061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:27:58.361313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=53 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:27:59.391348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Calling method '.version_select at 0x7f96e9aca430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:27:59.396353 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:27:59.396353 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:27:59.399914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:59.404732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:59.482627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:59.483714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:59.528382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:27:59.529033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:27:59.545037 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d6ac38b-18ce-4178-9053-5e62600dc802 tempest-PortsAdminExtendedAttrsTestJSON-1128788744 tempest-PortsAdminExtendedAttrsTestJSON-1128788744-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.196108 Jul 18 13:27:59.546475 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2769/5322] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:27:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:28:16.049787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:16.050365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:16.095928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:16.096765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=29 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:16.108526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.110534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.113951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.115645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.269534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3a2da25-e8fd-4c2f-937a-db31bf0f6f75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments/a4cd0818-47f3-4093-bc19-bbb402461800" status: 200 len: 194 microversion: 2.20 time: 0.231229 Jul 18 13:28:16.271514 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2554/5323] 10.222.0.88 () {60 vars in 1453 bytes} [Mon Jul 18 13:28:16 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments/a4cd0818-47f3-4093-bc19-bbb402461800 => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:16.442097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:16.443552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:16.459709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:16.464677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:16.468537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.471989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.478819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.479420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.674133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lazy-loading 'services' on Instance uuid e92559b4-dcfc-4706-96ac-d109395e2c13 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:28:16.830290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f54a90d-9fd7-4f37-bd3a-e3c4021cdf1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments/a4cd0818-47f3-4093-bc19-bbb402461800" status: 202 len: 0 microversion: 2.20 time: 0.393642 Jul 18 13:28:16.831481 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2770/5324] 10.222.0.88 () {60 vars in 1456 bytes} [Mon Jul 18 13:28:16 2022] DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments/a4cd0818-47f3-4093-bc19-bbb402461800 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:28:16.840184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:16.841129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:16.852373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.853022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.858047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:16.865755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:16.973011 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-323d07e6-bc39-453c-b7f7-1761e4c56c04 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137465 Jul 18 13:28:16.977173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2555/5325] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:16 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:17.987076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:17.991186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:18.003152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:18.004924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:18.006000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:18.006718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:18.069720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6962433-c1b7-406c-b4cf-f782e913260d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087409 Jul 18 13:28:18.071546 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2771/5326] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:17 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:19.085193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:19.086389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:19.120439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:19.122181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:19.126968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:19.128720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:19.263296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8914479-bfac-492f-b897-c666f6f6bdf9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181975 Jul 18 13:28:19.267319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2556/5327] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:19 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:20.276271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:20.278873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:20.289684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:20.294408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:20.299877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:20.302896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:20.390267 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07c836b8-f0f6-472b-a94f-ad0e7ce0613c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113436 Jul 18 13:28:20.395599 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2772/5328] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:20 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:21.402439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:21.403430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:21.422225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:21.422698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:21.423597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:21.424086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:21.545589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8638277e-fac1-4db4-ab2a-ee0e95406245 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147491 Jul 18 13:28:21.546251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2557/5329] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:21 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:22.558344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:22.559309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:22.569777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:22.570277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:22.592606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:22.592606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:22.705873 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5138d877-cd86-47a8-a6f7-026a6f333f30 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152097 Jul 18 13:28:22.713862 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2773/5330] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:22 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:23.725580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:23.726657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:23.750578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:23.751334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:23.752471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:23.752930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:23.846012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3de5f8f8-bb45-4a8e-a149-c889acfd2b69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124635 Jul 18 13:28:23.852703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2558/5331] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:23 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:24.857745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:24.858740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:24.876792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:24.877257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:24.878064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:24.880234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:24.942011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4fc1980-f5c3-4d65-8b1c-09f94f413ade tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088533 Jul 18 13:28:24.943226 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2774/5332] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:24 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:28:25.955295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:25.956305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:25.975486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:25.975945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:25.976751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:25.977187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:26.140032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71835383-dede-4d5f-a223-abeaf6b9b38b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189623 Jul 18 13:28:26.140666 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2559/5333] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:25 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:28:27.155224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:27.157806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:27.169150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.169843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:27.171555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.172901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:27.238666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e9ad330-f538-46a2-ad3d-9afe8d17c71e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083087 Jul 18 13:28:27.239328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2775/5334] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:28:27 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:28:27.369994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:27.371212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:27.385687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.386718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:27.388259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.389212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:27.439341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:28:27.575184 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9a1836b-9b18-488e-a27b-fe3282ac56cc tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 204 len: 0 microversion: 2.20 time: 0.210009 Jul 18 13:28:27.581623 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2560/5335] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:28:27 2022] DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:28:27.587628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:27.588289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:27.602413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.603427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:27.607116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:27.610671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:28.068034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:28.087872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:28.087872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:28.089074 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dff215e1-b434-47c7-9c9b-a3746b0abd2d tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.506243 Jul 18 13:28:28.101319 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2776/5336] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:27 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:29.111227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:29.112526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:29.121746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:29.122632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:29.123636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:29.124228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:29.731989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:29.767585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:29.773763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:29.777863 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-903662ec-2560-4aa4-8269-59cb979ecb6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.671914 Jul 18 13:28:29.789622 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2561/5337] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:29 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:30.797533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:30.798961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:30.807155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:30.807637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:30.808414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:30.809829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:31.242894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:31.259256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:31.260868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:31.262105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d42a34c0-636f-4dcd-b3a1-30af6cce290f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1722 microversion: 2.20 time: 0.468633 Jul 18 13:28:31.273112 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2777/5338] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:30 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:32.281380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:32.285742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:32.301199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:32.302647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:32.310519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:32.312219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:32.587720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:32.598774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:32.608474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:32.609823 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e779372-b5d1-4c73-bc9c-c3a30de905e3 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1654 microversion: 2.20 time: 0.333401 Jul 18 13:28:32.610459 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2562/5339] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:32 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1654 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:33.629999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:33.630716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:33.652459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:33.655304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:33.659010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:33.661815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:34.026029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d9599444-ac9c-45e5-8df0-cd856c018146 req-57e1949b-fd67-4d06-8cfb-f1d1df35eb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92559b4-dcfc-4706-96ac-d109395e2c13", "name": "network-vif-deleted", "tag": "1448be56-6a4c-4730-b292-e9e7b7219338"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:28:34.048910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d9599444-ac9c-45e5-8df0-cd856c018146 req-57e1949b-fd67-4d06-8cfb-f1d1df35eb02 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:34.051141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d9599444-ac9c-45e5-8df0-cd856c018146 req-57e1949b-fd67-4d06-8cfb-f1d1df35eb02 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:34.079704 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d9599444-ac9c-45e5-8df0-cd856c018146 req-57e1949b-fd67-4d06-8cfb-f1d1df35eb02 service nova] Creating event network-vif-deleted:1448be56-6a4c-4730-b292-e9e7b7219338 for instance e92559b4-dcfc-4706-96ac-d109395e2c13 on n-h1-850003-3 Jul 18 13:28:34.086493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d9599444-ac9c-45e5-8df0-cd856c018146 req-57e1949b-fd67-4d06-8cfb-f1d1df35eb02 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065799 Jul 18 13:28:34.088705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2563/5340] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:28:34.301968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:34.320148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:34.333652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:34.335281 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa0364c2-e184-4d2d-8fa2-763314d82767 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 200 len: 1654 microversion: 2.20 time: 0.710160 Jul 18 13:28:34.335882 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2778/5341] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:33 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 1654 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:35.359241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:35.361345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:35.388420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:35.388883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:35.389795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:35.393408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:35.428237 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 HTTP/1.1 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'e92559b4-dcfc-4706-96ac-d109395e2c13'} Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:28:35.434254 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:28:35.438635 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:28:35.439147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:28:35.441687 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9ec49b68-5865-42e7-b3a5-d6d354f22f1a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 404 len: 111 microversion: 2.20 time: 0.088706 Jul 18 13:28:35.442426 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2564/5342] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:35 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:28:35.469249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c00725ae-1603-42d5-8fc4-64621f8819a0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '.version_select at 0x7f96e99aeb80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:35.505241 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c00725ae-1603-42d5-8fc4-64621f8819a0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369016907" status: 204 len: 0 microversion: 2.20 time: 0.056395 Jul 18 13:28:35.507559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2779/5343] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 18 13:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369016907 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:28:38.653496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-916dfdce-abaa-44ad-b77f-fed2f1c39377 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: .version_select at 0x7f96e43670d0>, body: {"keypair": {"name": "tempest-keypair-2034277225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcDKP+E//xJFw3JAQsajC1y5DowB1Q+Nmn2y2c1KO8jNNaGh0/3jI/I9cD/4YLDIjJtzaexZmY5HUYPdIQ9pHF3Red6Uyu/dRUlZ5zUTZpf6oWwcD8T/H41VuZxuVkHCQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:28:38.729741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-916dfdce-abaa-44ad-b77f-fed2f1c39377 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for project eeb53b4c90074ccf8d023140962e116f. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:28:38.765426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-916dfdce-abaa-44ad-b77f-fed2f1c39377 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for user e1ff464f79ed4f948b6f2d7f3261f5be and project eeb53b4c90074ccf8d023140962e116f. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:28:38.875976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-916dfdce-abaa-44ad-b77f-fed2f1c39377 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.223560 Jul 18 13:28:38.883683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2565/5344] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 13:28:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 13:28:44.981233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:44.986321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-681941001", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9e14db0-4b8e-4177-8196-d5ce8429df44"}], "security_groups": [{"name": "tempest-securitygroup--874403629"}], "key_name": "tempest-keypair-2034277225", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:28:45.328862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] validate_networks() for [('e9e14db0-4b8e-4177-8196-d5ce8429df44', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:28:47.664363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:28:47.666006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:28:47.666527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:28:47.666946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:28:47.667365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:28:47.669425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:47.712954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:47.713452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:47.714566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:47.715007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:47.777613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for project eeb53b4c90074ccf8d023140962e116f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:28:47.793662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Getting quotas for user e1ff464f79ed4f948b6f2d7f3261f5be and project eeb53b4c90074ccf8d023140962e116f. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:28:47.827448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:28:47.830185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:28:47.945419 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56ee1a51-a07c-468f-ba2f-0473601ce14b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.965829 Jul 18 13:28:47.947164 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2780/5345] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 13:28:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2968 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 13:28:47.959122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:47.961002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:47.972491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:47.977524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:48.107531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:48.120355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:48.124669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:48.134366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a2529dbc-7e51-44b7-9952-66eb041e0f94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1281 microversion: 2.20 time: 0.172917 Jul 18 13:28:48.135311 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2566/5346] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:47 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:49.153957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:49.155202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:49.452079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:49.474231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:49.480877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:49.485046 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53e95c9e-c451-4425-b2c8-e0bdb5d1fdb1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1281 microversion: 2.20 time: 0.335665 Jul 18 13:28:49.498585 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2781/5347] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:49 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1281 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:50.515129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:50.516434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:51.046262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:51.080025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:51.088993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:51.093464 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3968a45-eeff-4f4f-b293-c5714671ca25 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1281 microversion: 2.20 time: 0.582288 Jul 18 13:28:51.095583 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2567/5348] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:50 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1281 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:52.113566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:52.114314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:52.136215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:52.140281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:52.145239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:52.145746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:52.331262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:52.355711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:52.368759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:52.371233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-563f11f7-cb12-40f8-a17f-87459a5ee750 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1285 microversion: 2.20 time: 0.262355 Jul 18 13:28:52.378239 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2782/5349] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:52 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1285 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:53.397714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:53.399843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:53.424915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:53.443401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:53.448849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:53.449314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:53.911780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:53.926774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:53.934684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:53.936639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3b30591a-0be0-42f7-bc06-b6c911850d2a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1277 microversion: 2.20 time: 0.544241 Jul 18 13:28:53.937842 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2568/5350] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:53 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1277 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:54.955631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:54.956256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:54.975589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:54.976249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:54.977144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:54.978572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:55.630085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:55.644230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:55.645851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:55.647104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b64062e9-4ac2-494c-9cfb-7dcf639cfaac tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1339 microversion: 2.20 time: 0.696035 Jul 18 13:28:55.661342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2783/5351] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:54 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1339 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:56.667329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:56.668549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:56.687506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:56.688405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:56.689365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:56.689960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:56.894417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:56.949288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:56.962750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:56.970098 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0e3847d7-3698-400f-a26c-9e1a4c8bbf77 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1339 microversion: 2.20 time: 0.306178 Jul 18 13:28:56.970869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2569/5352] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:56 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1339 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:57.989062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:57.991360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:57.999646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:28:58.001817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:58.002524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:58.003609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:28:58.004389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:28:58.925517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:58.942854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:58.947266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:28:58.951731 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3b1689a-60e0-470d-bd83-47d9e659c325 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 0.964888 Jul 18 13:28:58.954029 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2784/5353] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:57 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:28:59.976233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:28:59.979596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:28:59.996697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:00.000021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:00.001095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:00.002832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:00.574415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:29:00.579046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:00.593587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:00.596299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:00.599290 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a310886-f6b5-405a-8e5d-970b67b1bd4a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 0.628954 Jul 18 13:29:00.600252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2570/5354] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:28:59 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:01.341332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-767204e9-019d-4313-9033-8227fc7b9f6b req-048711ed-b03b-4d52-a0f2-7ff8606e1bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:29:01.367811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-767204e9-019d-4313-9033-8227fc7b9f6b req-048711ed-b03b-4d52-a0f2-7ff8606e1bae service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:01.368326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-767204e9-019d-4313-9033-8227fc7b9f6b req-048711ed-b03b-4d52-a0f2-7ff8606e1bae service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:01.432911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-767204e9-019d-4313-9033-8227fc7b9f6b req-048711ed-b03b-4d52-a0f2-7ff8606e1bae service nova] Creating event network-changed:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:29:01.444528 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-767204e9-019d-4313-9033-8227fc7b9f6b req-048711ed-b03b-4d52-a0f2-7ff8606e1bae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.875524 Jul 18 13:29:01.450357 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2785/5355] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:29:01.621572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:01.622375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:01.628354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:29:01.662681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:01.663550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:01.666536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:01.671445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:02.716690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:02.756651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:02.778530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:02.782647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e8652db-a4f3-497c-9164-011f1de21461 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 1.165944 Jul 18 13:29:02.783965 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2571/5356] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:01 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:03.803113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:03.803906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:03.823772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:03.824240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:03.825059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:03.825506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:04.554734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:04.570629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:04.573869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:04.576137 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9ecf98a-529c-4ded-aaed-d89e6ef07adf tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 0.778217 Jul 18 13:29:04.577387 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2786/5357] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:03 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:05.594952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:05.595568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:05.612522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:05.613183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:05.614334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:05.614959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:06.913248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:06.929932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:06.932347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:06.934461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f346676e-14c1-470c-a9a4-6ef8d98af2ef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 1.343556 Jul 18 13:29:06.946111 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2572/5358] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:05 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:07.953197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:07.953964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:07.974677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:07.977793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:07.980431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:07.984614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:08.297407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5137efed-7010-421e-8c99-a1002bc255a1 req-1b9814f8-cc50-4176-a70a-dcd557f7414c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-plugged", "status": "completed", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:29:08.334633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5137efed-7010-421e-8c99-a1002bc255a1 req-1b9814f8-cc50-4176-a70a-dcd557f7414c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:08.335488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5137efed-7010-421e-8c99-a1002bc255a1 req-1b9814f8-cc50-4176-a70a-dcd557f7414c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:08.396722 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5137efed-7010-421e-8c99-a1002bc255a1 req-1b9814f8-cc50-4176-a70a-dcd557f7414c service nova] Creating event network-vif-plugged:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:29:08.412178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5137efed-7010-421e-8c99-a1002bc255a1 req-1b9814f8-cc50-4176-a70a-dcd557f7414c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.657042 Jul 18 13:29:08.418380 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2787/5359] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:29:08.566502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:08.583872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:08.600658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:08.606868 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25110727-bc29-4a65-893f-cf8a349e5789 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 0.654373 Jul 18 13:29:08.613125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2573/5360] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:07 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:09.629291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:09.634120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:09.662212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:09.663079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:09.664193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:09.666730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:10.528328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:10.547578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:10.568440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:10.577235 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ed7935a-a279-41ba-ba32-8917b2314162 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1406 microversion: 2.20 time: 0.955213 Jul 18 13:29:10.580462 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2788/5361] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:09 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1406 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:11.605823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:11.609768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:11.644418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:11.653440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:11.655747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:11.662603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:12.863051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:12.894073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:12.903977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:29:12.905236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2865d45-2924-4000-a8f0-0c4922bc9f4b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1596 microversion: 2.20 time: 1.310821 Jul 18 13:29:12.905830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2574/5362] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:29:11 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1596 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:29:12.945234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:12.947096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:12.960301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:12.961231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:12.963809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:12.965378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:13.120560 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62c67e28-2f9b-4c29-b117-0d3a6d1f9537 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.180550 Jul 18 13:29:13.123351 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2789/5363] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 13:29:12 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:29:15.804622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5ad46903-c523-4839-9abe-3b77a1410ce6 req-8db21933-f879-47d6-b0b8-2a529a368a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:29:15.817837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5ad46903-c523-4839-9abe-3b77a1410ce6 req-8db21933-f879-47d6-b0b8-2a529a368a1b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:15.818321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5ad46903-c523-4839-9abe-3b77a1410ce6 req-8db21933-f879-47d6-b0b8-2a529a368a1b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:15.850191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5ad46903-c523-4839-9abe-3b77a1410ce6 req-8db21933-f879-47d6-b0b8-2a529a368a1b service nova] Creating event network-changed:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:29:15.866040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5ad46903-c523-4839-9abe-3b77a1410ce6 req-8db21933-f879-47d6-b0b8-2a529a368a1b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065100 Jul 18 13:29:15.866986 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2575/5364] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:29:16.795576 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:29:16.796343 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 13:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:29:58.504962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:29:58.507191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:29:58.511244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:29:58.537399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=40 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:29:58.584209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:58.584209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:58.584209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:29:58.584209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:29:58.656738 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-880880cd-10a1-4956-9977-8663006fcfb5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/ips" status: 200 len: 148 microversion: 2.20 time: 0.155439 Jul 18 13:29:58.657174 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2790/5365] 10.222.0.88 () {60 vars in 1288 bytes} [Mon Jul 18 13:29:58 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/ips => generated 148 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:30:03.243567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:30:03.249022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:03.262412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=23 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:03.263971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=44 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:03.268145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:03.269195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:03.271557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:03.272936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:03.350024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lazy-loading 'flavor' on Instance uuid 3aa93be8-78ac-432f-baa4-2a30ae035bfb {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:30:04.672471 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98776130-f80c-4c31-ac7a-e3c94855e4a4 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/action" status: 202 len: 0 microversion: 2.20 time: 1.440094 Jul 18 13:30:04.681893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:04.682932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:04.691049 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2576/5366] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:30:03 2022] POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/action => generated 0 bytes in 1467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:30:04.700519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:04.701147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:04.707190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:04.708043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:07.108563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:07.144713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:07.148597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:07.164787 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-75cca976-b861-41ff-9e6a-6a119ff3d0a6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 2.487113 Jul 18 13:30:07.183911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2791/5367] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:04 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:30:08.194010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:08.195429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:08.232450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:08.236697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:08.239226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:08.247617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:09.452848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:09.472329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:09.477135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:09.482589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0f5b99ed-c51c-42cf-8e20-f09bcbed8bef tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.296746 Jul 18 13:30:09.485919 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2577/5368] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:08 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:10.507795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:10.508650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:10.554448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:10.558325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:10.559622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:10.576083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:12.477527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:12.489646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:12.505765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:12.512840 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e38cd46-9329-410c-8b5b-48c8c00cb732 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 2.009449 Jul 18 13:30:12.514522 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2792/5369] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:10 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:13.532199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:13.533728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:13.551476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:13.553628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:13.558083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:13.559411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:14.446040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:14.457055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:14.481117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:14.497078 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e93898a-16ab-416f-86a7-c69913f51af6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 0.968963 Jul 18 13:30:14.509611 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2578/5370] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:13 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:15.524699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:15.527105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:15.550017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:15.552855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:15.557261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:15.563572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:16.498465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:16.517230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:16.521921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:16.527528 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ffa2bc4-fb9e-430a-b0ee-411c93cf5af5 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.007466 Jul 18 13:30:16.533351 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2793/5371] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:15 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:17.557291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:17.558950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:17.584152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:17.584613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:17.596776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:17.599625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:19.303185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:19.343738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:19.356605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:19.359639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1e7b144c-a6d8-4d76-8d61-79e2539e1f35 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.810190 Jul 18 13:30:19.362914 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2579/5372] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:17 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:20.389577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:20.391017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:20.408214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:20.411279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:20.413852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:20.415501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:20.944470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:20.963204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:20.966545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:20.980375 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a841bd02-94fa-44ef-a15e-9bd1b8e8173a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 0.602755 Jul 18 13:30:20.981683 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2794/5373] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:20 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:22.004206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:22.005722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:22.021986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:22.034470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:22.040610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:22.042214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:23.585497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:23.598910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:23.600954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:23.608785 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9eb96721-b021-4398-a332-ddc2ed429bf8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.607845 Jul 18 13:30:23.611250 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2580/5374] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:21 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:24.633407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:24.634350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:24.652052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:24.662466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:24.663778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:24.671102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:25.955296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:25.969383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:25.972240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:25.979783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-823b32a6-0e4b-42ab-8652-51da1bd3b6b9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.350559 Jul 18 13:30:25.980555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2795/5375] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:24 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:26.999816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:27.001117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:27.024551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:27.029805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:27.039680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:27.040403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:28.377997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:28.434698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:28.437909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:28.442592 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8cfb91fd-d51a-417d-bbd9-30ea9e80e6f6 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1740 microversion: 2.20 time: 1.446901 Jul 18 13:30:28.449981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2581/5376] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:26 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1740 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:29.481200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:29.504232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:29.546658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=13 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:29.549487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:29.554938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:29.559417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:29.563476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:29.600771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=35 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:32.353206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:32.387181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:32.390526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:32.398594 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-83b8b744-934f-4df1-b651-46a38974d008 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 2.934231 Jul 18 13:30:32.401702 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2796/5377] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:29 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:33.426299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:33.427277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:33.440740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=13 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:33.447696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:33.450734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:33.455078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:33.456119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:33.502579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:30:34.839043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:34.848987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:34.860654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:34.865181 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f840e8e-b547-4f1e-a457-077dfe404979 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.442167 Jul 18 13:30:34.866036 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2582/5378] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:33 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:35.890821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:35.894850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:35.930192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:35.934693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:35.937894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:35.938563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:37.187165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:37.211712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:37.218358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:37.219915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9267bd3d-c78c-423a-a895-ae7a0f05e241 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.335581 Jul 18 13:30:37.223842 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2797/5379] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:35 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:38.248882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:38.249523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:38.273460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:38.273943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:38.274748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:38.284065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:39.788613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-907be339-3d3c-485f-9808-9c2f581c6251 req-9178e8e2-bdea-49f9-a8e6-461f8f182e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-plugged", "status": "completed", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:30:39.830246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-907be339-3d3c-485f-9808-9c2f581c6251 req-9178e8e2-bdea-49f9-a8e6-461f8f182e5b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:39.831833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-907be339-3d3c-485f-9808-9c2f581c6251 req-9178e8e2-bdea-49f9-a8e6-461f8f182e5b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:39.898427 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-907be339-3d3c-485f-9808-9c2f581c6251 req-9178e8e2-bdea-49f9-a8e6-461f8f182e5b service nova] Creating event network-vif-plugged:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:30:39.912223 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-907be339-3d3c-485f-9808-9c2f581c6251 req-9178e8e2-bdea-49f9-a8e6-461f8f182e5b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129019 Jul 18 13:30:39.913441 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2798/5380] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:30:40.079559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:40.089397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:40.100513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:40.101798 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-90212d0d-2388-476d-aeb4-22e707e4fbb0 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.864868 Jul 18 13:30:40.116687 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2583/5381] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:38 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:41.130882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:41.131596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:41.157502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:41.158173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:41.159160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:41.159758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:43.058575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:43.069148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:43.070710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:43.102700 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10d4ab32-f8bd-4f7a-98f6-c33d9b724f66 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.946563 Jul 18 13:30:43.103451 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2799/5382] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:41 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:44.128906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:44.130442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:44.153284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:44.164785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:44.168897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:44.171635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:45.709410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:45.721493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:45.723542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:45.727271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b5540bf-8506-4a02-919d-c91e7aa7270f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.609042 Jul 18 13:30:45.741449 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2584/5383] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:44 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:46.756125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:46.756912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:46.804323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:46.805150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:46.806131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:46.807401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:49.468615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:49.512150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:49.513807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:49.546650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b70605f-92b2-4ae4-a8ad-bf4c029b3dc2 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 2.792640 Jul 18 13:30:49.559339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2800/5384] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:46 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 2803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:50.566199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:50.566813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:50.582421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:50.582883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:50.583692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:50.584134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:52.208405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:52.277651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:52.311083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:52.312383 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-43057d99-f482-441f-b941-92089cbbab75 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.750997 Jul 18 13:30:52.313064 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2585/5385] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:50 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:53.336111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:53.338734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:53.365117 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:53.365707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:53.366576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:53.367024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:54.440698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:54.451248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:54.471548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:54.481405 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-04ee32c4-2336-4e9f-a978-8ebbd0da3d60 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.152268 Jul 18 13:30:54.484771 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2801/5386] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:53 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:55.503505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:55.504355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:55.528044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:55.528217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:55.532241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:55.532241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:58.384333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:58.393781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:58.395332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:30:58.429227 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5c1458a-87bc-4932-84ff-ae461375c790 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 2.923370 Jul 18 13:30:58.429902 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2586/5387] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:55 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 2931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:30:59.448967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:30:59.449581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:30:59.476808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:59.477267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:30:59.478057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:30:59.497899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:00.373591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:00.388178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:00.413473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:00.417403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:00.424039 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1820beb-d717-46d9-9294-09c981b46b6f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 0.979516 Jul 18 13:31:00.428714 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2802/5388] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:30:59 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:01.448398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:01.449213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:01.495810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:01.502488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:01.511366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:01.513912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:02.763654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:02.772617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:02.784228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:02.800653 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69facc38-0c54-4116-ba0b-170a8c0139dd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.357231 Jul 18 13:31:02.812218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2587/5389] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:01 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:03.820144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:03.820767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:03.850127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:03.850127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:03.850639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:03.858085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:03.862685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:04.514566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:04.524325 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:04.537898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:04.539400 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-04db69f9-95bc-42d8-a12f-51a10a10e92f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 0.723464 Jul 18 13:31:04.548685 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2803/5390] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:03 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:05.574622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:05.575254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:05.629754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:05.635604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:05.636114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:05.636935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:05.639814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:05.700537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:07.168228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:07.178001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:07.189496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:07.190809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cd77a91-6076-4b97-836b-192a31a3a621 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.626998 Jul 18 13:31:07.191385 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2588/5391] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:05 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:08.211284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:08.211910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:08.258093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:08.258588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:08.259368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:08.260372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:10.013024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:10.049898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:10.054351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:10.055610 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-996a2202-4420-4d5f-b2e9-0a8ae3f8b552 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1735 microversion: 2.20 time: 1.849214 Jul 18 13:31:10.068030 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2804/5392] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:08 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1735 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:31:11.088895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:11.089659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:11.110694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:11.111308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:11.112419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:11.112864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:12.424221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:12.433415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:12.435059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:12.436284 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd6f98ca-dd64-440c-bca2-c7d35af2996a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1717 microversion: 2.20 time: 1.354991 Jul 18 13:31:12.436867 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2589/5393] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:11 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1717 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:13.455972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:13.457256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:13.476312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:13.477048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:13.478001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:13.479388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:14.319751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:14.336738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:14.338651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:14.340119 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1818351-04f4-4cc3-b3ee-c2df77b299fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1717 microversion: 2.20 time: 0.888173 Jul 18 13:31:14.354547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2805/5394] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:13 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1717 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:15.367897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:15.369388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:15.382589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:15.383316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:15.385466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:15.388409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:15.434767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a1ca566a-a434-4f2a-a063-5cad995782c3 req-4d6c164e-acdb-4be4-9ffd-6e65f2ca1853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-unplugged", "status": "completed", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:31:15.459372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a1ca566a-a434-4f2a-a063-5cad995782c3 req-4d6c164e-acdb-4be4-9ffd-6e65f2ca1853 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:15.465196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a1ca566a-a434-4f2a-a063-5cad995782c3 req-4d6c164e-acdb-4be4-9ffd-6e65f2ca1853 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:15.517286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.compute.server_external_events [req-a1ca566a-a434-4f2a-a063-5cad995782c3 req-4d6c164e-acdb-4be4-9ffd-6e65f2ca1853 service nova] Unable to find a host for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb. Dropping event network-vif-unplugged {{(pid=131366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 13:31:15.527421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a1ca566a-a434-4f2a-a063-5cad995782c3 req-4d6c164e-acdb-4be4-9ffd-6e65f2ca1853 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091249 Jul 18 13:31:15.531388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2806/5395] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 13:31:16.386790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:16.409108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:16.411876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:16.413083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38165a95-361b-44d7-ae30-5553695a72ff tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1720 microversion: 2.20 time: 1.051638 Jul 18 13:31:16.435915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b921da30-1c8c-4039-a0b4-75733e5b5613"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:31:16.437082 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2590/5396] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:15 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1720 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:16.438296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:16.448389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:16.454522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:16.455687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:16.457638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:17.216476 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a283c0a-f59b-49fc-91d2-1b4dbf833633 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.784404 Jul 18 13:31:17.219703 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2807/5397] 10.222.0.88 () {62 vars in 1363 bytes} [Mon Jul 18 13:31:16 2022] POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments => generated 188 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:31:17.530957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:17.531503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:17.560589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:17.561061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:17.561916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:17.562373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:18.222271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-567ed239-72cd-45e1-9b55-4651f5da0a2c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments/b921da30-1c8c-4039-a0b4-75733e5b5613" status: 202 len: 0 microversion: 2.20 time: 0.697103 Jul 18 13:31:18.223416 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2591/5398] 10.222.0.88 () {60 vars in 1456 bytes} [Mon Jul 18 13:31:17 2022] DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments/b921da30-1c8c-4039-a0b4-75733e5b5613 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:31:18.347503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:31:18.348672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:18.364199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:18.364882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:18.365830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:18.366483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:18.751548 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5312502d-6026-4f6e-b863-8b62f3a78f34 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/action" status: 202 len: 0 microversion: 2.20 time: 0.407880 Jul 18 13:31:18.756387 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2808/5399] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 13:31:18 2022] POST /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:31:18.763911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:18.765367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:18.798083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:18.800716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:18.803263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:18.804667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:20.185419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:20.202223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:20.219807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:20.226429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-728cd8d6-8fdd-4a63-897d-42bffc62f1e7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1668 microversion: 2.20 time: 1.465807 Jul 18 13:31:20.243360 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2592/5400] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:18 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1668 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:21.254799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:21.255493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:21.266132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:21.270700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:21.271835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:21.286474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:23.123733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:23.151461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:23.153508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:23.156560 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da696c20-83b0-4aa8-8c2f-7dc0a9290f6c tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1670 microversion: 2.20 time: 1.906251 Jul 18 13:31:23.163214 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2809/5401] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:21 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1670 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:24.190067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:24.192164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:24.216679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:24.217151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:24.217964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:24.218428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:25.058159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:25.077683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:25.080088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:25.090126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-87292917-9e55-4e7a-a986-d65488f5da94 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.910192 Jul 18 13:31:25.094217 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2593/5402] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:24 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:26.112489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:26.113114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:26.157576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:26.157712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:26.161984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:26.162495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:26.653042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:26.667517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:26.672672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:26.674520 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7cf3f38-c072-4bea-989b-158a4f9bfeda tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.569393 Jul 18 13:31:26.678483 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2810/5403] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:26 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:27.694699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:27.695478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:27.706488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:27.707194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:27.710081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:27.710742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:28.847274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:28.856888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:28.873625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:28.876064 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a9d955f-a348-491f-9af1-9053208f576a tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.185426 Jul 18 13:31:28.886755 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2594/5404] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:27 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:29.904320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:29.905913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:29.944252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:29.948286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:29.949310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:29.952840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:30.747792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:30.759827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:30.771270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:30.772605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0879d2be-3b0f-4880-b35d-73720835a914 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.874929 Jul 18 13:31:30.782750 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2811/5405] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:29 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:31.802009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:31.803473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:31.817283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:31.824097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:31.829137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:31.837960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:33.019580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:33.039856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:33.043126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:33.044851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38e5adf6-5037-4309-8f16-7380eef92689 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.247664 Jul 18 13:31:33.051015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2595/5406] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:31 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:34.073288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:34.074945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:34.088781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=20 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:34.093712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:34.098472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:34.099705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:34.100397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:34.172592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:35.903513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:35.924235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:35.926847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:35.928998 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4027008c-b27c-4a9e-93e2-099780f52ff9 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.860036 Jul 18 13:31:35.930138 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2812/5407] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:34 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:36.951048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:36.952363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:36.955964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:36.982713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:36.995642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:36.998684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:37.001971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:37.107767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:31:37.610120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:37.633172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:37.637536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:37.652548 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f5b17b51-edad-48e7-823b-27bd92b0b8de tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.707447 Jul 18 13:31:37.665711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2596/5408] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:36 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:38.691049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:38.695260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:38.732629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:38.737998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:38.739993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:38.741018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:39.227525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:39.237689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:39.239246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:39.240466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a465a2e3-10f2-4738-89d7-19aaf49d087e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.557744 Jul 18 13:31:39.241042 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2813/5409] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:38 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:40.293741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:40.298300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:40.355233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:40.356760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:40.359254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:40.366035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:41.862804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:41.883010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:41.892028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:41.898979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf0e41b5-a96e-46ce-9eec-3dd9168e4cc1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.625072 Jul 18 13:31:41.903197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2597/5410] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:40 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:42.926044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:42.926727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:42.954258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:42.954723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:42.955526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:42.955973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:44.031224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:44.047791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:44.054805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:44.061950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd35ad78-d8e1-4c08-8948-7d9c3f57e225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.143377 Jul 18 13:31:44.071928 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2814/5411] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:42 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:45.091561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:45.092186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:45.117856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:45.125824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:45.132110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:45.136627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:47.349606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:47.387033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:47.403615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:47.410572 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80af46bf-f455-408c-a3ee-4176cc598b47 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 2.323795 Jul 18 13:31:47.415185 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2598/5412] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:45 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:48.436448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:48.437850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:48.468937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:48.469946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:48.492663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:48.493655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:49.180289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:49.243817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:49.265254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:49.272787 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cfc571cd-84f9-4981-9ee5-a1c2dc70e12e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.842299 Jul 18 13:31:49.296624 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2815/5413] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:48 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:50.303295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:50.307361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:50.330902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:50.333008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:50.334083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:50.336154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:51.210837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:51.227157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:51.234249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:51.235875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-047971a3-d5eb-4d8a-850f-61716cb4e65e tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.936580 Jul 18 13:31:51.237460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2599/5414] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:50 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:52.254330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:52.255035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:52.270122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:52.270612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:52.271408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:52.271852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:52.718772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:52.728011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:52.729594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:52.730889 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3a2012e-c7f1-4384-ab57-cf7b907d7cba tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.480994 Jul 18 13:31:52.745820 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2816/5415] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:52 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:53.765163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:53.765796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:53.783187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:53.783666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:53.785044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:53.789304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:54.467737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:54.481746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:54.483788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:54.496416 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-877c6514-771c-4d07-973d-5c06bfe3e29f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.736401 Jul 18 13:31:54.497617 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2600/5416] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:53 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:55.517736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:55.518490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:55.539882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:55.540202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:55.544423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:55.546735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:57.743387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:57.762557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:57.764262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:31:57.768978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ed14258d-ecee-44f3-9c80-f56efff6d225 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 2.257734 Jul 18 13:31:57.769613 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2817/5417] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:55 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:31:58.791671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:31:58.792535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:31:58.833079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:58.856345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:58.871752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:58.872226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:59.747780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d815eff6-e54e-4872-8aee-394dd17377c1 req-c2170587-2e19-41fe-b98a-1038972ce6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-plugged", "status": "completed", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:31:59.794681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d815eff6-e54e-4872-8aee-394dd17377c1 req-c2170587-2e19-41fe-b98a-1038972ce6ca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:31:59.795466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d815eff6-e54e-4872-8aee-394dd17377c1 req-c2170587-2e19-41fe-b98a-1038972ce6ca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:31:59.837568 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d815eff6-e54e-4872-8aee-394dd17377c1 req-c2170587-2e19-41fe-b98a-1038972ce6ca service nova] Creating event network-vif-plugged:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:31:59.852493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d815eff6-e54e-4872-8aee-394dd17377c1 req-c2170587-2e19-41fe-b98a-1038972ce6ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110540 Jul 18 13:31:59.856266 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2818/5418] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:32:00.257060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:00.270708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:00.286097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:00.296636 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c8c39f1-f396-4d45-9165-2399998535fb tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.511298 Jul 18 13:32:00.297249 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2601/5419] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:31:58 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:01.320189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:01.321703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:01.332121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:01.332865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:01.334060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:01.334753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:02.383216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:02.407245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:02.411107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:02.413370 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c3ad1f6-a536-4310-b182-229810136e26 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 1.101664 Jul 18 13:32:02.428376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2819/5420] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:01 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:03.436937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:03.437737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:03.451281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:03.452347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:03.452489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:03.452910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:03.785515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:03.801355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:03.803094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:03.805774 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c9a8890e-5da7-49dd-9555-4ab41080b890 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1726 microversion: 2.20 time: 0.373693 Jul 18 13:32:03.811198 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2602/5421] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:03 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1726 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:04.829035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:04.830345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:04.840994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:04.844096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:04.848180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:04.849240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:04.849794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:04.861832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=44 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:07.050532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:07.080737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:07.086774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:07.094541 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4726bb49-fc1b-4c81-953e-317442c12e27 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1713 microversion: 2.20 time: 2.269645 Jul 18 13:32:07.095840 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2820/5422] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:04 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1713 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:32.746254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1f5d739e-0bcf-4403-b8a9-c80877d0881e tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Action: 'create', calling method: .version_select at 0x7f96e99fae50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-126852008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdCFhLKLG5Z80H/e4skCJj+ZyzvSUcbNYdIoarClMTvnxMgTAdFTMK2BvwhYAfZ8THvwM514+VoeSmWefbFUmLv8Mtrm8guEfeylFYRKcFnX4HmE7kjDlgDHqyvUjD7KQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:32:32.763249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=13 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:32.769351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=41 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:32.816201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1f5d739e-0bcf-4403-b8a9-c80877d0881e tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Getting quotas for project 8c68e9b76eab4e5a8b5415f2b763e883. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:32:32.832504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-1f5d739e-0bcf-4403-b8a9-c80877d0881e tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Getting quotas for user fc02341afda74e04b763dfe84bca7099 and project 8c68e9b76eab4e5a8b5415f2b763e883. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:32:32.914185 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1f5d739e-0bcf-4403-b8a9-c80877d0881e tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.173904 Jul 18 13:32:32.915252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2603/5423] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:32:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:32:36.805710 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:32:36.806740 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 13:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:32:40.028722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-538004125", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "488338da-2e2a-4a43-aabc-efdb2ed63b56", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-126852008", "security_groups": [{"name": "tempest-secgroup-smoke-184466704"}], "networks": [{"uuid": "f7e752fd-c79a-45f7-8390-63d28f413140"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:32:40.051050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:40.064976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=5 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:40.687781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] validate_networks() for [('f7e752fd-c79a-45f7-8390-63d28f413140', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:32:42.235037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:32:42.237129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:32:42.238385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:32:42.239525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:32:42.241555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:32:42.296452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:42.304948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:42.311254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:42.315697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:42.405509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Getting quotas for project 8c68e9b76eab4e5a8b5415f2b763e883. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:32:42.433786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Getting quotas for user fc02341afda74e04b763dfe84bca7099 and project 8c68e9b76eab4e5a8b5415f2b763e883. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:32:42.634780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:32:42.638928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='488338da-2e2a-4a43-aabc-efdb2ed63b56',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:32:42.999611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4bb98228-0111-4ec1-9fa1-a4b5ad8822b3 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.976234 Jul 18 13:32:43.003283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2821/5424] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:32:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:32:43.011972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:43.013388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:43.018668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f8215c3-9af7-4459-8539-ed54838305b2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:43.024147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f8215c3-9af7-4459-8539-ed54838305b2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:43.383025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f8215c3-9af7-4459-8539-ed54838305b2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:43.401402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f8215c3-9af7-4459-8539-ed54838305b2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1097 microversion: 2.1 time: 0.389543 Jul 18 13:32:43.409377 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2604/5425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:43 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1097 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:44.435621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9c0cbb79-0958-42fb-b286-70f4a2a592d6 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:44.436589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9c0cbb79-0958-42fb-b286-70f4a2a592d6 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:44.755338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9c0cbb79-0958-42fb-b286-70f4a2a592d6 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:44.766348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9c0cbb79-0958-42fb-b286-70f4a2a592d6 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1097 microversion: 2.1 time: 0.335297 Jul 18 13:32:44.769307 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2822/5426] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:44 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1097 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:45.795162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:45.795799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:45.818398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:45.819452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:45.822063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:45.823624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:47.107761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:47.168882 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0ab5285-2903-4470-9c48-95cb30e4e789 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1203 microversion: 2.1 time: 1.378787 Jul 18 13:32:47.176824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2605/5427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:45 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1203 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:48.200537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:48.201317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:48.222309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:48.224467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:48.226716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:48.227860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:48.680418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:48.699135 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5200379b-188c-46a4-a982-f6e624e411fa tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1213 microversion: 2.1 time: 0.503836 Jul 18 13:32:48.700409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2823/5428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:48 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1213 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:49.475964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:49.477003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:49.487216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.487970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.489321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.490934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.560831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c531e12-dea0-45b1-88f4-580b94b33cf1 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076606 Jul 18 13:32:49.569292 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2606/5429] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 13:32:49 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:49.682951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:49.683522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:49.693287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.694945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.696290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.696987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.719518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:49.720152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:49.730847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.731311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.732123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:49.732569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:49.740945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:32:50.035881 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a64eec1-0f8f-402b-918b-4c142e8babca tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 204 len: 0 microversion: 2.20 time: 0.357332 Jul 18 13:32:50.036964 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2824/5430] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:32:49 2022] DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:32:50.054191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:50.059499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:50.084667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:50.088262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:50.089197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:50.091806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:50.539377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:50.557400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:50.559526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:50.571230 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5522679-8b8e-41a7-8cc8-82a6cd0ac6cd tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 0.515035 Jul 18 13:32:50.572682 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2825/5431] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:50 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:51.396773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:51.422192 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d686d69-1a0b-4000-8b1c-75cb0995a7cb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1280 microversion: 2.1 time: 1.707418 Jul 18 13:32:51.426513 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2607/5432] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:49 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1280 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:51.595543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:51.596346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:51.609246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:51.620307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:51.623128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:51.624260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:52.366569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:52.444638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:52.445971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:52.462292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:52.480092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:52.481285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:52.481922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:53.052306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:53.095185 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8b5f410-0d80-4371-a6bf-d6d5b6417874 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1280 microversion: 2.1 time: 0.655357 Jul 18 13:32:53.096364 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2608/5433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:52 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1280 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:53.522103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:53.550915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:53.553188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:53.555075 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-06f7fc62-add3-441e-8e09-8b2c48d07075 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 1.964071 Jul 18 13:32:53.557902 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2826/5434] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:51 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:32:53.610834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:53.960049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0a545a2a-0b7c-47f8-98bc-9eaa48de76b9 req-91f50abb-cb16-4c4d-9915-efb29184939c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:32:53.975904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0a545a2a-0b7c-47f8-98bc-9eaa48de76b9 req-91f50abb-cb16-4c4d-9915-efb29184939c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:53.976645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0a545a2a-0b7c-47f8-98bc-9eaa48de76b9 req-91f50abb-cb16-4c4d-9915-efb29184939c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:54.006010 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0a545a2a-0b7c-47f8-98bc-9eaa48de76b9 req-91f50abb-cb16-4c4d-9915-efb29184939c service nova] Creating event network-changed:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:32:54.022842 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0a545a2a-0b7c-47f8-98bc-9eaa48de76b9 req-91f50abb-cb16-4c4d-9915-efb29184939c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421374 Jul 18 13:32:54.034241 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2609/5435] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:32:54.123991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:54.128615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:54.143553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:54.149122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:54.150964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:54.153395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:54.577958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:54.579149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:54.600147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:54.600622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:54.615265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:54.615873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:54.760020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:32:55.251267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:55.260052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:55.261566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:55.263018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6383bb5c-cf46-4d9c-978f-9e9911370cd8 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 0.689921 Jul 18 13:32:55.283054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2610/5436] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:54 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:55.288981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f22f992f-39db-4f38-b13d-c3e4d4a4e99c req-8b38a0ab-8885-4b3a-94aa-faef24671201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-unplugged", "status": "completed", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:32:55.320256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f22f992f-39db-4f38-b13d-c3e4d4a4e99c req-8b38a0ab-8885-4b3a-94aa-faef24671201 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:55.324454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f22f992f-39db-4f38-b13d-c3e4d4a4e99c req-8b38a0ab-8885-4b3a-94aa-faef24671201 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:55.395095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f22f992f-39db-4f38-b13d-c3e4d4a4e99c req-8b38a0ab-8885-4b3a-94aa-faef24671201 service nova] Creating event network-vif-unplugged:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:32:55.412126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f22f992f-39db-4f38-b13d-c3e4d4a4e99c req-8b38a0ab-8885-4b3a-94aa-faef24671201 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117484 Jul 18 13:32:55.413727 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2611/5437] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:32:55.848445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:55.870989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9300ec8-08f3-4704-bc63-066b1159f1c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1280 microversion: 2.1 time: 1.761218 Jul 18 13:32:55.876100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2827/5438] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:54 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1280 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:32:56.286837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:56.288455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:56.325050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:56.325514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:56.326346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:56.326999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:56.891834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:56.892465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:56.902339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:56.911252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:56.916331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:56.916723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:57.223300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:57.248133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:57.250232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:57.255809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd17cc07-fcfe-402f-97c4-8f4496aeef76 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1719 microversion: 2.20 time: 0.977616 Jul 18 13:32:57.256535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2612/5439] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:56 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1719 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 13:32:58.276305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:58.277202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:58.300807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:58.301603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:58.302645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:58.303305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:58.592729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:58.604302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4cec067e-1caa-40fb-a756-14b4748e89eb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1280 microversion: 2.1 time: 1.716273 Jul 18 13:32:58.614699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2828/5440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:56 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1280 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:32:58.795989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:58.808789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:58.814077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:32:58.819901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30cbfdf4-0963-42e2-9087-343c5527ae56 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1652 microversion: 2.20 time: 0.548157 Jul 18 13:32:58.825617 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2613/5441] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:58 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1652 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:32:59.631372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:59.631893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:59.641049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:59.641496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:59.642265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:59.642802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:59.707531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-98bb2bd3-dd2c-4296-a835-29e90bf3ec1c req-1736be72-1880-49da-a642-44cee0361f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa93be8-78ac-432f-baa4-2a30ae035bfb", "name": "network-vif-deleted", "tag": "a91602ee-1e59-45de-bb12-f81206554ad7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:32:59.729660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-98bb2bd3-dd2c-4296-a835-29e90bf3ec1c req-1736be72-1880-49da-a642-44cee0361f0c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:59.730109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-98bb2bd3-dd2c-4296-a835-29e90bf3ec1c req-1736be72-1880-49da-a642-44cee0361f0c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:59.800805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-98bb2bd3-dd2c-4296-a835-29e90bf3ec1c req-1736be72-1880-49da-a642-44cee0361f0c service nova] Creating event network-vif-deleted:a91602ee-1e59-45de-bb12-f81206554ad7 for instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb on n-h2-850003-3 Jul 18 13:32:59.824839 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-98bb2bd3-dd2c-4296-a835-29e90bf3ec1c req-1736be72-1880-49da-a642-44cee0361f0c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121055 Jul 18 13:32:59.831361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2614/5442] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:32:59.854019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:32:59.857566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:32:59.879112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:59.880446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:32:59.882865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:32:59.884613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:00.029448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:00.029912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:00.030410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lazy-loading 'fault' on Instance uuid 3aa93be8-78ac-432f-baa4-2a30ae035bfb {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:33:00.171905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:00.191390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:00.195345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ff464f79ed4f948b6f2d7f3261f5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb53b4c90074ccf8d023140962e116f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:00.197768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d385f061-4894-4072-ae41-6bff04f21c54 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 200 len: 1371 microversion: 2.20 time: 0.357128 Jul 18 13:33:00.201279 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2615/5443] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:32:59 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 13:33:00.663212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:00.677519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f41eced6-ff6f-47bc-b8a4-788a1bca2ea0 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 1.050016 Jul 18 13:33:00.678356 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2829/5444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:32:59 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:33:01.222875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:01.223407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:01.235067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:01.235530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:01.236386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:01.236836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:01.271176 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb HTTP/1.1 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '3aa93be8-78ac-432f-baa4-2a30ae035bfb'} Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:01.279232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:01.284141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:01.285684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:33:01.286822 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e505ac5-9441-48ce-a4ec-3535f177bec7 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 404 len: 111 microversion: 2.20 time: 0.071542 Jul 18 13:33:01.288183 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2616/5445] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:33:01 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:33:01.297201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7fcff826-2ac2-420e-910f-5e76dd43558b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '.version_select at 0x7f96e4bf5430>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:01.339915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7fcff826-2ac2-420e-910f-5e76dd43558b tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034277225" status: 204 len: 0 microversion: 2.20 time: 0.046719 Jul 18 13:33:01.340956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2830/5446] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 13:33:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034277225 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 13:33:01.705655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:01.707586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:01.728212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:01.735994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:01.738638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:01.739503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:02.816048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:02.827221 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b3f4e44-210c-475d-becf-7828e0e79abd tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 1.136156 Jul 18 13:33:02.838707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2617/5447] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:01 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:03.847936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:03.854958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:03.891333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:03.894452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:03.895390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:03.895861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:04.653357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:04.686183 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5c8aea5-baa5-4d9c-8d68-7df203eead6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 0.844837 Jul 18 13:33:04.689525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2831/5448] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:03 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:05.708805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:05.709598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:05.720149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:05.724519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:05.735363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:05.737612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:06.623250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:06.631981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd1f54ba-2013-47fe-82e6-f0784df521fb tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 0.926983 Jul 18 13:33:06.641174 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2618/5449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:05 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:07.652236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:07.652868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:07.664228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:07.664684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:07.665480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:07.665967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:08.517614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:08.535423 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13018d99-d820-4fc4-aaac-103912c2fe6d tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 0.887563 Jul 18 13:33:08.536342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2832/5450] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:07 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:09.412394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:09.413198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:09.428743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.429622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.433744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.434855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.488988 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb HTTP/1.1 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '3aa93be8-78ac-432f-baa4-2a30ae035bfb'} Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:33:09.491351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.497463 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.502728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:33:09.506655 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da4f39d8-9b5d-4196-a101-89015b6eaa95 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 404 len: 111 microversion: 2.20 time: 0.100047 Jul 18 13:33:09.520612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2619/5451] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:33:09 2022] DELETE /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:33:09.527378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:09.528659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: 3aa93be8-78ac-432f-baa4-2a30ae035bfb] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:09.546110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.556518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.557795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:09.558664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:09.559683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.568249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.601777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.604342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.606454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:09.607125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:09.634521 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb HTTP/1.1 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3aa93be8-78ac-432f-baa4-2a30ae035bfb'} Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.639001 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. Jul 18 13:33:09.643506 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:09.647925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance 3aa93be8-78ac-432f-baa4-2a30ae035bfb could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:33:09.655916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c708979f-de3c-42c9-8f69-127bbcc6830f tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb" status: 404 len: 111 microversion: 2.20 time: 0.128123 Jul 18 13:33:09.656788 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2833/5452] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:33:09 2022] GET /compute/v2.1/servers/3aa93be8-78ac-432f-baa4-2a30ae035bfb => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:33:10.243276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:10.256869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ef58c96-0348-4272-a90e-d99b4f1bf519 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 0.707231 Jul 18 13:33:10.263630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2620/5453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:09 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:33:11.279925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:11.281694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:11.292114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:11.314834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:11.323449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:11.326954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:11.334713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:11.365179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:12.073706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:12.082261 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ee52a71-7aae-4dd6-a1e7-cda9a6c88429 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 0.807877 Jul 18 13:33:12.096430 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2834/5454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:11 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:13.101012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:13.103824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:13.143055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=39 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:13.160436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:13.161306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:13.167437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:13.173675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:13.356598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=79 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:16.205216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:16.229261 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36297f84-b8fe-4e7c-abb3-d95d0dd602d9 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 3.133874 Jul 18 13:33:16.246246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2621/5455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:13 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 3136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:16.496194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9fafc0d0-6e50-48b4-8ebc-9c96dd4954b8 req-bbea7577-0cc1-4685-b66e-6bc727830f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "name": "network-vif-plugged", "status": "completed", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:33:16.523947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9fafc0d0-6e50-48b4-8ebc-9c96dd4954b8 req-bbea7577-0cc1-4685-b66e-6bc727830f19 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:16.538579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9fafc0d0-6e50-48b4-8ebc-9c96dd4954b8 req-bbea7577-0cc1-4685-b66e-6bc727830f19 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:16.648838 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9fafc0d0-6e50-48b4-8ebc-9c96dd4954b8 req-bbea7577-0cc1-4685-b66e-6bc727830f19 service nova] Creating event network-vif-plugged:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:33:16.681910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9fafc0d0-6e50-48b4-8ebc-9c96dd4954b8 req-bbea7577-0cc1-4685-b66e-6bc727830f19 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182762 Jul 18 13:33:16.685468 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2835/5456] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:33:17.249577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:17.250627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:17.271687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:17.272066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:17.272960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:17.273373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:17.961188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:17.961782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:17.985069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:17.985880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:17.990104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:17.994173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:18.031556 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 HTTP/1.1 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e92559b4-dcfc-4706-96ac-d109395e2c13'} Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:33:18.049735 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.054811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:33:18.062252 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-41d2f09e-c1cb-4041-a953-1791cd165a69 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 404 len: 111 microversion: 2.20 time: 0.098740 Jul 18 13:33:18.063586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2836/5457] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 13:33:17 2022] DELETE /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 13:33:18.078860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:18.079944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] [instance: e92559b4-dcfc-4706-96ac-d109395e2c13] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:18.097086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:18.100715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:18.105175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:18.108466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:18.134184 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] HTTP exception thrown: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Request method failure captured: Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 HTTP/1.1 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1V7bPcFT3GphPIaLMMKuSMgy6F8ONdBTChqCsesmHG3cU21gHXR2obJ_wed9IILf2pAEgWw9ZB4NKi-CgrXLL-Znbctv8Avkw_z4MnDn_k1-SexTGzmMVDYCG7LLUwR8dmv-vDvrwgJGJ77wN_vcOsH6ILrqH-25KqwF5QRoVTHlxT0 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_eeb53b4c90074ccf8d023140962e116f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/eeb53b4c90074ccf8d023140962e116f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: eeb53b4c90074ccf8d023140962e116f Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-629841942 Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e1ff464f79ed4f948b6f2d7f3261f5be Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-629841942-project Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e92559b4-dcfc-4706-96ac-d109395e2c13'} Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.148239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. Jul 18 13:33:18.152997 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:33:18.154943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] Returning 404 to user: Instance e92559b4-dcfc-4706-96ac-d109395e2c13 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:33:18.156041 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19c8521e-66c1-4800-beec-27e85af36814 tempest-AttachVolumeShelveTestJSON-629841942 tempest-AttachVolumeShelveTestJSON-629841942-project] 10.222.0.88 "GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13" status: 404 len: 111 microversion: 2.20 time: 0.088777 Jul 18 13:33:18.157204 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2837/5458] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 13:33:18 2022] GET /compute/v2.1/servers/e92559b4-dcfc-4706-96ac-d109395e2c13 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:33:18.658019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:18.669965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e56a7797-8c40-4316-8531-3d58d86d2698 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1268 microversion: 2.1 time: 1.424046 Jul 18 13:33:18.694558 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2622/5459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:17 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1268 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:19.692425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:19.693288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:19.713017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:19.715302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:19.719340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:19.720285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:21.043591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:21.056265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a27dba02-8807-4ca1-9703-57f34b7bea22 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1457 microversion: 2.1 time: 1.368209 Jul 18 13:33:21.056859 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2838/5460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:19 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1457 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:33:21.075963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:33:21.077115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:33:21.101872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:21.102625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:21.104225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:21.109043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:22.718641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:33:22.731444 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ee60cc1-0cda-4ffb-abac-ea258b0e6c28 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1457 microversion: 2.1 time: 1.659609 Jul 18 13:33:22.747981 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2623/5461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:33:21 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1457 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:33:27.739482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fea322c0-8873-4f06-af4f-6e2cc2bb7a77 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Action: 'create', calling method: .version_select at 0x7f96e42cf550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-910348233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEixqU3yZT5YhL62EANheufk8SGvAfDFxzLQKNGtLW6pVpCBLWfwvxzK/V7Jx/68EmergXRvc/CQq0YOcEZiEayHUhd2+QZbc/WUHvL42t/df7nNaDc7c+Cm17K4FaCIvQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:33:27.784318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fea322c0-8873-4f06-af4f-6e2cc2bb7a77 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for project a9ac4ccbd72e44459e07258b615d8209. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:33:27.811847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fea322c0-8873-4f06-af4f-6e2cc2bb7a77 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for user 07dd4a3d71794e69a913c24860047123 and project a9ac4ccbd72e44459e07258b615d8209. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:33:27.874680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fea322c0-8873-4f06-af4f-6e2cc2bb7a77 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.521162 Jul 18 13:33:27.875930 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2839/5462] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:33:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:33:34.295044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9cb877ae-6506-4521-8bad-3f04df8c5b6b req-3d62ce76-90a3-45e1-855c-8b16d860ab49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:33:34.300352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=5 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:34.310399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=17 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:34.337600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9cb877ae-6506-4521-8bad-3f04df8c5b6b req-3d62ce76-90a3-45e1-855c-8b16d860ab49 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:34.339178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9cb877ae-6506-4521-8bad-3f04df8c5b6b req-3d62ce76-90a3-45e1-855c-8b16d860ab49 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:34.374489 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9cb877ae-6506-4521-8bad-3f04df8c5b6b req-3d62ce76-90a3-45e1-855c-8b16d860ab49 service nova] Creating event network-changed:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:33:34.393082 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9cb877ae-6506-4521-8bad-3f04df8c5b6b req-3d62ce76-90a3-45e1-855c-8b16d860ab49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092485 Jul 18 13:33:34.394424 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2624/5463] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:33:39.027932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=17 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:39.029296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:39.030840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:33:39.045613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ee775d49-f1bb-4f1c-b857-0d0bea32e052 req-38c7f051-bb55-4c8b-a04b-f89b71de2411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:33:39.096537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ee775d49-f1bb-4f1c-b857-0d0bea32e052 req-38c7f051-bb55-4c8b-a04b-f89b71de2411 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:39.100734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ee775d49-f1bb-4f1c-b857-0d0bea32e052 req-38c7f051-bb55-4c8b-a04b-f89b71de2411 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:39.187365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ee775d49-f1bb-4f1c-b857-0d0bea32e052 req-38c7f051-bb55-4c8b-a04b-f89b71de2411 service nova] Creating event network-changed:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:33:39.206776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ee775d49-f1bb-4f1c-b857-0d0bea32e052 req-38c7f051-bb55-4c8b-a04b-f89b71de2411 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183029 Jul 18 13:33:39.211829 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2840/5464] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:33:41.297159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d96dcdb2-c532-4347-91bd-a50b43876bb4 req-43f0de6a-0aa8-466e-9f6e-bfb9b7bbb14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:33:41.328618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d96dcdb2-c532-4347-91bd-a50b43876bb4 req-43f0de6a-0aa8-466e-9f6e-bfb9b7bbb14a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:33:41.330683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d96dcdb2-c532-4347-91bd-a50b43876bb4 req-43f0de6a-0aa8-466e-9f6e-bfb9b7bbb14a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:33:41.371930 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d96dcdb2-c532-4347-91bd-a50b43876bb4 req-43f0de6a-0aa8-466e-9f6e-bfb9b7bbb14a service nova] Creating event network-changed:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:33:41.411609 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d96dcdb2-c532-4347-91bd-a50b43876bb4 req-43f0de6a-0aa8-466e-9f6e-bfb9b7bbb14a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114283 Jul 18 13:33:41.415751 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2625/5465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:02.706772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:02.707590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:02.719050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-167132873-access_point-428266085", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "38cd018d-fb2e-400c-96b2-36071510492a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-910348233", "security_groups": [{"name": "tempest-secgroup_access--1832945022"}, {"name": "tempest-secgroup_general--833616160"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:03.288229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] validate_networks() for [('38cd018d-fb2e-400c-96b2-36071510492a', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:34:05.284453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:34:05.285001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:34:05.285570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:34:05.286435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:34:05.287780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:34:05.322183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:05.322740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:05.323644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:05.324171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:05.379661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for project a9ac4ccbd72e44459e07258b615d8209. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:34:05.394565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for user 07dd4a3d71794e69a913c24860047123 and project a9ac4ccbd72e44459e07258b615d8209. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:34:05.435338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:34:05.440205 n-d-850003-3 devstack@n-api.service[131366]: WARNING nova.utils [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-167132873-access_point-428266085 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-167132873-acc Jul 18 13:34:05.445431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:34:05.557002 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b745bce6-c69f-4916-9100-3c2b7e835814 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.852542 Jul 18 13:34:05.558090 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2841/5466] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:34:02 2022] POST /compute/v2.1/servers => generated 457 bytes in 2855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:34:05.584770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b13a9c33-49b9-4f20-bb5b-34bd95cb3b8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:05.591593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b13a9c33-49b9-4f20-bb5b-34bd95cb3b8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:05.617205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:05.643048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:06.292257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b13a9c33-49b9-4f20-bb5b-34bd95cb3b8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:06.308229 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b13a9c33-49b9-4f20-bb5b-34bd95cb3b8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1292 microversion: 2.1 time: 0.741571 Jul 18 13:34:06.311152 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2626/5467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:05 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1292 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:07.326704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dfd35ace-49d1-4f85-8831-25e05c57ed23 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:07.328080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dfd35ace-49d1-4f85-8831-25e05c57ed23 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:07.505329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dfd35ace-49d1-4f85-8831-25e05c57ed23 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:07.514595 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dfd35ace-49d1-4f85-8831-25e05c57ed23 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1292 microversion: 2.1 time: 0.193405 Jul 18 13:34:07.518412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2842/5468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:07 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1292 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:08.080737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:08.081344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:08.102556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6adf47c5-3939-4b96-b007-ade542fa1a3a req-67cd864e-6f2c-4ac8-9b9c-90282cb06fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:08.119908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6adf47c5-3939-4b96-b007-ade542fa1a3a req-67cd864e-6f2c-4ac8-9b9c-90282cb06fbe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.122817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.126688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.135072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.136736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.136950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6adf47c5-3939-4b96-b007-ade542fa1a3a req-67cd864e-6f2c-4ac8-9b9c-90282cb06fbe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.206231 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6adf47c5-3939-4b96-b007-ade542fa1a3a req-67cd864e-6f2c-4ac8-9b9c-90282cb06fbe service nova] Creating event network-changed:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:34:08.220104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6adf47c5-3939-4b96-b007-ade542fa1a3a req-67cd864e-6f2c-4ac8-9b9c-90282cb06fbe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128593 Jul 18 13:34:08.223550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2843/5469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 13:34:08.263920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:34:08.494643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3d1ffd8-a6c1-40d5-8922-4e7d1c57ab9f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "DELETE /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 204 len: 0 microversion: 2.1 time: 0.417918 Jul 18 13:34:08.495404 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2627/5470] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:34:08 2022] DELETE /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:34:08.504817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:08.505710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:08.519225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.521981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.522952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.524499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.537134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:08.537905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:08.557471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.560541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.568826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:08.572769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:08.896576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:08.929254 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38141cbc-65cd-4206-ab55-eca4291e68e1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1296 microversion: 2.1 time: 0.387403 Jul 18 13:34:08.929996 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2628/5471] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:08 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1296 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:08.950829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:08.959366 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e975cb4c-fe62-457a-a721-c259de4b87c4 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1582 microversion: 2.1 time: 0.459253 Jul 18 13:34:08.964125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2844/5472] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:08 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1582 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:09.946593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:09.948472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:09.970187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:09.970923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:09.971972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:09.975024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:09.984682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:09.986407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:10.012273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:10.020558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:10.025111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:10.025544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:10.392694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:10.401521 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37d14abe-e8d7-439e-ad31-2f9a5306f4dc tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1582 microversion: 2.1 time: 0.422236 Jul 18 13:34:10.408911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2845/5473] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:09 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1582 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:11.426380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:11.426988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:11.461969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:11.465176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:11.467057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:11.468395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:11.616740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:11.632064 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3769d0d9-2cbc-4c1c-8197-b0b93279f767 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1350 microversion: 2.1 time: 1.689575 Jul 18 13:34:11.632684 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2629/5474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:09 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1350 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:12.448860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:12.500116 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ae0dc4c-68d7-4cd2-b109-ed36b32b2532 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1582 microversion: 2.1 time: 1.077906 Jul 18 13:34:12.509573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2846/5475] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:11 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1582 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:12.648936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:12.651481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:12.679479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:12.679937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:12.680745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:12.681277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:13.111810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:13.123900 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-468aa71d-7e18-48d1-99cb-de3465ca83fa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1350 microversion: 2.1 time: 0.478652 Jul 18 13:34:13.125015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2630/5476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:12 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1350 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:13.528494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:13.529474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:13.542586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:13.545776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:13.549467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:13.550137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:13.817269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64e14c5d-06ab-4a39-b039-084320f277a3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: .version_select at 0x7f96e43eea60>, body: {"keypair": {"name": "tempest-keypair-1866409333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAn58IlJRCQBN2Twz/rQj2jM7THueobWIt29pXOgqChyQG5F9tcqbXxsFqxia2KUj20ZVGGFxSIt+/rAU8z5ZYPLKmmd69hM+zVsVEBIanvh9tGNvZ9qOUYBUPX11EZVA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:13.861203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-64e14c5d-06ab-4a39-b039-084320f277a3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for project 1aec7414484a4d739a91422786ff8113. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:34:13.892719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-64e14c5d-06ab-4a39-b039-084320f277a3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for user 8aa1637455a04263aa9a39ed7399b645 and project 1aec7414484a4d739a91422786ff8113. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:34:13.959023 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64e14c5d-06ab-4a39-b039-084320f277a3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.719037 Jul 18 13:34:13.960332 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2847/5477] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:34:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:14.085012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:14.103648 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c1fbb67-15a7-4a94-9395-a2161e8ebbe2 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1228 microversion: 2.1 time: 0.580492 Jul 18 13:34:14.113782 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2631/5478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:13 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1228 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:14.141533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:14.142382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:14.170242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:14.171846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:14.174212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:14.176210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:14.340540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b7dc4a13-3d5d-4a21-9387-140f4849d2fc req-604c9a94-a838-4830-bd7e-c5eb6da2bd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96", "name": "network-vif-deleted", "tag": "b058c4e2-560e-4998-a934-151dee5b0585"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:14.366640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b7dc4a13-3d5d-4a21-9387-140f4849d2fc req-604c9a94-a838-4830-bd7e-c5eb6da2bd0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:14.368440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b7dc4a13-3d5d-4a21-9387-140f4849d2fc req-604c9a94-a838-4830-bd7e-c5eb6da2bd0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:14.382042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b7dc4a13-3d5d-4a21-9387-140f4849d2fc req-604c9a94-a838-4830-bd7e-c5eb6da2bd0e service nova] Creating event network-vif-deleted:b058c4e2-560e-4998-a934-151dee5b0585 for instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 on n-h1-850003-3 Jul 18 13:34:14.388657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b7dc4a13-3d5d-4a21-9387-140f4849d2fc req-604c9a94-a838-4830-bd7e-c5eb6da2bd0e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426827 Jul 18 13:34:14.390227 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2848/5479] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:14.561887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:14.576850 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b453e854-33c6-43c2-997f-41f005f47234 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1350 microversion: 2.1 time: 0.439410 Jul 18 13:34:14.577474 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2632/5480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:14 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1350 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:15.138054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:15.139512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:15.157550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:15.164342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:15.165278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:15.171065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:15.345646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:15.601949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:15.608590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:15.632675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:15.638503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:15.640378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:15.641272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:15.873204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:15.892021 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9af0e20-de7a-4a34-b3ad-13d71879eaee tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1228 microversion: 2.1 time: 0.765125 Jul 18 13:34:15.893269 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2849/5481] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:15 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1228 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:16.264216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:16.306762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:16.320460 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a1ef5e6-af97-4357-aa0a-a0954e13b124 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 0.724717 Jul 18 13:34:16.325716 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2633/5482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:15 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:16.921627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:16.923211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:16.942667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:16.948465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:16.949795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:16.951341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:17.287870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:17.303545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26e7a324-bda2-4f03-a460-5e47bcf7c82f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1396 microversion: 2.1 time: 0.385949 Jul 18 13:34:17.306484 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2850/5483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:16 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1396 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:17.359526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:17.360415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:17.379435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:17.381265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:17.382730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:17.395125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:18.323646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:18.325187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:18.357327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:18.358114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:18.361313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:18.361991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:18.797843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:18.807247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50584b69-a6f8-430a-88ad-3bdb77f4e79f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1396 microversion: 2.1 time: 0.488945 Jul 18 13:34:18.826394 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2851/5484] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:18 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1396 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:19.713402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:19.726706 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf976625-3a65-4fef-aec0-865c94068c6a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 2.371939 Jul 18 13:34:19.737305 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2634/5485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:17 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:19.825598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:19.826252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:19.844531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:19.846218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:19.850474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:19.852072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:20.750600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:20.753390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:20.770097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:20.770803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:20.771834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:20.772491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:20.799149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:20.808077 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50a22583-d217-4f2c-8553-1438672e0416 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1396 microversion: 2.1 time: 0.986809 Jul 18 13:34:20.808843 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2852/5486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:19 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1396 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:21.826995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:21.828348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:21.882113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:21.890934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:21.895206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:21.895843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:22.469151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:22.485229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8bc8f175-8e7a-437d-a723-6e612aa61a30 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1396 microversion: 2.1 time: 0.663712 Jul 18 13:34:22.487178 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2853/5487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:21 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1396 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:22.501617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b6a60adb-5e27-4184-a1aa-ff8ea0e5dd6b req-1959c87e-70b6-4b7b-be03-fc781de571dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea", "tag": "f89bcfb3-bf9e-49e6-853f-da6411fae6b2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:22.563371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b6a60adb-5e27-4184-a1aa-ff8ea0e5dd6b req-1959c87e-70b6-4b7b-be03-fc781de571dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:22.564235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b6a60adb-5e27-4184-a1aa-ff8ea0e5dd6b req-1959c87e-70b6-4b7b-be03-fc781de571dd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:22.597124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b6a60adb-5e27-4184-a1aa-ff8ea0e5dd6b req-1959c87e-70b6-4b7b-be03-fc781de571dd service nova] Creating event network-changed:f89bcfb3-bf9e-49e6-853f-da6411fae6b2 for instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea on n-h2-850003-3 Jul 18 13:34:22.611349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:22.624070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b6a60adb-5e27-4184-a1aa-ff8ea0e5dd6b req-1959c87e-70b6-4b7b-be03-fc781de571dd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131342 Jul 18 13:34:22.628203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2854/5488] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:22.653181 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c1752e09-4967-4bd6-87ac-f66b327fa729 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 1.908013 Jul 18 13:34:22.662034 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2635/5489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:20 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:23.506551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:23.508695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:23.521765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:23.523728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:23.526529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:23.527630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:23.678403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:23.680005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:23.726922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:23.729395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:23.734524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:23.742539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:23.921402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:24.049713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02341afda74e04b763dfe84bca7099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c68e9b76eab4e5a8b5415f2b763e883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:24.064135 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc762ab8-b1fb-45d3-aac8-ff74f7c430f1 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 200 len: 1396 microversion: 2.1 time: 0.563713 Jul 18 13:34:24.074053 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2855/5490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:23 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 1396 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:24.651496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:24.662394 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d561cfc-8f06-428d-869f-59687325feda tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 0.989201 Jul 18 13:34:24.666527 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2636/5491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:23 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:24.700698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1480308954", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678e68d-697e-4048-a907-885a35159145"}], "security_groups": [{"name": "tempest-securitygroup--338501676"}], "key_name": "tempest-keypair-1866409333", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:25.090424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:25.090424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] [instance: 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:25.106040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:25.106763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:25.107727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:25.108354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:25.156183 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] HTTP exception thrown: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Request method failure captured: Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 HTTP/1.1 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1V_YpybXpqoCC2ABEfRvF53mZU_3gOeRYuAgOp-saedtEj98VVAwoXyuEZ3cCrzkraMRwAC8VRy5j1qHHqv2j5WmZJJ0MVBZNpwzYeBweZzwhIvMeZ5Fk_jiFwHyB0jq0t8WChm7FnZ-UjFmmvQ8UhTLt7xdVOAPVQBT0rnagaYXVrc Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 8c68e9b76eab4e5a8b5415f2b763e883 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBackupRestore-1546244391 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8c68e9b76eab4e5a8b5415f2b763e883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8c68e9b76eab4e5a8b5415f2b763e883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8c68e9b76eab4e5a8b5415f2b763e883", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8c68e9b76eab4e5a8b5415f2b763e883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBackupRestore-1546244391 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 8c68e9b76eab4e5a8b5415f2b763e883 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1546244391 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBackupRestore-1546244391-project Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: fc02341afda74e04b763dfe84bca7099 Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBackupRestore-1546244391-project Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96'} Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:34:25.159425 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. Jul 18 13:34:25.164494 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:34:25.171418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Returning 404 to user: Instance 71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:34:25.171418 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e7c02cc-d5e2-493e-8cc0-718cbbb9ab7f tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96" status: 404 len: 111 microversion: 2.1 time: 0.093308 Jul 18 13:34:25.172578 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2637/5492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:25 2022] GET /compute/v2.1/servers/71a3aa4b-ee3c-4bc2-a260-eb880ad6cf96 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:34:25.528831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] validate_networks() for [('7678e68d-697e-4048-a907-885a35159145', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:34:25.690380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:25.691183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:25.714828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:25.718286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:25.719316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:25.720388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:26.407986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:26.422503 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-54980387-6f55-4416-bd9b-7eda00bbe45d tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 0.741904 Jul 18 13:34:26.427027 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2638/5493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:25 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:26.498005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0c8de7b0-4eaa-445f-86e4-2ecc6b27a487 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] Calling method '.version_select at 0x7f96d78a51f0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:26.556704 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0c8de7b0-4eaa-445f-86e4-2ecc6b27a487 tempest-TestVolumeBackupRestore-1546244391 tempest-TestVolumeBackupRestore-1546244391-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-126852008" status: 202 len: 0 microversion: 2.1 time: 0.061167 Jul 18 13:34:26.557412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2639/5494] 10.222.0.88 () {58 vars in 1265 bytes} [Mon Jul 18 13:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-126852008 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:34:27.445201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:27.447368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:27.486623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:27.487168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:27.501086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:27.501954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:29.855100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:34:29.855729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:34:29.856368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:34:29.856990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:34:29.857583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:34:29.884750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:29.892683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:29.896513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:29.897203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:29.990997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for project 1aec7414484a4d739a91422786ff8113. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:34:30.011297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for user 8aa1637455a04263aa9a39ed7399b645 and project 1aec7414484a4d739a91422786ff8113. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:34:30.102419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:34:30.106099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:34:30.278091 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8db8759-5777-4362-b027-c6815a627a9d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.582406 Jul 18 13:34:30.299278 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2856/5495] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:34:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 5605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:34:30.316746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d1e9970-2ccd-44b0-8736-deb4cf0677e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:30.317529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d1e9970-2ccd-44b0-8736-deb4cf0677e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:30.575899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:30.603420 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07409489-059f-4854-aa3c-6f14c45b1005 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 3.147016 Jul 18 13:34:30.614665 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2640/5496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:27 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 3175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:30.829358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d1e9970-2ccd-44b0-8736-deb4cf0677e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:30.837577 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d1e9970-2ccd-44b0-8736-deb4cf0677e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1238 microversion: 2.1 time: 0.536248 Jul 18 13:34:30.848560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2857/5497] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:30 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1238 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:31.633347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:31.636832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:31.686462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:31.692570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:31.698228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:31.701390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:31.867798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09a9cbdd-9e00-4888-99fd-67e53809d153 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:31.869665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09a9cbdd-9e00-4888-99fd-67e53809d153 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:32.132772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09a9cbdd-9e00-4888-99fd-67e53809d153 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:32.163617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09a9cbdd-9e00-4888-99fd-67e53809d153 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1238 microversion: 2.1 time: 0.295162 Jul 18 13:34:32.171358 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2858/5498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:31 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1238 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:32.672750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:32.702219 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7b332f0-fff6-4dfd-8b4c-ae6efb0df4f8 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 1.075716 Jul 18 13:34:32.706607 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2641/5499] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:31 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:33.190270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:33.190991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:33.197118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:33.214796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:33.215261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:33.221364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:33.222010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:33.240573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=65 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:33.724452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:33.725547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:33.754021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:33.758229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:33.761249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:33.764547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:34.235973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:34.253637 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-480c7dab-85ed-4e82-b73a-d59a82ac7618 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1290 microversion: 2.1 time: 1.068723 Jul 18 13:34:34.256716 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2859/5500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:33 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1290 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:34.546958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:34.562956 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fc6f995-6ce9-4fe9-9614-71b9e7b024aa tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 0.842552 Jul 18 13:34:34.565010 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2642/5501] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:33 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:35.274422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:35.275982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:35.296608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:35.298963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:35.300115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:35.308642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:35.514293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:35.522208 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33c7aed0-c5c5-4676-b499-e430c2fa2a5f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1296 microversion: 2.1 time: 0.252978 Jul 18 13:34:35.526176 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2860/5502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:35 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:35.583631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:35.584880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:35.598725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:35.602371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:35.604272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:35.604894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:35.674325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:36.558908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:36.560431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:36.582238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:36.585013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:36.589173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:36.590086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:36.744286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:36.751374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa81b012-5ce1-4913-b718-7ae07ff00ad9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1296 microversion: 2.1 time: 0.198346 Jul 18 13:34:36.753507 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2861/5503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:36 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:37.541035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:37.550355 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f35e0cd-102e-44b9-8241-c64f8de5a438 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 1.972193 Jul 18 13:34:37.561104 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2643/5504] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:35 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:37.783915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:37.783915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:37.802732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:37.805646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:37.809862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:37.818093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:38.199002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:38.246066 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5bc10c53-49b3-411b-80b6-5c596338a001 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1296 microversion: 2.1 time: 0.470760 Jul 18 13:34:38.260100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2862/5505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:37 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1296 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:38.579386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:38.580659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:38.586362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:38.603741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:38.604203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:38.605023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:38.605473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:39.267988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:39.269375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:39.302414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:39.303121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:39.304125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:39.306955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:39.941585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:40.169568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:40.224997 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-236eb394-00f0-46f1-908e-fab71b78a1ca tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 0.957893 Jul 18 13:34:40.226588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2863/5506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:39 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:40.616545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4097efbd-05cd-4b11-a89c-c3a9156caa4f req-3adf40bb-b2d3-46a3-a64e-99aebec2027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea", "name": "network-vif-plugged", "status": "completed", "tag": "f89bcfb3-bf9e-49e6-853f-da6411fae6b2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:40.642591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4097efbd-05cd-4b11-a89c-c3a9156caa4f req-3adf40bb-b2d3-46a3-a64e-99aebec2027b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:40.643482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4097efbd-05cd-4b11-a89c-c3a9156caa4f req-3adf40bb-b2d3-46a3-a64e-99aebec2027b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:40.681450 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4097efbd-05cd-4b11-a89c-c3a9156caa4f req-3adf40bb-b2d3-46a3-a64e-99aebec2027b service nova] Creating event network-vif-plugged:f89bcfb3-bf9e-49e6-853f-da6411fae6b2 for instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea on n-h2-850003-3 Jul 18 13:34:40.699386 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4097efbd-05cd-4b11-a89c-c3a9156caa4f req-3adf40bb-b2d3-46a3-a64e-99aebec2027b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469614 Jul 18 13:34:40.702339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2864/5507] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:40.880929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:40.900135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22eb73fc-5902-4d78-a967-eec2b9bb413e tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 2.322923 Jul 18 13:34:40.917229 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2644/5508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:38 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:41.246907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:41.248089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:41.265752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:41.266782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:41.270314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:41.271142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:41.920427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:41.921142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:41.942374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:41.942946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:41.960884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:41.963695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:42.044844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:42.069109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ab553ee1-3cce-4c6e-b6f2-248fe8eb9fc6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 0.827150 Jul 18 13:34:42.077235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2865/5509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:41 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:42.528866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:42.538777 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1799a9b-352c-4de0-9b48-4fd77f5d0cd3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1469 microversion: 2.1 time: 0.624159 Jul 18 13:34:42.545845 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2645/5510] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:41 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1469 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:43.102860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:43.104154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:43.115415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:34:43.123697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:43.126368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:43.130724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:43.131290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:43.565897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:43.567544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:43.580726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:43.586801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:43.588376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:43.607080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:43.943576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:43.956965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e4bfa1e2-af77-4777-b5b3-78ac1efaa9c3 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1641 microversion: 2.1 time: 0.396011 Jul 18 13:34:43.958213 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2646/5511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:43 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1641 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:43.976719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:43.978257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:43.995465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:43.996221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:43.999163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:44.001884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:44.188252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:44.202349 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8eeb430-268e-4ec5-9de3-2720244a528c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.103981 Jul 18 13:34:44.215438 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2866/5512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:43 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:45.073196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:45.085056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93a4e6a3-e345-4c30-a580-fd6102394856 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1641 microversion: 2.1 time: 1.112539 Jul 18 13:34:45.085670 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2647/5513] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:43 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1641 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:45.117240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:45.119884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:45.138048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:45.139050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:45.141262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:45.143538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:45.224346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:45.224968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:45.236401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:45.237951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:45.239313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:45.241819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:46.742128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-411b1e2c-9043-451a-bfb2-1d625296887d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1792 microversion: 2.1 time: 1.629653 Jul 18 13:34:46.742745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2867/5514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:45 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1792 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:46.986608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9678c277-60e8-4bf3-b5b0-7e83925579a4 req-450ea144-3eb8-43e4-9b64-c2df0705bddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ed8e6-7f13-44b2-a4a0-a79fa154be29", "tag": "164ce24b-97e6-41b1-a35e-d5e5ada01f00"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:47.030212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9678c277-60e8-4bf3-b5b0-7e83925579a4 req-450ea144-3eb8-43e4-9b64-c2df0705bddf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:47.030465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9678c277-60e8-4bf3-b5b0-7e83925579a4 req-450ea144-3eb8-43e4-9b64-c2df0705bddf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:47.076588 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9678c277-60e8-4bf3-b5b0-7e83925579a4 req-450ea144-3eb8-43e4-9b64-c2df0705bddf service nova] Creating event network-changed:164ce24b-97e6-41b1-a35e-d5e5ada01f00 for instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 on n-h1-850003-3 Jul 18 13:34:47.089959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9678c277-60e8-4bf3-b5b0-7e83925579a4 req-450ea144-3eb8-43e4-9b64-c2df0705bddf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107439 Jul 18 13:34:47.091463 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2868/5515] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:47.137561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:47.198601 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09b111e9-41fd-4e68-8592-e2c1a38b75a6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.978558 Jul 18 13:34:47.215835 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2648/5516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:45 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:34:48.219478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:48.220919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:48.235488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:48.237619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:48.238972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:48.241342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:49.259346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:49.283611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a44e7eb2-5ac1-4c7a-a2d5-028b4036f041 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.070019 Jul 18 13:34:49.298560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2869/5517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:48 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:50.308308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:50.309068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:50.345224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:50.346370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:50.352383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:50.353470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:51.791467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:51.805245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd61931b-aba8-4d4b-a630-f4afd057a355 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.506944 Jul 18 13:34:51.826745 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2649/5518] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:50 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:52.825985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:52.826851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:52.902010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:52.902645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:52.904071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:52.904860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:53.336385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:53.350195 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6565a8c2-090d-4513-b3f4-dae874d3d242 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 0.526542 Jul 18 13:34:53.357291 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2870/5519] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:52 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:54.381858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:54.382787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:54.423574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:54.424995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:54.427941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:54.434691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:56.113620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:56.161990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0448a38f-c6f4-479b-ac83-d1986f55cd80 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.769704 Jul 18 13:34:56.162706 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2650/5520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:54 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:57.187963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:57.189368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:57.210801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:57.212257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:57.216297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:57.217948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:57.270289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6e82d62d-47f9-417c-bd93-44314d9bfada req-6b1589a8-645e-43e2-b9df-09e4e513d935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed8e6-7f13-44b2-a4a0-a79fa154be29", "name": "network-vif-plugged", "status": "completed", "tag": "164ce24b-97e6-41b1-a35e-d5e5ada01f00"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:34:57.317085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e82d62d-47f9-417c-bd93-44314d9bfada req-6b1589a8-645e-43e2-b9df-09e4e513d935 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:57.318992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e82d62d-47f9-417c-bd93-44314d9bfada req-6b1589a8-645e-43e2-b9df-09e4e513d935 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:57.393317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6e82d62d-47f9-417c-bd93-44314d9bfada req-6b1589a8-645e-43e2-b9df-09e4e513d935 service nova] Creating event network-vif-plugged:164ce24b-97e6-41b1-a35e-d5e5ada01f00 for instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 on n-h1-850003-3 Jul 18 13:34:57.418073 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6e82d62d-47f9-417c-bd93-44314d9bfada req-6b1589a8-645e-43e2-b9df-09e4e513d935 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150455 Jul 18 13:34:57.420332 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2651/5521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:34:57.997051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:34:58.028351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30d70452-8964-4f00-b37b-b87c2e540d58 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 0.849427 Jul 18 13:34:58.030304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2871/5522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:57 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:34:59.055392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:34:59.075504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:34:59.119770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:59.147161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:34:59.170077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:34:59.172275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:00.353503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:00.380711 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f32d983-d741-45a8-bfd1-cd6be765c9a1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1363 microversion: 2.1 time: 1.336033 Jul 18 13:35:00.384577 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2652/5523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:34:59 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1363 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:35:00.551782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7715ca06-6c88-4aa4-9d63-ac8e9ac0b986 req-df7bb43e-cda1-45b0-bcb9-3489328540fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea", "tag": "f89bcfb3-bf9e-49e6-853f-da6411fae6b2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:00.604504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7715ca06-6c88-4aa4-9d63-ac8e9ac0b986 req-df7bb43e-cda1-45b0-bcb9-3489328540fe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:00.619254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7715ca06-6c88-4aa4-9d63-ac8e9ac0b986 req-df7bb43e-cda1-45b0-bcb9-3489328540fe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:00.671545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7715ca06-6c88-4aa4-9d63-ac8e9ac0b986 req-df7bb43e-cda1-45b0-bcb9-3489328540fe service nova] Creating event network-changed:f89bcfb3-bf9e-49e6-853f-da6411fae6b2 for instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea on n-h2-850003-3 Jul 18 13:35:00.687309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7715ca06-6c88-4aa4-9d63-ac8e9ac0b986 req-df7bb43e-cda1-45b0-bcb9-3489328540fe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149252 Jul 18 13:35:00.695138 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2872/5524] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:35:01.407117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:01.409130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:01.431102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:01.432086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:01.433114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:01.433740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:03.548698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:03.578911 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1cca8863-f416-4b0c-9cdc-36404fd5ae4c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1549 microversion: 2.1 time: 2.177409 Jul 18 13:35:03.588191 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2653/5525] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:01 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1549 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:03.610725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:03.624014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:03.653815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=28 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:03.677278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:03.678113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:03.679521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:03.691256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:03.796770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=72 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:04.347356 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-619d34bc-76fd-46a3-9462-48e54ef168f4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.744693 Jul 18 13:35:04.348344 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2873/5526] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:35:03 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-interface => generated 284 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:35:09.848899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a4d9d019-4cd7-4e97-9742-f2ee4ac0a122 req-e8d295d5-e792-4eb3-b867-79f11333c0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ed8e6-7f13-44b2-a4a0-a79fa154be29", "tag": "164ce24b-97e6-41b1-a35e-d5e5ada01f00"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:09.870802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=20 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:09.882522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a4d9d019-4cd7-4e97-9742-f2ee4ac0a122 req-e8d295d5-e792-4eb3-b867-79f11333c0fc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:09.883340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a4d9d019-4cd7-4e97-9742-f2ee4ac0a122 req-e8d295d5-e792-4eb3-b867-79f11333c0fc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:09.921772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=59 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:09.929642 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a4d9d019-4cd7-4e97-9742-f2ee4ac0a122 req-e8d295d5-e792-4eb3-b867-79f11333c0fc service nova] Creating event network-changed:164ce24b-97e6-41b1-a35e-d5e5ada01f00 for instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 on n-h1-850003-3 Jul 18 13:35:09.963188 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a4d9d019-4cd7-4e97-9742-f2ee4ac0a122 req-e8d295d5-e792-4eb3-b867-79f11333c0fc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120611 Jul 18 13:35:09.967816 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2654/5527] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:35:31.350710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-645087327", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:31.370878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:31.372568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:31.731232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:35:32.843142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:35:32.843863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:35:32.844329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:35:32.844747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:35:32.845159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:35:32.858916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:32.859591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:32.863435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:32.868220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:32.945021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Getting quotas for project 2e83c6a2176b4fa98e228fab069f8f21. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:35:32.963777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Getting quotas for user a891c94339c74562aae137ef53fc584f and project 2e83c6a2176b4fa98e228fab069f8f21. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:35:32.991293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:35:32.998471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:35:33.107444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e72f49e-9eda-484d-95a9-7a20522847e4 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761011 Jul 18 13:35:33.108141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2874/5528] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:35:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:35:33.123210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49347247-1946-40f8-ad64-2a889c66737d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:33.124762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49347247-1946-40f8-ad64-2a889c66737d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:33.481873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49347247-1946-40f8-ad64-2a889c66737d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:33.505280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49347247-1946-40f8-ad64-2a889c66737d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1214 microversion: 2.1 time: 0.389013 Jul 18 13:35:33.506535 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2655/5529] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:33 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1214 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:34.525366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:34.526451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:34.537523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:34.537981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:34.549146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:34.549933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:34.734399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:34.748592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-779bc0bb-0e9c-4820-b3bd-5c748d13566b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1210 microversion: 2.1 time: 0.229350 Jul 18 13:35:34.749519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2875/5530] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:34 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1210 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:35.769534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:35.770374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:35.811237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:35.812529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:35.815449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:35.816093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:35.987000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:36.005783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bbab187a-2f7e-4241-a811-db01cd174fd9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1274 microversion: 2.1 time: 0.242117 Jul 18 13:35:36.017125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2656/5531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:35 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:37.026357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:37.038285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:37.048625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:37.049358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:37.050411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:37.051026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:37.187336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:37.203638 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dc5d6b7-8756-446b-894d-99594a17971d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1272 microversion: 2.1 time: 0.183374 Jul 18 13:35:37.204909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2876/5532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:37 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:38.223069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:38.223699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:38.239478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:38.241375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:38.251498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:38.258370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:38.393263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:38.404532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2280c96d-ca28-4083-afd2-be211c57a690 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1272 microversion: 2.1 time: 0.186209 Jul 18 13:35:38.405900 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2657/5533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:38 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:39.427607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:39.428231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:39.442115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:39.442580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:39.443563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:39.449414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:39.998892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:40.021915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea034ae5-c606-45fe-bf56-7db5c3023ea9 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 0.602886 Jul 18 13:35:40.035093 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2877/5534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:39 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:40.632480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4d9ade7f-73bf-4615-87bd-8ec6b5525681 req-3a341703-7b37-47f5-b56b-a684df3ee033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9839991-f6c4-46ae-97f8-17fc571f5095", "tag": "25520e15-b877-4350-8633-27d81deb25d9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:40.645213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4d9ade7f-73bf-4615-87bd-8ec6b5525681 req-3a341703-7b37-47f5-b56b-a684df3ee033 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:40.647807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4d9ade7f-73bf-4615-87bd-8ec6b5525681 req-3a341703-7b37-47f5-b56b-a684df3ee033 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:40.665569 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4d9ade7f-73bf-4615-87bd-8ec6b5525681 req-3a341703-7b37-47f5-b56b-a684df3ee033 service nova] Creating event network-changed:25520e15-b877-4350-8633-27d81deb25d9 for instance e9839991-f6c4-46ae-97f8-17fc571f5095 on n-h2-850003-3 Jul 18 13:35:40.684159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4d9ade7f-73bf-4615-87bd-8ec6b5525681 req-3a341703-7b37-47f5-b56b-a684df3ee033 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060764 Jul 18 13:35:40.685107 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2658/5535] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:35:41.053323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:41.054035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:41.067260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:41.075059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:41.079048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:41.080426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:42.095926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:42.119081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08744eaa-9317-4e07-8266-f8acdb106b95 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 1.070629 Jul 18 13:35:42.120398 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2878/5536] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:41 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:43.159115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:43.178213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:43.227996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:43.235344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:43.236582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:43.238771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:43.493520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:44.238918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:44.250173 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ff97a5f-fc63-4109-90bd-d80d26f00403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 1.115989 Jul 18 13:35:44.262040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2659/5537] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:43 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:45.085253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-797895421", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "8840a955-d311-47b9-9b07-ef4cf0d5d7ec"}], "key_name": "tempest-TestSecurityGroupsBasicOps-910348233", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea"]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:45.101080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:45.102722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:45.194101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] validate_networks() for [('8840a955-d311-47b9-9b07-ef4cf0d5d7ec', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:35:45.267986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:45.269470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:45.324675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:45.326597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:45.327869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:45.329015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:45.973100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:35:45.973518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:35:45.973993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:35:45.974448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:35:45.974868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:35:45.992189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:45.993279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:45.994246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:45.994782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:46.055396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for project a9ac4ccbd72e44459e07258b615d8209. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:35:46.065988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Getting quotas for user 07dd4a3d71794e69a913c24860047123 and project a9ac4ccbd72e44459e07258b615d8209. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:35:46.105043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:35:46.109436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:35:46.220562 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8efa3738-48ce-43a2-a0ad-b6bdd91bf970 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.140663 Jul 18 13:35:46.222181 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2879/5538] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:35:45 2022] POST /compute/v2.1/servers => generated 361 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:35:46.236142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05ed4f7d-ee08-4cfd-bc1a-d4a5ce2d0125 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:46.237265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05ed4f7d-ee08-4cfd-bc1a-d4a5ce2d0125 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:46.340692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:46.353795 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-057cddc6-5423-43cf-a3d4-10970f5df7e3 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 1.089271 Jul 18 13:35:46.356666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05ed4f7d-ee08-4cfd-bc1a-d4a5ce2d0125 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:46.364343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05ed4f7d-ee08-4cfd-bc1a-d4a5ce2d0125 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1240 microversion: 2.1 time: 0.135373 Jul 18 13:35:46.364934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2880/5539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:46 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:46.367878 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2660/5540] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:45 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:47.375827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:47.376699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:47.382883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:47.385404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:47.399557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:47.400386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:47.403388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:47.404300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:47.408835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:47.412763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:47.417880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:47.418877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:47.707347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:47.728894 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-929e2e11-e4a0-4645-879d-5d93bcf7551b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1244 microversion: 2.1 time: 0.350181 Jul 18 13:35:47.733678 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2881/5541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:47 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1244 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:35:48.554049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:48.567515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56bd9ad4-302c-4ffa-8b21-af3a88a0a382 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 1.196518 Jul 18 13:35:48.580752 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2661/5542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:47 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:48.755935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:48.767835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:48.798377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:48.804270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:48.807267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:48.811726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:49.122832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:49.145659 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4b6579b3-7088-44e1-9f18-4a260d211f8b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.400914 Jul 18 13:35:49.152796 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2882/5543] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:48 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:49.592932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:49.598494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:49.619230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:49.622946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:49.626772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:49.630617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:50.070745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:50.080778 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ce9a910-9b06-4cf4-a85f-287bba701362 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 0.495374 Jul 18 13:35:50.086932 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2662/5544] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:49 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:50.178180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:50.180244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:50.192313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:50.193113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:50.194469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:50.195153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:50.427190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:50.447181 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-77f22ba4-31c3-456c-be54-f280698ec59b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.274459 Jul 18 13:35:50.449335 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2883/5545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:50 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:51.018662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a07eaed8-4714-4239-b7b4-1f44e4197cd9 req-ac11ba80-b51d-4453-aa82-92a6ab54d536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9839991-f6c4-46ae-97f8-17fc571f5095", "name": "network-vif-plugged", "status": "completed", "tag": "25520e15-b877-4350-8633-27d81deb25d9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:51.055283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a07eaed8-4714-4239-b7b4-1f44e4197cd9 req-ac11ba80-b51d-4453-aa82-92a6ab54d536 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:51.056434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a07eaed8-4714-4239-b7b4-1f44e4197cd9 req-ac11ba80-b51d-4453-aa82-92a6ab54d536 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:51.098085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a07eaed8-4714-4239-b7b4-1f44e4197cd9 req-ac11ba80-b51d-4453-aa82-92a6ab54d536 service nova] Creating event network-vif-plugged:25520e15-b877-4350-8633-27d81deb25d9 for instance e9839991-f6c4-46ae-97f8-17fc571f5095 on n-h2-850003-3 Jul 18 13:35:51.104681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:51.107309 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a07eaed8-4714-4239-b7b4-1f44e4197cd9 req-ac11ba80-b51d-4453-aa82-92a6ab54d536 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098302 Jul 18 13:35:51.109482 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2663/5546] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:35:51.112581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:51.127615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:51.128785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:51.131866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:51.133769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:51.466751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:51.467600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:51.484183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:51.486427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:51.488241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:51.489818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:51.681505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:51.701137 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2abe3b63-99d4-4bd8-96eb-bb21598d6384 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.239551 Jul 18 13:35:51.724435 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2664/5547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:51 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:52.438038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:52.456906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b90c700-a1dc-4631-81ed-f9d809dabd03 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1314 microversion: 2.1 time: 1.359850 Jul 18 13:35:52.457983 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2884/5548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:51 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1314 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:35:52.733855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:52.735156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:52.753007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:52.754830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:52.756456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:52.758529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:53.024886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:53.084453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1360f81b-ccd9-40c4-821b-9df5ebd09baf tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.353736 Jul 18 13:35:53.091850 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2665/5549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:52 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:53.483266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:53.485334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:53.532691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:53.533490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:53.534727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:53.535826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.109061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:54.109807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:54.140424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.142533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.152608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.154051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.396901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:54.420926 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a52a055-3ff9-4fbc-91f5-79ba8578f42b tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1463 microversion: 2.1 time: 0.945897 Jul 18 13:35:54.422054 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2885/5550] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:53 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1463 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:35:54.431731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:54.478613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36779d5a-5675-40fb-b5bd-995b820d2e45 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.373688 Jul 18 13:35:54.479879 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2666/5551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:54 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:54.501715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:54.502390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:54.516721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.517189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.518001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.518475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.585445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:35:54.822086 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6693dc9-d578-456c-83e7-2c5adedbf20d tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 204 len: 0 microversion: 2.1 time: 0.329192 Jul 18 13:35:54.827053 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2886/5552] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:35:54 2022] DELETE /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:35:54.841573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:54.842872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:54.865341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.867332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:54.870588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:54.877990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:55.294936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7191d845-db62-475c-89ad-b70443462594 req-a4e83209-3a75-4d99-835b-e7a828c81f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514feb95-e54c-4ead-965b-4309314486dc", "tag": "7d54a6d8-7ad5-4385-814c-a1c83d2beeb4"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:55.346699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7191d845-db62-475c-89ad-b70443462594 req-a4e83209-3a75-4d99-835b-e7a828c81f2c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:55.348679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7191d845-db62-475c-89ad-b70443462594 req-a4e83209-3a75-4d99-835b-e7a828c81f2c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:55.359064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:55.378269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7191d845-db62-475c-89ad-b70443462594 req-a4e83209-3a75-4d99-835b-e7a828c81f2c service nova] Creating event network-changed:7d54a6d8-7ad5-4385-814c-a1c83d2beeb4 for instance 514feb95-e54c-4ead-965b-4309314486dc on n-h1-850003-3 Jul 18 13:35:55.392411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7191d845-db62-475c-89ad-b70443462594 req-a4e83209-3a75-4d99-835b-e7a828c81f2c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120787 Jul 18 13:35:55.396758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2887/5553] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:35:55.408018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88dffd07-af42-4e5c-abc8-f885c30483e0 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1469 microversion: 2.1 time: 0.573383 Jul 18 13:35:55.422854 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2667/5554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:54 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:55.511443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:55.525704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:55.566878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:55.567419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:55.568271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:55.571498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:56.010576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:56.024862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:56.046052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ded5f978-bb69-420d-be99-26e383cb3797 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.545403 Jul 18 13:35:56.050476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2888/5555] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:55 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:56.443540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:56.445404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:56.469079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:56.469802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:56.475777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:56.477289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:56.818724 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:35:56.819120 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 13:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 (ip 10.222.0.88) !!! Jul 18 13:35:56.939652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:57.020228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b184d6f5-55cc-4a88-8c50-eacfcba7c494 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1469 microversion: 2.1 time: 0.577329 Jul 18 13:35:57.026908 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2668/5556] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:56 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:57.074210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:35:57.085376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:57.086852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:57.099849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:57.100618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:57.101687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:57.102842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:57.457777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:57.469936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a21f2e0-e104-426e-811a-0c01a5b99de6 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.396637 Jul 18 13:35:57.474447 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2889/5557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:57 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:57.767108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-46257148-99b2-4860-8d15-7c7c910972cd req-1de09092-4025-4760-94fe-29171715c923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9839991-f6c4-46ae-97f8-17fc571f5095", "name": "network-vif-deleted", "tag": "25520e15-b877-4350-8633-27d81deb25d9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:35:57.804204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46257148-99b2-4860-8d15-7c7c910972cd req-1de09092-4025-4760-94fe-29171715c923 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:57.805574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46257148-99b2-4860-8d15-7c7c910972cd req-1de09092-4025-4760-94fe-29171715c923 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:57.863397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-46257148-99b2-4860-8d15-7c7c910972cd req-1de09092-4025-4760-94fe-29171715c923 service nova] Creating event network-vif-deleted:25520e15-b877-4350-8633-27d81deb25d9 for instance e9839991-f6c4-46ae-97f8-17fc571f5095 on n-h2-850003-3 Jul 18 13:35:57.878276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-46257148-99b2-4860-8d15-7c7c910972cd req-1de09092-4025-4760-94fe-29171715c923 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120515 Jul 18 13:35:57.881754 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2669/5558] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:35:58.073487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:58.075740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:58.085978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:58.086817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:58.088753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:58.089567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:58.152550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:58.153009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:58.153470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lazy-loading 'fault' on Instance uuid e9839991-f6c4-46ae-97f8-17fc571f5095 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:35:58.212984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a891c94339c74562aae137ef53fc584f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e83c6a2176b4fa98e228fab069f8f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:58.221647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dd50f0e-93de-4756-b7b9-1d567567b403 tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 200 len: 1304 microversion: 2.1 time: 0.174656 Jul 18 13:35:58.232319 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2890/5559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:58 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:35:58.494854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:58.496169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:58.513668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:58.514448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:58.515523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:58.516403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:58.682126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:35:58.696622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-43d2c5fd-15e9-42c5-ba72-98ee3a18a84a tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.207141 Jul 18 13:35:58.710099 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2670/5560] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:58 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:35:59.239581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:59.240983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] [instance: e9839991-f6c4-46ae-97f8-17fc571f5095] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:59.254743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:59.259250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:59.260315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:59.261066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:59.294790 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] HTTP exception thrown: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Request method failure captured: Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 HTTP/1.1 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WGfnbfmmqiNplGdKD_2JwE8w98KZ2OYIYsFVpMit9FL2GAFxCczHJ9pGw3JUAn-PLpEpZc6N8gb2LpRQLy4x-jCorvhSlPkpYZQLiA_5JZW55LKkQ98pypPIxHk5ol-aJv2Pr4lfli5MF8_VUmAJIoOeFbD0sA8wfxcPsqEPTz6Fzo Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2e83c6a2176b4fa98e228fab069f8f21 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesNegativeTest-506076581 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2e83c6a2176b4fa98e228fab069f8f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2e83c6a2176b4fa98e228fab069f8f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2e83c6a2176b4fa98e228fab069f8f21", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2e83c6a2176b4fa98e228fab069f8f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesNegativeTest-506076581 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2e83c6a2176b4fa98e228fab069f8f21 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesNegativeTest-506076581 Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesNegativeTest-506076581-project Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: a891c94339c74562aae137ef53fc584f Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesNegativeTest-506076581-project Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e9839991-f6c4-46ae-97f8-17fc571f5095'} Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:35:59.301452 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. Jul 18 13:35:59.307510 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:35:59.310187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] Returning 404 to user: Instance e9839991-f6c4-46ae-97f8-17fc571f5095 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:35:59.314141 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca4587f7-a09a-42ce-9d23-8da43c695e6e tempest-VolumesNegativeTest-506076581 tempest-VolumesNegativeTest-506076581-project] 10.222.0.88 "GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095" status: 404 len: 111 microversion: 2.1 time: 0.079273 Jul 18 13:35:59.323293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2891/5561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:59 2022] GET /compute/v2.1/servers/e9839991-f6c4-46ae-97f8-17fc571f5095 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:35:59.717553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:35:59.719190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:35:59.738402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:59.743003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:35:59.745609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:35:59.748719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:00.022341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:00.032442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-758fc8a4-dbd8-43bc-bcfc-0bab293702a0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.320008 Jul 18 13:36:00.041864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2671/5562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:35:59 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:01.057920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:01.058426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:01.076877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:01.077336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:01.078162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:01.078611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:01.107239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:01.373996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:01.382824 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-444546ad-f6b5-46d7-b518-fe4d374064f0 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.328982 Jul 18 13:36:01.388058 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2892/5563] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:01 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:02.406609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:02.408182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:02.429439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:02.429439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:02.430833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:02.436716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:02.570734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:02.591216 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70024db8-0707-433b-b725-8225fe17e348 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.190071 Jul 18 13:36:02.595361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2672/5564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:02 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:03.614492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:03.615184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:03.617275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:03.624181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:03.624650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:03.625483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:03.625941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:04.302219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:04.311514 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e441890e-f336-4985-a29f-cc167b683779 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.703534 Jul 18 13:36:04.313359 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2893/5565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:03 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:05.338041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:05.345235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:05.364364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=40 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:05.380822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:05.383916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:05.385295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:05.387781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:05.414761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=92 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:05.651671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:05.687211 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-666cca65-6b02-4034-9942-d91661c4c761 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.359313 Jul 18 13:36:05.689501 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2673/5566] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:05 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:06.708076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:06.708849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:06.720865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:06.721750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:06.723010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:06.723701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:06.915343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:06.925215 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cffee847-331c-444a-9305-477b23537c8f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.221368 Jul 18 13:36:06.929822 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2894/5567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:06 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:07.311666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-92ec454b-a1fc-42c4-ad76-240e36661825 req-5486d533-d0e4-402e-8def-a06e937e3133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514feb95-e54c-4ead-965b-4309314486dc", "name": "network-vif-plugged", "status": "completed", "tag": "7d54a6d8-7ad5-4385-814c-a1c83d2beeb4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:07.334993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92ec454b-a1fc-42c4-ad76-240e36661825 req-5486d533-d0e4-402e-8def-a06e937e3133 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:07.335475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-92ec454b-a1fc-42c4-ad76-240e36661825 req-5486d533-d0e4-402e-8def-a06e937e3133 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:07.366337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-92ec454b-a1fc-42c4-ad76-240e36661825 req-5486d533-d0e4-402e-8def-a06e937e3133 service nova] Creating event network-vif-plugged:7d54a6d8-7ad5-4385-814c-a1c83d2beeb4 for instance 514feb95-e54c-4ead-965b-4309314486dc on n-h1-850003-3 Jul 18 13:36:07.380476 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-92ec454b-a1fc-42c4-ad76-240e36661825 req-5486d533-d0e4-402e-8def-a06e937e3133 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078863 Jul 18 13:36:07.383601 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2674/5568] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:07.971871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:07.972589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:07.999023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:08.003222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:08.004310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:08.005558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:08.712669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:08.729102 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d53ab355-38e2-43ab-8444-473ef1d3563f tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1298 microversion: 2.1 time: 0.781380 Jul 18 13:36:08.730290 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2895/5569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:07 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1298 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:09.710481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:09.711766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:09.729048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:09.729949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:09.733183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:09.736306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:09.752108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:09.752996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:09.768593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:09.769527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:09.775944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:09.777334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:09.806661 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b19c17e7-5b6c-4b69-ae5a-756dc0c089e9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/ips" status: 200 len: 146 microversion: 2.1 time: 0.109355 Jul 18 13:36:09.819501 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2675/5570] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:36:09 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/ips => generated 146 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:10.093136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:10.105105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-293526f1-e234-4dd2-aa09-3434bfb4eab2 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1471 microversion: 2.1 time: 0.357081 Jul 18 13:36:10.107378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2896/5571] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:09 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:36:10.125733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:10.127534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:10.136387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.138429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:10.139450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.140203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:10.334202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:10.350182 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-186b5488-8939-4468-8b02-0ea2dae187c5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1471 microversion: 2.1 time: 0.228749 Jul 18 13:36:10.353125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2676/5572] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:10 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:10.367608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:10.368254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:10.384401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.384878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:10.385693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.389941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:10.654592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fbc6bba8-a6b8-4818-b4e6-2804236e953d tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1622 microversion: 2.1 time: 0.290482 Jul 18 13:36:10.658247 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2897/5573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:10 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1622 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:10.673262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:10.674642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:10.708513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.708980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:10.713823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:10.715421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:12.076833 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc4a2f55-5ed1-460e-9b11-c50d717643a5 tempest-TestSecurityGroupsBasicOps-559254403 tempest-TestSecurityGroupsBasicOps-559254403-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1910 microversion: 2.1 time: 1.409201 Jul 18 13:36:12.077583 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2677/5574] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:10 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1910 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:12.469522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:12.471338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:12.491392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:12.492824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:12.493864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:12.494939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:12.585175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:36:12.792958 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aadbebee-27cd-4fe7-b115-d5138fd7622b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "DELETE /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 204 len: 0 microversion: 2.1 time: 0.328822 Jul 18 13:36:12.794350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2898/5575] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:36:12 2022] DELETE /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:36:12.802736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:12.804369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:12.813944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:12.815080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:12.816278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:12.816966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:12.957900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:12.970132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-84615a02-64ea-4fa3-8b41-d26f73d38a69 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1477 microversion: 2.1 time: 0.171557 Jul 18 13:36:12.971427 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2678/5576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:12 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:13.667142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e66204cf-71fd-449e-b212-b943019e8173"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:13.671330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:13.683034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:13.684534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:13.685811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:13.687168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:13.989782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:13.997668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:14.034215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:14.041408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:14.046863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:14.047574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:14.275316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da02c775-01c4-4410-97c9-681eac9f96a4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619359 Jul 18 13:36:14.276952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2899/5577] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:36:13 2022] POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:14.289814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:14.316303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8893d3d-34c8-4335-b724-81fa95d6e611 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1477 microversion: 2.1 time: 0.332125 Jul 18 13:36:14.323022 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2679/5578] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:13 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:36:15.341032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:15.342079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:15.364375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:15.370095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:15.383677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:15.384281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:15.709134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:15.735679 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5cd6738b-824a-401b-b69f-ab1ee8e27193 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1477 microversion: 2.1 time: 0.397287 Jul 18 13:36:15.736559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2900/5579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:15 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:16.089113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e12363a6-1b6b-4fe1-9a80-fd9084672ae2 req-25ccd632-b47d-4f08-9171-674be6eae1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514feb95-e54c-4ead-965b-4309314486dc", "name": "network-vif-deleted", "tag": "7d54a6d8-7ad5-4385-814c-a1c83d2beeb4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:16.131883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e12363a6-1b6b-4fe1-9a80-fd9084672ae2 req-25ccd632-b47d-4f08-9171-674be6eae1dc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:16.132416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e12363a6-1b6b-4fe1-9a80-fd9084672ae2 req-25ccd632-b47d-4f08-9171-674be6eae1dc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:16.166084 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e12363a6-1b6b-4fe1-9a80-fd9084672ae2 req-25ccd632-b47d-4f08-9171-674be6eae1dc service nova] Creating event network-vif-deleted:7d54a6d8-7ad5-4385-814c-a1c83d2beeb4 for instance 514feb95-e54c-4ead-965b-4309314486dc on n-h1-850003-3 Jul 18 13:36:16.178657 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e12363a6-1b6b-4fe1-9a80-fd9084672ae2 req-25ccd632-b47d-4f08-9171-674be6eae1dc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095185 Jul 18 13:36:16.187130 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2680/5580] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:16.755458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:16.756273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:16.776234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:16.776701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:16.780145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:16.780953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:16.864722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:16.865401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:16.866240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lazy-loading 'fault' on Instance uuid 514feb95-e54c-4ead-965b-4309314486dc {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:36:16.979654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:16.988160 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-adb8a832-62dc-4d04-af19-54dce574c0ff tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 200 len: 1330 microversion: 2.1 time: 0.238651 Jul 18 13:36:16.990528 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2901/5581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:16 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 1330 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:18.012612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:18.014063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: 514feb95-e54c-4ead-965b-4309314486dc] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:18.063674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:18.065348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:18.067170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:18.072631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:18.126886 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] HTTP exception thrown: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Request method failure captured: Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc HTTP/1.1 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WEk2jBR_O5z2ZfPQJHMaxz3vR4NP4HqG5LhN_HjfEMhTr5lQGsa9EipL6hy0rnNWUsK6xjx5fP5wFDIws_OMq30DhmEu75ZFG0tccDbhsBAD2_j2JyDEAPidb6_3eCeJDB8ar1pFszSczoUdPHqC6bb4d_pon5AmElqkrsBrB2hGoo Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a9ac4ccbd72e44459e07258b615d8209 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a9ac4ccbd72e44459e07258b615d8209", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a9ac4ccbd72e44459e07258b615d8209 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestSecurityGroupsBasicOps-167132873-project Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 07dd4a3d71794e69a913c24860047123 Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestSecurityGroupsBasicOps-167132873-project Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '514feb95-e54c-4ead-965b-4309314486dc'} Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:36:18.128636 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Returning 404 to user: Instance 514feb95-e54c-4ead-965b-4309314486dc could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19a86b9c-5dd0-473d-bd06-d70b3f08c7c1 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc" status: 404 len: 111 microversion: 2.1 time: 0.124943 Jul 18 13:36:18.136482 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2681/5582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:18 2022] GET /compute/v2.1/servers/514feb95-e54c-4ead-965b-4309314486dc => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:36:28.934107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c247f5ec-2263-4803-8e1d-e6a876696225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:28.938219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:28.940271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:28.958300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c247f5ec-2263-4803-8e1d-e6a876696225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:28.958848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c247f5ec-2263-4803-8e1d-e6a876696225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:29.017453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c247f5ec-2263-4803-8e1d-e6a876696225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:36:29.125142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c247f5ec-2263-4803-8e1d-e6a876696225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action" status: 202 len: 0 microversion: 2.1 time: 0.195298 Jul 18 13:36:29.127229 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2902/5583] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:36:28 2022] POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:36:29.136013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:29.137856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:29.148089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=17 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:29.156220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=39 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:29.158613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:29.159586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:29.161241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:29.161910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:30.061623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:30.075300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-152a79ce-57e0-4a5b-bbdf-9bc54e10376e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 0.943745 Jul 18 13:36:30.076302 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2682/5584] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:29 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:31.097761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:31.098659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:31.114451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:31.114945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:31.115782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:31.116225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:31.656299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:31.673896 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8b56971-b6dd-45e5-9c97-4695ab7edbd6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 0.581173 Jul 18 13:36:31.675168 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2903/5585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:31 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:32.435967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:32.436621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:32.448705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-77415317-1f9f-49cf-8c93-cae3a727656f req-1eba85d2-dfa7-4d1a-9a8f-9264599bb5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea", "tag": "f89bcfb3-bf9e-49e6-853f-da6411fae6b2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:32.464222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.464827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.465645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.474052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.474719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-77415317-1f9f-49cf-8c93-cae3a727656f req-1eba85d2-dfa7-4d1a-9a8f-9264599bb5ec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.477750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-77415317-1f9f-49cf-8c93-cae3a727656f req-1eba85d2-dfa7-4d1a-9a8f-9264599bb5ec service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.534582 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-77415317-1f9f-49cf-8c93-cae3a727656f req-1eba85d2-dfa7-4d1a-9a8f-9264599bb5ec service nova] Creating event network-changed:f89bcfb3-bf9e-49e6-853f-da6411fae6b2 for instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea on n-h2-850003-3 Jul 18 13:36:32.543996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-77415317-1f9f-49cf-8c93-cae3a727656f req-1eba85d2-dfa7-4d1a-9a8f-9264599bb5ec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099534 Jul 18 13:36:32.550600 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2904/5586] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:36:32.565644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:36:32.693188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:32.694588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:32.707490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.707954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.708752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.709221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.731330 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f83c3d3c-6f47-4101-b163-a0566f75b867 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 204 len: 0 microversion: 2.1 time: 0.298794 Jul 18 13:36:32.735487 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2683/5587] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:36:32 2022] DELETE /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:36:32.741655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:32.742416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:32.756303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.756760 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:32.758092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:32.762642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:33.152704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:33.165611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d80f886-af37-464d-a2c3-2aab299cc7c9 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1765 microversion: 2.1 time: 0.425585 Jul 18 13:36:33.167157 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2684/5588] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:32 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1765 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:36:33.921872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:33.941998 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5749a705-845e-4623-a0b0-8310d728bae0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 1.246083 Jul 18 13:36:33.943179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2905/5589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:32 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:36:34.190470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:34.191491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:34.222114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:34.222605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:34.223408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:34.223855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:34.968539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:34.969051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:34.983908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:34.984250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:34.999814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:35.000279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:35.164584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:35.172808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1856e38e-c389-4c5d-b6ad-0cba800f66e5 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1765 microversion: 2.1 time: 0.989033 Jul 18 13:36:35.179829 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2685/5590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:34 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1765 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:35.628900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:35.644500 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3f4b534d-96ca-41a8-8271-af4614e324e2 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 0.682673 Jul 18 13:36:35.646389 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2906/5591] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:34 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:35.928628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e4d52894-5aa3-44e4-bc62-7fb6b3e2b84a req-711736ab-c710-42a2-b077-d3cbacb66113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea", "name": "network-vif-deleted", "tag": "f89bcfb3-bf9e-49e6-853f-da6411fae6b2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:35.963999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e4d52894-5aa3-44e4-bc62-7fb6b3e2b84a req-711736ab-c710-42a2-b077-d3cbacb66113 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:35.966840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e4d52894-5aa3-44e4-bc62-7fb6b3e2b84a req-711736ab-c710-42a2-b077-d3cbacb66113 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.006528 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e4d52894-5aa3-44e4-bc62-7fb6b3e2b84a req-711736ab-c710-42a2-b077-d3cbacb66113 service nova] Creating event network-vif-deleted:f89bcfb3-bf9e-49e6-853f-da6411fae6b2 for instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea on n-h2-850003-3 Jul 18 13:36:36.026758 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e4d52894-5aa3-44e4-bc62-7fb6b3e2b84a req-711736ab-c710-42a2-b077-d3cbacb66113 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098318 Jul 18 13:36:36.029213 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2686/5592] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:36.199508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:36.204834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:36.233291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:36.234134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.237292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:36.243865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.359143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:36.359617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.360230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lazy-loading 'fault' on Instance uuid c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:36:36.480406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd4a3d71794e69a913c24860047123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ac4ccbd72e44459e07258b615d8209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:36.491038 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a813e7c8-19a4-4811-ab72-27282bcfb323 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 200 len: 1382 microversion: 2.1 time: 0.298651 Jul 18 13:36:36.497033 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2907/5593] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:36 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 1382 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:36.666460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:36.667246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:36.692798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:36.697289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.702766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:36.703824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:36.936939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:36.946727 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-abed09dc-4057-4032-affc-54cd7a67bd4b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 0.285574 Jul 18 13:36:36.949832 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2687/5594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:36 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:37.531352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:37.532728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] [instance: c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:37.559254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:37.560647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:37.563346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:37.563813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:37.582945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] HTTP exception thrown: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Request method failure captured: Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea HTTP/1.1 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WEk2jBR_O5z2ZfPQJHMaxz3vR4NP4HqG5LhN_HjfEMhTr5lQGsa9EipL6hy0rnNWUsK6xjx5fP5wFDIws_OMq30DhmEu75ZFG0tccDbhsBAD2_j2JyDEAPidb6_3eCeJDB8ar1pFszSczoUdPHqC6bb4d_pon5AmElqkrsBrB2hGoo Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a9ac4ccbd72e44459e07258b615d8209 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a9ac4ccbd72e44459e07258b615d8209", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9ac4ccbd72e44459e07258b615d8209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a9ac4ccbd72e44459e07258b615d8209 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-167132873 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestSecurityGroupsBasicOps-167132873-project Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 07dd4a3d71794e69a913c24860047123 Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestSecurityGroupsBasicOps-167132873-project Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea'} Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:36:37.585122 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. Jul 18 13:36:37.591481 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:36:37.594410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Returning 404 to user: Instance c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:36:37.597175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57a553c4-1b5a-4150-9c68-4b9607857076 tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea" status: 404 len: 111 microversion: 2.1 time: 0.081507 Jul 18 13:36:37.600447 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2908/5595] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:37 2022] GET /compute/v2.1/servers/c5439e05-4b88-4c7f-9dbe-aa2d199fc4ea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:36:37.973160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:37.976465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:38.013567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:38.014057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:38.015059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:38.015353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:38.517698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:38.546069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8756beca-4e11-4a30-880a-3473a28753d4 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1724 microversion: 2.1 time: 0.580608 Jul 18 13:36:38.551747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2688/5596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:37 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:39.580890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:39.586525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:39.612757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:39.615226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:39.616414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:39.619917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:40.317840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:40.347971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d202f762-c4d5-4f67-a780-65bedf182b5e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1701 microversion: 2.1 time: 0.782516 Jul 18 13:36:40.350471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2909/5597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:39 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1701 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:40.376267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb4c7fc5-f52f-46ca-9a9b-3469c65a9275 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:40.407773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb4c7fc5-f52f-46ca-9a9b-3469c65a9275 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:40.408778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb4c7fc5-f52f-46ca-9a9b-3469c65a9275 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:40.475400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb4c7fc5-f52f-46ca-9a9b-3469c65a9275 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Going to try to start instance {{(pid=131367) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 13:36:40.698911 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb4c7fc5-f52f-46ca-9a9b-3469c65a9275 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action" status: 202 len: 0 microversion: 2.1 time: 0.330618 Jul 18 13:36:40.704808 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2689/5598] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:36:40 2022] POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:36:40.717426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:40.718687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:40.755786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:40.763539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:40.767801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:40.769720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:41.607540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:41.627964 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50621208-ecb4-41b2-9aac-4282c2a9b0d8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1710 microversion: 2.1 time: 0.918339 Jul 18 13:36:41.629023 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2910/5599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:40 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1710 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:42.664356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:42.665228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:42.685589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:42.687539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:42.689650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:42.693201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:42.957201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1545f07-5a36-482a-a9bf-6304d494f4a4 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Action: 'create', calling method: .version_select at 0x7f96d7a72550>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1405614915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO63kcULzL+3eBg7AdM3wtB98WfUclficHwgKoJga8xfPDOXHlKaughPROwSSAIkafy1XIoF1CBYs+OqO4b/ici5859nlmn/y81w3LxMu1Bp3RDmYXau/irr9wxx1tGU8w=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:42.982551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a1545f07-5a36-482a-a9bf-6304d494f4a4 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for project b342dc2707954265bc9b5dba5353aa8e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:36:42.991001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a1545f07-5a36-482a-a9bf-6304d494f4a4 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for user 5c9349e058f24860b8683862c39bf4a8 and project b342dc2707954265bc9b5dba5353aa8e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:36:43.050728 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1545f07-5a36-482a-a9bf-6304d494f4a4 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328026 Jul 18 13:36:43.051413 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2911/5600] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:36:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:43.659665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:43.711123 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-800b4813-95ef-4ea5-8a9a-f841f947c274 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1710 microversion: 2.1 time: 1.051675 Jul 18 13:36:43.715743 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2690/5601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:42 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1710 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:44.755623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:44.760319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:44.801420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:44.806280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:44.810931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:44.813600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:45.809131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:45.823120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c6939cd-829e-472c-94bc-95086b3effb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1714 microversion: 2.1 time: 1.090779 Jul 18 13:36:45.824535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2912/5602] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:44 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1714 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:46.458685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-db3988b1-fc49-44a8-84aa-93c2616f797b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] Calling method '.version_select at 0x7f96d77eb4c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:46.500644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-db3988b1-fc49-44a8-84aa-93c2616f797b tempest-TestSecurityGroupsBasicOps-167132873 tempest-TestSecurityGroupsBasicOps-167132873-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-910348233" status: 202 len: 0 microversion: 2.1 time: 0.045990 Jul 18 13:36:46.501249 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2691/5603] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-910348233 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:36:48.667458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-939920672", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1405614915", "security_groups": [{"name": "tempest-secgroup-smoke-109554492"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5ed297f4-ba86-48d2-9ceb-8fc68f1733c6"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:48.946235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] validate_networks() for [('5ed297f4-ba86-48d2-9ceb-8fc68f1733c6', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:36:49.985525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for project b342dc2707954265bc9b5dba5353aa8e. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:36:50.024073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for user 5c9349e058f24860b8683862c39bf4a8 and project b342dc2707954265bc9b5dba5353aa8e. Resources: dict_keys(['metadata_items']) {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:36:50.093179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:36:50.095089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:36:50.095731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:36:50.096217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:36:50.096709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:36:50.142504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:50.143327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:50.145887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:50.164925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:50.250903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for project b342dc2707954265bc9b5dba5353aa8e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:36:50.274992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Getting quotas for user 5c9349e058f24860b8683862c39bf4a8 and project b342dc2707954265bc9b5dba5353aa8e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:36:50.325526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:36:50.336675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:36:50.452125 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2284f6bb-34b2-4cdc-aaa7-791facc787fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.805015 Jul 18 13:36:50.453395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2913/5604] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:36:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:36:50.465072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cc899ba8-2400-4731-ae32-02c677660cb5 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:50.467195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cc899ba8-2400-4731-ae32-02c677660cb5 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:50.595600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cc899ba8-2400-4731-ae32-02c677660cb5 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:50.605555 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cc899ba8-2400-4731-ae32-02c677660cb5 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1302 microversion: 2.1 time: 0.146100 Jul 18 13:36:50.608245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2692/5605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:50 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:51.636808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:51.639257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:51.673289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:51.675691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:51.677483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:51.685028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:51.865395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:51.893143 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fce87173-cdf1-4c51-aec2-e939ef82988b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1298 microversion: 2.1 time: 0.261996 Jul 18 13:36:51.893761 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2914/5606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:51 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:52.911710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:52.912541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:52.949091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:52.949934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:52.959417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:52.968240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:53.196194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:53.209695 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8af84da6-39ce-4419-a9fc-807896ca02e0 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1360 microversion: 2.1 time: 0.303030 Jul 18 13:36:53.215121 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2693/5607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:52 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1360 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:54.228869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:54.230198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:54.240584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:54.251251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:54.252361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:54.253537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:55.073049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:55.086031 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f019da7-328b-40e1-b188-2afd36a39174 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.860503 Jul 18 13:36:55.087653 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2915/5608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:54 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:36:55.733684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6d203c01-79b0-4f91-8a93-2c88236e6f7d req-8eabc1f0-4c5f-4bb2-913e-5919b4cdc814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5949d514-1f74-496d-a611-f81cbc17c047", "tag": "f3a1ceae-6c69-434a-af27-0b0e2682838b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:36:55.764719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6d203c01-79b0-4f91-8a93-2c88236e6f7d req-8eabc1f0-4c5f-4bb2-913e-5919b4cdc814 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:55.765394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6d203c01-79b0-4f91-8a93-2c88236e6f7d req-8eabc1f0-4c5f-4bb2-913e-5919b4cdc814 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:55.819964 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6d203c01-79b0-4f91-8a93-2c88236e6f7d req-8eabc1f0-4c5f-4bb2-913e-5919b4cdc814 service nova] Creating event network-changed:f3a1ceae-6c69-434a-af27-0b0e2682838b for instance 5949d514-1f74-496d-a611-f81cbc17c047 on n-h2-850003-3 Jul 18 13:36:55.838603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6d203c01-79b0-4f91-8a93-2c88236e6f7d req-8eabc1f0-4c5f-4bb2-913e-5919b4cdc814 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109606 Jul 18 13:36:55.842052 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2694/5609] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:36:56.108447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:56.109329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:56.121217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:56.122114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:56.124196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:56.124962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:57.018331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:57.028768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0bb62e67-6019-46b0-bc38-79f22ddb67fe tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.927238 Jul 18 13:36:57.029396 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2916/5610] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:56 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:36:58.078888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:36:58.082696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:36:58.101693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:58.105841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:58.107157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:36:58.116885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:36:59.199532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:36:59.231466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:36:59.249831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a960b998-8f3b-4d03-b4eb-37125cf5c41e tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 1.190054 Jul 18 13:36:59.275775 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2695/5611] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:36:58 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:00.320197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:00.321131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:00.344037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:00.344809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:00.347370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:00.354364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:00.354939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:00.370721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:00.371293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:00.385851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:01.071537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:01.087430 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b81d2da9-0dd5-477b-b559-4d9331cf288b tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.788199 Jul 18 13:37:01.098838 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2917/5612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:00 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:02.122828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:02.131217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:02.171782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:02.181843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:02.186437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:02.187893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:02.191037 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:02.192681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:02.667614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:02.731089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f9b20f2-4944-40bf-a0b2-5a8797d6d3c1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.615824 Jul 18 13:37:02.731820 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2696/5613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:02 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:03.804278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:03.810602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:03.826358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:03.827849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:03.829428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:03.833008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:04.354549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:04.369674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-432a7b1a-8a7f-4a1f-bb2f-32ca93ddd487 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.607646 Jul 18 13:37:04.371938 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2918/5614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:03 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:05.414832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:05.415885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:05.453821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:05.455339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:05.456536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:05.457665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:05.741264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-faf64ad2-4f9a-4adf-ab38-bcd61e8ab39f req-4dcb6f58-d29f-4c73-96bd-f8851b5577b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5949d514-1f74-496d-a611-f81cbc17c047", "name": "network-vif-plugged", "status": "completed", "tag": "f3a1ceae-6c69-434a-af27-0b0e2682838b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:05.772485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-faf64ad2-4f9a-4adf-ab38-bcd61e8ab39f req-4dcb6f58-d29f-4c73-96bd-f8851b5577b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:05.774951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-faf64ad2-4f9a-4adf-ab38-bcd61e8ab39f req-4dcb6f58-d29f-4c73-96bd-f8851b5577b0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:05.832316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-faf64ad2-4f9a-4adf-ab38-bcd61e8ab39f req-4dcb6f58-d29f-4c73-96bd-f8851b5577b0 service nova] Creating event network-vif-plugged:f3a1ceae-6c69-434a-af27-0b0e2682838b for instance 5949d514-1f74-496d-a611-f81cbc17c047 on n-h2-850003-3 Jul 18 13:37:05.853705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-faf64ad2-4f9a-4adf-ab38-bcd61e8ab39f req-4dcb6f58-d29f-4c73-96bd-f8851b5577b0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114497 Jul 18 13:37:05.857841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2919/5615] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:37:06.030991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:06.130181 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1b98997-be11-4798-b5b0-86e532885fa1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.729382 Jul 18 13:37:06.141284 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2697/5616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:05 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:07.183869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:07.186041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:07.197087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:07.197826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:07.198795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:07.199321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:07.600541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:07.627089 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e1dfe55-0e69-455e-8f3d-791f979debdb tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1427 microversion: 2.1 time: 0.457247 Jul 18 13:37:07.629230 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2920/5617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:07 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1427 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:08.656206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:08.657702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:08.681508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:08.684393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:08.689476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:08.691203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:09.503418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:09.516869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c1a5ca6-bbfb-4f46-90e2-4050d41635dc tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1608 microversion: 2.1 time: 0.867278 Jul 18 13:37:09.517780 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2698/5618] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:08 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1608 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:09.535949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:09.537275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:09.573613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:09.575441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:09.577682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:09.580006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:10.336064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:10.348983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-de257673-836b-44b3-aa11-d0d851fd34ed tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1608 microversion: 2.1 time: 0.817235 Jul 18 13:37:10.349909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2921/5619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:09 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1608 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:10.416933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:10.417931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:10.468216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:10.472982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:10.481249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:10.481835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:10.970311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:10.993916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d397cdec-b9a2-4f9e-80d5-2877fffcc26a tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1608 microversion: 2.1 time: 0.621278 Jul 18 13:37:10.995004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2699/5620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:10 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1608 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:17.700183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a3b172aa-73b5-456b-a018-ab08ec68c9d3 req-3ef875d7-3f04-4875-badb-a7171ac5a192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5949d514-1f74-496d-a611-f81cbc17c047", "tag": "f3a1ceae-6c69-434a-af27-0b0e2682838b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:17.723936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a3b172aa-73b5-456b-a018-ab08ec68c9d3 req-3ef875d7-3f04-4875-badb-a7171ac5a192 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:17.724437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a3b172aa-73b5-456b-a018-ab08ec68c9d3 req-3ef875d7-3f04-4875-badb-a7171ac5a192 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:17.748510 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a3b172aa-73b5-456b-a018-ab08ec68c9d3 req-3ef875d7-3f04-4875-badb-a7171ac5a192 service nova] Creating event network-changed:f3a1ceae-6c69-434a-af27-0b0e2682838b for instance 5949d514-1f74-496d-a611-f81cbc17c047 on n-h2-850003-3 Jul 18 13:37:17.766811 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a3b172aa-73b5-456b-a018-ab08ec68c9d3 req-3ef875d7-3f04-4875-badb-a7171ac5a192 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073890 Jul 18 13:37:17.767849 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2922/5621] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:20.274273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:20.275703 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:37:20.275703 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:37:20.277171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:20.277803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:20.279280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:20.280065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:20.341003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75e63b4c-1765-47e1-a837-ff52eb9e4a3a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.369857 Jul 18 13:37:20.362348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2700/5622] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 18 13:37:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:20.695069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2132720483", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "availability_zone": "nova:n-h2-850003-3", "networks": [{"uuid": "81f63d5a-ffa5-427d-acae-e9eaed3d7c93"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:20.835555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] validate_networks() for [('81f63d5a-ffa5-427d-acae-e9eaed3d7c93', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:37:21.545615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:37:21.546413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:37:21.547113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:37:21.548289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:37:21.552805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:37:21.567519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:21.568129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:21.568794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:21.569291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:21.638331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Getting quotas for project b6d7bc4346d8405c8602bd2b09e369a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:37:21.678399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Getting quotas for user 76c40c4fe9be459e83f383b0babbacf5 and project b6d7bc4346d8405c8602bd2b09e369a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:37:21.708326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:37:21.714649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:37:21.871714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82493d1e-d13d-41f9-b808-60d80c0bd3ae tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183064 Jul 18 13:37:21.879215 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2923/5623] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:37:21.889545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32338d68-4d51-4cf4-9b81-72904e56713d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:21.893531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32338d68-4d51-4cf4-9b81-72904e56713d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:22.201737 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32338d68-4d51-4cf4-9b81-72904e56713d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1329 microversion: 2.1 time: 0.321917 Jul 18 13:37:22.208833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2701/5624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:21 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1329 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:23.237457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1edc97e4-3386-40f1-b0f4-c96db62feb67 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:23.238211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1edc97e4-3386-40f1-b0f4-c96db62feb67 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:23.399996 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1edc97e4-3386-40f1-b0f4-c96db62feb67 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1329 microversion: 2.1 time: 0.166769 Jul 18 13:37:23.400699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2924/5625] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:23 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1329 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:24.418141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:24.419143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:24.440444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:24.440873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:24.441995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:24.452047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:24.715530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ab90c872-1c6e-4394-836b-8b07f0a58dc3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1416 microversion: 2.1 time: 0.300596 Jul 18 13:37:24.717922 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2702/5626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:24 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1416 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:25.739976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:25.742919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:25.753180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:25.754367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:25.754761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:25.755389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:26.342591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b0cabc59-25ac-4dda-9693-03f19b7eb6f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1422 microversion: 2.1 time: 0.606479 Jul 18 13:37:26.354716 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2925/5627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:25 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1422 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:27.376705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:27.378661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:27.417344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:27.418023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:27.425853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:27.426605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:27.995530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63dc8357-a70f-434f-b913-d4e90bf71441 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.626521 Jul 18 13:37:27.997944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2703/5628] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:27 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:28.867512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e19813ea-428a-41f8-8786-b70bfa13217b req-a1a39f5d-6fcc-4455-ad11-dd1b42380ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5354f87e-0a78-4e45-899a-342bf9880940", "tag": "49c07b84-dc89-4fb3-8f19-1f2897197d9f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:28.887512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e19813ea-428a-41f8-8786-b70bfa13217b req-a1a39f5d-6fcc-4455-ad11-dd1b42380ea8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:28.887990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e19813ea-428a-41f8-8786-b70bfa13217b req-a1a39f5d-6fcc-4455-ad11-dd1b42380ea8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:28.918704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e19813ea-428a-41f8-8786-b70bfa13217b req-a1a39f5d-6fcc-4455-ad11-dd1b42380ea8 service nova] Creating event network-changed:49c07b84-dc89-4fb3-8f19-1f2897197d9f for instance 5354f87e-0a78-4e45-899a-342bf9880940 on n-h2-850003-3 Jul 18 13:37:28.932288 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e19813ea-428a-41f8-8786-b70bfa13217b req-a1a39f5d-6fcc-4455-ad11-dd1b42380ea8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069981 Jul 18 13:37:28.932920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2926/5629] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:29.014732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:29.015343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:29.041066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:29.042384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:29.043842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:29.044825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:29.329889 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-982cad6c-05a8-441e-8ded-f4f86b3c1752 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.319403 Jul 18 13:37:29.335244 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2704/5630] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:29 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:30.354582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:30.356583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:30.375532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:30.375996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:30.376804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:30.377248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:30.541922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=42 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:30.553144 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5721f2e6-405c-4782-869d-11f68c08b0bf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.204222 Jul 18 13:37:30.555109 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2927/5631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:30 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:31.572321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:31.573513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:31.577746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:31.584323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:31.585937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:31.587582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:31.588797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:32.198170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:32.286239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=50 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:32.295613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-185a22d7-3361-4623-ac10-5fe0be17b091 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.727381 Jul 18 13:37:32.296695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2705/5632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:31 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:33.074191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-598a4add-7d26-46b3-8f7b-760bd544c64c req-14672263-b32d-4dba-8fc6-2cf3ce13c865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5354f87e-0a78-4e45-899a-342bf9880940", "name": "network-vif-plugged", "status": "completed", "tag": "49c07b84-dc89-4fb3-8f19-1f2897197d9f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:33.085471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:33.090214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:33.104016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-598a4add-7d26-46b3-8f7b-760bd544c64c req-14672263-b32d-4dba-8fc6-2cf3ce13c865 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:33.106476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-598a4add-7d26-46b3-8f7b-760bd544c64c req-14672263-b32d-4dba-8fc6-2cf3ce13c865 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:33.159444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-598a4add-7d26-46b3-8f7b-760bd544c64c req-14672263-b32d-4dba-8fc6-2cf3ce13c865 service nova] Creating event network-vif-plugged:49c07b84-dc89-4fb3-8f19-1f2897197d9f for instance 5354f87e-0a78-4e45-899a-342bf9880940 on n-h2-850003-3 Jul 18 13:37:33.187780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-598a4add-7d26-46b3-8f7b-760bd544c64c req-14672263-b32d-4dba-8fc6-2cf3ce13c865 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120975 Jul 18 13:37:33.190713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2928/5633] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:33.317435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:33.320847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:33.339159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=24 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:33.343723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:33.346366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:33.347795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:33.348797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:33.593642 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd9c0da0-de2c-4e39-82d2-43b2cd1b9285 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.283489 Jul 18 13:37:33.603814 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2706/5634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:33 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:34.609872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:34.617199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:34.618026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:34.653787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:34.654573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:34.655856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:34.656569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:34.957052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b5e73c6-79b6-4443-8b5d-fe4147fa947f tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1464 microversion: 2.1 time: 0.348479 Jul 18 13:37:34.960250 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2929/5635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:34 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:35.979014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:35.980205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:35.992772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:35.995546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:35.997318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:35.998452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:36.203054 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3b67f7e-f166-4451-ac90-97fa053b5748 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1649 microversion: 2.1 time: 0.228905 Jul 18 13:37:36.204531 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2707/5636] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:35 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1649 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:36.227005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:36.230019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:36.238323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:36.239556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:36.241491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:36.242168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:36.586887 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aba6c662-6843-47ea-abd7-ebdc93b74538 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1649 microversion: 2.1 time: 0.366684 Jul 18 13:37:36.602683 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2930/5637] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:36 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1649 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:36.607900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:36.608524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:36.629282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:36.630001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:36.631062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:36.631726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:37.036324 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-269d0b2f-31f5-4e0a-8b34-703aab8274b8 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1649 microversion: 2.1 time: 0.433059 Jul 18 13:37:37.058102 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2708/5638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:36 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1649 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:37.222587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-792751481", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "availability_zone": "nova:n-h1-850003-3", "networks": [{"uuid": "81f63d5a-ffa5-427d-acae-e9eaed3d7c93"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:37.298264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] validate_networks() for [('81f63d5a-ffa5-427d-acae-e9eaed3d7c93', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:37:38.093300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:37:38.093885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:37:38.094647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:37:38.103273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:37:38.107651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:37:38.121533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:38.122016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:38.127036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:38.128238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:38.153402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Getting quotas for project b6d7bc4346d8405c8602bd2b09e369a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:37:38.161728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Getting quotas for user 76c40c4fe9be459e83f383b0babbacf5 and project b6d7bc4346d8405c8602bd2b09e369a0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:37:38.180865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:37:38.184595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:37:38.304367 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea739555-ec5e-4635-a94f-8312dc5541cf tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085665 Jul 18 13:37:38.306296 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2931/5639] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:37:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:37:38.317213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-212806b1-940c-42d6-9cce-b38072971de0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:38.317842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-212806b1-940c-42d6-9cce-b38072971de0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:38.475880 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-212806b1-940c-42d6-9cce-b38072971de0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1328 microversion: 2.1 time: 0.162702 Jul 18 13:37:38.486038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2709/5640] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:38 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:39.494667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:39.504390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:39.528149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:39.530335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:39.533926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:39.536276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:39.745348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34f782e6-25b3-497d-a3b9-21e302c1b7f7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1337 microversion: 2.1 time: 0.255440 Jul 18 13:37:39.747004 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2932/5641] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:39 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1337 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:40.766185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:40.767084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:40.776949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:40.777875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:40.778920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:40.779671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:40.932365 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8460ce5-2bc5-469e-bf05-51f65272f54c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1421 microversion: 2.1 time: 0.171122 Jul 18 13:37:40.933125 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2710/5642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:40 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:41.505157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:41.505954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:41.528079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:41.532027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:41.533692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:41.535953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:41.768290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lazy-loading 'services' on Instance uuid a52ed8e6-7f13-44b2-a4a0-a79fa154be29 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:37:41.914664 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3839753b-30df-4608-9e45-8bf0739f3ef7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments/e66204cf-71fd-449e-b212-b943019e8173" status: 202 len: 0 microversion: 2.1 time: 0.420341 Jul 18 13:37:41.917909 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2933/5643] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:37:41 2022] DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments/e66204cf-71fd-449e-b212-b943019e8173 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:37:41.961606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:41.963815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:41.995039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:41.996479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:41.998282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:42.001741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:42.484396 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1594ddbf-b83d-4771-8b6d-e2f915665063 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.534820 Jul 18 13:37:42.486396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2711/5644] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:41 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:43.291537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-df6f8f5e-0bd8-4960-873d-3b8d44fc68f0 req-3f02faf6-4a8c-4d71-81cb-9c0295c3e7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3af923-92c8-445c-b6c6-e7bbd1588c59", "tag": "765bf258-55a5-4025-895d-03862bfdfdbb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:43.348489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-df6f8f5e-0bd8-4960-873d-3b8d44fc68f0 req-3f02faf6-4a8c-4d71-81cb-9c0295c3e7d8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:43.362123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-df6f8f5e-0bd8-4960-873d-3b8d44fc68f0 req-3f02faf6-4a8c-4d71-81cb-9c0295c3e7d8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:43.440196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-df6f8f5e-0bd8-4960-873d-3b8d44fc68f0 req-3f02faf6-4a8c-4d71-81cb-9c0295c3e7d8 service nova] Creating event network-changed:765bf258-55a5-4025-895d-03862bfdfdbb for instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 on n-h1-850003-3 Jul 18 13:37:43.462644 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-df6f8f5e-0bd8-4960-873d-3b8d44fc68f0 req-3f02faf6-4a8c-4d71-81cb-9c0295c3e7d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186877 Jul 18 13:37:43.475474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2934/5645] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:43.513354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:43.524450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:43.552721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:43.563186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:43.573697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:43.576930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:44.079299 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c0bacdf-dcb1-4376-af3c-5fd5dc6b01a9 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.574910 Jul 18 13:37:44.082490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2712/5646] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:43 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:45.109960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:45.110894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:45.133981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:45.135011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:45.136671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:45.137848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:45.431286 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b469508e-fa52-499b-8973-fd882c4c1164 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.328068 Jul 18 13:37:45.433591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2935/5647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:45 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:46.453429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:46.454960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:46.465262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:46.466229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:46.467242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:46.467858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:46.768541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25c4d7c9-bf36-44ec-a463-27f57127c176 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.320163 Jul 18 13:37:46.772045 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2713/5648] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:46 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:47.792936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:47.797778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:47.830785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:47.831827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:47.838444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:47.839564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:48.144181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:48.172759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:48.297910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d33cf1c0-3c3c-453a-9404-fea25bbf2992 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.513642 Jul 18 13:37:48.318271 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2936/5649] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:47 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:49.338241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:49.339102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:49.351804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:49.357414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:49.358310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:49.359443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:49.359886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:49.665652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ffc219a9-7820-438e-9c94-08d3d5ae62d0 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.333874 Jul 18 13:37:49.668465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2714/5650] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:49 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:50.283532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4dd9213c-4f7f-4062-ae76-ae42fcaeaaf5 req-9c5a35a0-edf0-4eac-a984-eb8ea466701a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3af923-92c8-445c-b6c6-e7bbd1588c59", "name": "network-vif-plugged", "status": "completed", "tag": "765bf258-55a5-4025-895d-03862bfdfdbb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:50.368639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4dd9213c-4f7f-4062-ae76-ae42fcaeaaf5 req-9c5a35a0-edf0-4eac-a984-eb8ea466701a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:50.385479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4dd9213c-4f7f-4062-ae76-ae42fcaeaaf5 req-9c5a35a0-edf0-4eac-a984-eb8ea466701a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:50.435233 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4dd9213c-4f7f-4062-ae76-ae42fcaeaaf5 req-9c5a35a0-edf0-4eac-a984-eb8ea466701a service nova] Creating event network-vif-plugged:765bf258-55a5-4025-895d-03862bfdfdbb for instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 on n-h1-850003-3 Jul 18 13:37:50.470814 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4dd9213c-4f7f-4062-ae76-ae42fcaeaaf5 req-9c5a35a0-edf0-4eac-a984-eb8ea466701a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200691 Jul 18 13:37:50.472409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2937/5651] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:50.692103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:50.692764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:50.712913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:50.727848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:50.728493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:50.730423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:51.327609 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-21a644e0-eadc-4ea2-8fd0-4930badba6ab tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.639566 Jul 18 13:37:51.334541 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2715/5652] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:50 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:51.439316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a46211e-2278-4e0d-9358-371248012644 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:51.449088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a46211e-2278-4e0d-9358-371248012644 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:51.451034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a46211e-2278-4e0d-9358-371248012644 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:51.489337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a46211e-2278-4e0d-9358-371248012644 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Going to try to stop instance {{(pid=131366) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 13:37:51.557696 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a46211e-2278-4e0d-9358-371248012644 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action" status: 202 len: 0 microversion: 2.1 time: 0.125119 Jul 18 13:37:51.570274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:51.571385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:51.572176 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2938/5653] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:37:51 2022] POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:37:51.596585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:51.599219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:51.602023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:51.602862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:51.953516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:51.964197 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d4d4c72-bba6-4085-9c5f-cad0ff381915 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.400607 Jul 18 13:37:51.965083 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2716/5654] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:51 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:52.360356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:52.361547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:52.374454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:52.375601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:52.376867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:52.377738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:52.597017 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d3b784ac-a4a8-4863-8d5b-39395b447ad3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1463 microversion: 2.1 time: 0.249749 Jul 18 13:37:52.602279 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2939/5655] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:52 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1463 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:37:52.988186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:52.988913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:53.002752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.009820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:53.011709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.012322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:53.279468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:53.297373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d0e7adcd-93de-4131-905e-e27c4dfad40b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.312750 Jul 18 13:37:53.298737 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2717/5656] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:52 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:53.622554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:53.623725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:53.635688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.636875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:53.638662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.639355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:53.909775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7c4caae5-df6a-4170-b719-564226a98330 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1648 microversion: 2.1 time: 0.294443 Jul 18 13:37:53.911592 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2940/5657] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:53 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1648 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:53.933508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:53.934175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:53.941259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.941717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:53.942705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:53.943283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.143502 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea488a1e-bd49-4f93-9d65-5879f660b69d tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1648 microversion: 2.1 time: 0.214997 Jul 18 13:37:54.178640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2718/5658] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:53 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1648 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:54.180705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:54.181190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:54.190378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.190879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.192311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.192816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.324102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:54.325639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:54.335866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.337511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.339642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.340496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.406021 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc03beed-f259-4588-8715-a68a5174d555 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1648 microversion: 2.1 time: 0.231249 Jul 18 13:37:54.407633 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2941/5659] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:54 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1648 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:54.427555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:54.429342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:54.440344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.441210 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.442807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.443854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.515331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:37:54.595155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:54.613780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-78ea516f-7915-4d48-8372-c8b30bf0716d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.298373 Jul 18 13:37:54.615053 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2719/5660] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:54 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:54.670877 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4c611c2d-6527-4a23-b03e-3300a617aaf7 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 204 len: 0 microversion: 2.1 time: 0.247545 Jul 18 13:37:54.675094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2942/5661] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:37:54 2022] DELETE /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:37:54.690463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:54.691700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:54.704780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.705678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.706683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:54.707463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:54.990534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2e17a47b-8a7b-453b-a2f2-4b5d506c0142 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1654 microversion: 2.1 time: 0.308693 Jul 18 13:37:54.991135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2720/5662] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:54 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1654 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:55.651027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:55.652416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:55.671914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:55.672653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:55.673480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:55.673945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:55.937139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:55.944053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:55.952361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6452ceb6-f26e-43fa-b39f-8237cacfef3e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.316772 Jul 18 13:37:55.953827 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2943/5663] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:55 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:56.016514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:56.020383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:56.044329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:56.046789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:56.047855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:56.048318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:56.294457 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79058f36-692a-4526-aff6-530f0ab05389 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1654 microversion: 2.1 time: 0.285362 Jul 18 13:37:56.295898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2721/5664] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:56 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1654 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:56.977791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:56.979067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:57.014843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:57.015235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:57.026196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:57.030923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:57.319583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:57.320746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:57.331779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:57.333671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:57.337053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:57.352992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:57.410698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:57.450293 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6d3f74d6-fe30-4d41-9eb5-629ca0b7161d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.460829 Jul 18 13:37:57.451807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2944/5665] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:56 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:57.723049 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba0db695-70ad-4680-8720-945004296088 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 200 len: 1612 microversion: 2.1 time: 0.409764 Jul 18 13:37:57.725753 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2722/5666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:57 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 1612 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:57.759111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6c22b362-2385-4554-a691-5490ebc2282d req-18ea0df3-9a76-4378-9761-3c14a039cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3af923-92c8-445c-b6c6-e7bbd1588c59", "name": "network-vif-deleted", "tag": "765bf258-55a5-4025-895d-03862bfdfdbb"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:37:57.783425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6c22b362-2385-4554-a691-5490ebc2282d req-18ea0df3-9a76-4378-9761-3c14a039cc4d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:57.783884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6c22b362-2385-4554-a691-5490ebc2282d req-18ea0df3-9a76-4378-9761-3c14a039cc4d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:57.809487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6c22b362-2385-4554-a691-5490ebc2282d req-18ea0df3-9a76-4378-9761-3c14a039cc4d service nova] Creating event network-vif-deleted:765bf258-55a5-4025-895d-03862bfdfdbb for instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 on n-h1-850003-3 Jul 18 13:37:57.828721 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6c22b362-2385-4554-a691-5490ebc2282d req-18ea0df3-9a76-4378-9761-3c14a039cc4d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374621 Jul 18 13:37:57.835168 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2945/5667] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:37:58.478535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:58.479838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:58.495480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.496568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.499398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.501736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.553977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:37:58.755983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:58.758380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: fc3af923-92c8-445c-b6c6-e7bbd1588c59] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:58.795460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.796748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.800057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.801141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.854265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] HTTP exception thrown: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. Jul 18 13:37:58.858826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Request method failure captured: Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 HTTP/1.1 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WIP0wfQq0vV368xgvmCyL1XEXQ148eULDBl3HxwsMOkJ9tqnpv_d_BPVa9qEHxKLcx_a4K2CkiUHlbQCKjDT9SUXxJMzDjhUPZLZFUaYTTjewn5XfI-qqFDC0H1poFiLGsm95h1dENTTwIC2jEOEklS4slLwJTO9tveHqpOevucuXE Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: b6d7bc4346d8405c8602bd2b09e369a0 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestServerMultinode-591473170 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b6d7bc4346d8405c8602bd2b09e369a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestServerMultinode-591473170 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: b6d7bc4346d8405c8602bd2b09e369a0 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestServerMultinode-591473170 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestServerMultinode-591473170-project-admin Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 76c40c4fe9be459e83f383b0babbacf5 Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestServerMultinode-591473170-project-admin Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'fc3af923-92c8-445c-b6c6-e7bbd1588c59'} Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:37:58.864911 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Returning 404 to user: Instance fc3af923-92c8-445c-b6c6-e7bbd1588c59 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:37:58.870488 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2acc4fae-e233-4ab9-a5ca-cb9c9136cc7c tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59" status: 404 len: 111 microversion: 2.1 time: 0.127700 Jul 18 13:37:58.871643 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0387a01-96ce-4e5f-854c-1e77463f7db3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.402676 Jul 18 13:37:58.872803 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2723/5668] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:58 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:58.883287 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2946/5669] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:58 2022] GET /compute/v2.1/servers/fc3af923-92c8-445c-b6c6-e7bbd1588c59 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:37:58.898054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:58.899130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:58.914069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.915576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.918560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:58.919840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:58.993452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:37:59.278746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97789316-e498-4a9c-ace6-fc4b4a2cf79a tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 204 len: 0 microversion: 2.1 time: 0.386532 Jul 18 13:37:59.278746 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2724/5670] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:37:58 2022] DELETE /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:37:59.293265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:59.297970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:59.341314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:59.342083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:59.343616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:59.344461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:59.791863 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb04a4c1-e6f5-4478-a1a0-9ae03f1de6f3 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1655 microversion: 2.1 time: 0.505142 Jul 18 13:37:59.794412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2947/5671] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:59 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1655 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:37:59.891150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:37:59.892694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:37:59.900696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:59.901489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:37:59.902516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:37:59.903153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:00.199837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:00.223827 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11d01eb1-4c36-4d70-a4a7-d9807bb1fc78 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.335270 Jul 18 13:38:00.226039 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2725/5672] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:37:59 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:38:00.485368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:00.485872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:00.493581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:00.494389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:00.495227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:00.495669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:00.540534 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f555500-a241-48ee-b376-c5b99ab46e00 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.058747 Jul 18 13:38:00.541385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2948/5673] 10.222.0.88 () {58 vars in 1292 bytes} [Mon Jul 18 13:38:00 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047/os-server-password => generated 116 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:38:00.812724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:00.813972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:00.837153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:00.837919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:00.840018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:00.840866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:01.103268 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c72b562b-4906-4ccc-870f-98f622b66439 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1655 microversion: 2.1 time: 0.293256 Jul 18 13:38:01.106694 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2726/5674] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:00 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1655 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:01.249555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:01.250744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:01.260570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:01.261028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:01.261814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:01.262285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:01.641218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:01.650683 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4447c5e-ba4d-4bb9-bd77-5636d04fde29 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.404962 Jul 18 13:38:01.651440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2949/5675] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:01 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:02.026436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ec401d15-31df-4c76-99ff-2a4c30613e07 req-1ceb64be-8728-4521-915e-cb7ac03dd93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5354f87e-0a78-4e45-899a-342bf9880940", "name": "network-vif-deleted", "tag": "49c07b84-dc89-4fb3-8f19-1f2897197d9f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:02.039710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ec401d15-31df-4c76-99ff-2a4c30613e07 req-1ceb64be-8728-4521-915e-cb7ac03dd93f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:02.040372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ec401d15-31df-4c76-99ff-2a4c30613e07 req-1ceb64be-8728-4521-915e-cb7ac03dd93f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:02.064634 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ec401d15-31df-4c76-99ff-2a4c30613e07 req-1ceb64be-8728-4521-915e-cb7ac03dd93f service nova] Creating event network-vif-deleted:49c07b84-dc89-4fb3-8f19-1f2897197d9f for instance 5354f87e-0a78-4e45-899a-342bf9880940 on n-h2-850003-3 Jul 18 13:38:02.074733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ec401d15-31df-4c76-99ff-2a4c30613e07 req-1ceb64be-8728-4521-915e-cb7ac03dd93f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052686 Jul 18 13:38:02.076213 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2727/5676] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:38:02.123342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:02.124023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:02.134361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:02.135248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:02.136274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:02.136731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:02.323069 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a81b6579-a828-47a6-b066-2b181691a2e1 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 200 len: 1449 microversion: 2.1 time: 0.204940 Jul 18 13:38:02.323752 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2950/5677] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:02 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 1449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:02.670725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:02.671459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:02.678563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:02.679184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:02.680130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:02.680862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:02.859947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:02.873029 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c6f3c5b-1cfa-4f05-abd9-367e610fa62d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1678 microversion: 2.1 time: 0.207296 Jul 18 13:38:02.874706 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2728/5678] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:02 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:03.346480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:03.347820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] [instance: 5354f87e-0a78-4e45-899a-342bf9880940] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:03.352427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:03.357765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:03.358955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:03.360349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:03.360902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:03.379109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] HTTP exception thrown: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Request method failure captured: Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 HTTP/1.1 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WIP0wfQq0vV368xgvmCyL1XEXQ148eULDBl3HxwsMOkJ9tqnpv_d_BPVa9qEHxKLcx_a4K2CkiUHlbQCKjDT9SUXxJMzDjhUPZLZFUaYTTjewn5XfI-qqFDC0H1poFiLGsm95h1dENTTwIC2jEOEklS4slLwJTO9tveHqpOevucuXE Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: b6d7bc4346d8405c8602bd2b09e369a0 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestServerMultinode-591473170 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b6d7bc4346d8405c8602bd2b09e369a0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b6d7bc4346d8405c8602bd2b09e369a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestServerMultinode-591473170 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: b6d7bc4346d8405c8602bd2b09e369a0 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestServerMultinode-591473170 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestServerMultinode-591473170-project-admin Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 76c40c4fe9be459e83f383b0babbacf5 Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestServerMultinode-591473170-project-admin Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '5354f87e-0a78-4e45-899a-342bf9880940'} Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:38:03.380746 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] Returning 404 to user: Instance 5354f87e-0a78-4e45-899a-342bf9880940 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:38:03.386351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dd5ad5d7-81e9-4d24-9cf0-86cea82b2719 tempest-TestServerMultinode-591473170 tempest-TestServerMultinode-591473170-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940" status: 404 len: 111 microversion: 2.1 time: 0.041633 Jul 18 13:38:03.388405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2951/5679] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:03 2022] GET /compute/v2.1/servers/5354f87e-0a78-4e45-899a-342bf9880940 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:38:03.892150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:03.893599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:03.898485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:03.908839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:03.911359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:03.914863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:03.919034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:04.147606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:04.164143 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dac36a8d-0f02-4814-94df-c21572fe6e96 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1655 microversion: 2.1 time: 0.275501 Jul 18 13:38:04.169295 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2729/5680] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:03 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1655 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:04.200452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6034af99-f68b-4ed9-a1ba-05a93ee907b5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:04.214102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6034af99-f68b-4ed9-a1ba-05a93ee907b5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:04.214724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6034af99-f68b-4ed9-a1ba-05a93ee907b5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:04.249457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6034af99-f68b-4ed9-a1ba-05a93ee907b5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Going to try to start instance {{(pid=131366) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 13:38:04.321686 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6034af99-f68b-4ed9-a1ba-05a93ee907b5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action" status: 202 len: 0 microversion: 2.1 time: 0.121763 Jul 18 13:38:04.328007 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2952/5681] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:38:04 2022] POST /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:38:04.338438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:04.339871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:04.352989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:04.354142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:04.357207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:04.359235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:04.813338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:04.831573 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-37334cc6-10d7-4821-8d73-b22d56f0047c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1664 microversion: 2.1 time: 0.501501 Jul 18 13:38:04.834646 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2730/5682] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:04 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1664 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:05.865344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:05.866790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:05.883500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:05.883973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:05.884791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:05.885245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:06.145374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:06.154920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07b13bb7-de72-479d-b121-f165ba4d7225 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1664 microversion: 2.1 time: 0.294542 Jul 18 13:38:06.156141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2953/5683] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:05 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1664 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:07.179753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:07.180417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:07.213403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:07.214358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:07.215353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:07.219594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:07.496661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:07.510848 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93fd30ff-26fa-4a87-a28f-3316ec994fe5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1668 microversion: 2.1 time: 0.338684 Jul 18 13:38:07.516860 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2731/5684] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:07 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:39.510470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-970005155", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:39.518395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=5 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:39.519066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:39.568110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:38:39.769457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:38:39.769882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:38:39.770430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:38:39.771005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:38:39.772068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:38:39.781333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:39.781793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:39.782634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:39.783080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:39.801516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Getting quotas for project 1c9cbe461d2b45149b79a092af3cda9c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:38:39.808655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Getting quotas for user 05cb763035eb471c9d7b93d11ddab41c and project 1c9cbe461d2b45149b79a092af3cda9c. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:38:39.822211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:38:39.824419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:38:39.870983 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20ffc32b-8696-4d58-b4d7-90ca73201dc4 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.365763 Jul 18 13:38:39.871654 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2954/5685] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:38:39.882258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26fdc8dd-75e4-4244-a759-306deb390116 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:39.882893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26fdc8dd-75e4-4244-a759-306deb390116 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:39.885374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=5 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:39.886045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:39.948357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26fdc8dd-75e4-4244-a759-306deb390116 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:39.955626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26fdc8dd-75e4-4244-a759-306deb390116 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1213 microversion: 2.1 time: 0.077801 Jul 18 13:38:39.956226 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2732/5686] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:39 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:40.976360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:40.977160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:40.992237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:40.992870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:40.993902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:40.994443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:41.110516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:41.119284 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4a5b1e5-8b88-4887-bbe3-e21f5cf0bfa8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1273 microversion: 2.1 time: 0.149982 Jul 18 13:38:41.120157 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2955/5687] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:40 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:42.138245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:42.140619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:42.149875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:42.150432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:42.151489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:42.152365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:42.312337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:42.322400 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49655ea1-c515-4f50-935d-935d0744324c tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.188447 Jul 18 13:38:42.323912 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2733/5688] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:42 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:42.856930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-54b2fa5f-2d35-40d3-9efb-8b2f2374f2ad req-f1837a08-a5c0-425e-8474-823e5adde1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69859fda-a5a5-423c-b795-74b22dcd438f", "tag": "da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:42.885877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54b2fa5f-2d35-40d3-9efb-8b2f2374f2ad req-f1837a08-a5c0-425e-8474-823e5adde1b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:42.887041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-54b2fa5f-2d35-40d3-9efb-8b2f2374f2ad req-f1837a08-a5c0-425e-8474-823e5adde1b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:42.906961 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-54b2fa5f-2d35-40d3-9efb-8b2f2374f2ad req-f1837a08-a5c0-425e-8474-823e5adde1b3 service nova] Creating event network-changed:da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d for instance 69859fda-a5a5-423c-b795-74b22dcd438f on n-h2-850003-3 Jul 18 13:38:42.915061 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-54b2fa5f-2d35-40d3-9efb-8b2f2374f2ad req-f1837a08-a5c0-425e-8474-823e5adde1b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065715 Jul 18 13:38:42.916414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2956/5689] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:38:43.348472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:43.349947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:43.358602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:43.359153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:43.360186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:43.360766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:43.533243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:43.542842 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b26e825f-d492-4013-9555-994558f27994 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.198187 Jul 18 13:38:43.543450 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2734/5690] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:43 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:44.567422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:44.568380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:44.576051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:44.576595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:44.577447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:44.577950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:44.809163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:44.820969 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8191fddf-ec82-424c-bc39-1e46b50f8a68 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.257683 Jul 18 13:38:44.822651 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2957/5691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:44 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:45.839491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:45.840040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:45.847006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:45.847463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:45.848247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:45.848690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:45.984346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:45.992243 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60c88c64-bd36-44ec-be93-cae60572b308 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.157138 Jul 18 13:38:45.992897 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2735/5692] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:45 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:47.009238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:47.010389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:47.017379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:47.017830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:47.018642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:47.019085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:47.184644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:47.196167 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fea4e7a2-9006-4c29-b918-bf07600213ed tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.190953 Jul 18 13:38:47.206445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2958/5693] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:47 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:48.215565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:48.216090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:48.227145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:48.228007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:48.231761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:48.232557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:48.435388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:48.443530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-859603da-5c4e-4a9e-aa2c-558594c30746 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.232289 Jul 18 13:38:48.444274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2736/5694] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:48 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:49.420437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-40a2239a-57d8-46e6-a85f-5067b380b58e req-48c41515-b03b-4c47-897f-8feab9e33dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69859fda-a5a5-423c-b795-74b22dcd438f", "name": "network-vif-plugged", "status": "completed", "tag": "da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:49.445420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40a2239a-57d8-46e6-a85f-5067b380b58e req-48c41515-b03b-4c47-897f-8feab9e33dc7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:49.448045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-40a2239a-57d8-46e6-a85f-5067b380b58e req-48c41515-b03b-4c47-897f-8feab9e33dc7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:49.462281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:49.464073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:49.464187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-40a2239a-57d8-46e6-a85f-5067b380b58e req-48c41515-b03b-4c47-897f-8feab9e33dc7 service nova] Creating event network-vif-plugged:da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d for instance 69859fda-a5a5-423c-b795-74b22dcd438f on n-h2-850003-3 Jul 18 13:38:49.471573 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-40a2239a-57d8-46e6-a85f-5067b380b58e req-48c41515-b03b-4c47-897f-8feab9e33dc7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055394 Jul 18 13:38:49.473313 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2959/5695] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:38:49.476224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:49.477154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:49.478952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:49.480503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:49.812662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:49.823008 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0892e71f-452b-4cd5-aa47-6fc309f72b49 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.365953 Jul 18 13:38:49.824126 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2737/5696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:49 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:38:50.842545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:50.843072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:50.844800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:50.845474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:50.854417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:50.854876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:50.855683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:50.856132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:51.033383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:51.049742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-38c11d7b-9666-41ec-b2da-29e30ec35334 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1313 microversion: 2.1 time: 0.212532 Jul 18 13:38:51.050715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2960/5697] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:50 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:52.073149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:52.074253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:52.082276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:38:52.086928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:52.087674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:52.089053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:52.090035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:52.273910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:52.289397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-313bbf9b-5327-4fa4-bddb-779d2583763b tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1463 microversion: 2.1 time: 0.224700 Jul 18 13:38:52.290354 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2738/5698] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:52 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:38:52.320917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d11f274-be3d-45a6-9f2d-c03297caac2b", "device": "/dev/sdb"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:38:52.323234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:52.336138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:52.336801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:52.338187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:52.338903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:52.721985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f564e57-1e38-458b-9f02-c640dc8870b7 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "POST /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408741 Jul 18 13:38:52.722801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2961/5699] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:38:52 2022] POST /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:38:56.233403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:56.234927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:56.248309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.249539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.251222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.252272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.292996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fdd07ec5-8e8e-4925-9f10-f2f780ad1369 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066366 Jul 18 13:38:56.293992 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2739/5700] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:38:56 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:38:56.382752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:56.384966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:56.398604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.399861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.402275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.406277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.444563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:38:56.575398 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-723c6fd6-edad-4e47-a6c2-f0727dcb0a61 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 204 len: 0 microversion: 2.1 time: 0.202505 Jul 18 13:38:56.581761 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2962/5701] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:38:56 2022] DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:38:56.590729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:56.592917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:56.604421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.605716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.607296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:56.608177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:56.864594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:56.876013 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-409d8aa1-423c-43a6-a018-d5ec339152e3 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1674 microversion: 2.1 time: 0.292640 Jul 18 13:38:56.877131 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2740/5702] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:56 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:38:57.903458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:57.907057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:57.916294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:57.916736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:57.917706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:57.918340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:58.152746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:58.171936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-85cc6970-3ec5-4f0d-8658-b4cc3947cbe6 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1674 microversion: 2.1 time: 0.274517 Jul 18 13:38:58.172540 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2963/5703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:57 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1674 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:38:59.204638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:38:59.207061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:38:59.224147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:59.225767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:59.227752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:38:59.228769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:38:59.855438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:38:59.872170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ef7ee6bf-5677-4c5e-9bdf-2aae7dda56ad tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1674 microversion: 2.1 time: 0.684650 Jul 18 13:38:59.873460 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2741/5704] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:38:59 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1674 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:39:00.492062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-63dfa618-7606-43b4-ac0b-20ca175ca0fc req-d146f2ba-0fee-4f6a-b649-3b125ad2035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed8e6-7f13-44b2-a4a0-a79fa154be29", "name": "network-vif-deleted", "tag": "164ce24b-97e6-41b1-a35e-d5e5ada01f00"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:00.510932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-63dfa618-7606-43b4-ac0b-20ca175ca0fc req-d146f2ba-0fee-4f6a-b649-3b125ad2035a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:00.511968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-63dfa618-7606-43b4-ac0b-20ca175ca0fc req-d146f2ba-0fee-4f6a-b649-3b125ad2035a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:00.535668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-63dfa618-7606-43b4-ac0b-20ca175ca0fc req-d146f2ba-0fee-4f6a-b649-3b125ad2035a service nova] Creating event network-vif-deleted:164ce24b-97e6-41b1-a35e-d5e5ada01f00 for instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 on n-h1-850003-3 Jul 18 13:39:00.543805 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-63dfa618-7606-43b4-ac0b-20ca175ca0fc req-d146f2ba-0fee-4f6a-b649-3b125ad2035a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060474 Jul 18 13:39:00.548200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2964/5705] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:00.901094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:00.901737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:00.910581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:00.911033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:00.912504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:00.913288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:01.000084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:01.000804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:01.001818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lazy-loading 'fault' on Instance uuid a52ed8e6-7f13-44b2-a4a0-a79fa154be29 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:39:01.078045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:01.088457 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-39a95b43-62c2-45d2-96fd-5d9b8604f7cf tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 200 len: 1328 microversion: 2.1 time: 0.193850 Jul 18 13:39:01.089555 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2742/5706] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:00 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 1328 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:02.115296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:02.116534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:02.130942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:02.132524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:02.134291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:02.135331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:02.170323 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 HTTP/1.1 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a52ed8e6-7f13-44b2-a4a0-a79fa154be29'} Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:39:02.178780 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec787912-a980-43ff-942e-9807c94149e0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 404 len: 111 microversion: 2.1 time: 0.074622 Jul 18 13:39:02.186308 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2965/5707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:02 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:39:02.201012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b41958d3-340c-4e0e-946a-e950309c4722 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '.version_select at 0x7f96e9aaeb80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:02.236951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b41958d3-340c-4e0e-946a-e950309c4722 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866409333" status: 202 len: 0 microversion: 2.1 time: 0.045262 Jul 18 13:39:02.240432 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2743/5708] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866409333 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:39:03.455134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfcf385c-bc2f-4d73-897b-306295399050 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: .version_select at 0x7f96e4146b80>, body: {"keypair": {"name": "tempest-keypair-2113801700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqychZ3p62xYUgRhKFH1Lv/JAjIbSjmtrpca+WQg6aBO25rYmtwbwrZsh9z0G/vNu/Crx6yS1zGi5YATKroUevw13Yr+isQs2QBK/BW/SQCBtd3LjizyW4k+pe5Bc4HEA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:03.487388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-bfcf385c-bc2f-4d73-897b-306295399050 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for project 1aec7414484a4d739a91422786ff8113. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:39:03.501868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-bfcf385c-bc2f-4d73-897b-306295399050 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for user 8aa1637455a04263aa9a39ed7399b645 and project 1aec7414484a4d739a91422786ff8113. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:39:03.550266 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bfcf385c-bc2f-4d73-897b-306295399050 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102654 Jul 18 13:39:03.551074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2966/5709] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:39:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:05.800854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1337335356", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678e68d-697e-4048-a907-885a35159145"}], "security_groups": [{"name": "tempest-securitygroup--1651007700"}], "key_name": "tempest-keypair-2113801700", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:05.986559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] validate_networks() for [('7678e68d-697e-4048-a907-885a35159145', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:39:07.001064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:39:07.001923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:39:07.002101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:39:07.002484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:39:07.002913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:39:07.016661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:07.017301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:07.018199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:07.018731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:07.041587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for project 1aec7414484a4d739a91422786ff8113. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:39:07.049677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Getting quotas for user 8aa1637455a04263aa9a39ed7399b645 and project 1aec7414484a4d739a91422786ff8113. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:39:07.073200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:39:07.076214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:39:07.135876 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [18f5e316-9f42-4828-9e54-08c164b05d33] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:39:07.680946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90fcd652-0d39-484e-b2fd-9f32dcda2b8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: .version_select at 0x7f96e9a7ee50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-779172775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMlkdsA8Mm4QBt2G/09xjHUlDw7vJdAZTx7MywQ04t+EcuiRIv2fPQq3jxzn54bHdHkL3SytgbWpVSmUe4TdHNDDXkKpe6IuJf9/enBHqiDU4F6UOVVMCpoLzTiLHlw9A=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:07.700913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-90fcd652-0d39-484e-b2fd-9f32dcda2b8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:39:07.708145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-90fcd652-0d39-484e-b2fd-9f32dcda2b8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:39:07.744603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90fcd652-0d39-484e-b2fd-9f32dcda2b8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.335368 Jul 18 13:39:07.748977 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2967/5710] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:39:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:08.144893 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [18f5e316-9f42-4828-9e54-08c164b05d33] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 50714. Jul 18 13:39:08.164425 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f623de2a-13b3-4437-b28c-4f6569e0a29e tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.370396 Jul 18 13:39:08.171098 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2744/5711] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:39:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:39:08.176913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-faf4aec4-18a9-4264-8f94-f111c686cb12 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:08.178424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-faf4aec4-18a9-4264-8f94-f111c686cb12 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:08.274870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-faf4aec4-18a9-4264-8f94-f111c686cb12 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:08.283477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-faf4aec4-18a9-4264-8f94-f111c686cb12 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1238 microversion: 2.1 time: 0.110664 Jul 18 13:39:08.298101 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2968/5712] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:08 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1238 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:09.309532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:09.310829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:09.320039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:09.320547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:09.321376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:09.321892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:09.428476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:09.440275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74bb4d58-641e-47c2-8e78-4459d0c8f606 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1290 microversion: 2.1 time: 0.141056 Jul 18 13:39:09.440968 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2745/5713] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:09 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:10.461685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:10.464102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:10.469694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:10.475622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:10.476323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:10.477542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:10.478223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:10.518358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:10.943844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:10.953112 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0280004f-ff8a-4740-8816-19540c8c92ea tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.496720 Jul 18 13:39:10.966599 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2969/5714] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:10 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:11.929680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3a3fb20c-0a4e-41d8-a7e4-4c769f809c81 req-6ba41226-3dd4-4aff-8dae-b697cdb56c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa48dde-23e3-4e43-b194-57d09cd3329f", "tag": "a04f0c2b-0ec7-41d2-9a0d-629c374ac709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:11.939481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:11.942069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3a3fb20c-0a4e-41d8-a7e4-4c769f809c81 req-6ba41226-3dd4-4aff-8dae-b697cdb56c7d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:11.943494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3a3fb20c-0a4e-41d8-a7e4-4c769f809c81 req-6ba41226-3dd4-4aff-8dae-b697cdb56c7d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:11.970713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:11.972221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:11.977656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=71 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:11.984594 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3a3fb20c-0a4e-41d8-a7e4-4c769f809c81 req-6ba41226-3dd4-4aff-8dae-b697cdb56c7d service nova] Creating event network-changed:a04f0c2b-0ec7-41d2-9a0d-629c374ac709 for instance 2aa48dde-23e3-4e43-b194-57d09cd3329f on n-h1-850003-3 Jul 18 13:39:11.989299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:11.990751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:11.997426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:11.997922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:12.011033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3a3fb20c-0a4e-41d8-a7e4-4c769f809c81 req-6ba41226-3dd4-4aff-8dae-b697cdb56c7d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085503 Jul 18 13:39:12.013226 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2746/5715] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:39:12.405304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:12.453518 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8d075dc-78a5-492d-9925-02bead9b7cb8 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.486455 Jul 18 13:39:12.455078 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2970/5716] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:11 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:39:13.473116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:13.475164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:13.486630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:13.487391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:13.488436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:13.489043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:13.723300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:13.740645 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec80b97a-1436-4e11-a126-866342e5482b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.271905 Jul 18 13:39:13.745343 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2747/5717] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:13 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:15.085360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:15.086997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:15.099242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:15.099905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:15.101284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:15.102778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:15.869437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:15.882054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6bbdd78-6fe1-47a4-bd26-9a4e505e8973 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 1.101974 Jul 18 13:39:15.883437 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2971/5718] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:14 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:16.951088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:16.953217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:16.961710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:16.963487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:16.964624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:16.965450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:17.040025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:17.060340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:17.281483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:17.362356 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f28cb013-8ac7-4ed3-97fb-629b69895c44 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.419651 Jul 18 13:39:17.372792 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2748/5719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:16 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:18.183783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1889330086", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "2dfaf0e5-49e4-409b-a15d-12c985b0320e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-779172775", "security_groups": [{"name": "tempest-secgroup-smoke-1032958319"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:18.294546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:18.356542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] validate_networks() for [('2dfaf0e5-49e4-409b-a15d-12c985b0320e', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:39:18.381737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:18.382396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:18.400780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:18.401410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:18.402530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:18.407250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:18.644394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:18.657259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d9a7787-879c-4b5a-9c7f-ca0c08a65173 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.280442 Jul 18 13:39:18.661597 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2749/5720] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:18 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:19.013854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:39:19.014315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:39:19.014799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:39:19.016054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:39:19.016483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:39:19.018457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-53e375f4-ca14-4a5e-974b-201052697cbb req-eac42abf-0203-40b3-8571-1b17fe2e363b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa48dde-23e3-4e43-b194-57d09cd3329f", "name": "network-vif-plugged", "status": "completed", "tag": "a04f0c2b-0ec7-41d2-9a0d-629c374ac709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:19.030037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:19.032769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:19.034189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:19.035990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-53e375f4-ca14-4a5e-974b-201052697cbb req-eac42abf-0203-40b3-8571-1b17fe2e363b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:19.036176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:19.036647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-53e375f4-ca14-4a5e-974b-201052697cbb req-eac42abf-0203-40b3-8571-1b17fe2e363b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:19.064901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-53e375f4-ca14-4a5e-974b-201052697cbb req-eac42abf-0203-40b3-8571-1b17fe2e363b service nova] Creating event network-vif-plugged:a04f0c2b-0ec7-41d2-9a0d-629c374ac709 for instance 2aa48dde-23e3-4e43-b194-57d09cd3329f on n-h1-850003-3 Jul 18 13:39:19.069997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:39:19.080195 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-53e375f4-ca14-4a5e-974b-201052697cbb req-eac42abf-0203-40b3-8571-1b17fe2e363b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065886 Jul 18 13:39:19.080400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:39:19.081141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2750/5721] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:39:19.098710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:39:19.102594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:39:19.233094 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3277720d-aa12-4dd1-94e0-3b5cc2db2be7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.052647 Jul 18 13:39:19.234793 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2972/5722] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:39:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:39:19.255342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-192ce6ae-b847-4668-b50e-f69ed0ac74f8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:19.256103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-192ce6ae-b847-4668-b50e-f69ed0ac74f8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:19.356825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-192ce6ae-b847-4668-b50e-f69ed0ac74f8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:19.368117 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-192ce6ae-b847-4668-b50e-f69ed0ac74f8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1266 microversion: 2.1 time: 0.125856 Jul 18 13:39:19.370402 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2751/5723] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:19 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:19.677828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:19.678761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:19.693919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:19.695413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:19.696420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:19.697842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:19.971989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:19.982937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2467470-9c16-4c48-a188-098dfc714e77 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1364 microversion: 2.1 time: 0.309164 Jul 18 13:39:19.983540 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2973/5724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:19 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:20.388963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:20.390595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:20.400763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:20.401459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:20.402551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:20.403147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:20.484883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:20.500067 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b75c815f-6f3d-4bed-b1a7-ce5c4e9d09b4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1262 microversion: 2.1 time: 0.117463 Jul 18 13:39:20.504546 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2752/5725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:20 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1262 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:21.008675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:21.009490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:21.017401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.017860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.018988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.019434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.194040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:21.204227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-35131ec8-6ff4-4a1f-a82d-6d8a6b1b20cd tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1550 microversion: 2.1 time: 0.200057 Jul 18 13:39:21.205954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2974/5726] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:21 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1550 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:21.229644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:21.230180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:21.242848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.243785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.244993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.245824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.434308 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e561967-c80a-4262-9b6c-ac787e7e7177 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215402 Jul 18 13:39:21.436459 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2753/5727] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:39:21 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:21.524838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:21.525604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:21.534488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.535444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.537380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:21.537957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:21.643074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:21.661346 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9252f84-6535-4f70-ba2c-9645bf04db05 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1324 microversion: 2.1 time: 0.141181 Jul 18 13:39:21.663416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2975/5728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:21 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1324 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:22.683920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:22.685519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:22.695026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:22.696059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:22.697503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:22.698255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:22.951941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d4dccd5a-d98a-43c0-9f92-042a2045e32d req-5761443c-6012-48ea-b33e-726e3a6c7a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa48dde-23e3-4e43-b194-57d09cd3329f", "tag": "a04f0c2b-0ec7-41d2-9a0d-629c374ac709"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:22.962736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d4dccd5a-d98a-43c0-9f92-042a2045e32d req-5761443c-6012-48ea-b33e-726e3a6c7a5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:22.970411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d4dccd5a-d98a-43c0-9f92-042a2045e32d req-5761443c-6012-48ea-b33e-726e3a6c7a5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:23.018669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d4dccd5a-d98a-43c0-9f92-042a2045e32d req-5761443c-6012-48ea-b33e-726e3a6c7a5e service nova] Creating event network-changed:a04f0c2b-0ec7-41d2-9a0d-629c374ac709 for instance 2aa48dde-23e3-4e43-b194-57d09cd3329f on n-h1-850003-3 Jul 18 13:39:23.032812 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d4dccd5a-d98a-43c0-9f92-042a2045e32d req-5761443c-6012-48ea-b33e-726e3a6c7a5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200408 Jul 18 13:39:23.040529 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2976/5729] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:23.108698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:23.119164 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8819bd6-d15c-481f-a680-302e1bb6d5c0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.442384 Jul 18 13:39:23.122027 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2754/5730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:22 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:23.301622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ee970a0d-031e-41d3-acf0-05cb1fd58612 req-b611d8fd-a891-49b0-98d2-76c98fa1f607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:23.320339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ee970a0d-031e-41d3-acf0-05cb1fd58612 req-b611d8fd-a891-49b0-98d2-76c98fa1f607 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:23.322283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ee970a0d-031e-41d3-acf0-05cb1fd58612 req-b611d8fd-a891-49b0-98d2-76c98fa1f607 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:23.347974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ee970a0d-031e-41d3-acf0-05cb1fd58612 req-b611d8fd-a891-49b0-98d2-76c98fa1f607 service nova] Creating event network-changed:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h1-850003-3 Jul 18 13:39:23.359799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ee970a0d-031e-41d3-acf0-05cb1fd58612 req-b611d8fd-a891-49b0-98d2-76c98fa1f607 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062860 Jul 18 13:39:23.360956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2977/5731] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:39:24.145298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:24.146433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:24.154427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:24.154985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:24.155780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:24.156228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:24.344156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:24.359165 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3285c13a-e2f9-4676-8fc0-4133cc1a1ab0 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.217045 Jul 18 13:39:24.360432 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2755/5732] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:24 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:25.382289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:25.383164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:25.389745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:25.390859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:25.391661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:25.392114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:25.541178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:25.548860 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-771b4376-2786-4f03-8d7c-ace3d1d334c8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.172809 Jul 18 13:39:25.549620 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2978/5733] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:25 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:26.572916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:26.573536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:26.580888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:26.581367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:26.582218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:26.582741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:26.725595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:26.734710 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9aacca7b-ac36-44de-a9ce-3a60fbe0f3a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.165518 Jul 18 13:39:26.735716 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2756/5734] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:26 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:27.753741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:27.754925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:27.761254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:27.761727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:27.762518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:27.762952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:27.914131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:27.922394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3b6d2d82-efb6-4ae5-b03d-f7956fc218a9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.173778 Jul 18 13:39:27.923179 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2979/5735] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:27 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:28.888747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-109be599-db18-40a6-a712-12dee3ef0fad req-a1e394b8-981e-4d88-bc80-792550a349e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "name": "network-vif-plugged", "status": "completed", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:28.899301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-109be599-db18-40a6-a712-12dee3ef0fad req-a1e394b8-981e-4d88-bc80-792550a349e6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:28.900411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-109be599-db18-40a6-a712-12dee3ef0fad req-a1e394b8-981e-4d88-bc80-792550a349e6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:28.913479 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-109be599-db18-40a6-a712-12dee3ef0fad req-a1e394b8-981e-4d88-bc80-792550a349e6 service nova] Creating event network-vif-plugged:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h1-850003-3 Jul 18 13:39:28.918838 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-109be599-db18-40a6-a712-12dee3ef0fad req-a1e394b8-981e-4d88-bc80-792550a349e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033775 Jul 18 13:39:28.919524 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2757/5736] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:28.939400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:28.940166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:28.947089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:28.947541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:28.948315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:28.948748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:29.055542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:29.090660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:29.136579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:29.144485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b82318a-f5e9-4b20-9532-1d4884eacfc4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.208845 Jul 18 13:39:29.145075 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2980/5737] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:28 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:30.158707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:39:30.164570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:30.165321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:30.172767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:30.173134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:30.173910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:30.174384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:30.329579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:30.337665 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e475fb7-96a5-4b32-b01c-01bf837e51da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1392 microversion: 2.1 time: 0.180310 Jul 18 13:39:30.338279 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2758/5738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:30 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:39:31.355300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:31.356101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:31.363834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:31.363834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:31.365264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:31.365708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:31.515762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:31.523017 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-429ecdf1-86c0-414c-b304-11106dffe3b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1565 microversion: 2.1 time: 0.171590 Jul 18 13:39:31.523971 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2981/5739] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:31 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:39:31.540705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:31.541245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:31.548515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:31.548957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:31.549762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:31.550362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:31.700228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:31.709191 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aef7d3bb-24e8-4e08-84a5-e42e65b4506b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1565 microversion: 2.1 time: 0.173538 Jul 18 13:39:31.709955 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2759/5740] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:31 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:39:33.515324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-59394c37-b1a4-43f2-bca1-665cb11fa03f req-86b9e63a-4da6-451f-aabb-ed65bb31caaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:39:33.516748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:39:33.517779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:39:33.526304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:33.527114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:33.528212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:33.528742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:33.533192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-59394c37-b1a4-43f2-bca1-665cb11fa03f req-86b9e63a-4da6-451f-aabb-ed65bb31caaf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:39:33.535890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-59394c37-b1a4-43f2-bca1-665cb11fa03f req-86b9e63a-4da6-451f-aabb-ed65bb31caaf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:39:33.553234 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-59394c37-b1a4-43f2-bca1-665cb11fa03f req-86b9e63a-4da6-451f-aabb-ed65bb31caaf service nova] Creating event network-changed:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h1-850003-3 Jul 18 13:39:33.559100 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-59394c37-b1a4-43f2-bca1-665cb11fa03f req-86b9e63a-4da6-451f-aabb-ed65bb31caaf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047575 Jul 18 13:39:33.566335 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2760/5741] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:39:33.704217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:39:33.720478 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d17de5a-b5f1-4fd0-9202-fd5a0a4322c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1565 microversion: 2.1 time: 0.213747 Jul 18 13:39:33.722687 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2982/5742] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:39:33 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:05.331735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=31 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:05.332863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=65 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:05.337635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:05.338265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:05.345785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:05.346265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:05.347077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:05.347515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:05.434719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lazy-loading 'services' on Instance uuid 69859fda-a5a5-423c-b795-74b22dcd438f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:40:05.505402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9cd87d6f-39b1-4373-80b0-e316a2e2b753 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "DELETE /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f/os-volume_attachments/6d11f274-be3d-45a6-9f2d-c03297caac2b" status: 202 len: 0 microversion: 2.1 time: 0.176056 Jul 18 13:40:05.506031 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2761/5743] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:40:05 2022] DELETE /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f/os-volume_attachments/6d11f274-be3d-45a6-9f2d-c03297caac2b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:40:08.116412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:08.117353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:08.119783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:08.120648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=71 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:08.127347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:08.127986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:08.128806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:08.129254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:08.194020 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e03db3ba-dd71-4285-955e-da8e88282808 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action" status: 200 len: 24519 microversion: 2.1 time: 0.081874 Jul 18 13:40:08.200923 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2983/5744] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:40:08 2022] POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action => generated 24519 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:40:10.852812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:10.853389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:10.859646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:10.860087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:10.860844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:10.861275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:10.887379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:40:10.968371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e0a12c9-3ada-48c4-8d5e-eede5e8849ac tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "DELETE /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 204 len: 0 microversion: 2.1 time: 0.120756 Jul 18 13:40:10.968978 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2762/5745] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:40:10 2022] DELETE /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:40:10.977883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:10.978633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:10.986733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:10.987188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:10.987979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:10.988418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:11.138671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:11.147936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65156fe2-19c7-41ee-917b-0ea2c6eb84a8 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1469 microversion: 2.1 time: 0.174363 Jul 18 13:40:11.148535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2984/5746] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:10 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:12.167393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:12.168109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:12.175348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:12.175804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:12.176604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:12.177040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:12.334677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:12.344002 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e4274a4b-8da2-4288-8afc-5bf49f39197a tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1469 microversion: 2.1 time: 0.181693 Jul 18 13:40:12.344603 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2763/5747] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:12 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:13.190555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-bd62076a-8baa-401d-8829-a780c78ae948 req-4978c7b4-001b-451c-8675-954d654aaf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69859fda-a5a5-423c-b795-74b22dcd438f", "name": "network-vif-deleted", "tag": "da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:13.201979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bd62076a-8baa-401d-8829-a780c78ae948 req-4978c7b4-001b-451c-8675-954d654aaf95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:13.202517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bd62076a-8baa-401d-8829-a780c78ae948 req-4978c7b4-001b-451c-8675-954d654aaf95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:13.221543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-bd62076a-8baa-401d-8829-a780c78ae948 req-4978c7b4-001b-451c-8675-954d654aaf95 service nova] Creating event network-vif-deleted:da8d4d9a-d1a1-4e1b-bf06-a4f32cba7f8d for instance 69859fda-a5a5-423c-b795-74b22dcd438f on n-h2-850003-3 Jul 18 13:40:13.229016 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-bd62076a-8baa-401d-8829-a780c78ae948 req-4978c7b4-001b-451c-8675-954d654aaf95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044009 Jul 18 13:40:13.229652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2985/5748] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:40:13.369025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:13.369614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:13.377257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:13.377622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:13.378443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:13.378878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:13.414854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:13.415300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:13.415752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lazy-loading 'fault' on Instance uuid 69859fda-a5a5-423c-b795-74b22dcd438f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:40:13.464487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cb763035eb471c9d7b93d11ddab41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9cbe461d2b45149b79a092af3cda9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:13.478095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da43d975-bf23-4587-83e4-81e076bd72f2 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 200 len: 1303 microversion: 2.1 time: 0.114214 Jul 18 13:40:13.479197 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2764/5749] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:13 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:14.500092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:14.500677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] [instance: 69859fda-a5a5-423c-b795-74b22dcd438f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:14.507596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:14.508044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:14.508811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:14.509244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:14.523154 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] HTTP exception thrown: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Request method failure captured: Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f HTTP/1.1 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WJdJfZaBWlGLOc7b9VmMBa45MciVIJVvB4qfGKRtBrypjXXKZGsi-0vx4Ml9Yqln_0VGCEBBV71zwRkAJKNeUoebPOViwaxuYw8Wh6nIrlf2fVfcBeMjnhWd8uZ3HrnvJ3YFBZeyOPdOV45Ppi_gBpIUK4uKWAmL0pC4l4EEfE4Rmk Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1c9cbe461d2b45149b79a092af3cda9c Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesBackupsTest-1075678463 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1c9cbe461d2b45149b79a092af3cda9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c9cbe461d2b45149b79a092af3cda9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1c9cbe461d2b45149b79a092af3cda9c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c9cbe461d2b45149b79a092af3cda9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesBackupsTest-1075678463 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1c9cbe461d2b45149b79a092af3cda9c Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesBackupsTest-1075678463 Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesBackupsTest-1075678463-project Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 05cb763035eb471c9d7b93d11ddab41c Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesBackupsTest-1075678463-project Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '69859fda-a5a5-423c-b795-74b22dcd438f'} Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:40:14.524814 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] Returning 404 to user: Instance 69859fda-a5a5-423c-b795-74b22dcd438f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-630e3cf6-002e-4896-a90b-98ce635dec91 tempest-VolumesBackupsTest-1075678463 tempest-VolumesBackupsTest-1075678463-project] 10.222.0.88 "GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f" status: 404 len: 111 microversion: 2.1 time: 0.031337 Jul 18 13:40:14.529444 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2986/5750] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:14 2022] GET /compute/v2.1/servers/69859fda-a5a5-423c-b795-74b22dcd438f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:40:38.329084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:38.329688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:38.332147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:38.332806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:38.339594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:38.340110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:38.340893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:38.341333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:38.367568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1eb47058-4161-4aa8-a2be-842112dd86da tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/ips" status: 200 len: 146 microversion: 2.1 time: 0.042253 Jul 18 13:40:38.368351 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2765/5751] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:40:38 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:40:39.719725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a07b9bc-0773-41f6-a161-2c081ea371d1"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:39.720841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:39.723705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:39.724500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:40:39.730786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:39.731249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:39.732037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:39.732474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:40.111586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-369f6042-a4b5-4c45-8c00-79c71c739524 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395945 Jul 18 13:40:40.114740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2987/5752] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:40:39 2022] POST /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:40:47.143561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:47.144294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:47.151740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.152339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.153158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.153601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.455735 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92e2bf5a-bfc2-4f31-942c-9326872ac350 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1835 microversion: 2.1 time: 0.316502 Jul 18 13:40:47.468918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2766/5753] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:47 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1835 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:47.476380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:47.477422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:47.483870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.484329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.485115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.486291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.627020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:47.636169 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-291bb2aa-1df3-4a9b-ab9e-8bbb56c4c554 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1684 microversion: 2.1 time: 0.166633 Jul 18 13:40:47.639938 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2988/5754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:47 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:47.732634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:47.733631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:47.739704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.740147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.740906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.741342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.804083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60f0e8b3-ab44-489c-a34f-8076d8c96ae8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action" status: 200 len: 32591 microversion: 2.1 time: 0.075503 Jul 18 13:40:47.810612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2767/5755] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:40:47 2022] POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action => generated 32591 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:40:47.986194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:47.986698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:47.993473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.993924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:47.994712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:47.995148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:48.035184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a0ba8c5e4adb48e78ce63c16943889bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaf997f8e724ab0a406a0d4a290db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:48.035796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] flavor_id is None. Assuming migration. {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 13:40:48.037003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:40:48.279232 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6182bc4-4847-4da3-b0f5-8a24fdbe0ba3 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action" status: 202 len: 0 microversion: 2.1 time: 0.296451 Jul 18 13:40:48.280395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2989/5756] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:40:47 2022] POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:40:48.290100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:48.290897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:48.298646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:48.299118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:48.299902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:48.300350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:48.497322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:48.507459 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec41ea8a-2998-4482-8fdd-87b5d33c4de1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1693 microversion: 2.1 time: 0.222708 Jul 18 13:40:48.508209 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2768/5757] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:48 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:40:49.526491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:49.526491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:49.532956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:49.533538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:49.534494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:49.534933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:49.684525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:49.711170 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bef59331-3a65-4e90-aacf-4b248b336415 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1693 microversion: 2.1 time: 0.189475 Jul 18 13:40:49.712591 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2990/5758] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:49 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:50.730675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:50.731965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:50.743020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.743733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:50.744704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.745563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:50.885520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:50.886540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:50.904007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.904623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:50.905797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.906481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:50.946607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:50.955396 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9589f7a-fb11-40e9-81df-9db5198c734d tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073851 Jul 18 13:40:50.955932 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c44ebbb-7741-495c-99cf-57a812a3fa71 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1693 microversion: 2.1 time: 0.230167 Jul 18 13:40:50.961465 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2991/5759] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:40:50 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:40:50.961624 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2769/5760] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:50 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1693 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:50.970926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:50.971838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:50.978508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.978959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:50.979726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:50.980161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:51.012362 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c099f8a-1821-4adb-a717-ada1706ddc3a tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1" status: 200 len: 194 microversion: 2.1 time: 0.045174 Jul 18 13:40:51.013154 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2992/5761] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 13:40:50 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:40:51.973054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:51.974444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:51.981601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:51.982301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:51.983162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:51.983812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:52.140317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:52.149633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec766a94-8a1d-4935-9658-03a5d4ea3863 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.180439 Jul 18 13:40:52.160685 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2770/5762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:51 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:52.358881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e7c2e8b-39a0-40d1-be73-491517a31fd1"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:40:52.359950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:52.367770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:52.368217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:52.368999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:52.369437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:52.645473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1bbfcca9-22df-4018-b609-46467505464c tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "POST /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290418 Jul 18 13:40:52.646729 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2993/5763] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:40:52 2022] POST /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:40:53.168189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:53.168862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:53.175869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:53.176322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:53.177114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:53.177552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:53.335765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:53.343881 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ccac35d-4c34-42fe-a9b2-dda0a3215204 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.179557 Jul 18 13:40:53.345032 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2771/5764] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:53 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:54.362575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:54.363440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:54.369866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:54.370350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:54.371121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:54.371552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:54.514784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:54.523666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ddec6e9d-f353-4ffa-82e3-e3d159c6627f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.166405 Jul 18 13:40:54.524331 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2994/5765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:54 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:55.541940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:55.542758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:55.549455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:55.549922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:55.550767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:55.551201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:55.688538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:55.697041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b3c5766-a2e0-4a6d-888b-dee3873bed1a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.159494 Jul 18 13:40:55.701089 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2772/5766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:55 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:56.714804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:56.715593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:56.723207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:56.723681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:56.724638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:56.725080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:56.880775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:56.889171 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13616ba7-55a3-4b98-a7f0-19748b854f06 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.178444 Jul 18 13:40:56.890209 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2995/5767] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:56 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:57.907236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:57.907954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:57.915936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:57.916387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:57.917162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:57.917598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:58.069942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:58.077937 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d94a0879-3309-416e-8bd7-2328dedfd150 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.174686 Jul 18 13:40:58.078900 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2773/5768] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:57 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:40:59.097182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:40:59.098540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:40:59.108520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:59.109073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:59.109990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:40:59.110448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:40:59.259445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:40:59.269092 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3184c2f4-3154-4509-ace1-39c51247b071 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.176095 Jul 18 13:40:59.278190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2996/5769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:40:59 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:00.287281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:00.287913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:00.295561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:00.295934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:00.297727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:00.297727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:00.435264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:00.443890 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9506c823-954c-4873-b54e-d705a12f1e8c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.161096 Jul 18 13:41:00.444613 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2774/5770] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:00 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:01.461592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:01.462231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:01.469861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:01.470347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:01.471131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:01.471573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:01.625392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:01.636345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d7c8ffb2-3aaa-4219-a5ea-6dbda285b9b7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.178797 Jul 18 13:41:01.637129 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2997/5771] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:01 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:02.654673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:02.655293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:02.662924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:02.663649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:02.664439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:02.664885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:02.801312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:02.809685 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a920dc03-a311-4206-bf7b-92c7d144bfd7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1698 microversion: 2.1 time: 0.158951 Jul 18 13:41:02.810358 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2775/5772] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:02 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:03.827101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:03.828023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:03.835748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:03.836378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:03.837380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:03.838029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.052175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:04.060680 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15868e35-2e7a-416c-af2b-b9d9173fb32e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1697 microversion: 2.1 time: 0.237547 Jul 18 13:41:04.072711 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2998/5773] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:03 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1697 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:04.082043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "name": "network-vif-unplugged", "status": "completed", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:04.091738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.092977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.108608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] Creating event network-vif-unplugged:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h2-850003-3 Jul 18 13:41:04.115842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:41:04.135895 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-eaaa6334-d3cb-43a6-823f-7e78d584af9c req-ddea32b5-bdd4-41f2-8fb5-213ebcc5b3a7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057481 Jul 18 13:41:04.136538 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2776/5774] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:41:04.453889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:04.454916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:04.462212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.462667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.463702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.464156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.468369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:04.499178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-099bb433-ab82-4913-9230-e1894fe12b92 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049104 Jul 18 13:41:04.499779 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 2999/5775] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:41:04 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:04.650306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:04.650894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:04.657892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.658778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.659748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.660386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.705671 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8356091a-4b0d-4b77-948f-971a0c1bf66b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1" status: 200 len: 194 microversion: 2.1 time: 0.061209 Jul 18 13:41:04.706592 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2777/5776] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 13:41:04 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:04.717915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:04.718557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:04.727877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.729205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.730960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:04.731821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:04.821658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lazy-loading 'services' on Instance uuid 2aa48dde-23e3-4e43-b194-57d09cd3329f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:41:04.912685 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b714dd80-7d68-490a-b828-dc62c9b505a5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1" status: 202 len: 0 microversion: 2.1 time: 0.199892 Jul 18 13:41:04.914533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3000/5777] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:41:04 2022] DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/8a07b9bc-0773-41f6-a161-2c081ea371d1 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:41:05.080272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:05.080890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:05.089385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:05.090730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:05.091757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:05.092423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:05.262065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:05.272098 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0afcbdbc-ecfa-4aae-9d67-6692509c49fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1697 microversion: 2.1 time: 0.196098 Jul 18 13:41:05.273271 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2778/5778] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:05 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:06.180410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:06.189787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:06.190472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:06.204563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] Creating event network-changed:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h2-850003-3 Jul 18 13:41:06.211789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:41:06.223667 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3f6f69f9-223a-458b-b08e-792ad8731568 req-5a311583-444f-4c05-8011-9239fc838ebe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048665 Jul 18 13:41:06.224464 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3001/5779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:06.300455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:06.302515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:06.309887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:06.310716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:06.311717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:06.312351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:06.616463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:06.629144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45ac553f-d41d-4115-a7b8-8963fcc4cc24 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1695 microversion: 2.1 time: 0.343982 Jul 18 13:41:06.632117 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2779/5780] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:06 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1695 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:07.651792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:07.652504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:07.659049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.659512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:07.660365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.660917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:07.811810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:07.825100 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d49db209-aece-4e88-aafb-69c11b0b687f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1692 microversion: 2.1 time: 0.179028 Jul 18 13:41:07.825100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3002/5781] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:07 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:07.841150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:07.841715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:07.849475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.850198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:07.851290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.851878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:07.936759 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee080943-c6bc-4da3-a771-93310bcd8fcb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action" status: 204 len: 0 microversion: 2.1 time: 0.098849 Jul 18 13:41:07.938133 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2780/5782] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:41:07 2022] POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:41:07.946939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:07.947615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:07.964053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.964747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:07.965870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:07.966575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:08.231211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:08.242402 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b82836e-cd60-4768-bee7-64e39cf88b2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1692 microversion: 2.1 time: 0.299673 Jul 18 13:41:08.243370 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3003/5783] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:07 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1692 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:09.263428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:09.264163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:09.266442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=33 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:09.272716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:09.273215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:09.274004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:09.275079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:09.277718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:09.448492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:09.458436 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-146c7b71-8267-4ca0-828f-f3002e31e63e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1692 microversion: 2.1 time: 0.200380 Jul 18 13:41:09.469479 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2781/5784] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:09 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:10.120618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3e8d0426-64da-4eda-9760-dc40e26cf463 req-6d4b0fe2-d066-4fcc-9160-142bc1fd1c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "name": "network-vif-plugged", "status": "completed", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:10.131770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=37 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:10.134623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3e8d0426-64da-4eda-9760-dc40e26cf463 req-6d4b0fe2-d066-4fcc-9160-142bc1fd1c18 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.135286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3e8d0426-64da-4eda-9760-dc40e26cf463 req-6d4b0fe2-d066-4fcc-9160-142bc1fd1c18 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.150046 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3e8d0426-64da-4eda-9760-dc40e26cf463 req-6d4b0fe2-d066-4fcc-9160-142bc1fd1c18 service nova] Creating event network-vif-plugged:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h2-850003-3 Jul 18 13:41:10.156302 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3e8d0426-64da-4eda-9760-dc40e26cf463 req-6d4b0fe2-d066-4fcc-9160-142bc1fd1c18 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133480 Jul 18 13:41:10.158051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3004/5785] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:10.436650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:10.437127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:10.445099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.445557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.446387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.446834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.476800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:10.477662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:10.477842 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5266d91b-1584-415d-8de5-d3d2f8ec2298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/0e7c2e8b-39a0-40d1-be73-491517a31fd1" status: 200 len: 194 microversion: 2.1 time: 0.045162 Jul 18 13:41:10.478719 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2782/5786] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 13:41:10 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/0e7c2e8b-39a0-40d1-be73-491517a31fd1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:10.485507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.486125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.487016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.487552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.488490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:10.489520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:10.496951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.497609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.498423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:10.498869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:10.588191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lazy-loading 'services' on Instance uuid 2aa48dde-23e3-4e43-b194-57d09cd3329f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:41:10.665339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:10.667973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd555ae8-1b6d-4eff-bdae-bdab8dad748b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/0e7c2e8b-39a0-40d1-be73-491517a31fd1" status: 202 len: 0 microversion: 2.1 time: 0.183288 Jul 18 13:41:10.668615 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2783/5787] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:41:10 2022] DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments/0e7c2e8b-39a0-40d1-be73-491517a31fd1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:41:10.675616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02e49a95-7e82-4131-9747-ce01fcbca0b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1684 microversion: 2.1 time: 0.202872 Jul 18 13:41:10.677600 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3005/5788] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:10 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:16.090907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:16.091971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:16.099875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.100337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.101121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.101689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.138938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0c10db3c-094d-4d07-9053-e7fb05a8f5f1 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053434 Jul 18 13:41:16.139845 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2784/5789] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:41:16 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:41:16.268144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:16.269875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:16.279338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.279875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.280713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.281230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.318620 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb98d67a-13be-467f-b8c8-aab70bb0230f tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058617 Jul 18 13:41:16.321025 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3006/5790] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:41:16 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:41:16.380345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:16.380848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:16.387023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.387472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.388234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.388669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.418994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:41:16.506046 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b837787e-937f-46e0-8000-824933b68a13 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 204 len: 0 microversion: 2.1 time: 0.129308 Jul 18 13:41:16.506963 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2785/5791] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:41:16 2022] DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:41:16.516587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:16.517223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:16.524038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.524494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.525276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:16.525718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:16.671550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:16.679459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b2160be-367e-4bd2-b8ab-751deca3e79b tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1675 microversion: 2.1 time: 0.167966 Jul 18 13:41:16.680123 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3007/5792] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:16 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:17.697614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:17.698398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:17.705342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:17.705794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:17.706604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:17.707041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:17.851929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:17.860059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7a2d9be5-8196-4b0f-ae88-382c23960e48 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1675 microversion: 2.1 time: 0.166618 Jul 18 13:41:17.860832 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2786/5793] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:17 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:18.878556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:18.879395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:18.887522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:18.888067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:18.888918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:18.889529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:19.033208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:19.045887 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-97ed14b0-63f2-4e1a-83b8-dfa5c27adcb9 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1675 microversion: 2.1 time: 0.169040 Jul 18 13:41:19.053629 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3008/5794] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:18 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:19.605033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-56e46a97-643d-4fe1-8c51-9778b12233d0 req-e9fff782-eda7-4214-aa01-141a94d28acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa48dde-23e3-4e43-b194-57d09cd3329f", "name": "network-vif-deleted", "tag": "a04f0c2b-0ec7-41d2-9a0d-629c374ac709"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:19.619877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-56e46a97-643d-4fe1-8c51-9778b12233d0 req-e9fff782-eda7-4214-aa01-141a94d28acb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:19.620620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-56e46a97-643d-4fe1-8c51-9778b12233d0 req-e9fff782-eda7-4214-aa01-141a94d28acb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:19.649051 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-56e46a97-643d-4fe1-8c51-9778b12233d0 req-e9fff782-eda7-4214-aa01-141a94d28acb service nova] Creating event network-vif-deleted:a04f0c2b-0ec7-41d2-9a0d-629c374ac709 for instance 2aa48dde-23e3-4e43-b194-57d09cd3329f on n-h1-850003-3 Jul 18 13:41:19.659578 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-56e46a97-643d-4fe1-8c51-9778b12233d0 req-e9fff782-eda7-4214-aa01-141a94d28acb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062151 Jul 18 13:41:19.660900 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2787/5795] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:20.061961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:20.064043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:20.074861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:20.075535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:20.076469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:20.077054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:20.137491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:20.137941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:20.138459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lazy-loading 'fault' on Instance uuid 2aa48dde-23e3-4e43-b194-57d09cd3329f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:41:20.212378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa1637455a04263aa9a39ed7399b645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aec7414484a4d739a91422786ff8113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:20.222621 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5b16ebb-d533-47e9-b52b-fb92f653c100 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 200 len: 1328 microversion: 2.1 time: 0.165095 Jul 18 13:41:20.224770 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3009/5796] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:20 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:21.242558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:21.243398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:21.250042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:21.250618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:21.251601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:21.252138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:21.267958 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f HTTP/1.1 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2aa48dde-23e3-4e43-b194-57d09cd3329f'} Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:21.269678 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de75a4d9-6e10-4968-a92f-7f4e5cee18c5 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 404 len: 111 microversion: 2.1 time: 0.034630 Jul 18 13:41:21.273430 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2788/5797] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:21 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:41:21.282513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8276c03c-91de-405f-b837-48b7d9f68861 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '.version_select at 0x7f96e4499040>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:21.307495 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8276c03c-91de-405f-b837-48b7d9f68861 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113801700" status: 202 len: 0 microversion: 2.1 time: 0.028762 Jul 18 13:41:21.308376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3010/5798] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113801700 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:41:28.517940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:28.523451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:28.536744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:28.537679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:28.539157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:28.541287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:28.556938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f HTTP/1.1 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2aa48dde-23e3-4e43-b194-57d09cd3329f'} Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:28.558935 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.562966 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.564709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:28.566167 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-138a5634-789b-4230-8cdb-59720a2130f7 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 404 len: 111 microversion: 2.1 time: 0.052776 Jul 18 13:41:28.567518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2789/5799] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:41:28 2022] DELETE /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:41:28.584641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:28.587259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: 2aa48dde-23e3-4e43-b194-57d09cd3329f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:28.596047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:28.596859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:28.597921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:28.599260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:28.615154 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f HTTP/1.1 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '2aa48dde-23e3-4e43-b194-57d09cd3329f'} Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:28.617429 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. Jul 18 13:41:28.621092 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:28.622966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance 2aa48dde-23e3-4e43-b194-57d09cd3329f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:28.624087 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5893ba7a-626a-4b43-83aa-280d20d32298 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f" status: 404 len: 111 microversion: 2.1 time: 0.050122 Jul 18 13:41:28.625228 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3011/5800] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:28 2022] GET /compute/v2.1/servers/2aa48dde-23e3-4e43-b194-57d09cd3329f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:41:31.918167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:31.918745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:31.929571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:31.930960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:31.932127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:31.932735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:31.953995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 HTTP/1.1 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a52ed8e6-7f13-44b2-a4a0-a79fa154be29'} Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:31.955692 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:31.963690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd00056b-05b8-4c76-9795-b1ce328f8093 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 404 len: 111 microversion: 2.1 time: 0.046286 Jul 18 13:41:31.964781 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2790/5801] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:41:31 2022] DELETE /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:41:31.973331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:31.974184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] [instance: a52ed8e6-7f13-44b2-a4a0-a79fa154be29] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:31.983001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:31.983455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:31.992704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:31.993164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:32.011653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] HTTP exception thrown: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Request method failure captured: Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 HTTP/1.1 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WFUczDMsgWrrVYFPDzkaUI9c-zN2XSXok8CCShrshK-1BXl-aZv8rPQ0xuCQUY2H_pmI31zIl0eS2pHmhXKUJ93l2hB98VpoqN_YU3HNfnx-L6AHj7hpbe4j4eHqlwUZn4XpKo5kluKjwKCKW55o5WyaSBr1wFkAHJh07wPdLmUFmQ Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1aec7414484a4d739a91422786ff8113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1aec7414484a4d739a91422786ff8113", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1aec7414484a4d739a91422786ff8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1aec7414484a4d739a91422786ff8113 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1220843942 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 8aa1637455a04263aa9a39ed7399b645 Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeTestJSON-1220843942-project Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a52ed8e6-7f13-44b2-a4a0-a79fa154be29'} Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:32.013327 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] Returning 404 to user: Instance a52ed8e6-7f13-44b2-a4a0-a79fa154be29 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-219c543f-6f89-43be-8395-3f07484084d0 tempest-AttachVolumeTestJSON-1220843942 tempest-AttachVolumeTestJSON-1220843942-project] 10.222.0.88 "GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29" status: 404 len: 111 microversion: 2.1 time: 0.048519 Jul 18 13:41:32.021626 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3012/5802] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:31 2022] GET /compute/v2.1/servers/a52ed8e6-7f13-44b2-a4a0-a79fa154be29 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:41:35.177564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:35.178616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:35.191699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:35.192331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:35.194929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:35.195535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:35.268135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63cad4a0-97f9-4a19-8055-f4fb0d37936d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action" status: 200 len: 24579 microversion: 2.1 time: 0.095090 Jul 18 13:41:35.270477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2791/5803] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:41:35 2022] POST /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec/action => generated 24579 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:41:41.488262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:41.489718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:41.504309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:41.507893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:41.508634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:41.511289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:41.511975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:41.533051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:41.794794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f77a4f3-c2c3-41b9-b63e-d99da158a61b tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1835 microversion: 2.1 time: 0.312698 Jul 18 13:41:41.796065 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3013/5804] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:41 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1835 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:43.098930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ca59c80-0de8-4812-b55d-3efa3fcbbae7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: .version_select at 0x7f96d73a5700>, body: {"keypair": {"name": "tempest-keypair-1769122304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuJo/Rgnucyz4/wKaNZTbTCn9eeBVAw0f7pDxvHL7JKgfZiZYJEF4EGz5vZlZvEvA1ikF6PY/YoLKWj8sYENTAd+LprRHQ96GtZeKRQ3a7OXl+6CWAvqBjJ0OIssBZ+Ww=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:43.114959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:43.136840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6ca59c80-0de8-4812-b55d-3efa3fcbbae7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:41:43.146298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6ca59c80-0de8-4812-b55d-3efa3fcbbae7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:41:43.179185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:43.179740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:43.186508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ca59c80-0de8-4812-b55d-3efa3fcbbae7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270898 Jul 18 13:41:43.187717 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2792/5805] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:41:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:43.194326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:43.194708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:43.196631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6e9191c4-4ad0-4194-91ba-b6c3c988cbc8 req-b4e13314-d1c7-43ac-b00b-21e2bc87da42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:43.199158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:43.199748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:43.208957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e9191c4-4ad0-4194-91ba-b6c3c988cbc8 req-b4e13314-d1c7-43ac-b00b-21e2bc87da42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:43.209400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e9191c4-4ad0-4194-91ba-b6c3c988cbc8 req-b4e13314-d1c7-43ac-b00b-21e2bc87da42 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:43.221655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:43.226309 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6e9191c4-4ad0-4194-91ba-b6c3c988cbc8 req-b4e13314-d1c7-43ac-b00b-21e2bc87da42 service nova] Creating event network-changed:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h2-850003-3 Jul 18 13:41:43.233953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6e9191c4-4ad0-4194-91ba-b6c3c988cbc8 req-b4e13314-d1c7-43ac-b00b-21e2bc87da42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043473 Jul 18 13:41:43.235885 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2793/5806] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:43.258351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:41:43.398164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f976898-4ec5-42c4-94d3-39ee61ccb1ae tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 204 len: 0 microversion: 2.1 time: 0.222922 Jul 18 13:41:43.401446 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3014/5807] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:41:43 2022] DELETE /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:41:43.414841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:43.415812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:43.423628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:43.424347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:43.425338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:43.426026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:43.721235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:43.737361 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0c2f7c04-27f9-4025-bd1a-f0fa8aab0aac tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1690 microversion: 2.1 time: 0.331086 Jul 18 13:41:43.751382 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2794/5808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:43 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1690 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:41:44.760584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:44.765859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:44.789320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:44.789782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:44.790640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:44.791086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:45.046315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:45.060544 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c71f7eab-ddd0-4eb2-9a54-f86a92609028 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1690 microversion: 2.1 time: 0.307569 Jul 18 13:41:45.063835 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3015/5809] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:44 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1690 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:45.881122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-957939360", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2112c8d0-f5a5-4e18-8577-541bfd3a1558"}], "security_groups": [{"name": "tempest-securitygroup--426323469"}], "key_name": "tempest-keypair-1769122304", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:46.081035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:46.081782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:46.091380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:46.092106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:46.094444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:46.095133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:46.124377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] validate_networks() for [('2112c8d0-f5a5-4e18-8577-541bfd3a1558', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:41:46.276651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:46.284846 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-538b4bcd-0b71-410e-8229-722a4f045648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 200 len: 1503 microversion: 2.1 time: 0.210568 Jul 18 13:41:46.288887 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3016/5810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:46 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:41:46.294797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2b02911c-ce1c-41c9-a5af-06e28ee771d3 req-d7f4f8e9-dd02-4c6a-bc57-eebf8817e78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31f0f58-4a62-45ec-bb03-88ca94aa4dec", "name": "network-vif-deleted", "tag": "2610fad7-c9e4-4705-92c5-7262a8c68caa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:46.323850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b02911c-ce1c-41c9-a5af-06e28ee771d3 req-d7f4f8e9-dd02-4c6a-bc57-eebf8817e78e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:46.324536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b02911c-ce1c-41c9-a5af-06e28ee771d3 req-d7f4f8e9-dd02-4c6a-bc57-eebf8817e78e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:46.353408 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2b02911c-ce1c-41c9-a5af-06e28ee771d3 req-d7f4f8e9-dd02-4c6a-bc57-eebf8817e78e service nova] Creating event network-vif-deleted:2610fad7-c9e4-4705-92c5-7262a8c68caa for instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec on n-h2-850003-3 Jul 18 13:41:46.365741 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2b02911c-ce1c-41c9-a5af-06e28ee771d3 req-d7f4f8e9-dd02-4c6a-bc57-eebf8817e78e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075481 Jul 18 13:41:46.367127 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3017/5811] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:41:47.091525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:41:47.091955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:41:47.092406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:41:47.092811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:41:47.093269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:41:47.103407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:47.103806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:47.104597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:47.105029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:47.123926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:41:47.138197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:41:47.164578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:41:47.166951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:41:47.219246 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8187c949-bcec-40d0-acec-eaa41232d77b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.342653 Jul 18 13:41:47.222230 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2795/5812] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:41:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:41:47.233423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1748493-1099-4463-ae45-b95e0893bbb1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:47.234968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1748493-1099-4463-ae45-b95e0893bbb1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:47.302898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1748493-1099-4463-ae45-b95e0893bbb1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:47.307252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:47.308299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: b31f0f58-4a62-45ec-bb03-88ca94aa4dec] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:47.310616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1748493-1099-4463-ae45-b95e0893bbb1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1241 microversion: 2.1 time: 0.083470 Jul 18 13:41:47.311973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3018/5813] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:47 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:47.315517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:47.315966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:47.316790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:47.317230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:47.337358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] HTTP exception thrown: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Request method failure captured: Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec HTTP/1.1 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WJ65TQS0urSCpFuaN0Emoqp6p_daCZcpkSRzYLEVPOGlQZutHGVcuEBtIZr7Tj0a1G2sNwcfBmElG5R5960SJVP-m7qSDaJ3CnmVSMi_nhf97lCxscPeOj70t2TiV8Pw0RvILRyZrpEnnsAVl6noo5HOXQpgP9buGrNpGVvCXYBBPM Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c38d1ce804d0438bb4387adf316eb065", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 03a79841909d4f259345be53bf4be4aa Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b31f0f58-4a62-45ec-bb03-88ca94aa4dec'} Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:41:47.344293 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. Jul 18 13:41:47.349582 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:41:47.351220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Returning 404 to user: Instance b31f0f58-4a62-45ec-bb03-88ca94aa4dec could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:41:47.352096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-caa6add1-76c9-4b64-9d23-2cb8676bbcba tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec" status: 404 len: 111 microversion: 2.1 time: 0.050032 Jul 18 13:41:47.352855 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2796/5814] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:47 2022] GET /compute/v2.1/servers/b31f0f58-4a62-45ec-bb03-88ca94aa4dec => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:41:48.328878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:48.330686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:48.343043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:48.343507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:48.344288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:48.344916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:48.554328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:48.565945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c267c8e-cd87-4701-af2b-229c26468265 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1301 microversion: 2.1 time: 0.242397 Jul 18 13:41:48.572086 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3019/5815] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:48 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1301 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:49.591718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:49.592483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:49.602328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:49.602958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:49.603899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:49.604448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:50.049547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:50.068614 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fde6b48-01ef-46d5-bf2d-cd675a824edc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.481131 Jul 18 13:41:50.070141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2797/5816] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:49 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:50.798218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7a81568f-4a4c-446f-8f30-d982f5cb015e req-3acb9a87-6e08-4e70-818d-443a615fd03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89755eec-6d0b-4f25-a677-d0be315e96c8", "tag": "0a86427c-e831-4410-9b7c-0d13a1e99ca3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:50.822627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7a81568f-4a4c-446f-8f30-d982f5cb015e req-3acb9a87-6e08-4e70-818d-443a615fd03e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:50.823174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7a81568f-4a4c-446f-8f30-d982f5cb015e req-3acb9a87-6e08-4e70-818d-443a615fd03e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:50.853907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7a81568f-4a4c-446f-8f30-d982f5cb015e req-3acb9a87-6e08-4e70-818d-443a615fd03e service nova] Creating event network-changed:0a86427c-e831-4410-9b7c-0d13a1e99ca3 for instance 89755eec-6d0b-4f25-a677-d0be315e96c8 on n-h2-850003-3 Jul 18 13:41:50.864352 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7a81568f-4a4c-446f-8f30-d982f5cb015e req-3acb9a87-6e08-4e70-818d-443a615fd03e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072363 Jul 18 13:41:50.868479 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3020/5817] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:41:51.086794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:51.087414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:51.100708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:51.101175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:51.101975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:51.102448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:51.460121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:51.469834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb209f18-7033-4fb3-b322-a060645a74cf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.386888 Jul 18 13:41:51.471302 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2798/5818] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:51 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:52.490409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:52.492259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:52.506705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:52.506705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:52.506705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:52.507417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:52.619477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b82dceb0-d09a-42ee-b3b2-9808785dabc1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '.version_select at 0x7f96d73a5d30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:52.681124 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b82dceb0-d09a-42ee-b3b2-9808785dabc1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-779172775" status: 202 len: 0 microversion: 2.1 time: 0.066857 Jul 18 13:41:52.686864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2799/5819] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 13:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-779172775 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:41:52.713465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bba6f3c8-ac70-4771-8e4b-c223d93ee71e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: .version_select at 0x7f96d7397ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1367167176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXwLlejjgpl+Cur9YpvQVbvZ47mbqkc6GDvcX3gibhEmjvShT6FRddnmLyCZkRxC6ile1zBvIiF1WkBBRzCVDW5aamcCPDuVHGB9h0WjL+zcDO7+vJ/xfKNU3j2NWrKbg=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:52.726560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:52.741080 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-326f5807-b720-4295-ae99-60c7e9d89b42 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.257373 Jul 18 13:41:52.750985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3021/5820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:52 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:41:52.761916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bba6f3c8-ac70-4771-8e4b-c223d93ee71e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:41:52.767523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bba6f3c8-ac70-4771-8e4b-c223d93ee71e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:41:52.794044 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bba6f3c8-ac70-4771-8e4b-c223d93ee71e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.085501 Jul 18 13:41:52.794718 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2800/5821] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:41:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:41:53.762711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:53.763333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:53.770719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:53.771179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:53.772140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:53.772788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:53.992482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:54.004030 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-48cb2a1d-1e31-4ed8-accd-e56309f3dfde tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.244603 Jul 18 13:41:54.013836 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3022/5822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:53 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:55.023340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:55.024558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:55.032038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:55.032242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:55.033413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:55.033854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:55.287729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:55.296286 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1766d87-bb2e-44a4-a834-02411e4c2fe4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.278821 Jul 18 13:41:55.296933 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2801/5823] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:55 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:56.314995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:56.315785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:56.324939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:56.325393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:56.326206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:56.326650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:56.484584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:56.497032 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5f6e0fc3-a0cb-449c-92bd-eac4eafe6008 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.186043 Jul 18 13:41:56.498186 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3023/5824] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:56 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:41:56.543550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8179d4bc-b5bb-4c38-a77a-0a53dea6350d req-dd425413-0493-4f0b-b5c8-002592f67917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89755eec-6d0b-4f25-a677-d0be315e96c8", "name": "network-vif-plugged", "status": "completed", "tag": "0a86427c-e831-4410-9b7c-0d13a1e99ca3"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:41:56.554977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8179d4bc-b5bb-4c38-a77a-0a53dea6350d req-dd425413-0493-4f0b-b5c8-002592f67917 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:56.555703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8179d4bc-b5bb-4c38-a77a-0a53dea6350d req-dd425413-0493-4f0b-b5c8-002592f67917 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:56.570649 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8179d4bc-b5bb-4c38-a77a-0a53dea6350d req-dd425413-0493-4f0b-b5c8-002592f67917 service nova] Creating event network-vif-plugged:0a86427c-e831-4410-9b7c-0d13a1e99ca3 for instance 89755eec-6d0b-4f25-a677-d0be315e96c8 on n-h2-850003-3 Jul 18 13:41:56.578074 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8179d4bc-b5bb-4c38-a77a-0a53dea6350d req-dd425413-0493-4f0b-b5c8-002592f67917 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038145 Jul 18 13:41:56.580213 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2802/5825] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:41:57.525745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:57.527069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:57.529302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:57.536404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:57.537108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:57.538441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:57.539049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:57.731409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:57.747240 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-06b848e7-c20c-42c0-ac99-bd260600f831 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1366 microversion: 2.1 time: 0.234205 Jul 18 13:41:57.747863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3024/5826] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:57 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:58.765966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:58.766807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:58.768771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:41:58.795841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:58.796295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:58.797098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:58.797538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:59.359797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:41:59.384475 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75ce2a6f-f2bc-4684-b596-278dbd68005c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1555 microversion: 2.1 time: 0.623081 Jul 18 13:41:59.404346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:41:59.404857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:41:59.426995 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2803/5827] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:41:58 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1555 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:41:59.459834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:59.460126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:59.464943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:41:59.465479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:41:59.608779 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6a0ba78-e8dc-42e2-98e1-b4220d5bb8e0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208518 Jul 18 13:41:59.609855 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3025/5828] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:41:59 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:01.923695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1017870437", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "ab1013f3-05b1-48d7-98ba-94be089696d8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1367167176", "security_groups": [{"name": "tempest-secgroup-smoke-359783889"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:02.009997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d924feee-ea07-4075-94b2-07a03c581bfc req-09916ade-ad8c-41d9-ad6c-fb4b41dcac5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89755eec-6d0b-4f25-a677-d0be315e96c8", "tag": "0a86427c-e831-4410-9b7c-0d13a1e99ca3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:02.022662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d924feee-ea07-4075-94b2-07a03c581bfc req-09916ade-ad8c-41d9-ad6c-fb4b41dcac5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:02.023318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d924feee-ea07-4075-94b2-07a03c581bfc req-09916ade-ad8c-41d9-ad6c-fb4b41dcac5d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:02.045128 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d924feee-ea07-4075-94b2-07a03c581bfc req-09916ade-ad8c-41d9-ad6c-fb4b41dcac5d service nova] Creating event network-changed:0a86427c-e831-4410-9b7c-0d13a1e99ca3 for instance 89755eec-6d0b-4f25-a677-d0be315e96c8 on n-h2-850003-3 Jul 18 13:42:02.073491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d924feee-ea07-4075-94b2-07a03c581bfc req-09916ade-ad8c-41d9-ad6c-fb4b41dcac5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066936 Jul 18 13:42:02.078521 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3026/5829] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:02.087333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] validate_networks() for [('ab1013f3-05b1-48d7-98ba-94be089696d8', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:42:02.776342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=14 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:02.943739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:42:02.944519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:42:02.945006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:42:02.945611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:42:02.946356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:42:02.959107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:02.959807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:02.960817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:02.961415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:02.993198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:42:03.002851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:42:03.018711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:42:03.022233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:42:03.108331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6eb80de3-2f32-45a8-8fb5-5f6c9a176a8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.189537 Jul 18 13:42:03.117403 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2804/5830] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:42:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:42:03.120912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62bf4b3f-84a4-4d6e-bcf2-cedca78dad68 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:03.121723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62bf4b3f-84a4-4d6e-bcf2-cedca78dad68 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:03.318822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-62bf4b3f-84a4-4d6e-bcf2-cedca78dad68 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:03.329692 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62bf4b3f-84a4-4d6e-bcf2-cedca78dad68 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1267 microversion: 2.1 time: 0.212878 Jul 18 13:42:03.339522 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3027/5831] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:03 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:42:04.351301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:04.352684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:04.388027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:04.388488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:04.389307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:04.389751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:04.550012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:04.559873 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d13199ed-c25f-4302-90c3-a5468bf57e2f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1319 microversion: 2.1 time: 0.214567 Jul 18 13:42:04.566487 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2805/5832] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:04 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:05.285427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:05.286004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:05.295747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.297277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.298616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.299249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.333698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:42:05.482493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e8d4b71-7b7c-4284-abef-5ca557e6fb18 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 204 len: 0 microversion: 2.1 time: 0.379514 Jul 18 13:42:05.483159 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3028/5833] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:42:05 2022] DELETE /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:42:05.497676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:05.500274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:05.515160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.516316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.518015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.519162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.582127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:05.582975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:05.599758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.600214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.601029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:05.601537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:05.760064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:05.772035 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2d6bbe0-ef58-4dbe-a10a-fa20c46586da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1325 microversion: 2.1 time: 0.195205 Jul 18 13:42:05.773304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3029/5834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:05 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:05.864874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:05.914040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f808b86a-15d5-455f-a894-81c17aa76bb1 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1733 microversion: 2.1 time: 0.422974 Jul 18 13:42:05.927378 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2806/5835] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:05 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1733 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:06.792810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:06.794062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:06.802328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:06.802994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:06.804000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:06.804612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:06.957470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:06.962670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:06.985789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:06.990748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:06.992007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:06.992749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:07.095597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:07.099328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:07.110903 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b6ca9c10-4407-47dc-905c-4b38f1d3dd73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.321434 Jul 18 13:42:07.111649 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3030/5836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:06 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:07.367723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:07.383923 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8eaea2c-46c6-471b-a634-78c2329aa6c8 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1733 microversion: 2.1 time: 0.433314 Jul 18 13:42:07.404418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2807/5837] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:06 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1733 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:08.132459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:08.133580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:08.150613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:08.151752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:08.153321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:08.156052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:08.365437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:08.375939 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-526ca9d0-f74c-4bc5-9301-4e596a7e648a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.249934 Jul 18 13:42:08.398426 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3031/5838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:08 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:08.431583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:08.434831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:08.445455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:08.446195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:08.448379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:08.449386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:08.511729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-16b46a24-05a5-4ee1-b59b-f5e581704df7 req-51ac9ff4-e22e-4270-a36a-6fb09a48e266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:08.523971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-16b46a24-05a5-4ee1-b59b-f5e581704df7 req-51ac9ff4-e22e-4270-a36a-6fb09a48e266 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:08.526045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-16b46a24-05a5-4ee1-b59b-f5e581704df7 req-51ac9ff4-e22e-4270-a36a-6fb09a48e266 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:08.558673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:08.563239 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-16b46a24-05a5-4ee1-b59b-f5e581704df7 req-51ac9ff4-e22e-4270-a36a-6fb09a48e266 service nova] Creating event network-changed:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:42:08.575233 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc5df228-41b6-4db1-baa4-bb4fe3dac58f tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1666 microversion: 2.1 time: 0.158683 Jul 18 13:42:08.579369 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2808/5839] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:08 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:08.584538 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-16b46a24-05a5-4ee1-b59b-f5e581704df7 req-51ac9ff4-e22e-4270-a36a-6fb09a48e266 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076737 Jul 18 13:42:08.585830 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3032/5840] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:09.404395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:09.406984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:09.420782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:09.421595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:09.423283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:09.423848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:09.613522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:09.618077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:09.652915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:09.654229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:09.656517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:09.657858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:09.745415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:09.746748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:09.747827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lazy-loading 'fault' on Instance uuid 5949d514-1f74-496d-a611-f81cbc17c047 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:42:09.772261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:09.788118 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7265e64-fd8f-4ce1-890a-10ce04c75ef3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.387558 Jul 18 13:42:09.790313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2809/5841] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:09 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:09.840631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9349e058f24860b8683862c39bf4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b342dc2707954265bc9b5dba5353aa8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:09.852803 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3aaff8f0-473c-4b23-b10f-bc3a66c5439d tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 200 len: 1388 microversion: 2.1 time: 0.254199 Jul 18 13:42:09.854535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3033/5842] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:09 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 1388 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:10.634671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9c9a25c9-e6ba-481f-b751-d453b6871fc2 req-55f4ff5e-39c2-4fd0-82c7-5576c138b714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5949d514-1f74-496d-a611-f81cbc17c047", "name": "network-vif-deleted", "tag": "f3a1ceae-6c69-434a-af27-0b0e2682838b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:10.645281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c9a25c9-e6ba-481f-b751-d453b6871fc2 req-55f4ff5e-39c2-4fd0-82c7-5576c138b714 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:10.645841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c9a25c9-e6ba-481f-b751-d453b6871fc2 req-55f4ff5e-39c2-4fd0-82c7-5576c138b714 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:10.661683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9c9a25c9-e6ba-481f-b751-d453b6871fc2 req-55f4ff5e-39c2-4fd0-82c7-5576c138b714 service nova] Creating event network-vif-deleted:f3a1ceae-6c69-434a-af27-0b0e2682838b for instance 5949d514-1f74-496d-a611-f81cbc17c047 on n-h2-850003-3 Jul 18 13:42:10.668388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9c9a25c9-e6ba-481f-b751-d453b6871fc2 req-55f4ff5e-39c2-4fd0-82c7-5576c138b714 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037194 Jul 18 13:42:10.669821 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2810/5843] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:10.817912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:10.818707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:10.825872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:10.826621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:10.827638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:10.828088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:10.874171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:10.874171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:10.884773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:10.885392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:10.886230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:10.886812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:10.905493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] HTTP exception thrown: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Request method failure captured: Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 HTTP/1.1 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WHakPtIj76_4UPfJNQseGUI4Q-jz_KUI_efBNCjf3BK_97NJG8pVQlcBuNWfkiaO-lht3Il6jaqpKjt-W6iKJfmhrMWQH1I5VsM5l_j--I0feYPxgQwT-dN8fzYacrvHvIYYb2YkqW7hVXky3IOo_AiUbEgq7xuOpp85lQ6C4l6KHk Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b342dc2707954265bc9b5dba5353aa8e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 5c9349e058f24860b8683862c39bf4a8 Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5949d514-1f74-496d-a611-f81cbc17c047'} Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:10.907198 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Returning 404 to user: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e04f8a67-4be1-4abb-9611-8e21b8053ac6 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 404 len: 111 microversion: 2.1 time: 0.039087 Jul 18 13:42:10.912537 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2811/5844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:10 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:42:11.101603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:11.110138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-58c321a5-7bdf-4a59-88f2-a827df3550ed tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.302989 Jul 18 13:42:11.123056 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3034/5845] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:10 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:11.637020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:11.638139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:11.652646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:11.653658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:11.655122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:11.656002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:11.679818 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] HTTP exception thrown: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Request method failure captured: Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 HTTP/1.1 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WHakPtIj76_4UPfJNQseGUI4Q-jz_KUI_efBNCjf3BK_97NJG8pVQlcBuNWfkiaO-lht3Il6jaqpKjt-W6iKJfmhrMWQH1I5VsM5l_j--I0feYPxgQwT-dN8fzYacrvHvIYYb2YkqW7hVXky3IOo_AiUbEgq7xuOpp85lQ6C4l6KHk Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b342dc2707954265bc9b5dba5353aa8e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 5c9349e058f24860b8683862c39bf4a8 Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5949d514-1f74-496d-a611-f81cbc17c047'} Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:42:11.683134 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.688899 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.693073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Returning 404 to user: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:42:11.694873 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4a1809c2-5210-4569-a53f-d4881b05738c tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 404 len: 111 microversion: 2.1 time: 0.064592 Jul 18 13:42:11.705116 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2812/5846] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:42:11 2022] DELETE /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:42:11.715162 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:11.716166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] [instance: 5949d514-1f74-496d-a611-f81cbc17c047] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:11.724669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:11.728475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:11.730029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:11.732278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:11.733865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:11.759891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] HTTP exception thrown: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Request method failure captured: Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 HTTP/1.1 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WHakPtIj76_4UPfJNQseGUI4Q-jz_KUI_efBNCjf3BK_97NJG8pVQlcBuNWfkiaO-lht3Il6jaqpKjt-W6iKJfmhrMWQH1I5VsM5l_j--I0feYPxgQwT-dN8fzYacrvHvIYYb2YkqW7hVXky3IOo_AiUbEgq7xuOpp85lQ6C4l6KHk Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b342dc2707954265bc9b5dba5353aa8e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b342dc2707954265bc9b5dba5353aa8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: b342dc2707954265bc9b5dba5353aa8e Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestServerBasicOps-1282738137 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 5c9349e058f24860b8683862c39bf4a8 Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestServerBasicOps-1282738137-project Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '5949d514-1f74-496d-a611-f81cbc17c047'} Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:42:11.761701 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. Jul 18 13:42:11.766168 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:42:11.769778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Returning 404 to user: Instance 5949d514-1f74-496d-a611-f81cbc17c047 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:42:11.770874 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae4bbf42-b167-4873-a63d-734757d2cdc7 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047" status: 404 len: 111 microversion: 2.1 time: 0.061530 Jul 18 13:42:11.771920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3035/5847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:11 2022] GET /compute/v2.1/servers/5949d514-1f74-496d-a611-f81cbc17c047 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:42:12.086919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7d72e72a-c0c7-4886-a71d-a69ba0bce087 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] Calling method '.version_select at 0x7f96e44f9b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:12.132129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:12.132869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:12.141979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7d72e72a-c0c7-4886-a71d-a69ba0bce087 tempest-TestServerBasicOps-1282738137 tempest-TestServerBasicOps-1282738137-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1405614915" status: 202 len: 0 microversion: 2.1 time: 0.059292 Jul 18 13:42:12.144307 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2813/5848] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 13:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1405614915 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:42:12.145190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:12.145653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:12.146697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:12.147142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:12.466142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:12.477499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32a6da3b-3f39-40e2-9e3a-b34935dd69e2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.350698 Jul 18 13:42:12.488879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3036/5849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:12 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:13.494782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:13.495411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:13.500281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:13.500915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:13.502957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:13.511577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:13.512309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:13.513129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:13.513653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:13.518843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=76 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:13.719459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:13.732472 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83d4ae42-1ae9-4232-8a03-29cfec879a2d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.239566 Jul 18 13:42:13.733315 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2814/5850] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:13 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:13.867978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-31fa0f5c-ac7e-496c-97ca-7a3bed28b36e req-668df05b-fa0c-465a-817b-45b23c676abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-plugged", "status": "completed", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:13.885778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:13.890612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-31fa0f5c-ac7e-496c-97ca-7a3bed28b36e req-668df05b-fa0c-465a-817b-45b23c676abd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:13.891273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-31fa0f5c-ac7e-496c-97ca-7a3bed28b36e req-668df05b-fa0c-465a-817b-45b23c676abd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:13.917634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-31fa0f5c-ac7e-496c-97ca-7a3bed28b36e req-668df05b-fa0c-465a-817b-45b23c676abd service nova] Creating event network-vif-plugged:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:42:13.934556 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-31fa0f5c-ac7e-496c-97ca-7a3bed28b36e req-668df05b-fa0c-465a-817b-45b23c676abd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078559 Jul 18 13:42:13.938455 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3037/5851] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:42:14.751198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:14.752395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:14.760790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:14.761519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:14.762486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:14.763098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:15.019424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:15.041351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82229732-b2f9-4e9a-8223-991d1a0c9303 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1392 microversion: 2.1 time: 0.293606 Jul 18 13:42:15.042172 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2815/5852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:14 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:16.061171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:16.062680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:16.074870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:16.075428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:16.076331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:16.076855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:16.316108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:16.324888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-532cec79-52ad-4c64-a1a4-34f086a1567a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1563 microversion: 2.1 time: 0.268870 Jul 18 13:42:16.325490 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3038/5853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:16 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:16.344996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:16.345640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:16.356130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:16.358304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:16.359309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:16.362048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:16.836396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:16.851306 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4b90ef6-5243-4490-9eb9-0cee4bae83d4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1563 microversion: 2.1 time: 0.512199 Jul 18 13:42:16.853031 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2816/5854] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:16 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1563 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:19.686930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bcf272ff-b14d-4326-bda6-06de18617c4a req-3659f5ae-ff69-421a-a343-99c1a18c4e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:19.719753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:19.720957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:19.733948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bcf272ff-b14d-4326-bda6-06de18617c4a req-3659f5ae-ff69-421a-a343-99c1a18c4e1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:19.734624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bcf272ff-b14d-4326-bda6-06de18617c4a req-3659f5ae-ff69-421a-a343-99c1a18c4e1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:19.750577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:19.751591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:19.752687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:19.754608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:19.762900 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bcf272ff-b14d-4326-bda6-06de18617c4a req-3659f5ae-ff69-421a-a343-99c1a18c4e1a service nova] Creating event network-changed:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:42:19.777534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bcf272ff-b14d-4326-bda6-06de18617c4a req-3659f5ae-ff69-421a-a343-99c1a18c4e1a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099474 Jul 18 13:42:19.780138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2817/5855] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:20.101259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:20.112776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f582380-b814-4837-8708-ccd75411af74 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1563 microversion: 2.1 time: 0.446666 Jul 18 13:42:20.142257 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3039/5856] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:19 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1563 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:45.378232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:45.378910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:45.388100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:45.389006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=19 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:45.391104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:45.391633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:45.392608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:45.393249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:45.429065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee71aad2-0795-4b71-9079-2d4e9c336d22 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.063211 Jul 18 13:42:45.430386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2818/5857] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:42:45 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/ips => generated 149 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:48.256642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa43930e-0054-4c5e-9c41-c41a8704a606"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:48.257748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:48.269535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=9 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:48.270530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=45 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:42:48.277442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:48.277916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:48.279897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:48.280526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:48.821841 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88799357-8bfc-4ec5-b97c-a6d7f7d95a31 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571128 Jul 18 13:42:48.831196 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3040/5858] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:42:48 2022] POST /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:52.822497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:52.825218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:52.836079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:52.836871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:52.837911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:52.838674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:52.914584 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-07875b97-2a4d-4c78-9ab9-6850a3ef22b9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action" status: 200 len: 24556 microversion: 2.1 time: 0.102680 Jul 18 13:42:52.915996 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2819/5859] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:42:52 2022] POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action => generated 24556 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:42:54.220090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-497140609", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "059bf64b-4a24-4b1c-a8b6-29a6e16c8376", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:54.294895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:42:54.803091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:42:54.804037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:42:54.804696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:42:54.805285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:42:54.805874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:42:54.819338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:54.819975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:54.820979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:54.821578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:54.844277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:42:54.851684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:42:54.931865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:42:54.935619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='059bf64b-4a24-4b1c-a8b6-29a6e16c8376',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:42:55.129558 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d4a1f9f-482f-4e51-a07d-e134fb4cdeed tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914307 Jul 18 13:42:55.130811 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3041/5860] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:42:55.141688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3b09e6e-32bc-4824-a516-bdde13acc1c6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:55.142758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3b09e6e-32bc-4824-a516-bdde13acc1c6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:55.214250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c3b09e6e-32bc-4824-a516-bdde13acc1c6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:55.222322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3b09e6e-32bc-4824-a516-bdde13acc1c6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1056 microversion: 2.1 time: 0.085387 Jul 18 13:42:55.223741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2820/5861] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:55 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:56.243666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:56.245021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:56.254531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:56.255015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:56.255909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:56.257060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:56.332953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:56.344927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32ece5e9-0dc8-42b2-8800-ee832d07d9ca tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1154 microversion: 2.1 time: 0.107562 Jul 18 13:42:56.345524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3042/5862] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:56 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1154 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:42:57.364227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:57.364744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:57.390562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:57.391064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:57.391939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:57.392372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:57.783106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:57.797105 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cafc1896-7965-4a32-b774-7cfefbda8f77 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1214 microversion: 2.1 time: 0.438119 Jul 18 13:42:57.798485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2821/5863] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:57 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1214 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:42:58.652232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-91482a4c-c59b-4077-8f63-d3c030051ec8 req-d66f7a3a-0920-4d27-91c2-8a7631920ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf", "tag": "07d61bb8-d203-44af-8deb-b381d5dc5c4b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:42:58.665101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-91482a4c-c59b-4077-8f63-d3c030051ec8 req-d66f7a3a-0920-4d27-91c2-8a7631920ef5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:58.665561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-91482a4c-c59b-4077-8f63-d3c030051ec8 req-d66f7a3a-0920-4d27-91c2-8a7631920ef5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:58.723714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-91482a4c-c59b-4077-8f63-d3c030051ec8 req-d66f7a3a-0920-4d27-91c2-8a7631920ef5 service nova] Creating event network-changed:07d61bb8-d203-44af-8deb-b381d5dc5c4b for instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf on n-h2-850003-3 Jul 18 13:42:58.731826 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-91482a4c-c59b-4077-8f63-d3c030051ec8 req-d66f7a3a-0920-4d27-91c2-8a7631920ef5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.422207 Jul 18 13:42:58.732772 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3043/5864] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:42:58.824336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:42:58.824957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:42:58.836915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:58.839548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:58.841457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:42:58.842208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:42:59.090138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:42:59.110924 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e6bc2e6-6ccc-4f88-9b2a-b480bf42375a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1214 microversion: 2.1 time: 0.290375 Jul 18 13:42:59.116030 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2822/5865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:42:58 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1214 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:00.130989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:00.131699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:00.139110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:00.139388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:00.140171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:00.140611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:00.321869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:00.330042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b2601f37-b8f8-4669-a5e9-a3864194d9aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1214 microversion: 2.1 time: 0.205451 Jul 18 13:43:00.331020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3044/5866] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:00 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:01.347775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:01.348400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:01.356038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:01.356537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:01.357330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:01.357771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:01.505367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:01.513675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-defb0397-84fb-4da3-8f9d-12e3ff78f82b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1214 microversion: 2.1 time: 0.170747 Jul 18 13:43:01.514804 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2823/5867] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:01 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:02.039953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14500c2a-de08-46ae-a632-22e0b2fb923d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: .version_select at 0x7f96d731a3a0>, body: {"keypair": {"name": "tempest-keypair-441914327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4/rcLcno6sjzPpGwx66MyyCKqsVRYIgo+O/htSVj3zgPbmaEOO75Vh/TTOWPjrtZ/mjLpAWKGbkOatgXtAioPiC7jq/g770p+Es/e23w3hFhhVB6Sxe4HzgTMU+ZyknA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:02.059390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-14500c2a-de08-46ae-a632-22e0b2fb923d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:43:02.067847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-14500c2a-de08-46ae-a632-22e0b2fb923d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:43:02.094278 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14500c2a-de08-46ae-a632-22e0b2fb923d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058934 Jul 18 13:43:02.095168 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3045/5868] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:43:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:43:02.532145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:02.533674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:02.546531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:02.547201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:02.548469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:02.549360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:02.825754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:02.837376 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de76c68e-b683-4ff4-b946-15ddbdc39846 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1214 microversion: 2.1 time: 0.309347 Jul 18 13:43:02.840340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2824/5869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:02 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:03.856052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:03.857532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:03.865835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:03.866761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:03.868209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:03.868656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:04.036663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-618508437", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2112c8d0-f5a5-4e18-8577-541bfd3a1558"}], "security_groups": [{"name": "tempest-securitygroup--1810569681"}], "key_name": "tempest-keypair-441914327", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:04.045268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:04.054077 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e536b923-6870-4deb-89e6-50eb9d3217d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.202697 Jul 18 13:43:04.054734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3046/5870] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:03 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:04.167372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] validate_networks() for [('2112c8d0-f5a5-4e18-8577-541bfd3a1558', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:43:04.579741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:43:04.580672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:43:04.581347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:43:04.581762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:43:04.582206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:43:04.602141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:04.602628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:04.603439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:04.603889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:04.621172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:43:04.626547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:43:04.639114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:43:04.641387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:43:04.689970 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0cf7cc04-2d10-4827-89a6-bc7691f3cc3f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660235 Jul 18 13:43:04.690984 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2825/5871] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:43:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:43:04.701599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-382302e4-3776-4ae7-b34f-282ba1fc77ae tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:04.702799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-382302e4-3776-4ae7-b34f-282ba1fc77ae tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:04.779227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-382302e4-3776-4ae7-b34f-282ba1fc77ae tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:04.787228 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-382302e4-3776-4ae7-b34f-282ba1fc77ae tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1240 microversion: 2.1 time: 0.090030 Jul 18 13:43:04.788315 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3047/5872] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:04 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:05.072069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:05.072719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:05.079947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:05.080667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:05.081653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:05.082290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:05.237401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:05.245208 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5f082a3-beb8-488f-a013-f142b4c890a9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.177908 Jul 18 13:43:05.245920 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2826/5873] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:05 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:05.808582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:05.809246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:05.812993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:05.821466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:05.821932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:05.822901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:05.823539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:05.911817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:05.921198 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac52f076-2b48-4435-a5b3-5b636be07242 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1300 microversion: 2.1 time: 0.119555 Jul 18 13:43:05.921779 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3048/5874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:05 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:06.262481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:06.263369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:06.271824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:06.272810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:06.273990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:06.274563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:06.516226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:06.534359 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26b618f0-01d9-4aa3-aaaf-f280d7c2f417 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.275667 Jul 18 13:43:06.534975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2827/5875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:06 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:06.940305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:06.941061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:06.951503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:06.953371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:06.965877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:06.970240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:07.166400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:07.175501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bee78e7e-6653-497e-a989-f5fbb26ec490 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.239190 Jul 18 13:43:07.176409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3049/5876] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:06 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:07.558481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:07.559322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:07.571888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:07.572354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:07.573227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:07.573669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:07.710560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-012cbbe3-2d65-4ec1-84a3-80dc66bf0e56 req-0b9b3490-871c-4635-b426-2420000c02bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671589ea-d2e7-4b6c-b08f-7d66c9549ec3", "tag": "bf24261f-0427-4652-9450-cd97ad42e5db"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:07.730468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-012cbbe3-2d65-4ec1-84a3-80dc66bf0e56 req-0b9b3490-871c-4635-b426-2420000c02bb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:07.731244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-012cbbe3-2d65-4ec1-84a3-80dc66bf0e56 req-0b9b3490-871c-4635-b426-2420000c02bb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:07.755243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-012cbbe3-2d65-4ec1-84a3-80dc66bf0e56 req-0b9b3490-871c-4635-b426-2420000c02bb service nova] Creating event network-changed:bf24261f-0427-4652-9450-cd97ad42e5db for instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 on n-h1-850003-3 Jul 18 13:43:07.761248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-012cbbe3-2d65-4ec1-84a3-80dc66bf0e56 req-0b9b3490-871c-4635-b426-2420000c02bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054815 Jul 18 13:43:07.762417 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3050/5877] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:07.894893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:07.904321 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b790eae-60b4-4654-aec6-ca8e3bcec078 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.356000 Jul 18 13:43:07.917258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2828/5878] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:07 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:08.194743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:08.195465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:08.204898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:08.205994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:08.207190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:08.208050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:08.389316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:08.398011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49923dd1-8838-4af9-8fa6-a9d2dd43270a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.208637 Jul 18 13:43:08.399167 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3051/5879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:08 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:08.922889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:08.923547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:08.931060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:08.931513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:08.932291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:08.932740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:09.079907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:09.088169 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ca3cd9e4-8b05-4274-a47a-06b0efd15324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.169237 Jul 18 13:43:09.088690 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2829/5880] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:08 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:09.415566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:09.416175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:09.423256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:09.423751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:09.425045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:09.425478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:09.564090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:09.572725 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7662700e-5e6b-4e6c-b793-91c11d43c664 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.161228 Jul 18 13:43:09.573328 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3052/5881] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:09 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:10.105264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:10.105885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:10.113122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:10.113504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:10.114323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:10.114768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:10.251380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:10.268283 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-14f55bb0-8f8f-4228-8e0a-ba604a4568b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.166229 Jul 18 13:43:10.268982 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2830/5882] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:10 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:10.590011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:10.591083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:10.598825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:10.599269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:10.600248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:10.600710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:10.806013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:10.819988 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac2e3fb6-8a44-4894-a6eb-e335dfd52311 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.233850 Jul 18 13:43:10.822974 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3053/5883] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:10 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:11.285365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:11.286090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:11.295924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:11.296664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:11.297949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:11.298735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:11.439079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:11.451666 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8bc789ff-183c-45ef-98b1-2a4c1573c9d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.170334 Jul 18 13:43:11.452793 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2831/5884] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:11 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:11.839175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:11.839788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:11.847093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:11.847546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:11.848390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:11.848994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:11.991747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:12.000051 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-26a858cf-ec41-4015-8b5c-7544f0b5098f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.164602 Jul 18 13:43:12.006786 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3054/5885] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:11 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:12.477920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:12.479223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:12.487890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:12.488390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:12.489389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:12.490305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:12.659500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:12.668394 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-746dae18-7e6f-4f1b-8729-abdfef1a51d9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.195528 Jul 18 13:43:12.669815 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2832/5886] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:12 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:12.917696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-021f6f4b-1d9f-4fe5-8219-315fec205196 req-bb79b24f-f6bc-4e95-a5f8-afaf0406aef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf", "name": "network-vif-plugged", "status": "completed", "tag": "07d61bb8-d203-44af-8deb-b381d5dc5c4b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:12.929110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-021f6f4b-1d9f-4fe5-8219-315fec205196 req-bb79b24f-f6bc-4e95-a5f8-afaf0406aef5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:12.929561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-021f6f4b-1d9f-4fe5-8219-315fec205196 req-bb79b24f-f6bc-4e95-a5f8-afaf0406aef5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:12.941446 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-021f6f4b-1d9f-4fe5-8219-315fec205196 req-bb79b24f-f6bc-4e95-a5f8-afaf0406aef5 service nova] Creating event network-vif-plugged:07d61bb8-d203-44af-8deb-b381d5dc5c4b for instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf on n-h2-850003-3 Jul 18 13:43:12.946629 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-021f6f4b-1d9f-4fe5-8219-315fec205196 req-bb79b24f-f6bc-4e95-a5f8-afaf0406aef5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037147 Jul 18 13:43:12.947558 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3055/5887] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:13.018303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:13.018923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:13.029082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:13.029537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:13.030448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:13.030972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:13.232222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:13.240917 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94b1ec94-3505-497c-a3e9-46e28797cfb5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.227422 Jul 18 13:43:13.241530 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2833/5888] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:13 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:13.688714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:13.690082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:13.698019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:13.698500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:13.699307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:13.699754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:13.881407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:13.895622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07846c11-0972-4a88-9630-9053b47e9ff9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1202 microversion: 2.1 time: 0.210832 Jul 18 13:43:13.898463 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3056/5889] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:13 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1202 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:14.259794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:14.260499 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:14.271611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:14.272386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:14.273450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:14.273970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:14.447388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:14.460940 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6f2e483-1175-4581-87a3-588288cb7b97 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.205657 Jul 18 13:43:14.461545 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2834/5890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:14 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:14.915610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:14.916222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:14.919092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:14.925312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:14.925769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:14.926604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:14.927049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:14.973051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-be656360-05f8-44ce-9a48-4f20c74e4498 req-cd449ff9-405d-4fe2-8611-aab9304dcdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671589ea-d2e7-4b6c-b08f-7d66c9549ec3", "name": "network-vif-plugged", "status": "completed", "tag": "bf24261f-0427-4652-9450-cd97ad42e5db"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:14.976940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:14.977630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:14.997983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be656360-05f8-44ce-9a48-4f20c74e4498 req-cd449ff9-405d-4fe2-8611-aab9304dcdc9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:14.998548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-be656360-05f8-44ce-9a48-4f20c74e4498 req-cd449ff9-405d-4fe2-8611-aab9304dcdc9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.013305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-be656360-05f8-44ce-9a48-4f20c74e4498 req-cd449ff9-405d-4fe2-8611-aab9304dcdc9 service nova] Creating event network-vif-plugged:bf24261f-0427-4652-9450-cd97ad42e5db for instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 on n-h1-850003-3 Jul 18 13:43:15.019034 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-be656360-05f8-44ce-9a48-4f20c74e4498 req-cd449ff9-405d-4fe2-8611-aab9304dcdc9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058570 Jul 18 13:43:15.019968 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2835/5891] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:43:15.116919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:15.125458 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-984d9706-5777-46b6-ae4a-563cecfba3a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1390 microversion: 2.1 time: 0.214256 Jul 18 13:43:15.126079 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3057/5892] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:14 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:15.146060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:15.147210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:15.166414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.167187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.168388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.169212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.346680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:15.365527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-519bb782-e8fd-472c-a0bf-e0aa89e020b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1390 microversion: 2.1 time: 0.225914 Jul 18 13:43:15.366208 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2836/5893] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:15 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:15.382033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:15.382687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:15.391455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.391911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.392690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.393189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.479917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:15.482999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:15.488576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:15.496808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.497897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.499407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.500479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.511181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:15.570757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:15.584054 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1ff6d78-3a83-458a-958e-28629f9dd19c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1390 microversion: 2.1 time: 0.205922 Jul 18 13:43:15.584782 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3058/5894] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:15 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:15.603545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:15.604004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:15.610948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.612239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.613315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.613918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.643030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:43:15.646954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:15.700837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:15.713864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de0c5fe3-ce51-4c0e-9de0-02b828498986 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1366 microversion: 2.1 time: 0.237938 Jul 18 13:43:15.726200 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2837/5895] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:15 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:15.753778 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df1293d4-effa-4f21-be6b-eb7ba5e8e381 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 204 len: 0 microversion: 2.1 time: 0.153440 Jul 18 13:43:15.755354 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3059/5896] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:43:15 2022] DELETE /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:43:15.773949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:15.774972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:15.785751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.786273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:15.787088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:15.787798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:16.021628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:16.034312 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-637ff61a-51ab-4e8c-9037-1e73c566067e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1396 microversion: 2.1 time: 0.266336 Jul 18 13:43:16.035155 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2838/5897] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:15 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1396 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:16.746282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:16.747238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:16.757354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:16.758003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:16.759079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:16.759606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:16.981154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:16.995917 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b84a4060-bc0c-4bc4-90b3-0ee792b98786 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1555 microversion: 2.1 time: 0.255854 Jul 18 13:43:16.998447 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3060/5898] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:16 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:17.019422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:17.021216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:17.034027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:17.035480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:17.036742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:17.037724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:17.075474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:17.076211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:17.102785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:17.103147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:17.103965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:17.104411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:17.212871 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5de977d-7805-4eaa-852f-319b74d129de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196197 Jul 18 13:43:17.214127 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2839/5899] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:43:17 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:17.359867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:17.369979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf21ad12-0f29-415c-a5bb-88df235f800e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1396 microversion: 2.1 time: 0.306383 Jul 18 13:43:17.383428 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3061/5900] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:17 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1396 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:18.392141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:18.395793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:18.407497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:18.409281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:18.411173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:18.412267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:18.910732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:18.928626 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a24e5b18-d616-48aa-b5a5-39f44cd73802 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1396 microversion: 2.1 time: 0.541145 Jul 18 13:43:18.943212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2840/5901] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:18 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1396 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:19.136724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dc1c3876-7a2a-4fc8-94aa-572d918583c7 req-cbe553b5-ebb7-4e05-a88f-8f8e15a9f2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf", "name": "network-vif-deleted", "tag": "07d61bb8-d203-44af-8deb-b381d5dc5c4b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:19.146000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:19.172628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc1c3876-7a2a-4fc8-94aa-572d918583c7 req-cbe553b5-ebb7-4e05-a88f-8f8e15a9f2d7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:19.173100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dc1c3876-7a2a-4fc8-94aa-572d918583c7 req-cbe553b5-ebb7-4e05-a88f-8f8e15a9f2d7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:19.212011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dc1c3876-7a2a-4fc8-94aa-572d918583c7 req-cbe553b5-ebb7-4e05-a88f-8f8e15a9f2d7 service nova] Creating event network-vif-deleted:07d61bb8-d203-44af-8deb-b381d5dc5c4b for instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf on n-h2-850003-3 Jul 18 13:43:19.220124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dc1c3876-7a2a-4fc8-94aa-572d918583c7 req-cbe553b5-ebb7-4e05-a88f-8f8e15a9f2d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086416 Jul 18 13:43:19.224239 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3062/5902] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:19.956717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:19.957817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:19.964530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:19.964921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:19.965789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:19.966291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:20.047924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:20.062794 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9ce54867-bc10-4e7b-aef0-77cbef74a495 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1187 microversion: 2.1 time: 0.109033 Jul 18 13:43:20.062794 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2841/5903] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:19 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:21.081049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:21.081747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:21.089379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:21.089830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:21.090663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:21.091098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:21.171284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:21.179884 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c2cf6822-b4d0-44d2-9918-330f2b7d9e7b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1187 microversion: 2.1 time: 0.105157 Jul 18 13:43:21.180593 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3063/5904] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:21 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:21.237944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-806c23cd-696c-4c1a-8ca2-0f964ded6d5d req-7b8e2b6b-8f6d-417d-b552-5b6e183c957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671589ea-d2e7-4b6c-b08f-7d66c9549ec3", "tag": "bf24261f-0427-4652-9450-cd97ad42e5db"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:21.249579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-806c23cd-696c-4c1a-8ca2-0f964ded6d5d req-7b8e2b6b-8f6d-417d-b552-5b6e183c957e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:21.250018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-806c23cd-696c-4c1a-8ca2-0f964ded6d5d req-7b8e2b6b-8f6d-417d-b552-5b6e183c957e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:21.266251 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-806c23cd-696c-4c1a-8ca2-0f964ded6d5d req-7b8e2b6b-8f6d-417d-b552-5b6e183c957e service nova] Creating event network-changed:bf24261f-0427-4652-9450-cd97ad42e5db for instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 on n-h1-850003-3 Jul 18 13:43:21.273022 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-806c23cd-696c-4c1a-8ca2-0f964ded6d5d req-7b8e2b6b-8f6d-417d-b552-5b6e183c957e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039187 Jul 18 13:43:21.273648 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2842/5905] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:22.198694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:22.199594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:22.206437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:22.206883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:22.207715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:22.208150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:22.288984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:22.307134 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6078fe0-a70f-449c-83e4-e8fe775e31f0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1187 microversion: 2.1 time: 0.112529 Jul 18 13:43:22.309510 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3064/5906] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:22 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:23.330423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:23.331658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:23.337860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:23.338450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:23.339237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:23.339744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:23.404270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:23.412683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da50a62e-400f-4654-b466-2e4528c5a5cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1187 microversion: 2.1 time: 0.087065 Jul 18 13:43:23.413187 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2843/5907] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:23 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:24.432074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:24.432663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:24.441347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:24.441817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:24.442626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:24.443071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:24.483006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:24.483451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:24.483912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lazy-loading 'fault' on Instance uuid a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:43:24.529513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:24.538916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c376c54e-ed4c-4802-889c-a1adc3e64abb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 200 len: 1192 microversion: 2.1 time: 0.112361 Jul 18 13:43:24.539691 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3065/5908] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:24 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:25.555900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:25.556601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:25.564696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:25.564932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:25.565696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:25.566166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:25.581568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf HTTP/1.1 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf'} Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:43:25.583321 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6286ca6-ad0b-480f-bd21-6bc2d13b4021 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf" status: 404 len: 111 microversion: 2.1 time: 0.032987 Jul 18 13:43:25.589841 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2844/5909] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:25 2022] GET /compute/v2.1/servers/a6dc3640-6ee2-4f4a-9d5a-60d3a1d99ecf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:43:31.824610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:31.826399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:31.837249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:31.838871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:31.839717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:31.840159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.095871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9cc2d16c-d552-42ea-ae16-f92b47a5b5f9 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1832 microversion: 2.1 time: 0.285940 Jul 18 13:43:32.096963 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3066/5910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:31 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1832 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:32.118337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:32.119497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:32.137873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.138797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.140199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.140954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.351559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:32.359840 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34a106a0-83e2-4e1d-93f3-6504af4bb5ab tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1681 microversion: 2.1 time: 0.250329 Jul 18 13:43:32.360443 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2845/5911] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:32 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:32.465383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:32.466594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:32.473396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.473853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.474682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.475226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.555964 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87d52b3f-2680-4a94-92fd-d7ae85889648 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action" status: 200 len: 32627 microversion: 2.1 time: 0.094330 Jul 18 13:43:32.558205 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3067/5912] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:43:32 2022] POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action => generated 32627 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:43:32.733726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:32.734207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:32.744301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.744957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.745817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:32.746282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:32.794444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a0ba8c5e4adb48e78ce63c16943889bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaf997f8e724ab0a406a0d4a290db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:32.795292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] flavor_id is None. Assuming migration. {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 13:43:32.795749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:43:33.037613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae7c2789-1b7b-4c29-980a-1677b1119c87 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action" status: 202 len: 0 microversion: 2.1 time: 0.308950 Jul 18 13:43:33.039033 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2846/5913] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:43:32 2022] POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:43:33.063136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:33.065063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:33.091018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:33.091943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:33.092888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:33.098945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:33.323958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:33.335642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bdb3ccc1-28c6-4a57-ba23-a06f0d2a584e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1690 microversion: 2.1 time: 0.288179 Jul 18 13:43:33.336560 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3068/5914] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:33 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:34.357770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:34.358459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:34.368304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:34.368849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:34.370560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:34.371244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:34.639407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:34.652669 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ea56b17d-2b15-4982-bc27-20b6e5026e76 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1690 microversion: 2.1 time: 0.301090 Jul 18 13:43:34.653490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2847/5915] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:34 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1690 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:35.673933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:35.676034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:35.683448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:35.684167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:35.685244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:35.685919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:35.919180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:35.935964 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f4e0e79-4388-4e06-bd1a-d5ec2712e8f4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1690 microversion: 2.1 time: 0.266397 Jul 18 13:43:35.937471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3069/5916] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:35 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1690 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:36.955701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:36.956418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:36.964929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:36.965749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:36.966850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:36.967522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:37.146835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:37.157511 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a187d8e5-6486-4ffa-8914-975345fc1069 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.206477 Jul 18 13:43:37.158348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2848/5917] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:36 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:38.176683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:38.177431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:38.184798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:38.185259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:38.186082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:38.186549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:38.401925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:38.416446 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ba2ccdc-50a0-4a33-a438-b8712af45c3c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.244104 Jul 18 13:43:38.427644 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3070/5918] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:38 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:39.435282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:39.435879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:39.444457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:39.444704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:39.445598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:39.446048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:39.693158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:39.716345 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-67cb0964-eb1d-46e2-96a3-69800b6071aa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.285658 Jul 18 13:43:39.717684 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2849/5919] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:39 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:40.742726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:40.743813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:40.751780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:40.752338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:40.753181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:40.753616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:40.913588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:40.921311 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ba52c7f-83cf-4a96-a63c-d5a7ff047120 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.182287 Jul 18 13:43:40.922377 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3071/5920] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:40 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:41.943519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:41.950045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:41.967818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:41.968459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:41.969696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:41.970880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:42.183454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:42.205002 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f270b1d1-4b08-453e-81a6-5cb4a10fc7a7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.267338 Jul 18 13:43:42.206263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2850/5921] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:41 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:43.235053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:43.236046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:43.244203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:43.245190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:43.246284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:43.246954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:43.492362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:43.505742 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4f97916-abfa-47c7-9169-6fa54151dca1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.275050 Jul 18 13:43:43.522972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3072/5922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:43 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:44.533883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:44.535555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:44.544842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:44.545661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:44.546858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:44.549979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:44.790645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:44.807058 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7eb7dbc0-c421-435a-9b2c-7f3bf0ecbcec tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.280358 Jul 18 13:43:44.808870 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2851/5923] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:44 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:45.826640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:45.828355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:45.837686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:45.838141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:45.838967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:45.839443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:45.842779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:46.067784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:46.085170 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d967e76-b522-4f7f-8e1c-f46c0ce9bd8f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.259207 Jul 18 13:43:46.097375 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3073/5924] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:45 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:47.105393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:47.106476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:47.114486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=32 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:47.117103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:47.117664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:47.118643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:47.119351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:47.127722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:47.403691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:47.416444 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-927c85bd-a332-4c8f-9622-7e9e976d87e1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1695 microversion: 2.1 time: 0.315348 Jul 18 13:43:47.417287 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2852/5925] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:47 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1695 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:48.441024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:48.443288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:48.458227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:48.459338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:48.461166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:48.462185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:48.760806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:48.780349 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4a4a683-aa92-4bf8-981e-f67fced0eaf2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1694 microversion: 2.1 time: 0.346817 Jul 18 13:43:48.781967 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3074/5926] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:48 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1694 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:49.017018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-unplugged", "status": "completed", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:49.029646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:49.030505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:49.046769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] Creating event network-vif-unplugged:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h2-850003-3 Jul 18 13:43:49.054969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:43:49.077448 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c74a5a25-390f-4d04-99ab-80fc62c37409 req-7cf1b982-3458-4716-8b7c-9f086b2b45cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064141 Jul 18 13:43:49.078698 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2853/5927] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:49.801690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:49.803790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:49.817183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:49.818533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:49.819653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:49.835087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:50.198244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:50.236152 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be1c9a92-c725-41ff-94e9-544c5931c7dc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1694 microversion: 2.1 time: 0.440166 Jul 18 13:43:50.237135 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3075/5928] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:49 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1694 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:51.106630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:51.119343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:51.120074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:51.138340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] Creating event network-changed:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h2-850003-3 Jul 18 13:43:51.144967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:43:51.160932 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-00a5fe0b-9ae3-48af-8c5f-7a7ed67ab202 req-6023257e-1a6e-4a5f-abf5-c41577166a64 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068130 Jul 18 13:43:51.162043 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2854/5929] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:51.258430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:51.259060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:51.265767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=30 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:43:51.268440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:51.269329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:51.270530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:51.271778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:51.516941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:51.525266 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f2dedc4a-d2be-40c0-869a-d64ba3e7a427 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1692 microversion: 2.1 time: 0.272637 Jul 18 13:43:51.526297 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3076/5930] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:51 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:52.553838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:52.553838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:52.555764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:52.556351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:52.557531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:52.558368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:53.176721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:53.186740 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f44627f0-9282-4201-976a-1451ceab599b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1692 microversion: 2.1 time: 0.645159 Jul 18 13:43:53.188985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2855/5931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:52 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1692 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:54.209614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:54.211662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:54.229138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.229774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:54.232866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.234480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:54.460110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:54.469952 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72a1428c-2c72-4331-bef5-280b052f8fea tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1689 microversion: 2.1 time: 0.267454 Jul 18 13:43:54.481851 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3077/5932] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:54 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1689 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:54.487754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:54.489128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:54.496836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.497392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:54.498525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.499050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:54.665083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-35828149-c7cb-490e-8eaf-23d577e65094 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action" status: 202 len: 0 microversion: 2.1 time: 0.181233 Jul 18 13:43:54.666191 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2856/5933] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:43:54 2022] POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:43:54.741244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:54.741800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:54.812799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.814414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:54.815543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:54.816365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:55.181595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:55.195832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-84330a82-6c02-4c4d-8ee0-4b778484a6fa tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.517510 Jul 18 13:43:55.196863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3078/5934] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:54 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:56.226637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:56.228217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:56.239847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:56.240612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:56.241886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:56.242641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:56.325511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-307451304", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "884f42d9-2eff-4f6e-a2ff-62e6487260d1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:56.445225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:56.454628 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-14b8c46c-655e-480f-aec9-87a1410285e5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.240520 Jul 18 13:43:56.455576 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2857/5935] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:56 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:56.471184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:43:56.943534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-plugged", "status": "completed", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:43:56.969048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:56.971168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:57.004322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] Creating event network-vif-plugged:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h2-850003-3 Jul 18 13:43:57.012906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:43:57.028227 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3ddbe8b4-18a4-4201-80e8-18006162430d req-72f7b48d-793a-45b3-89a2-5150c3a9a83f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093104 Jul 18 13:43:57.029715 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2858/5936] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:43:57.347121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:43:57.348392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:43:57.349101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:43:57.349732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:43:57.350302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:43:57.365668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:57.367153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:57.368513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:57.369073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:57.402780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:43:57.414008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:43:57.434766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:43:57.436837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='884f42d9-2eff-4f6e-a2ff-62e6487260d1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:43:57.480072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:57.487886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:57.500410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:57.501231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:57.502648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:57.503396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:57.552381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-638e9888-fc83-4c24-ae5e-debc83b8cb72 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233169 Jul 18 13:43:57.558387 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3079/5937] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:43:57.566501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa91b907-d880-4f62-8f5b-76209b7e2071 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:57.567206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa91b907-d880-4f62-8f5b-76209b7e2071 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:57.661131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa91b907-d880-4f62-8f5b-76209b7e2071 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:57.678989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa91b907-d880-4f62-8f5b-76209b7e2071 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1056 microversion: 2.1 time: 0.116622 Jul 18 13:43:57.680873 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3080/5938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:57 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1056 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:43:57.882523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:57.899953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11b8630c-e6d7-4120-88b5-b5d97fbba704 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.430146 Jul 18 13:43:57.901481 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2859/5939] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:57 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:58.701360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:58.704390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:58.711437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:58.712181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:58.713974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:58.713974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:58.819654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:58.831448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e899be0c-cb64-4795-9334-528b203507dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1108 microversion: 2.1 time: 0.134004 Jul 18 13:43:58.832751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3081/5940] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:58 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1108 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:58.924328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:58.925413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:58.974660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:58.975865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:58.976861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:58.978498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:59.394280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:43:59.404093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c0607f0-3817-439a-94a2-cf6cfc5e9d82 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.487106 Jul 18 13:43:59.409719 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2860/5941] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:58 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:43:59.851662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:43:59.852489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:43:59.871986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:59.873654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:43:59.875752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:43:59.877073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:00.012768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:00.031056 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56dc50fb-9d77-4401-9d59-251200847c29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1126 microversion: 2.1 time: 0.183779 Jul 18 13:44:00.038977 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3082/5942] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:43:59 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1126 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:00.431038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:00.432264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:00.440639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:00.441387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:00.442998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:00.443783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:00.511632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-unplugged", "status": "completed", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:00.523582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:00.524319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:00.540301 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] Creating event network-vif-unplugged:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:44:00.547033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:44:00.569698 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0463fd91-0b41-4fde-96c9-74e1d957802d req-ec0155d8-affa-4cf6-9c0a-4c6ab00b48b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061352 Jul 18 13:44:00.571466 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3083/5943] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:44:00.927682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:00.950255 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2047558-0ea6-4728-a6b8-69047fb542b5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.523016 Jul 18 13:44:00.953115 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2861/5944] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:00 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:01.077871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:01.082776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:01.095138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:01.095894 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:01.096948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:01.097612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:01.455220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:01.464477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7a40d880-c4ea-43bd-901f-72acb9ce366f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.408679 Jul 18 13:44:01.472407 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3084/5945] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:01 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:01.973245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:01.973952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:01.987359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:01.987826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:01.988667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:01.989753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:02.403089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:02.414028 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf94597b-2d71-4a9d-ae93-1f46c819dd31 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.447929 Jul 18 13:44:02.426727 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2862/5946] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:01 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:02.489279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:02.489938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:02.504938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:02.507073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:02.513070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:02.513704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:02.616446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:02.657977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:02.660538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:02.696246 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] Creating event network-changed:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:44:02.723902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:44:02.787458 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-813fedcd-ef9c-4000-baa2-0a377b3f4477 req-1b502086-eac2-4e1a-9f5f-e3c86ec62dae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168061 Jul 18 13:44:02.795456 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2863/5947] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:44:02.903284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:02.917733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a90c6770-795f-489d-a866-9df2ee9e9d01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.433407 Jul 18 13:44:02.919628 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3085/5948] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:02 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:03.433661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:03.434984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:03.452979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:03.453465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:03.454401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:03.455562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:03.937813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:03.944676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:03.948347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:03.950111 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a49300e5-97c2-4e88-a886-e42e79816bc5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.520724 Jul 18 13:44:03.960491 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2864/5949] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:03 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:03.977020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:03.977516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:03.978378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:03.978826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:04.249803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:04.260592 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-96403a08-6f22-4ed4-9679-7bb7df107ad7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.328159 Jul 18 13:44:04.272907 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3086/5950] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:03 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:04.828401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c31dafb6-e5b3-45c4-8437-17a53e8a0cc0 req-78b6a99d-2a65-438f-992b-3b76b070c7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dba2d1-7268-4547-9b08-c78454f722f3", "tag": "12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:04.840205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c31dafb6-e5b3-45c4-8437-17a53e8a0cc0 req-78b6a99d-2a65-438f-992b-3b76b070c7c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:04.841166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c31dafb6-e5b3-45c4-8437-17a53e8a0cc0 req-78b6a99d-2a65-438f-992b-3b76b070c7c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:04.862314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c31dafb6-e5b3-45c4-8437-17a53e8a0cc0 req-78b6a99d-2a65-438f-992b-3b76b070c7c0 service nova] Creating event network-changed:12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0 for instance f1dba2d1-7268-4547-9b08-c78454f722f3 on n-h2-850003-3 Jul 18 13:44:04.869066 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c31dafb6-e5b3-45c4-8437-17a53e8a0cc0 req-78b6a99d-2a65-438f-992b-3b76b070c7c0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044760 Jul 18 13:44:04.870732 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2865/5951] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:04.974945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:04.976850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:04.993254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:04.993715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:04.994690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:04.995004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:05.252809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:05.261455 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07e1c163-9c96-403e-a3ca-55b887b742dd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1688 microversion: 2.1 time: 0.293890 Jul 18 13:44:05.262753 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3087/5952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:04 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1688 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:05.295445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:05.296960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:05.317641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:05.318929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:05.320303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:05.321066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:05.673517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:05.692689 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f414f17e-24be-47c0-abd9-af6d4bb4f644 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.415488 Jul 18 13:44:05.693863 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2866/5953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:05 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:06.618969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:06.620060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:06.641043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:06.642656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:06.643588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:06.645560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:06.726624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:06.728011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:06.740242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:06.740242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:06.743486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:06.743486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:06.929371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:06.940857 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-01904cba-e7af-442e-9534-e7772a64179e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1681 microversion: 2.1 time: 0.646164 Jul 18 13:44:06.946663 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3088/5954] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:06 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1681 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:07.124564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:07.135535 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-23249f0f-143d-429b-939e-9cee690ecb38 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.419649 Jul 18 13:44:07.136683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2867/5955] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:06 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:08.161360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:08.162663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:08.166279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:08.168102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:08.174238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:08.174899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:08.175908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:08.176594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:08.452159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:08.469294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-446a3a6b-a84c-4cd4-9f1f-83ad8663d863 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.313641 Jul 18 13:44:08.479374 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3089/5956] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:08 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:08.587862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6ee0a61f-ef99-4979-a6db-18eb863e33b4 req-93eacd8f-495a-40c4-8dd3-b9b01dcbdf8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-plugged", "status": "completed", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:08.610669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6ee0a61f-ef99-4979-a6db-18eb863e33b4 req-93eacd8f-495a-40c4-8dd3-b9b01dcbdf8a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:08.611150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6ee0a61f-ef99-4979-a6db-18eb863e33b4 req-93eacd8f-495a-40c4-8dd3-b9b01dcbdf8a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:08.636348 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6ee0a61f-ef99-4979-a6db-18eb863e33b4 req-93eacd8f-495a-40c4-8dd3-b9b01dcbdf8a service nova] Creating event network-vif-plugged:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:44:08.660314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6ee0a61f-ef99-4979-a6db-18eb863e33b4 req-93eacd8f-495a-40c4-8dd3-b9b01dcbdf8a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079459 Jul 18 13:44:08.661705 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2868/5957] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:09.495499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:09.496834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:09.507178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:09.507368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:09.508502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:09.509343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:09.670729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:09.679951 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2449f5ac-fffe-49ed-80a5-b4154cc72526 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.192779 Jul 18 13:44:09.680813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3090/5958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:09 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:10.704742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:10.706555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:10.717207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:10.717920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:10.718912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:10.719621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:10.745572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:10.887862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:10.895677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c522be9-3126-467a-8883-9df7a34919ac tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.202168 Jul 18 13:44:10.896274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2869/5959] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:10 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:11.913268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:11.913880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:11.923965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:11.924423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:11.925241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:11.925711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:12.073673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:12.076463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:12.084801 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc439154-c4dc-49d3-9bb9-5e3cef36981d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.175534 Jul 18 13:44:12.085643 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3091/5960] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:11 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:13.103062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:13.103809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:13.111914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:13.112365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:13.113317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:13.113795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:13.273379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:13.281512 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57cd6f3d-a185-48d0-852e-a1d96e37c675 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.182395 Jul 18 13:44:13.282313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2870/5961] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:13 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:14.299243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:14.299861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:14.309140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:14.309594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:14.310877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:14.311317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:14.479689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:14.488203 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-849f43ca-e8a7-48de-9e31-df57a4cb7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.193048 Jul 18 13:44:14.490195 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3092/5962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:14 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:15.505334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:15.505928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:15.516486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:15.516486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:15.516486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:15.516486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:15.676183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:15.685177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-713bb0d2-368e-4ee3-9876-0f89524a65cc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.183994 Jul 18 13:44:15.685771 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2871/5963] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:15 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:16.704850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:16.705526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:16.713264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:16.713728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:16.714568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:16.714969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:16.865955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:16.874651 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca59998a-e982-46c4-8dbd-c1bf73f58ec4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1168 microversion: 2.1 time: 0.175827 Jul 18 13:44:16.875731 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3093/5964] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:16 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:17.892412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:17.893091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:17.895962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=44 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:17.904313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:17.905032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:17.906010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:17.906813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:18.082508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:18.090749 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-14a0ebe8-4026-42bc-a899-148c69ebf852 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.202935 Jul 18 13:44:18.091271 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2872/5965] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:17 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:19.113665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:19.114829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:19.131877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:19.132348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:19.133376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:19.133826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:19.293182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:19.301526 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e38635f-eb34-46b0-9677-eb83e8a44652 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.195110 Jul 18 13:44:19.302116 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3094/5966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:19 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:20.318720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:20.319376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:20.328855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:20.328855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:20.328855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:20.336612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:20.476260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:20.484509 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10e27742-2a1e-4127-8352-ba5978b554a1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.169845 Jul 18 13:44:20.485396 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2873/5967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:20 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:21.502718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:21.503400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:21.507213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:21.514597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:21.515701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:21.516395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:21.516855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:21.666291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:21.675417 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff041da2-492f-47de-a08e-81afedb2d984 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.177889 Jul 18 13:44:21.676050 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3095/5968] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:21 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:22.693156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:22.693774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:22.700923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:22.701372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:22.702174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:22.702615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:22.851801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:22.861172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0abdf19a-ed12-4633-a0b9-6590bd20a1b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.171709 Jul 18 13:44:22.861774 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2874/5969] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:22 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:23.880563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:23.881230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:23.888852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:23.889311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:23.890106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:23.890649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:24.041607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:24.052792 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-556d5ff2-988d-4f51-95be-8f98c1cbd427 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.176422 Jul 18 13:44:24.053511 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3096/5970] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:23 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:25.074636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:25.075345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:25.082380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:25.082841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:25.083624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:25.084066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:25.219822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:25.227611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e43c8abc-585e-4e13-be16-5245ad799dcc tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.160768 Jul 18 13:44:25.228198 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2875/5971] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:25 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:26.244643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:26.245522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:26.253278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:26.253847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:26.254767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:26.255203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:26.401042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:26.409882 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb7379af-116b-44d3-982d-00e8677eea0c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.169093 Jul 18 13:44:26.410524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3097/5972] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:26 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:27.430445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:27.431476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:27.439883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:27.440592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:27.441765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:27.442241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:27.635157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:27.649669 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cdba793-a02b-4923-9db9-eef8ec47e3b1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.225251 Jul 18 13:44:27.650857 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2876/5973] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:27 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:44:28.671125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:28.671850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:28.678990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:28.679445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:28.680226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:28.680667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:28.821500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:28.830103 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4111a6dc-499e-482e-beeb-f88bbe603387 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.162864 Jul 18 13:44:28.831146 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3098/5974] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:28 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:28.984636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a78fffee-94cb-443d-9d0a-c3a368928486 req-fddc1df0-b417-4c2f-a2c4-f9ded996743a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1dba2d1-7268-4547-9b08-c78454f722f3", "name": "network-vif-plugged", "status": "completed", "tag": "12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:28.995178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a78fffee-94cb-443d-9d0a-c3a368928486 req-fddc1df0-b417-4c2f-a2c4-f9ded996743a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:28.995883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a78fffee-94cb-443d-9d0a-c3a368928486 req-fddc1df0-b417-4c2f-a2c4-f9ded996743a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:29.009086 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a78fffee-94cb-443d-9d0a-c3a368928486 req-fddc1df0-b417-4c2f-a2c4-f9ded996743a service nova] Creating event network-vif-plugged:12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0 for instance f1dba2d1-7268-4547-9b08-c78454f722f3 on n-h2-850003-3 Jul 18 13:44:29.014493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a78fffee-94cb-443d-9d0a-c3a368928486 req-fddc1df0-b417-4c2f-a2c4-f9ded996743a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Jul 18 13:44:29.015199 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2877/5975] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:29.848741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:29.849386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:29.857009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:29.857466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:29.858290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:29.858738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:30.006691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:30.014829 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ccc56254-5439-4b5d-b80c-5d5e871d3f5f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1202 microversion: 2.1 time: 0.169964 Jul 18 13:44:30.015925 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3099/5976] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:29 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:31.038519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:31.040148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:31.056784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.057549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.059484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.059484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.268046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:31.277522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2e85ed96-eda1-45f8-83fa-7c6a9b0d1067 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1390 microversion: 2.1 time: 0.245466 Jul 18 13:44:31.278141 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2878/5977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:31 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:31.300963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:31.302334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:31.314520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.315333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.316712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.317637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.499539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:31.516307 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a43a17ee-9af7-4f82-9a5b-463ebe1460c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1390 microversion: 2.1 time: 0.222254 Jul 18 13:44:31.516550 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3100/5978] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:31 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:31.537902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:31.538930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:31.547343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.547885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.548841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.550422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.735049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:31.746032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb031ff7-4378-425c-b31b-2dc518d365ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1390 microversion: 2.1 time: 0.214116 Jul 18 13:44:31.747521 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2879/5979] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:31 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1390 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:31.879604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:31.880297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:31.889040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.889444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.890229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:31.890771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:31.924519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:44:32.083732 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6666ee02-5c61-4b0e-919d-f245a984977f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 204 len: 0 microversion: 2.1 time: 0.211693 Jul 18 13:44:32.090628 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3101/5980] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:44:31 2022] DELETE /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:44:32.097740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:32.098626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:32.107614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:32.109380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:32.110588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:32.111210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:32.316732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:32.326495 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bb961601-dd85-409a-baac-f5c4f06b9b0a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1396 microversion: 2.1 time: 0.234225 Jul 18 13:44:32.338331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2880/5981] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:32 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1396 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:33.364206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:33.365875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:33.377619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:33.377619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:33.379424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:33.379424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:33.617198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:33.631492 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e84f5f9d-0a4a-49c7-85af-b355c6a7b3dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1396 microversion: 2.1 time: 0.281163 Jul 18 13:44:33.632853 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3102/5982] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:33 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1396 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:34.667625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:34.669248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:34.678466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.679302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.680430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.681005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.706009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:34.707465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:34.720433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.721460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.722667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.723415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.751945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eab9712c-0251-4ffb-a24e-4538315595ed tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/ips" status: 200 len: 148 microversion: 2.1 time: 0.050070 Jul 18 13:44:34.753265 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3103/5983] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:44:34 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:34.764658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa43930e-0054-4c5e-9c41-c41a8704a606"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:34.766427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:34.774301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.775140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.776340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.777036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.889937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/os-volume_attachments HTTP/1.1 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 74 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: {"volumeAttachment": {"volumeId": "aa43930e-0054-4c5e-9c41-c41a8704a606"}} Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '671589ea-d2e7-4b6c-b08f-7d66c9549ec3', 'body': {'volumeAttachment': {'volumeId': 'aa43930e-0054-4c5e-9c41-c41a8704a606'}}} Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:44:34.903180 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 Jul 18 13:44:34.909420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:34.929042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:34.929721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 400 to user: Invalid volume: volume aa43930e-0054-4c5e-9c41-c41a8704a606 is already attached to instances: 89755eec-6d0b-4f25-a677-d0be315e96c8 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:34.930772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e1f7d07d-6faf-44a6-adeb-bacd9d372639 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170456 Jul 18 13:44:34.939160 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3104/5984] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:44:34 2022] POST /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3/os-volume_attachments => generated 174 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 13:44:34.947080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:34.948483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:34.949812 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a8516af0-483a-4aec-8190-3f699322e722 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1396 microversion: 2.1 time: 0.295922 Jul 18 13:44:34.950189 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2881/5985] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:34 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1396 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:34.960200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.961436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:34.963003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:34.963448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:35.012855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9ae842ec-e190-438d-9413-97506e7bd557 req-43b038c0-1165-451a-abb7-9409462abb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1dba2d1-7268-4547-9b08-c78454f722f3", "name": "network-vif-deleted", "tag": "12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:35.026714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9ae842ec-e190-438d-9413-97506e7bd557 req-43b038c0-1165-451a-abb7-9409462abb73 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:35.027595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9ae842ec-e190-438d-9413-97506e7bd557 req-43b038c0-1165-451a-abb7-9409462abb73 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:35.041411 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9ae842ec-e190-438d-9413-97506e7bd557 req-43b038c0-1165-451a-abb7-9409462abb73 service nova] Creating event network-vif-deleted:12a3090f-c8f3-4c63-8c37-90f9bbe1b5b0 for instance f1dba2d1-7268-4547-9b08-c78454f722f3 on n-h2-850003-3 Jul 18 13:44:35.061983 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9ae842ec-e190-438d-9413-97506e7bd557 req-43b038c0-1165-451a-abb7-9409462abb73 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044784 Jul 18 13:44:35.061983 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2882/5986] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:35.072421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:44:35.179384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:35.294579 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-189db024-afa5-467a-a6ba-a65beecce9a9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 204 len: 0 microversion: 2.1 time: 0.345749 Jul 18 13:44:35.300519 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3105/5987] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:44:34 2022] DELETE /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:44:35.309466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:35.310343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:35.318015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:35.318777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:35.319768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:35.320213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:35.529871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:35.540129 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5204f46d-3dad-4224-8392-c4433564229e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1679 microversion: 2.1 time: 0.234985 Jul 18 13:44:35.541571 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2883/5988] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:35 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:35.973364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:35.975395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:35.990140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:35.990954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:35.992460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:35.993400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:36.088416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:36.098891 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6390c7c2-ab46-43a6-abc6-0fea4e47d42b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1187 microversion: 2.1 time: 0.133416 Jul 18 13:44:36.100122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3106/5989] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:35 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1187 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:36.559753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:36.560365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:36.569088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:36.569629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:36.570538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:36.571051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:36.735209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:36.747742 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7bbff25-b134-489b-b02f-84d774a82072 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1679 microversion: 2.1 time: 0.192199 Jul 18 13:44:36.749194 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2884/5990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:36 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:37.118786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:37.121093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:37.135519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:37.136999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:37.139062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:37.139973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:37.232645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:37.246076 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ac97f16-a3b8-4a21-ab61-3f487edcde78 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1187 microversion: 2.1 time: 0.133408 Jul 18 13:44:37.256602 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3107/5991] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:37 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:37.767052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:37.767658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:37.775791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:37.776671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:37.777861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:37.778581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:37.873019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:37.884449 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-67bb6a26-257a-4e66-959d-eda75e8d9b99 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 200 len: 1611 microversion: 2.1 time: 0.121372 Jul 18 13:44:37.885068 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2885/5992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:37 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 1611 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:38.142245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-03e90f9a-24e5-47e8-9f0c-7d8de625f6d4 req-0edda7a1-e4c0-4ee8-9ad3-96396579e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671589ea-d2e7-4b6c-b08f-7d66c9549ec3", "name": "network-vif-deleted", "tag": "bf24261f-0427-4652-9450-cd97ad42e5db"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:38.173814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-03e90f9a-24e5-47e8-9f0c-7d8de625f6d4 req-0edda7a1-e4c0-4ee8-9ad3-96396579e83f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:38.174522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-03e90f9a-24e5-47e8-9f0c-7d8de625f6d4 req-0edda7a1-e4c0-4ee8-9ad3-96396579e83f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:38.193913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-03e90f9a-24e5-47e8-9f0c-7d8de625f6d4 req-0edda7a1-e4c0-4ee8-9ad3-96396579e83f service nova] Creating event network-vif-deleted:bf24261f-0427-4652-9450-cd97ad42e5db for instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 on n-h1-850003-3 Jul 18 13:44:38.224049 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-03e90f9a-24e5-47e8-9f0c-7d8de625f6d4 req-0edda7a1-e4c0-4ee8-9ad3-96396579e83f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089887 Jul 18 13:44:38.224849 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3108/5993] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:38.263693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:38.264315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:38.271488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:38.271866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:38.272650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:38.273090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:38.363429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:38.371382 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3ef28b0-97f5-4936-8cd2-4a0fe2a69cf2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1187 microversion: 2.1 time: 0.111538 Jul 18 13:44:38.371983 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2886/5994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:38 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:38.903709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:38.904518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:38.911692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:38.912508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:38.913299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:38.913734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:38.934337 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 HTTP/1.1 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '671589ea-d2e7-4b6c-b08f-7d66c9549ec3'} Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:38.936377 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:44:38.942851 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:38.945549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:38.946803 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bf469d6a-28c7-424e-8471-ea2e2882d657 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 404 len: 111 microversion: 2.1 time: 0.048038 Jul 18 13:44:38.949110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3109/5995] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:38 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:44:38.956768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e4e16c37-27cb-48de-81cc-b91f70fa5b66 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '.version_select at 0x7f96d7300700>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:38.980879 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e4e16c37-27cb-48de-81cc-b91f70fa5b66 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441914327" status: 202 len: 0 microversion: 2.1 time: 0.028462 Jul 18 13:44:38.982975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2887/5996] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:44:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441914327 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:44:39.389922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:39.391777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:39.400611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:39.401436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:39.402464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:39.402962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:39.528992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:39.537372 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5108934b-f778-42ef-af8a-2a9b49ad2931 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1187 microversion: 2.1 time: 0.152080 Jul 18 13:44:39.538286 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3110/5997] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:39 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:39.851474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:39.851976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:39.859563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:39.860159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:39.861199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:39.861606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:39.881563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:39.951967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lazy-loading 'services' on Instance uuid 89755eec-6d0b-4f25-a677-d0be315e96c8 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:44:40.030349 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed168d75-bf77-4721-b446-745b9e6f1427 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments/aa43930e-0054-4c5e-9c41-c41a8704a606" status: 202 len: 0 microversion: 2.1 time: 0.182792 Jul 18 13:44:40.031348 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2888/5998] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:44:39 2022] DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments/aa43930e-0054-4c5e-9c41-c41a8704a606 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:44:40.040503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:40.041697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:40.049483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:40.050044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:40.051301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:40.053699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:40.127081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f1cd6b9-7818-43e4-a827-073d2d5df9bf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090722 Jul 18 13:44:40.128478 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3111/5999] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:40 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:44:40.558337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:40.559286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:40.566289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:40.567005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:40.567877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:40.568397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:40.603051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:40.603503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:40.603964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lazy-loading 'fault' on Instance uuid f1dba2d1-7268-4547-9b08-c78454f722f3 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:44:40.652128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:40.660542 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45a65b99-a254-473d-8715-5300cc6bf1bb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 200 len: 1192 microversion: 2.1 time: 0.109643 Jul 18 13:44:40.661138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2889/6000] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:40 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:41.140015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:41.141933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:41.149586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.150287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.151334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.151988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.186945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8747a37-f3b1-4be4-9220-4e4d7ff2fc54 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050841 Jul 18 13:44:41.188645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3112/6001] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:41 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:41.356777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:41.358767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:41.368500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.368954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.369777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.370305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.436922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-491c0b3b-d290-449a-a617-da9e34666064 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action" status: 200 len: 62909 microversion: 2.1 time: 0.084167 Jul 18 13:44:41.446889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2890/6002] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:44:41 2022] POST /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64/action => generated 62909 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:44:41.678837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:41.679698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:41.686059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.686849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.688627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:41.689257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:41.708161 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 HTTP/1.1 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'f1dba2d1-7268-4547-9b08-c78454f722f3'} Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:41.710241 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:41.714809 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:41.716091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:41.717109 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d39ee9cc-320e-40da-ada1-3c87929bf6c7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 404 len: 111 microversion: 2.1 time: 0.042498 Jul 18 13:44:41.722277 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3113/6003] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:41 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:44:42.200424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:42.201816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:42.210322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:42.210984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:42.211847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:42.212371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:42.276647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e9fcefa-4f0f-43e8-8e21-81ea15e9672e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080822 Jul 18 13:44:42.278313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2891/6004] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:42 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:43.291124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:43.293089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:43.301955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:43.302823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:43.303811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:43.304428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:43.342775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d4fb81f-e057-4656-bc65-2234f06397cb tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056741 Jul 18 13:44:43.344446 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3114/6005] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:43 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:43.947543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:43.948643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:43.957306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:43.957986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:43.958967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:43.959565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:43.975829 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 HTTP/1.1 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'f1dba2d1-7268-4547-9b08-c78454f722f3'} Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:44:43.978067 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:43.982702 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:44:43.984729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:43.985760 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9cf0316-5d4b-46d9-b615-5e5b4b075bcd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 404 len: 111 microversion: 2.1 time: 0.042277 Jul 18 13:44:43.995082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:43.995966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: f1dba2d1-7268-4547-9b08-c78454f722f3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:44.009180 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2892/6006] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:44:43 2022] DELETE /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:44:44.011787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:44.012437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:44.013397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:44.013998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:44.030112 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 HTTP/1.1 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'f1dba2d1-7268-4547-9b08-c78454f722f3'} Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:44.032737 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. Jul 18 13:44:44.037785 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:44.039253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance f1dba2d1-7268-4547-9b08-c78454f722f3 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:44.040469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abd0ad87-305e-4bbe-803e-7bae7ee12fab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3" status: 404 len: 111 microversion: 2.1 time: 0.049339 Jul 18 13:44:44.044633 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3115/6007] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:43 2022] GET /compute/v2.1/servers/f1dba2d1-7268-4547-9b08-c78454f722f3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:44:44.355590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:44.356808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:44.372555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:44.373288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:44.374340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:44.375522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:44.442857 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b0fcfb9-48e0-49a2-ab54-29d52e948a80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089985 Jul 18 13:44:44.451952 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2893/6008] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:44 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:45.462626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:45.463696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:45.472719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:45.479010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:45.480166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:45.480680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:45.524510 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6668850-0d40-42d5-a379-f87cb8f92e80 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066359 Jul 18 13:44:45.525382 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3116/6009] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:45 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:44:46.537289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:46.538364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:46.545962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:46.546438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:46.547437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:46.547893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:46.845425 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b61d66dd-2e63-4ac9-bc76-b2fe7e8aeb2f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.312083 Jul 18 13:44:46.851757 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2894/6010] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:44:46 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8/os-volume_attachments => generated 25 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:44:46.926821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:46.927546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:46.934482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:46.935153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:46.936086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:46.936686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:46.965707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:44:47.064567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60f538ba-cb47-4da3-8f45-7baceb7fa3ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 204 len: 0 microversion: 2.1 time: 0.141592 Jul 18 13:44:47.068686 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3117/6011] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:44:46 2022] DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:44:47.073983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:47.074609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:47.081335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:47.082011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:47.083034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:47.083426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:47.298246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:47.310281 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64b67efb-98b4-419a-ba9b-777b98dae8e7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1680 microversion: 2.1 time: 0.240157 Jul 18 13:44:47.311482 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2895/6012] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:47 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:48.334748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:48.336305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:48.343347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:48.344149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:48.345160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:48.346027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:48.566094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:48.575416 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a3ee40d-c81c-4da8-ac72-ab79f5f9900c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1680 microversion: 2.1 time: 0.245279 Jul 18 13:44:48.576473 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3118/6013] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:48 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:49.607657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:49.608617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:49.657578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:49.659824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:49.660282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:49.661078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:49.661522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:50.179265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:50.191632 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-060cc8db-5c27-4324-9625-312d4c624acf tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1613 microversion: 2.1 time: 0.596616 Jul 18 13:44:50.206859 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2896/6014] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:49 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1613 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:50.467476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b5b54ae1-10ca-424d-bbbd-041c828dcf97 req-b93e5d18-8418-428d-9dbd-f203799ebd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89755eec-6d0b-4f25-a677-d0be315e96c8", "name": "network-vif-deleted", "tag": "0a86427c-e831-4410-9b7c-0d13a1e99ca3"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:50.522077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b5b54ae1-10ca-424d-bbbd-041c828dcf97 req-b93e5d18-8418-428d-9dbd-f203799ebd3e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:50.527501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b5b54ae1-10ca-424d-bbbd-041c828dcf97 req-b93e5d18-8418-428d-9dbd-f203799ebd3e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:50.564187 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b5b54ae1-10ca-424d-bbbd-041c828dcf97 req-b93e5d18-8418-428d-9dbd-f203799ebd3e service nova] Creating event network-vif-deleted:0a86427c-e831-4410-9b7c-0d13a1e99ca3 for instance 89755eec-6d0b-4f25-a677-d0be315e96c8 on n-h2-850003-3 Jul 18 13:44:50.584175 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b5b54ae1-10ca-424d-bbbd-041c828dcf97 req-b93e5d18-8418-428d-9dbd-f203799ebd3e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121436 Jul 18 13:44:50.585181 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3119/6015] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:51.209497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:51.210119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:51.220065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:51.220852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:51.222381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:51.223036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:51.260749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:51.263070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:51.263940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lazy-loading 'fault' on Instance uuid 89755eec-6d0b-4f25-a677-d0be315e96c8 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:44:51.321540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:51.332354 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52271a6d-35ef-42a4-bae0-fb05866d0a9a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 200 len: 1331 microversion: 2.1 time: 0.126850 Jul 18 13:44:51.339085 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2897/6016] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:51 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:52.357142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:52.358243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:52.361661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:44:52.367810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:52.368494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:52.369412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:52.369959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:52.387564 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 HTTP/1.1 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '89755eec-6d0b-4f25-a677-d0be315e96c8'} Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:44:52.389240 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b46b975-fe53-4577-b701-f7b6fc7c1d38 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 404 len: 111 microversion: 2.1 time: 0.038579 Jul 18 13:44:52.393634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3120/6017] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:52 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:44:52.400525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bff0c860-898f-4a95-8f33-2879be9e79ac tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '.version_select at 0x7f96d72910d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:52.424256 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bff0c860-898f-4a95-8f33-2879be9e79ac tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769122304" status: 202 len: 0 microversion: 2.1 time: 0.027532 Jul 18 13:44:52.425376 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2898/6018] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769122304 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:44:53.172076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f71e098-b458-4c3e-a6f4-86d50b3c89b3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: .version_select at 0x7f96d72d3430>, body: {"keypair": {"name": "tempest-keypair-1578195097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjD2ssrH9aebt+FZD+HNYpetRKPdK7mtwk6NisZk/S1JuX0HfLWW6iUic/BLYIqAVMaUhyCmD3y6KSaFQLlwqL3HkIw1/n+gS5Bwq96xJ1MtFjH2sXth3MFnRGxAydu5w=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:53.188055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-9f71e098-b458-4c3e-a6f4-86d50b3c89b3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:44:53.198065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-9f71e098-b458-4c3e-a6f4-86d50b3c89b3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:44:53.228730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f71e098-b458-4c3e-a6f4-86d50b3c89b3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061430 Jul 18 13:44:53.229370 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3121/6019] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:44:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:54.708364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-413344921", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2112c8d0-f5a5-4e18-8577-541bfd3a1558"}], "security_groups": [{"name": "tempest-securitygroup--307663208"}], "key_name": "tempest-keypair-1578195097", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:54.822970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] validate_networks() for [('2112c8d0-f5a5-4e18-8577-541bfd3a1558', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:44:55.398021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:44:55.398483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:44:55.399390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:44:55.399818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:44:55.400234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:44:55.414036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:55.414611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:55.415519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:55.415960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:55.434380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:44:55.440768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:44:55.454465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:44:55.456729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:44:55.504802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6b741c54-2269-43e0-8161-0d618a9d2609 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.802403 Jul 18 13:44:55.516708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-411af9d6-8c89-4556-815d-8f7f5656443a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:55.517333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-411af9d6-8c89-4556-815d-8f7f5656443a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:55.521321 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2899/6020] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:44:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:44:55.598137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411af9d6-8c89-4556-815d-8f7f5656443a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:55.607569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-411af9d6-8c89-4556-815d-8f7f5656443a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1241 microversion: 2.1 time: 0.095655 Jul 18 13:44:55.609011 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3122/6021] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:55 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:56.626297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:56.627326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:56.641788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:56.648352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:56.649249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:56.649693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:56.777677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:56.787475 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec8a6b36-b61b-40ed-a0fb-291ec65813be tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1301 microversion: 2.1 time: 0.165669 Jul 18 13:44:56.788536 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2900/6022] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:56 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1301 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:57.806794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:57.807417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:57.817580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:57.817580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:57.818396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:57.818829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:58.049278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:58.063048 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-540e9b39-aeeb-4c2c-acea-70826f8c26cc tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.258719 Jul 18 13:44:58.063992 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3123/6023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:57 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:44:59.081291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:44:59.081927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:44:59.096609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:59.097078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:59.097888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:59.099808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:59.460097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ca62b280-dc43-4181-98a9-4efe7163b98b req-6bdd0e65-3388-4b45-9e11-125ac168de25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00d48be-9174-403d-baec-08ac32114865", "tag": "46e5abb9-3366-4b84-973a-7ffbb63ce68c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:44:59.485635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ca62b280-dc43-4181-98a9-4efe7163b98b req-6bdd0e65-3388-4b45-9e11-125ac168de25 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:44:59.486352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ca62b280-dc43-4181-98a9-4efe7163b98b req-6bdd0e65-3388-4b45-9e11-125ac168de25 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:44:59.529420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ca62b280-dc43-4181-98a9-4efe7163b98b req-6bdd0e65-3388-4b45-9e11-125ac168de25 service nova] Creating event network-changed:46e5abb9-3366-4b84-973a-7ffbb63ce68c for instance b00d48be-9174-403d-baec-08ac32114865 on n-h2-850003-3 Jul 18 13:44:59.542506 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ca62b280-dc43-4181-98a9-4efe7163b98b req-6bdd0e65-3388-4b45-9e11-125ac168de25 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089992 Jul 18 13:44:59.545768 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3124/6024] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:44:59.643542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:44:59.658574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fdcea014-d44a-4420-aa36-232853f2737f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.581204 Jul 18 13:44:59.663594 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2901/6025] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:44:59 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:00.687140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:00.691423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:00.706627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:00.707656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:00.708854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:00.709645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:00.942247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:00.955365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-422a5e5d-3fc2-4ced-af63-ae7661750be6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.278548 Jul 18 13:45:00.956122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3125/6026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:00 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:01.973112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:01.973838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:01.983283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:01.983663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:01.984481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:01.984930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:02.136505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:02.145788 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4a3c2c7-ef75-45ab-a1fc-0777ca80f386 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.176515 Jul 18 13:45:02.154494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2902/6027] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:01 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:03.164017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:03.164631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:03.174299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:03.175114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:03.176380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:03.177379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:03.430706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:03.439628 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-45c3afaf-2a07-4a99-83f6-d90324cf9ffe tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.280242 Jul 18 13:45:03.440244 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3126/6028] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:03 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:04.395414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:04.396262 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:04.403957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:04.404530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:04.405946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:04.406557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:04.456923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:04.457532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:04.468603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:04.469056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:04.469831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:04.470288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:04.473411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:04.579769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57ae14dd-240f-41b7-a45f-883a168cc1d1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1832 microversion: 2.1 time: 0.459435 Jul 18 13:45:04.581359 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2903/6029] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:04 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1832 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:04.629869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:04.638354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5c037ef3-4ae1-4769-8295-971e57cc248b tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.186128 Jul 18 13:45:04.641155 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3127/6030] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:04 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:05.316493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-4480d23c-a25c-4cbf-b124-506446eb9d8c req-7e696232-21f1-4a3e-94b8-27af1040916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00d48be-9174-403d-baec-08ac32114865", "name": "network-vif-plugged", "status": "completed", "tag": "46e5abb9-3366-4b84-973a-7ffbb63ce68c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:05.340186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4480d23c-a25c-4cbf-b124-506446eb9d8c req-7e696232-21f1-4a3e-94b8-27af1040916c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:05.340625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-4480d23c-a25c-4cbf-b124-506446eb9d8c req-7e696232-21f1-4a3e-94b8-27af1040916c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:05.352525 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-4480d23c-a25c-4cbf-b124-506446eb9d8c req-7e696232-21f1-4a3e-94b8-27af1040916c service nova] Creating event network-vif-plugged:46e5abb9-3366-4b84-973a-7ffbb63ce68c for instance b00d48be-9174-403d-baec-08ac32114865 on n-h2-850003-3 Jul 18 13:45:05.379898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-4480d23c-a25c-4cbf-b124-506446eb9d8c req-7e696232-21f1-4a3e-94b8-27af1040916c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067596 Jul 18 13:45:05.384593 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2904/6031] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:05.661127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:05.663714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:05.669007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:05.678089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:05.679534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:05.680902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:05.683865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:05.968485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:05.981504 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b21d223-d4f8-4fa5-8c58-e77cb089a331 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1366 microversion: 2.1 time: 0.325191 Jul 18 13:45:05.993059 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3128/6032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:05 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:06.171076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:06.171856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:06.176700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:06.177718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a4b0cfbc-19c7-4e06-ba8c-964a4aa938b1 req-297b5b9f-38e6-47fd-94ee-5d4ed10fbb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:06.178336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:06.189420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a4b0cfbc-19c7-4e06-ba8c-964a4aa938b1 req-297b5b9f-38e6-47fd-94ee-5d4ed10fbb0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:06.189783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a4b0cfbc-19c7-4e06-ba8c-964a4aa938b1 req-297b5b9f-38e6-47fd-94ee-5d4ed10fbb0e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:06.195085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:06.197919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:06.199327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:06.204184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:06.205624 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a4b0cfbc-19c7-4e06-ba8c-964a4aa938b1 req-297b5b9f-38e6-47fd-94ee-5d4ed10fbb0e service nova] Creating event network-changed:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:45:06.222586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a4b0cfbc-19c7-4e06-ba8c-964a4aa938b1 req-297b5b9f-38e6-47fd-94ee-5d4ed10fbb0e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048645 Jul 18 13:45:06.223225 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3129/6033] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:45:06.263976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:45:06.353877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:06.496456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fc675931-4b9f-4b53-b94b-2261b9294e0a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 204 len: 0 microversion: 2.1 time: 0.325588 Jul 18 13:45:06.501597 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2905/6034] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:45:06 2022] DELETE /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:45:06.515158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:06.517351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:06.542424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:06.543504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:06.544531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:06.545159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:06.753136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:06.768627 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71e3d802-3d6c-4824-b629-7ccf4b19527d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1687 microversion: 2.1 time: 0.261169 Jul 18 13:45:06.769880 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3130/6035] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:06 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:07.002067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:07.002816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:07.014387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.016088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:07.016936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.017387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:07.249942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:07.260875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc7ab043-fdca-4994-9212-e7b40c7fd98f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1556 microversion: 2.1 time: 0.264700 Jul 18 13:45:07.262107 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2906/6036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:06 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:07.278965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:07.279697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:07.288017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.288743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:07.289701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.290333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:07.389212 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c62147d-d5e1-4a27-b4f9-39f0ae6f1958 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114589 Jul 18 13:45:07.390841 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3131/6037] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:45:07 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:07.789386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:07.790435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:07.800962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.805629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:07.806756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:07.812639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:08.263112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:08.271488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-53f628f0-9346-4ad8-a233-4d72f205e84a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1687 microversion: 2.1 time: 0.486542 Jul 18 13:45:08.272679 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2907/6038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:07 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1687 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:08.947543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4f663370-73b0-451e-b9b0-57911800fe1a req-8ac51870-bf04-4873-84a3-2ab7e58ca266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e691aa1-122e-46ed-ab0f-238230b76c64", "name": "network-vif-deleted", "tag": "21e5ad96-6fad-4bed-93c8-8d1626c42158"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:08.960630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4f663370-73b0-451e-b9b0-57911800fe1a req-8ac51870-bf04-4873-84a3-2ab7e58ca266 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:08.961334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4f663370-73b0-451e-b9b0-57911800fe1a req-8ac51870-bf04-4873-84a3-2ab7e58ca266 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:08.979626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4f663370-73b0-451e-b9b0-57911800fe1a req-8ac51870-bf04-4873-84a3-2ab7e58ca266 service nova] Creating event network-vif-deleted:21e5ad96-6fad-4bed-93c8-8d1626c42158 for instance 5e691aa1-122e-46ed-ab0f-238230b76c64 on n-h1-850003-3 Jul 18 13:45:08.992132 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4f663370-73b0-451e-b9b0-57911800fe1a req-8ac51870-bf04-4873-84a3-2ab7e58ca266 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298415 Jul 18 13:45:08.996256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3132/6039] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:09.292288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:09.293019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:09.307659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:09.308447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:09.309549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:09.310535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:09.354698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:09.355641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:09.356436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lazy-loading 'fault' on Instance uuid 5e691aa1-122e-46ed-ab0f-238230b76c64 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:45:09.449758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:09.457604 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d65dcbe-9184-4a73-ae27-34322c8f51d2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 200 len: 1357 microversion: 2.1 time: 0.170779 Jul 18 13:45:09.470692 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2908/6040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:09 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:09.538557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-076938c7-d78d-40fa-bee2-d36b453cb5b8 req-62de5528-5c24-4727-9102-764eb82c06cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00d48be-9174-403d-baec-08ac32114865", "tag": "46e5abb9-3366-4b84-973a-7ffbb63ce68c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:09.550443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-076938c7-d78d-40fa-bee2-d36b453cb5b8 req-62de5528-5c24-4727-9102-764eb82c06cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:09.551378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-076938c7-d78d-40fa-bee2-d36b453cb5b8 req-62de5528-5c24-4727-9102-764eb82c06cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:09.571836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-076938c7-d78d-40fa-bee2-d36b453cb5b8 req-62de5528-5c24-4727-9102-764eb82c06cc service nova] Creating event network-changed:46e5abb9-3366-4b84-973a-7ffbb63ce68c for instance b00d48be-9174-403d-baec-08ac32114865 on n-h2-850003-3 Jul 18 13:45:09.577004 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-076938c7-d78d-40fa-bee2-d36b453cb5b8 req-62de5528-5c24-4727-9102-764eb82c06cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042931 Jul 18 13:45:09.580945 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3133/6041] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:10.490605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:10.492010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: 5e691aa1-122e-46ed-ab0f-238230b76c64] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:10.502566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:10.503025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:10.504140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:10.504787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:10.524123 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] HTTP exception thrown: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Request method failure captured: Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 HTTP/1.1 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WJ65TQS0urSCpFuaN0Emoqp6p_daCZcpkSRzYLEVPOGlQZutHGVcuEBtIZr7Tj0a1G2sNwcfBmElG5R5960SJVP-m7qSDaJ3CnmVSMi_nhf97lCxscPeOj70t2TiV8Pw0RvILRyZrpEnnsAVl6noo5HOXQpgP9buGrNpGVvCXYBBPM Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c38d1ce804d0438bb4387adf316eb065", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 03a79841909d4f259345be53bf4be4aa Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '5e691aa1-122e-46ed-ab0f-238230b76c64'} Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:45:10.526565 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. Jul 18 13:45:10.531660 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:45:10.533561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Returning 404 to user: Instance 5e691aa1-122e-46ed-ab0f-238230b76c64 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:45:10.535270 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6ab152c-3699-4efd-8034-d1420fc1a13a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64" status: 404 len: 111 microversion: 2.1 time: 0.050491 Jul 18 13:45:10.537066 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2909/6042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:10 2022] GET /compute/v2.1/servers/5e691aa1-122e-46ed-ab0f-238230b76c64 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:45:12.249790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-44028451", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bba66cb5-18e3-4e8c-9b95-4017f49efd0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:12.322132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:45:13.238430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:45:13.238871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:45:13.239360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:45:13.239778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:45:13.240202 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:45:13.277153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:13.277788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:13.280860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:13.281359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:13.306295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:45:13.314281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:45:13.424213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:45:13.426453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bba66cb5-18e3-4e8c-9b95-4017f49efd0a',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:45:13.692588 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c420b6e-7572-4140-96fd-35294207a0ba tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448775 Jul 18 13:45:13.699122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3134/6043] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:45:13.704266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa5da20b-96d5-403d-8dcd-bad8a943d51a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:13.705671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa5da20b-96d5-403d-8dcd-bad8a943d51a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:13.846439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa5da20b-96d5-403d-8dcd-bad8a943d51a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:13.863279 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa5da20b-96d5-403d-8dcd-bad8a943d51a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1069 microversion: 2.1 time: 0.162962 Jul 18 13:45:13.870407 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2910/6044] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:13 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1069 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:14.882611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:14.883487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:14.892052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:14.892756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:14.893830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:14.894304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:14.981529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:14.997625 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6681cc6c-c8c0-4505-827c-1c82fbf41f6d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1167 microversion: 2.1 time: 0.118926 Jul 18 13:45:14.998256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3135/6045] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:14 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1167 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:15.101582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1abd2777-0687-4b03-818e-c83105155043 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '.version_select at 0x7f96d73a5af0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:15.153080 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1abd2777-0687-4b03-818e-c83105155043 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1367167176" status: 202 len: 0 microversion: 2.1 time: 0.061956 Jul 18 13:45:15.154400 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2911/6046] 10.222.0.88 () {58 vars in 1283 bytes} [Mon Jul 18 13:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1367167176 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:45:15.206257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ced36ee-4b8c-4932-b168-56ccc906c181 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: .version_select at 0x7f96d72b6820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-887319191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5P/OUN/UWb7/8z2Rb8O8pKCa5UtwIeyIWVHvDlUOSuy+WkC3eY2kE2/GSmLkteqqZZRVKsBBa/jZUyc89rYzAo7GkXXHqRmY5oKHr0rhsoJwBkCnCZN1xQtPO6yYWTiA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:15.223174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-0ced36ee-4b8c-4932-b168-56ccc906c181 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:45:15.229583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-0ced36ee-4b8c-4932-b168-56ccc906c181 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:45:15.254737 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ced36ee-4b8c-4932-b168-56ccc906c181 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053798 Jul 18 13:45:15.255639 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3136/6047] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:45:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:16.016320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:16.017722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:16.024363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:16.025181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:16.026273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:16.026951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:16.143429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:16.178652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c73bdea-8f57-4218-bdbf-5f0b041ab2c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1185 microversion: 2.1 time: 0.166316 Jul 18 13:45:16.190846 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2912/6048] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:16 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:17.208299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:17.209021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:17.223471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:17.225591 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:17.231067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:17.232409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:17.689267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:17.707378 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0689eda8-2435-44fe-bcc3-44e6d0cab2c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1227 microversion: 2.1 time: 0.503160 Jul 18 13:45:17.708125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3137/6049] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:17 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1227 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:17.833121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a85e73ae-aafd-411c-ac71-9612a3b896db req-a5aaa58c-ca0d-402f-ae48-e2c0068340e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e738f8-5e58-4db1-9d58-f62180701b94", "tag": "c5a0d818-e2de-44a5-b7ee-8435ecb58693"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:17.853789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a85e73ae-aafd-411c-ac71-9612a3b896db req-a5aaa58c-ca0d-402f-ae48-e2c0068340e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:17.864329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a85e73ae-aafd-411c-ac71-9612a3b896db req-a5aaa58c-ca0d-402f-ae48-e2c0068340e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:17.912207 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a85e73ae-aafd-411c-ac71-9612a3b896db req-a5aaa58c-ca0d-402f-ae48-e2c0068340e2 service nova] Creating event network-changed:c5a0d818-e2de-44a5-b7ee-8435ecb58693 for instance 43e738f8-5e58-4db1-9d58-f62180701b94 on n-h1-850003-3 Jul 18 13:45:17.927380 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a85e73ae-aafd-411c-ac71-9612a3b896db req-a5aaa58c-ca0d-402f-ae48-e2c0068340e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099356 Jul 18 13:45:17.928611 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2913/6050] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:18.734682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:18.735600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:18.755645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:18.756269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:18.757357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:18.757950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:19.064296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:19.077166 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9370ea03-c1f6-41c7-8f9b-97235d6a1762 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1227 microversion: 2.1 time: 0.355754 Jul 18 13:45:19.078199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3138/6051] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:18 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1227 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:20.106863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:20.109035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:20.122119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:20.133548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:20.136044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:20.137965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:20.139207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:20.533559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:20.551481 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3ecdb76-b750-449b-b4ea-6f5b916f010b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1227 microversion: 2.1 time: 0.452787 Jul 18 13:45:20.565926 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2914/6052] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:20 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1227 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:21.582260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:21.583034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:21.606903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:21.607278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:21.613165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:21.613768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:22.011116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:22.025149 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9132729-7021-4aed-b87f-a751669ffe8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1227 microversion: 2.1 time: 0.449119 Jul 18 13:45:22.036050 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3139/6053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:21 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1227 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:23.070936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:23.071593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:23.101196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:23.103229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:23.104391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:23.108563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:23.340763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:23.352287 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f0e44af8-de7b-4f22-9113-780221404ebf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.312197 Jul 18 13:45:23.363992 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2915/6054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:23 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:24.372670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:24.375016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:24.383720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:24.387532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:24.392439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:24.393123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:24.398799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:24.399546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:24.523251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1817489924", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "ca092083-d2a6-4bf7-a774-0ee129837432"}], "key_name": "tempest-TestNetworkAdvancedServerOps-887319191", "security_groups": [{"name": "tempest-secgroup-smoke-1675198340"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:24.542223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:24.681018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:24.690768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fbfdf823-440f-43b7-a6b4-83ef87386d00 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.324159 Jul 18 13:45:24.692037 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3140/6055] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:24 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:24.856331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] validate_networks() for [('ca092083-d2a6-4bf7-a774-0ee129837432', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:45:25.471704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:45:25.472131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:45:25.473294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:45:25.473712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:45:25.474366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:45:25.493563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:25.494670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:25.495677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:25.496502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:25.521545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:45:25.538296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:45:25.573975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:45:25.578282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:45:25.665372 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f4b8ec1-052a-40dd-a232-1437f7e10cd9 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.146036 Jul 18 13:45:25.672991 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2916/6056] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:45:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:45:25.682475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3575fd69-1aac-40b7-acf7-8af1a0b2f361 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:25.684069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3575fd69-1aac-40b7-acf7-8af1a0b2f361 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:25.686691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:25.723569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:25.726305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:25.746763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:25.747260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:25.748058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:25.748644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:25.869889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3575fd69-1aac-40b7-acf7-8af1a0b2f361 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:25.878493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3575fd69-1aac-40b7-acf7-8af1a0b2f361 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1266 microversion: 2.1 time: 0.199816 Jul 18 13:45:25.890994 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3141/6057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:25 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:25.972321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:25.984976 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-55b32b80-19d6-4c5c-9303-c050e8c2a3b6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.271868 Jul 18 13:45:25.995699 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2917/6058] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:25 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:26.896492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:26.897763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:26.908450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:26.909303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:26.910396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:26.911066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:26.991628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:27.003874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:27.005141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:27.014496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9803a5a5-bd17-40b6-8330-7034438d2026 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1318 microversion: 2.1 time: 0.121708 Jul 18 13:45:27.028670 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3142/6059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:26 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:27.032293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:27.033082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:27.034091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:27.035103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:27.386283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:27.403652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13aab17e-4039-43e7-bb1f-d5fd77b2d919 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.404994 Jul 18 13:45:27.404287 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2918/6060] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:26 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:28.035967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:28.036849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:28.054871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:28.055326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:28.056156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:28.056586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:28.288618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:28.305821 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eba4de63-ef48-4fdf-bf15-31c77e4304fb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.270378 Jul 18 13:45:28.306476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3143/6061] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:28 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:28.422895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:28.423558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:28.438992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:28.439360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:28.440423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:28.440868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:28.765906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:28.779697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-580db792-e81a-40a9-a112-faa89c4ce928 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.360751 Jul 18 13:45:28.780875 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2919/6062] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:28 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:29.280479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-dda2f50e-acd8-4878-bccf-2b230bf5b85b req-2c2aaad3-0a2a-4772-aa3a-75034c1d616f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:29.290323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dda2f50e-acd8-4878-bccf-2b230bf5b85b req-2c2aaad3-0a2a-4772-aa3a-75034c1d616f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:29.291057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-dda2f50e-acd8-4878-bccf-2b230bf5b85b req-2c2aaad3-0a2a-4772-aa3a-75034c1d616f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:29.306061 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-dda2f50e-acd8-4878-bccf-2b230bf5b85b req-2c2aaad3-0a2a-4772-aa3a-75034c1d616f service nova] Creating event network-changed:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:45:29.313806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-dda2f50e-acd8-4878-bccf-2b230bf5b85b req-2c2aaad3-0a2a-4772-aa3a-75034c1d616f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038260 Jul 18 13:45:29.314781 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3144/6063] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:29.332958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:29.332958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:29.346248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:29.346849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:29.347904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:29.349764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:29.629307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:29.643281 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-53fedb6c-e8c5-4057-83ce-312c3f33d362 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.320663 Jul 18 13:45:29.651801 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2920/6064] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:29 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:29.798275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:29.799136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:29.806727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:29.807274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:29.808135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:29.808639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:29.994753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:30.003209 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0146aef9-ad50-4e7e-a91f-7bf5ebe1bccf tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.209934 Jul 18 13:45:30.005200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3145/6065] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:29 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:30.663426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:30.664464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:30.677419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:30.678222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:30.679831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:30.680626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:30.901447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:30.913492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7637ce7-730b-4182-b774-3fcbaf4d2802 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.255699 Jul 18 13:45:30.914321 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2921/6066] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:30 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:31.031295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:31.032020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:31.040299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:31.040760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:31.041617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:31.042059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:31.209456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:31.218595 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-291b7a70-1165-46b5-acbc-f2a8b02f58c1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.192298 Jul 18 13:45:31.219233 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3146/6067] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:31 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:31.934323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:31.935054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:31.946789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:31.947269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:31.948477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:31.949234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:32.165483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:32.181557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd95466b-40ca-4e6c-9500-fc95799e3a97 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.251787 Jul 18 13:45:32.183551 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2922/6068] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:31 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:32.236232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:32.238197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:32.247687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:32.248761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:32.250109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:32.250740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:32.452816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:32.461879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9bc9634-eb3d-4100-82ca-7d2f773c5552 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.229939 Jul 18 13:45:32.462559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3147/6069] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:32 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:32.898184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-481b15d5-793c-4868-9713-ae6694b086f7 req-e75b5742-823d-4819-b4ae-81cd7832b5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e738f8-5e58-4db1-9d58-f62180701b94", "name": "network-vif-plugged", "status": "completed", "tag": "c5a0d818-e2de-44a5-b7ee-8435ecb58693"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:32.907857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-481b15d5-793c-4868-9713-ae6694b086f7 req-e75b5742-823d-4819-b4ae-81cd7832b5cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:32.908535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-481b15d5-793c-4868-9713-ae6694b086f7 req-e75b5742-823d-4819-b4ae-81cd7832b5cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:32.921055 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-481b15d5-793c-4868-9713-ae6694b086f7 req-e75b5742-823d-4819-b4ae-81cd7832b5cc service nova] Creating event network-vif-plugged:c5a0d818-e2de-44a5-b7ee-8435ecb58693 for instance 43e738f8-5e58-4db1-9d58-f62180701b94 on n-h1-850003-3 Jul 18 13:45:32.928303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-481b15d5-793c-4868-9713-ae6694b086f7 req-e75b5742-823d-4819-b4ae-81cd7832b5cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jul 18 13:45:32.929394 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2923/6070] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:33.208753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:33.209372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:33.216885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:33.217084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:33.217871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:33.218347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:33.425650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:33.434620 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9293b63-c438-4937-b0f2-9126889defa4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.230560 Jul 18 13:45:33.435294 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3148/6071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:33 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:33.483605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:33.484405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:33.493552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:33.494410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:33.495233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:33.495841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:33.677870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:33.686856 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a316528d-7d3d-4f5a-aff6-630a1f92a810 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1215 microversion: 2.1 time: 0.209454 Jul 18 13:45:33.687566 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2924/6072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:33 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:34.455398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:34.457643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:34.465753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.466578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:34.467517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.468889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:34.493559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=100 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:34.656658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:34.668717 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5d8b8a4f-3816-4528-ae30-66140809673f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.219527 Jul 18 13:45:34.670729 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3149/6073] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:34 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:34.705470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:34.706252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:34.714662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.714882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:34.716002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.716399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:34.871836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:34.881091 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aff437ad-cbc2-4100-bc12-937e1f312c08 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1402 microversion: 2.1 time: 0.179693 Jul 18 13:45:34.881669 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2925/6074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:34 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1402 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:34.898879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:34.899494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:34.906501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.906955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:34.907793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:34.908247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.052068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:35.061898 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d27679c-e8b0-48b1-9f3d-4d28d1b0a7d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1402 microversion: 2.1 time: 0.167017 Jul 18 13:45:35.062588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3150/6075] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:34 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:35.079282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1271201568"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:35.080367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:35.092508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:35.093206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.093942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:35.094488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.117876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:35.200875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Attempting to quiesce instance before volume snapshot. Jul 18 13:45:35.273802 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 18 13:45:35.364802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Creating snapshot from volume bba66cb5-18e3-4e8c-9b95-4017f49efd0a. {{(pid=131367) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 18 13:45:35.494587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-75036576-7553-4520-b1b8-3d288a776143 req-27dd025e-7157-42d4-a753-8f384ca244b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "name": "network-vif-plugged", "status": "completed", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:35.506064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75036576-7553-4520-b1b8-3d288a776143 req-27dd025e-7157-42d4-a753-8f384ca244b4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:35.506799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-75036576-7553-4520-b1b8-3d288a776143 req-27dd025e-7157-42d4-a753-8f384ca244b4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.509575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:35.522011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-75036576-7553-4520-b1b8-3d288a776143 req-27dd025e-7157-42d4-a753-8f384ca244b4 service nova] Creating event network-vif-plugged:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:45:35.536913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-75036576-7553-4520-b1b8-3d288a776143 req-27dd025e-7157-42d4-a753-8f384ca244b4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042089 Jul 18 13:45:35.536913 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3151/6076] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:45:35.563266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:35.690588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:35.691568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:35.709257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:35.712539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.713810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:35.716491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:35.875421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:35.979541 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:35.990423 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7e64f90-807a-4a23-bcb6-c4e1211e54ad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.304815 Jul 18 13:45:35.991683 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3152/6077] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:35 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:36.750443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0563a56d-c721-4f02-9ea3-ba7969c355a2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94/action" status: 202 len: 0 microversion: 2.1 time: 1.674680 Jul 18 13:45:36.754211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2926/6078] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:45:35 2022] POST /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94/action => generated 0 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 13:45:37.017899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:37.019410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:37.028775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:37.029955 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:37.031756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:37.032234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:37.351530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:37.360957 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23b558d1-e4eb-4a4a-b1c7-e1ab52610ce5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1392 microversion: 2.1 time: 0.348483 Jul 18 13:45:37.363020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3153/6079] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:37 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:37.932528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-858322919", "imageRef": "e755d79d-6c5e-49e2-8621-ba5ce6aa1f74", "flavorRef": "452", "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:37.996423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:45:38.380601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:38.381239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:38.389761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.390249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.391203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.391625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.552395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:38.563164 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f39984ff-21d2-49e2-9e18-29e799bce3c6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1564 microversion: 2.1 time: 0.186931 Jul 18 13:45:38.564103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3154/6080] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:38 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:38.586387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:38.587383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:38.595639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.596163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.597129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.597537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.775588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:38.792927 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd0540f4-0b32-4ca5-897f-f4ea026c65a2 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1564 microversion: 2.1 time: 0.213618 Jul 18 13:45:38.793532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3155/6081] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:38 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:38.800151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:45:38.800609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:45:38.801095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:45:38.801518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:45:38.802440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:45:38.818139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.818787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.819744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:38.820206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:38.839097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:45:38.846516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:45:38.866375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:45:38.869949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='489d3883-0504-4866-917f-e5400ca4d341',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:45:38.964678 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e6cc8da-f970-49f2-955a-ce6f6a8af907 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036929 Jul 18 13:45:38.975999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b473106-9d3f-4e87-b441-f0ae7e652038 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:38.976771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b473106-9d3f-4e87-b441-f0ae7e652038 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:38.981077 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2927/6082] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:45:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:45:39.055382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b473106-9d3f-4e87-b441-f0ae7e652038 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:39.068911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b473106-9d3f-4e87-b441-f0ae7e652038 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1229 microversion: 2.1 time: 0.094813 Jul 18 13:45:39.069995 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3156/6083] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:38 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:40.088355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:40.089235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:40.100863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:40.101467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:40.102895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:40.102895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:40.256325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:40.278038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7f4901e4-0aa8-4840-aab5-44644badd337 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1281 microversion: 2.1 time: 0.190637 Jul 18 13:45:40.290239 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2928/6084] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:40 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:41.133950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:41.134639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:41.147468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e97fe6f2-a24c-4cc7-b026-ac6e06570d50 req-800a5ea7-fcdd-4939-9374-3c9c154a8640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:41.158238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:41.164002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e97fe6f2-a24c-4cc7-b026-ac6e06570d50 req-800a5ea7-fcdd-4939-9374-3c9c154a8640 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:41.164457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e97fe6f2-a24c-4cc7-b026-ac6e06570d50 req-800a5ea7-fcdd-4939-9374-3c9c154a8640 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:41.164901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:41.166067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:41.168775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:41.194136 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e97fe6f2-a24c-4cc7-b026-ac6e06570d50 req-800a5ea7-fcdd-4939-9374-3c9c154a8640 service nova] Creating event network-changed:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:45:41.204412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e97fe6f2-a24c-4cc7-b026-ac6e06570d50 req-800a5ea7-fcdd-4939-9374-3c9c154a8640 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060599 Jul 18 13:45:41.205656 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2929/6085] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:45:41.300141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:41.301137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:41.314679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:41.315370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:41.316325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:41.320464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:41.696955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:41.710085 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33d58ad7-d6bc-47e9-8e33-e01ed0f817e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.413981 Jul 18 13:45:41.721695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2930/6086] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:41 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:42.138825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:42.156483 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6278dd0-9874-4404-8073-a11cd9b0b48f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1564 microversion: 2.1 time: 1.023695 Jul 18 13:45:42.157331 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3157/6087] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:41 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1564 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:42.729172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:42.730588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:42.747714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:42.749614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:42.751881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:42.755111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:43.023414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:43.041834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecbbca80-f4be-4de8-a61b-0e009968d447 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.316732 Jul 18 13:45:43.043112 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2931/6088] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:42 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:43.551590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4879c9d5-06d3-4755-95f3-832eb391c1bd req-7ef53279-2adb-419c-ae53-d9c0069e8c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f1945d-8a3d-4254-ad69-ed571e343c2a", "tag": "dc61a367-1aca-4668-9277-34c658d25813"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:43.601066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4879c9d5-06d3-4755-95f3-832eb391c1bd req-7ef53279-2adb-419c-ae53-d9c0069e8c41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:43.601720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4879c9d5-06d3-4755-95f3-832eb391c1bd req-7ef53279-2adb-419c-ae53-d9c0069e8c41 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:43.635082 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4879c9d5-06d3-4755-95f3-832eb391c1bd req-7ef53279-2adb-419c-ae53-d9c0069e8c41 service nova] Creating event network-changed:dc61a367-1aca-4668-9277-34c658d25813 for instance b0f1945d-8a3d-4254-ad69-ed571e343c2a on n-h1-850003-3 Jul 18 13:45:43.654414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4879c9d5-06d3-4755-95f3-832eb391c1bd req-7ef53279-2adb-419c-ae53-d9c0069e8c41 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116874 Jul 18 13:45:43.656334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3158/6089] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:44.068210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:44.073616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:44.084999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:44.085917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:44.086990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:44.087722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:44.326728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:44.341456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe0f15e0-5140-4c01-9f90-b2584d239a01 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.277267 Jul 18 13:45:44.352954 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2932/6090] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:44 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:45.371773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:45.375002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:45.387339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:45.398522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:45.400751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:45.401522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:45.669207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:45.682676 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2884cc20-9a96-461c-9ef9-d5d9b2102dc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.315834 Jul 18 13:45:45.690202 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3159/6091] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:45 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:46.710287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:46.711810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:46.720977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:46.722884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:46.722884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:46.722884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:46.962725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:46.976818 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93cce034-bd45-44d6-9c16-2628ab139c64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.271055 Jul 18 13:45:46.978245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2933/6092] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:46 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:48.006082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:48.008568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:48.027757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:48.028614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:48.030128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:48.030646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:48.297937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:48.310523 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-609f3498-b8c7-41b0-b46f-e5e403dd754b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.314048 Jul 18 13:45:48.322225 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3160/6093] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:47 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:49.339903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:49.341912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:49.352966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:49.356595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:49.367531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:49.369087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:49.371970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:49.373986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:49.712914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:49.724239 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a526b1e-f20e-46d9-ad60-d72c2cfbcefb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.391563 Jul 18 13:45:49.725062 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2934/6094] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:49 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:50.744169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:50.745141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:50.755252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:50.758592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:50.759705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:50.760995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:50.761957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:50.959704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:50.969552 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3fa57cb-19a5-49b5-8d51-d12e3f77b757 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.231907 Jul 18 13:45:50.982620 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3161/6095] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:50 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:51.992019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:51.992902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:51.996500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:52.005086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:52.005856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:52.006846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:52.007407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:52.161414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:52.169641 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-09cbbba7-100d-49c0-a35c-dada69630d8d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.181643 Jul 18 13:45:52.170859 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2935/6096] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:51 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:53.193249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:53.193852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:53.205722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:53.205722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:53.206766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:53.207277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:53.398626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:53.413459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6dec3d5-c9d5-4a35-8d3d-5e4178a4a0c9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.225946 Jul 18 13:45:53.426806 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3162/6097] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:53 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:53.814901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:53.815514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:53.824716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:53.825322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:53.826687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:53.827390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:53.863781 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9889af60-fb1c-4b96-9d71-e552c315c1de tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/ips" status: 200 len: 149 microversion: 2.1 time: 0.054188 Jul 18 13:45:53.866451 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2936/6098] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:45:53 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:54.442717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:54.444362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:54.449214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=50 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:45:54.454411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:54.455205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:54.456236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:54.456838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:54.703673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:54.719835 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69d06d69-e835-446e-8315-6281ef26419c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.287834 Jul 18 13:45:54.721256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3163/6099] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:54 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:45:55.258527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:45:55.259672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:55.267922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:55.268619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:55.269440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:55.270206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:55.635884 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5d50759-b6c5-4060-bd2b-c6bb2563184e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381624 Jul 18 13:45:55.644889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2937/6100] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:45:55 2022] POST /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:45:55.752948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:55.755731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:55.771363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:55.772415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:55.773701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:55.774700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:55.976746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:55.987889 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee98e380-9e9d-45f7-8ff4-64045680efb3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.243530 Jul 18 13:45:55.989088 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3164/6101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:55 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:57.006526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:57.007608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:57.016334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:57.017280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:57.018090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:57.018776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:57.197040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:57.206061 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-375cfd5b-5cde-4014-93fc-bd94d0bbd997 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.204611 Jul 18 13:45:57.206708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2938/6102] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:56 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:58.227675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:58.228886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:58.244557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:58.245471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:58.247286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:58.248916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:58.541033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:58.577363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aa48ec36-b0dc-42fa-9fd6-9c2041e82823 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.353142 Jul 18 13:45:58.579814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3165/6103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:58 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:45:59.599023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:45:59.600361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:45:59.610689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:59.611427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:59.612615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:45:59.613138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:45:59.873550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:45:59.882682 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73c03da6-3767-48f2-92db-27efd610ac51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.287571 Jul 18 13:45:59.883862 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2939/6104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:45:59 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:00.904346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:00.905937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:00.922174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:00.924530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:00.926923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:00.928003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:01.262709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:01.283379 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6763a011-c3e1-4516-be58-c04c95b7c057 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.385815 Jul 18 13:46:01.285437 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3166/6105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:00 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:02.306447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:02.307682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:02.324507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:02.325402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:02.327456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:02.328430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:02.537667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:02.551996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fce4a599-7367-4d25-a099-ee6aea921c20 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1341 microversion: 2.1 time: 0.252327 Jul 18 13:46:02.553256 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2940/6106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:02 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1341 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:03.571184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:03.572088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:03.582017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:03.582690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:03.583666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:03.584192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:03.924035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:03.933339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a789379-f75e-467b-8b75-92a9894db968 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.367267 Jul 18 13:46:03.948296 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3167/6107] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:03 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:04.961755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:04.963007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:04.973704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:04.974227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:04.975068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:04.975534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:04.995266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:05.168381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:05.180541 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d2b74c6-b7da-4ceb-a623-3e48356e281c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.224994 Jul 18 13:46:05.190297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2941/6108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:04 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:05.863378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-13098178", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "47c76da7-9419-4d59-b193-ff861ac44a39"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:05.928805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] validate_networks() for [('47c76da7-9419-4d59-b193-ff861ac44a39', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:46:06.201915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:06.203145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:06.212894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:06.213366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:06.214181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:06.214643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:06.376059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:06.384728 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5fbee36f-279e-4aed-826a-acbfd8c9ba64 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.190262 Jul 18 13:46:06.385378 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2942/6109] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:06 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:06.440008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:46:06.440757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:46:06.441382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:46:06.441932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:46:06.442471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:46:06.455705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:06.456157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:06.456973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:06.457416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:06.465808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:06.488860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Getting quotas for project 413ef590978a4db0905f5d0d37567af6. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:46:06.497179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Getting quotas for user e3ba2da02691477b9704c5ddfdcfd2de and project 413ef590978a4db0905f5d0d37567af6. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:46:06.515868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:46:06.518616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:46:06.569768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d0101bde-28ce-49bf-9096-61071e4793a1 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863587 Jul 18 13:46:06.570474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3168/6110] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:46:06.583382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45442a9e-4c55-4202-9143-5523fd30b82a tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:06.584073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45442a9e-4c55-4202-9143-5523fd30b82a tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:06.648771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45442a9e-4c55-4202-9143-5523fd30b82a tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:06.657906 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45442a9e-4c55-4202-9143-5523fd30b82a tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1213 microversion: 2.1 time: 0.078372 Jul 18 13:46:06.659009 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2943/6111] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:06 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:07.403263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:07.404030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:07.413886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:07.413886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:07.414434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:07.414887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:07.590679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:07.598932 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-66711dc5-05f9-48f9-9b75-b09388720d44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.199759 Jul 18 13:46:07.599544 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3169/6112] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:07 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:07.678665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:07.679466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:07.687921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:07.688379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:07.689207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:07.689698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:07.789816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:07.806993 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9ad92670-839c-47ea-8386-aee484d46c26 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1273 microversion: 2.1 time: 0.132153 Jul 18 13:46:07.807974 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2944/6113] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:07 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:08.625015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:08.626585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:08.645299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:08.646479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:08.648554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:08.649631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:08.829585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:08.829585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:08.833787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:08.841248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:08.841806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:08.842774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93954309-2b89-4f7e-b7dc-d6d4aeef3f65 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.229027 Jul 18 13:46:08.843173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:08.843494 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3170/6114] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:08 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:08.843781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:09.471144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:09.479891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-efecccb2-9e08-45af-8caa-34341e1ef0d4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.656806 Jul 18 13:46:09.480503 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2945/6115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:08 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:09.862693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:09.863378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:09.871450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:09.871960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:09.873066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:09.873462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:09.911781 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a2b6a28d-0f2c-42cf-a3b7-5b9f08ec6085 req-da1cbeb4-9627-4f42-8510-7dc693531623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09838024-43ca-4930-8cd8-30c2262f96a1", "tag": "c8444668-0c25-4a41-b2aa-b7ce4d59dde2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:09.921222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a2b6a28d-0f2c-42cf-a3b7-5b9f08ec6085 req-da1cbeb4-9627-4f42-8510-7dc693531623 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:09.921687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a2b6a28d-0f2c-42cf-a3b7-5b9f08ec6085 req-da1cbeb4-9627-4f42-8510-7dc693531623 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:09.935033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a2b6a28d-0f2c-42cf-a3b7-5b9f08ec6085 req-da1cbeb4-9627-4f42-8510-7dc693531623 service nova] Creating event network-changed:c8444668-0c25-4a41-b2aa-b7ce4d59dde2 for instance 09838024-43ca-4930-8cd8-30c2262f96a1 on n-h2-850003-3 Jul 18 13:46:09.940864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a2b6a28d-0f2c-42cf-a3b7-5b9f08ec6085 req-da1cbeb4-9627-4f42-8510-7dc693531623 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036033 Jul 18 13:46:09.941807 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2946/6116] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:10.073192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:10.083188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05d8dde4-4ac7-425e-a033-b4cf9bafedbb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.224622 Jul 18 13:46:10.083778 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3171/6117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:09 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:10.514712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:10.517941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:10.536525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:10.537743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:10.540432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:10.541861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:10.749472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:10.751883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:10.764280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:10.765100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:10.766596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:10.768868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:10.853913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1fad48dd-2313-43ad-b9a3-b49576982293 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action" status: 200 len: 24571 microversion: 2.1 time: 0.116135 Jul 18 13:46:10.863425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3172/6118] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:10 2022] POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action => generated 24571 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:46:10.896488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:10.911973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-153c8830-140f-416a-8d3a-26c254df9eb4 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.412635 Jul 18 13:46:10.913741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2947/6119] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:10 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:11.101293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:11.102349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:11.113926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.114424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.115213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.115774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.285598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:11.298586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-198de5d2-ecca-405c-9f4f-0ea062ee907b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.201576 Jul 18 13:46:11.299261 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3173/6120] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:11 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:11.425186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:11.426217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:11.432579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.433040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.433829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.434426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.530656 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments HTTP/1.1 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 74 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: {"volumeAttachment": {"volumeId": "9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9"}} Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: exception: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': 'b00d48be-9174-403d-baec-08ac32114865', 'body': {'volumeAttachment': {'volumeId': '9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9'}}} Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:46:11.532469 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 400 to user: Invalid volume: volume 9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 is already attached to instances: b00d48be-9174-403d-baec-08ac32114865 {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88e9aecd-e29e-4558-a324-191c546fe358 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113115 Jul 18 13:46:11.537351 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2948/6121] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:46:11 2022] POST /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 13:46:11.603287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:11.604125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:11.615233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.615861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.616722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.617269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.713909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lazy-loading 'services' on Instance uuid b00d48be-9174-403d-baec-08ac32114865 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:46:11.803179 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b744bf6b-6852-48fe-8a19-af5701a2ce56 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments/9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9" status: 202 len: 0 microversion: 2.1 time: 0.205401 Jul 18 13:46:11.803798 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3174/6122] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:46:11 2022] DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments/9d16ce3b-f7ca-4cb1-8156-4c110c5de4f9 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:11.813163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:11.814266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:11.820603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.821071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.821864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.822437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.859034 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7fda0cfa-f902-4428-a90d-32f10c8c15d9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050550 Jul 18 13:46:11.859635 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2949/6123] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:11 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:11.933198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:11.935204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:11.943952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.944592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:11.945331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:11.945777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.094982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:12.103130 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e43b0cf3-cbd6-45f9-80f5-e8d2d36717b3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.175233 Jul 18 13:46:12.103722 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3175/6124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:11 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:12.317145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:12.317943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:12.326410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:12.326889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.327757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:12.328215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.493272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:12.502859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-831687b6-c688-4e0a-89cb-18c09ff8b283 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.189927 Jul 18 13:46:12.503541 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2950/6125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:12 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:12.870982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:12.873239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:12.880668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:12.881120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.881897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:12.882361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.925052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9fb6ff71-6aaf-4ebd-acd9-418029c6851f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058293 Jul 18 13:46:12.925975 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3176/6126] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:12 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:12.974786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e30af92e-2a7b-472b-84b9-c5ee7e18ce27 req-5295c95f-a568-43c0-8e85-43c033c1ebd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f1945d-8a3d-4254-ad69-ed571e343c2a", "name": "network-vif-plugged", "status": "completed", "tag": "dc61a367-1aca-4668-9277-34c658d25813"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:12.984839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e30af92e-2a7b-472b-84b9-c5ee7e18ce27 req-5295c95f-a568-43c0-8e85-43c033c1ebd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:12.985270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e30af92e-2a7b-472b-84b9-c5ee7e18ce27 req-5295c95f-a568-43c0-8e85-43c033c1ebd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:12.997924 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e30af92e-2a7b-472b-84b9-c5ee7e18ce27 req-5295c95f-a568-43c0-8e85-43c033c1ebd0 service nova] Creating event network-vif-plugged:dc61a367-1aca-4668-9277-34c658d25813 for instance b0f1945d-8a3d-4254-ad69-ed571e343c2a on n-h1-850003-3 Jul 18 13:46:13.003302 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e30af92e-2a7b-472b-84b9-c5ee7e18ce27 req-5295c95f-a568-43c0-8e85-43c033c1ebd0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122343 Jul 18 13:46:13.004050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2951/6127] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:46:13.120853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:13.121476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:13.128689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.129241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.130297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.130744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.304310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:13.313204 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eb6b8b90-995e-4b74-aa16-36190219a6fe tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.196356 Jul 18 13:46:13.314461 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3177/6128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:13 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:13.531166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:13.531803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:13.539539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.540270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.541076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.541542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.719944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:13.729470 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b51cba0f-df92-4b24-ad55-06df07062262 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1375 microversion: 2.1 time: 0.204121 Jul 18 13:46:13.730083 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2952/6129] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:13 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1375 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:13.939930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:13.940994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:13.948658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.949106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.949937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:13.951024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:13.985785 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-99227452-ef96-4f0e-b869-408ec02633c1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050023 Jul 18 13:46:13.986767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3178/6130] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:13 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:14.329512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:14.330274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:14.336802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.337271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.338056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.338552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.489552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:14.499607 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10451630-2a06-497f-98f7-5a47fc48ade8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.173916 Jul 18 13:46:14.500209 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2953/6131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:14 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:14.750332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:14.759332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:14.766885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.767747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.768813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.769522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.925787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:14.933905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94bab9b4-5aa6-4673-8612-16ffc4db65e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1562 microversion: 2.1 time: 0.189372 Jul 18 13:46:14.934963 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3179/6132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:14 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:14.952413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:14.953250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:14.961320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.962303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.962779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:14.963092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:14.999735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:15.000908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:15.008868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.009466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.010393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.010936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.056775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bc0e3dd4-659d-4d0e-9301-0615667ac1f5 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061701 Jul 18 13:46:15.061344 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3180/6133] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:14 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:46:15.117842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:15.126043 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e773cc71-e441-470c-a02c-b9d2c5258223 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1562 microversion: 2.1 time: 0.178603 Jul 18 13:46:15.126701 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2954/6134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:14 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:15.198503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:15.199006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:15.205964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.206458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.207239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.207686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.234518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:46:15.322685 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b198abf-534d-443d-9e54-c618d0e20d89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 204 len: 0 microversion: 2.1 time: 0.127514 Jul 18 13:46:15.323607 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3181/6135] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:15 2022] DELETE /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:46:15.333511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:15.334276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:15.340756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.341812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.342698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.343158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.498868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:15.510844 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2bc86f5e-4f41-4a0a-b43e-897c6f6b3884 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1568 microversion: 2.1 time: 0.181474 Jul 18 13:46:15.511733 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2955/6136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:15 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:15.524784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:15.525610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:15.534292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.535018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.536340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.536919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.675431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-02b559e1-b1c4-43f6-8971-8875b2e14d4a req-d5e0900e-5bb2-4c50-b52c-d2d5fcece9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09838024-43ca-4930-8cd8-30c2262f96a1", "name": "network-vif-plugged", "status": "completed", "tag": "c8444668-0c25-4a41-b2aa-b7ce4d59dde2"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:15.688783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-02b559e1-b1c4-43f6-8971-8875b2e14d4a req-d5e0900e-5bb2-4c50-b52c-d2d5fcece9e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:15.690043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-02b559e1-b1c4-43f6-8971-8875b2e14d4a req-d5e0900e-5bb2-4c50-b52c-d2d5fcece9e2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:15.711501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:15.713540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-02b559e1-b1c4-43f6-8971-8875b2e14d4a req-d5e0900e-5bb2-4c50-b52c-d2d5fcece9e2 service nova] Creating event network-vif-plugged:c8444668-0c25-4a41-b2aa-b7ce4d59dde2 for instance 09838024-43ca-4930-8cd8-30c2262f96a1 on n-h2-850003-3 Jul 18 13:46:15.723953 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2168fb76-e0c5-4f86-9302-e06cc5892dfb tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.205713 Jul 18 13:46:15.725445 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-02b559e1-b1c4-43f6-8971-8875b2e14d4a req-d5e0900e-5bb2-4c50-b52c-d2d5fcece9e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053888 Jul 18 13:46:15.725743 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3182/6137] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:15 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:15.726850 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2956/6138] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:16.073394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:16.074366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:16.082413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.083004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.083871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.084310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.102032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:16.126136 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b15491a-4a2d-41ab-b45d-b139ac604240 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057368 Jul 18 13:46:16.127334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3183/6139] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:16 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:16.531538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:16.532483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:16.541720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.541720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.541720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.541720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.655537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:16.746298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:16.756392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:16.757032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:16.763480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c38c0295-a62b-437f-bcc2-e48fc488c517 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1568 microversion: 2.1 time: 0.236441 Jul 18 13:46:16.763745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:16.765764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2957/6140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:16 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:16.767752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:16.781518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.781997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.782842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:16.783385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:16.986601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:16.996699 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0487ce49-8146-458b-b2b0-864bac6d7846 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1313 microversion: 2.1 time: 0.256538 Jul 18 13:46:16.998447 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3184/6141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:16 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:17.140720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:17.141597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:17.150246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:17.150727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:17.151552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:17.152023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:17.196744 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6abeea85-add9-4392-af86-9757debdd752 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059980 Jul 18 13:46:17.197710 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2958/6142] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:17 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:17.787487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:17.788252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:17.797167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:17.797618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:17.798865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:17.799304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:17.934194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d70e332c-771b-4d0f-a791-610304456f94 req-1e03b736-a6d6-4b3f-a38b-d199ce1dd98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f1945d-8a3d-4254-ad69-ed571e343c2a", "name": "network-vif-deleted", "tag": "dc61a367-1aca-4668-9277-34c658d25813"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:17.948480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d70e332c-771b-4d0f-a791-610304456f94 req-1e03b736-a6d6-4b3f-a38b-d199ce1dd98a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:17.948944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d70e332c-771b-4d0f-a791-610304456f94 req-1e03b736-a6d6-4b3f-a38b-d199ce1dd98a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:17.964998 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d70e332c-771b-4d0f-a791-610304456f94 req-1e03b736-a6d6-4b3f-a38b-d199ce1dd98a service nova] Creating event network-vif-deleted:dc61a367-1aca-4668-9277-34c658d25813 for instance b0f1945d-8a3d-4254-ad69-ed571e343c2a on n-h1-850003-3 Jul 18 13:46:17.973997 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d70e332c-771b-4d0f-a791-610304456f94 req-1e03b736-a6d6-4b3f-a38b-d199ce1dd98a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047979 Jul 18 13:46:17.974704 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2959/6143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:46:18.030330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.032402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.049147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.050235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.051574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.052408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.250911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:18.264597 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8843d8cf-d9bd-46ff-9ab2-fb43f0fa10f0 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1500 microversion: 2.1 time: 0.246823 Jul 18 13:46:18.265588 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2960/6144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:18 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1500 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:18.271991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.273224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.284598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.285495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.286840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.287428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.330176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:18.338072 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1fc1117-776e-49c3-9070-a1be79b3df88 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070454 Jul 18 13:46:18.338706 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2961/6145] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:46:18 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:46:18.344302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.345327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.352822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.353294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.354085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.354562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.369543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:18.390316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c15335e9-03cc-4b3e-86fc-86a75d656a69 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1526 microversion: 2.1 time: 0.606768 Jul 18 13:46:18.412125 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3185/6146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:17 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1526 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:18.476223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.477397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.485483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.486195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.487238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.487821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.538463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:46:18.592236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:18.604928 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e6ed2b72-96c9-4342-89b2-67cc8a3ccd0e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1500 microversion: 2.1 time: 0.264666 Jul 18 13:46:18.606180 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2962/6147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:18 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1500 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:18.645601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:18.664733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.669146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-343854e2-d166-47d7-96f8-0a9d493c4d59 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 204 len: 0 microversion: 2.1 time: 0.196634 Jul 18 13:46:18.671741 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3186/6148] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:18 2022] DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:46:18.686530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.687948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.688191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.688661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.689699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.690363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.703332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.704414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.706733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.708919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.729340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lazy-loading 'flavor' on Instance uuid 09838024-43ca-4930-8cd8-30c2262f96a1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:46:18.880489 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3184329b-9e28-4d7f-8769-df2e9d1cc9b8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action" status: 202 len: 0 microversion: 2.1 time: 0.247122 Jul 18 13:46:18.885957 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2963/6149] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:18 2022] POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:18.897460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:18.900050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:18.910529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.911255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:18.912238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:18.912802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:19.011410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:19.028936 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4d64485-4def-4b1c-ab3c-5b404822d80c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1680 microversion: 2.1 time: 0.350263 Jul 18 13:46:19.042256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3187/6150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:18 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1680 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:19.216178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:19.227600 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27ef61b6-759f-49e6-bad9-7081dbdce4c5 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1508 microversion: 2.1 time: 0.338281 Jul 18 13:46:19.228494 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2964/6151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:18 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:19.421235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:19.422511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:19.432770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:19.433328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:19.434661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:19.435116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:19.520824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:19.536764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ebca50d-8cf6-4758-9221-bb881b3360ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1360 microversion: 2.1 time: 0.120809 Jul 18 13:46:19.538014 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3188/6152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:19 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1360 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:20.059643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:20.061007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:20.071359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.072472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.073918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.074826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.256644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:20.258598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:20.275961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.276807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.278895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.279844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.311398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:20.328036 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-503f297f-f06c-4d38-97d1-0e8014edd94a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1680 microversion: 2.1 time: 0.274102 Jul 18 13:46:20.329683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2965/6153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:20 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1680 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:20.559425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:20.560363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:20.561279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:20.572707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.573497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.575703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:20.576577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:20.586879 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba0891f4-d2f0-42e4-b75a-3e3bb331d7bc tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1508 microversion: 2.1 time: 0.341741 Jul 18 13:46:20.602993 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3189/6154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:20 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:20.680832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:20.696409 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d63f9d0-514c-4507-b1bd-b2a0510fdbc7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1360 microversion: 2.1 time: 0.140749 Jul 18 13:46:20.697710 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2966/6155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:20 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1360 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:21.358759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:21.360827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:21.374269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.375147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.375689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.377547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.625879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:21.636206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:21.638108 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d4d3ddc0-d8cf-4503-8f58-334b6f0a8cb9 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1680 microversion: 2.1 time: 0.284278 Jul 18 13:46:21.638925 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3190/6156] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:21 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1680 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:21.639776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:21.651425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.652223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.654342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.655681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.729445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:21.730835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:21.742265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.743318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.744635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.745510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.844590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:21.863326 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1629b5c2-4a33-47db-989e-a890fce09d80 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1360 microversion: 2.1 time: 0.142563 Jul 18 13:46:21.865730 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3191/6157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:21 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:21.952982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:21.971016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:21.971642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:21.975074 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-750c3f8a-dcec-4d42-961d-d375dde4388c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1491 microversion: 2.1 time: 0.355783 Jul 18 13:46:21.975703 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2967/6158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:21 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1491 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:21.980248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.980998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:21.981990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:21.982820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.010931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:22.012334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.036863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=68 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:22.039716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.040500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.041506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.042247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.165797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:22.176493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-16f26c65-cbb1-4bb2-94c5-4a5a629d45a3 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action" status: 202 len: 0 microversion: 2.1 time: 0.176964 Jul 18 13:46:22.181444 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2968/6159] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:21 2022] POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:22.188575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:22.189313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.194300 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-272e78da-b8ad-485d-8b43-afd67dfc0ad1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1683 microversion: 2.1 time: 0.226992 Jul 18 13:46:22.195380 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3192/6160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:21 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:22.196774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.197258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.198088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.198599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.344536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:22.345581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.354548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.355018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.355914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.356495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.420808 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bf55d1a0-77d1-461b-8872-a2e65e6f39a1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action" status: 200 len: 32633 microversion: 2.1 time: 0.080564 Jul 18 13:46:22.422986 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3193/6161] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:22 2022] POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action => generated 32633 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:46:22.429324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:22.440517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5e27743-9a2f-4d3a-909d-5cba96a5a3ef tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1497 microversion: 2.1 time: 0.256053 Jul 18 13:46:22.440517 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2969/6162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:22 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:22.660106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:22.663378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.670359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:22.678883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.689074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.689734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.691569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.701363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.704228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.706966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.708611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.721028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.891975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:22.908451 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42da0bec-a980-49dd-8ea5-9b5a3bbed195 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 200 len: 1326 microversion: 2.1 time: 0.256161 Jul 18 13:46:22.913339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3194/6163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:22 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 1326 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:22.920568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-28f931db-be5f-4b96-b502-ecced0dd8275 req-ab9bb394-0009-4dc8-960f-e66a392f9c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00d48be-9174-403d-baec-08ac32114865", "name": "network-vif-deleted", "tag": "46e5abb9-3366-4b84-973a-7ffbb63ce68c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:22.947839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-28f931db-be5f-4b96-b502-ecced0dd8275 req-ab9bb394-0009-4dc8-960f-e66a392f9c61 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.948711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-28f931db-be5f-4b96-b502-ecced0dd8275 req-ab9bb394-0009-4dc8-960f-e66a392f9c61 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:22.955423 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-df340f28-a509-4068-8afe-a4c5823f64e1 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1834 microversion: 2.1 time: 0.292652 Jul 18 13:46:22.962741 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2970/6164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:22 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1834 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:22.968823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-28f931db-be5f-4b96-b502-ecced0dd8275 req-ab9bb394-0009-4dc8-960f-e66a392f9c61 service nova] Creating event network-vif-deleted:46e5abb9-3366-4b84-973a-7ffbb63ce68c for instance b00d48be-9174-403d-baec-08ac32114865 on n-h2-850003-3 Jul 18 13:46:22.973434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:22.978193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:22.978612 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-28f931db-be5f-4b96-b502-ecced0dd8275 req-ab9bb394-0009-4dc8-960f-e66a392f9c61 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061937 Jul 18 13:46:22.987341 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3195/6165] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:22.999090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:22.999590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.000890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.001540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.004111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:23.007779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:23.019500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.020267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.021365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.022003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.083127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lazy-loading 'flavor' on Instance uuid c3ef0c79-8b8f-44f0-a155-5ac8abd51467 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:46:23.117784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Going to try to live migrate instance to another host {{(pid=131366) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 13:46:23.128700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:23.146032 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8c77d64-6d2a-4531-b899-a5c6e79883a6 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1360 microversion: 2.1 time: 0.181524 Jul 18 13:46:23.158224 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2971/6166] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:22 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:23.457894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:23.459623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:23.476682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.478836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.480191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.483690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.755312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:23.778341 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5993d55-96b0-4160-b58d-9fbf922b9ada tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1497 microversion: 2.1 time: 0.324473 Jul 18 13:46:23.779135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2972/6167] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:23 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:23.932071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:23.933741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:23.949642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.951856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.954452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:23.955945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:23.990867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 HTTP/1.1 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b00d48be-9174-403d-baec-08ac32114865'} Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:23.994812 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f36af3d1-c230-4105-9765-73a31f1717f7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 404 len: 111 microversion: 2.1 time: 0.071670 Jul 18 13:46:24.002941 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2973/6168] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:23 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:46:24.015040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5556ba50-51bc-4f6d-b8ca-954f469897b2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '.version_select at 0x7f96e99f7c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:24.064084 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5556ba50-51bc-4f6d-b8ca-954f469897b2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578195097" status: 202 len: 0 microversion: 2.1 time: 0.058439 Jul 18 13:46:24.067605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2974/6169] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 13:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578195097 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:24.176837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:24.182504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:24.204049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:24.205460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:24.211592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:24.212803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:24.402489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:24.420090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-48b671ec-c389-4c51-ba1d-db6e18e89451 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 200 len: 1360 microversion: 2.1 time: 0.253792 Jul 18 13:46:24.425013 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2975/6170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:24 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:24.802883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:24.803755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:24.831866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:24.837980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:24.844138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:24.848795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.170660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:25.180241 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08a40363-1b4b-4135-b609-2f54bbd8545d tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1500 microversion: 2.1 time: 0.382770 Jul 18 13:46:25.182221 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2976/6171] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:24 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1500 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:25.218402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:25.220168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:25.249487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.263687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.268067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.268979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.295370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:25.314700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lazy-loading 'flavor' on Instance uuid 09838024-43ca-4930-8cd8-30c2262f96a1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:46:25.450402 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e5e788f-af3f-46ef-956b-9d3cefde50e9 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action" status: 202 len: 0 microversion: 2.1 time: 0.239938 Jul 18 13:46:25.455492 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2977/6172] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:25 2022] POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:25.462605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:25.463515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:25.474044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.474617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.476373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.476936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.499048 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a HTTP/1.1 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b0f1945d-8a3d-4254-ad69-ed571e343c2a'} Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:25.501782 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5714ef6a-3f85-47c0-9b97-3a4b010537b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 404 len: 111 microversion: 2.1 time: 0.049412 Jul 18 13:46:25.512940 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2978/6173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:25 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:25.528740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:25.529447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:25.564438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.565972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.575476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:25.576535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:25.986132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:26.002039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58db9bea-3d48-4452-8433-1159f6729764 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1508 microversion: 2.1 time: 0.479523 Jul 18 13:46:26.003574 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2979/6174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:25 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1508 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:26.010715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97c5e6f2-8e39-4b95-afa5-1e1d47f110f1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: .version_select at 0x7f96d74de040>, body: {"keypair": {"name": "tempest-keypair-973152092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxWdEEVxs5jeq3EtNaXQaOysU+OSyUOvxelZm+golVhGZJoy6oAqAGK60qMf7cY5p6amq5L0rXT7qHQVlSVEgYHY/HfQnbCmklEEmwyyBqDkf/m8xrIwDMFDK27/B6KMQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:26.033580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97c5e6f2-8e39-4b95-afa5-1e1d47f110f1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:46:26.040446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-97c5e6f2-8e39-4b95-afa5-1e1d47f110f1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:46:26.080779 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97c5e6f2-8e39-4b95-afa5-1e1d47f110f1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074950 Jul 18 13:46:26.081813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2980/6175] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:46:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:26.511121 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1183fbc9-7050-4293-a344-c5cd3494cdbe tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action" status: 202 len: 0 microversion: 2.1 time: 3.515942 Jul 18 13:46:26.512625 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3196/6176] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:22 2022] POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action => generated 0 bytes in 3519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:26.522885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:26.523725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:26.533258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:26.534179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:26.535508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:26.536375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:26.806913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:26.820179 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-01106ccd-80ed-4947-a503-456663be8a0c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.302315 Jul 18 13:46:26.821379 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2981/6177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:26 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:27.034063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:27.035026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:27.038906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:27.049649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.050493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.052400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.053084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.335173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:27.347929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:27.351663 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87d7b0c7-028d-420c-824b-2f924a45bce7 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1491 microversion: 2.1 time: 0.324554 Jul 18 13:46:27.371922 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3197/6178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:27 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1491 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:27.378009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:27.378847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:27.385552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.386366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.387568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.388221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.542480 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-06430e51-4cf6-4bb5-a308-6df431022f8b tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action" status: 202 len: 0 microversion: 2.1 time: 0.168165 Jul 18 13:46:27.555368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:27.556220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:27.559801 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2982/6179] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:27 2022] POST /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:27.567506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.568740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.570161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.570868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.852274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:27.853015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:27.871819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.872910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:27.878590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:27.886934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:28.085056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:28.097797 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7840116-de02-4e5e-8213-221b8c16cbc8 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1497 microversion: 2.1 time: 0.547023 Jul 18 13:46:28.110747 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3198/6180] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:27 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1497 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:28.464664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:28.476728 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11c548bb-e492-4661-95d8-4fd258c08561 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.628778 Jul 18 13:46:28.487044 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2983/6181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:27 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:28.695888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-9d65a6f7-5130-44c9-a645-0d937d1b3a4e req-330a687f-14e8-47a6-bd1b-30ede3bdc466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "name": "network-vif-unplugged", "status": "completed", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:28.720194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9d65a6f7-5130-44c9-a645-0d937d1b3a4e req-330a687f-14e8-47a6-bd1b-30ede3bdc466 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:28.721385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-9d65a6f7-5130-44c9-a645-0d937d1b3a4e req-330a687f-14e8-47a6-bd1b-30ede3bdc466 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:28.766470 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-9d65a6f7-5130-44c9-a645-0d937d1b3a4e req-330a687f-14e8-47a6-bd1b-30ede3bdc466 service nova] Creating event network-vif-unplugged:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:46:28.790789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-9d65a6f7-5130-44c9-a645-0d937d1b3a4e req-330a687f-14e8-47a6-bd1b-30ede3bdc466 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114466 Jul 18 13:46:28.792545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3199/6182] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:28.956852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834764900", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2112c8d0-f5a5-4e18-8577-541bfd3a1558"}], "security_groups": [{"name": "tempest-securitygroup--1135020741"}], "key_name": "tempest-keypair-973152092", "user_data": "}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:29.126584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:29.130956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:29.166094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:29.172049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:29.174090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:29.177328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:29.254357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] validate_networks() for [('2112c8d0-f5a5-4e18-8577-541bfd3a1558', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:46:29.867356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:29.881325 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90e0ce7f-f05b-46be-b60b-dbd558e800af tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1497 microversion: 2.1 time: 0.765337 Jul 18 13:46:29.883677 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3200/6183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:29 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1497 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:29.891689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:29.892803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:29.907138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:29.908468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:29.910951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:29.911747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:30.169461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:30.190503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3956060e-9cb2-44df-8ca2-bf5f3451e521 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.302850 Jul 18 13:46:30.197592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:46:30.198433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:46:30.199389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:46:30.200420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:46:30.201228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:46:30.203249 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3201/6184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:29 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:30.222320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:30.223656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:30.225312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:30.226199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:30.276156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:46:30.291749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Getting quotas for user abdc212e7fda4b2cb312aac78f90237e and project 1a06616058ad46af9496acfa5d9b34c8. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:46:30.317312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:46:30.321360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:46:30.456829 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bdc010cb-78b5-425b-a55f-4540d78068a1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.504697 Jul 18 13:46:30.459011 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2984/6185] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:46:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:46:30.475100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e46e026d-a031-4643-bf03-51cd41b87669 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:30.476228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e46e026d-a031-4643-bf03-51cd41b87669 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:30.563370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e46e026d-a031-4643-bf03-51cd41b87669 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:30.570884 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e46e026d-a031-4643-bf03-51cd41b87669 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1240 microversion: 2.1 time: 0.102381 Jul 18 13:46:30.571844 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3202/6186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:30 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:30.814172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-02a08bb5-dfbb-437b-b7e8-03eb3cc8f026 req-85a55ee1-170c-4ca8-a53d-7c4e91450b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:30.823279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-02a08bb5-dfbb-437b-b7e8-03eb3cc8f026 req-85a55ee1-170c-4ca8-a53d-7c4e91450b7b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:30.824199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-02a08bb5-dfbb-437b-b7e8-03eb3cc8f026 req-85a55ee1-170c-4ca8-a53d-7c4e91450b7b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:30.848629 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-02a08bb5-dfbb-437b-b7e8-03eb3cc8f026 req-85a55ee1-170c-4ca8-a53d-7c4e91450b7b service nova] Creating event network-changed:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:46:30.864963 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-02a08bb5-dfbb-437b-b7e8-03eb3cc8f026 req-85a55ee1-170c-4ca8-a53d-7c4e91450b7b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054799 Jul 18 13:46:30.865633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2985/6187] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:30.902291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:30.903537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:30.920558 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:30.921133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:30.922035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:30.923530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.216801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:31.218402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:31.233982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.234876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.235834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.238394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.307098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:31.327223 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-293dab2c-fe98-48ab-99e2-247da2ef658e tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1500 microversion: 2.1 time: 0.430105 Jul 18 13:46:31.327890 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3203/6188] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:30 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1500 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:31.345495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:31.346409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:31.364992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.365596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.367132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.367695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.407103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:46:31.542534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:31.548985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13b2e8ea-4f23-4fb9-b3c3-fd0e9617d013 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "DELETE /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 204 len: 0 microversion: 2.1 time: 0.206245 Jul 18 13:46:31.555540 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3204/6189] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:31 2022] DELETE /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:46:31.565793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:31.566060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ffdba2a-e6cc-4588-b33d-9476d50585f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.359937 Jul 18 13:46:31.566718 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2986/6190] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:31 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:31.567049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:31.582879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.583455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.584310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.584953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.600713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:31.601947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:31.612757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.614417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.615534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:31.618565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:31.706500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:31.721522 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a636a087-6c92-4e53-a3d6-09cf065663c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1292 microversion: 2.1 time: 0.127126 Jul 18 13:46:31.723485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2987/6191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:31 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:31.806446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:31.820228 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-04621921-9842-46e7-aef9-91a53a7f836c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1506 microversion: 2.1 time: 0.261798 Jul 18 13:46:31.820837 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3205/6192] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:31 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:32.370385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:32.371291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:32.380860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.381593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.382708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.383359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.419507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:46:32.516651 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51e914db-c540-41fc-9223-61e5d9608555 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 204 len: 0 microversion: 2.1 time: 0.150077 Jul 18 13:46:32.517525 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2988/6193] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:32 2022] DELETE /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:46:32.528585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:32.532167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:32.537901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.538406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.539261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.539261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.587373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:32.587965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:32.595944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.596879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.600913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.600913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.797917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:32.810377 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4947da8-d8b4-40d3-b01e-32a70d4e6cd8 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.227509 Jul 18 13:46:32.813758 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2989/6194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:32 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:32.821390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:32.822824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:32.836246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.836936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.838690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.839540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.921684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:32.939118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e88992a-2b1b-440a-9c53-7e9169dcd7ad tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1408 microversion: 2.1 time: 0.415683 Jul 18 13:46:32.954312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:32.955268 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-745df791-a803-4f08-bd2e-a28dccd629c0 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1298 microversion: 2.1 time: 0.142187 Jul 18 13:46:32.956171 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3206/6195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:32 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:32.957894 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2990/6196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:32 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1298 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:32.968387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:32.969938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:32.980487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.981984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:32.983493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:32.984114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:33.232257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:33.242406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-93162290-7f4c-4955-9535-2fc3e36fd549 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1506 microversion: 2.1 time: 0.284060 Jul 18 13:46:33.243312 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3207/6197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:32 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:33.839537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:33.841484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:33.849426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:33.849928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:33.850861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:33.851317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:33.972095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:33.973502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:33.984239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:33.985091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:33.986120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:33.986816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.006774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:34.023965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a274fdc3-0ed7-413d-a062-01d1b0f1b3f5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.192600 Jul 18 13:46:34.028846 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2991/6198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:33 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:34.034701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:34.035352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:34.045719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:34.046341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.047091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:34.047567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.297453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:34.301433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:34.307971 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b477306-fa1c-42a0-a5d0-b7daec0cb42f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.281471 Jul 18 13:46:34.308732 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2992/6199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:34 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:34.315342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:34.316985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:34.324694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:34.327149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.327149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:34.327695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.363920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:34.382498 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-986fc111-ca56-42de-8705-86ec87a46ec5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1408 microversion: 2.1 time: 0.416726 Jul 18 13:46:34.396392 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3208/6200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:33 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:34.686660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:34.697321 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-15d07948-d56f-4d35-ad23-dd96a4bdaa6c tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1506 microversion: 2.1 time: 0.386234 Jul 18 13:46:34.697931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2993/6201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:34 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:34.739618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c2d5a513-6b3f-4891-b3d1-4ed9054f54e4 req-a0778ea3-a9ff-4c78-bfb1-82ebb8dfa0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466ebab2-a5ea-4809-8edd-ffa05cc98ba2", "tag": "cda8f99e-9f5e-4e46-a3e7-26b4cedf3879"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:34.758998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c2d5a513-6b3f-4891-b3d1-4ed9054f54e4 req-a0778ea3-a9ff-4c78-bfb1-82ebb8dfa0a6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:34.760897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c2d5a513-6b3f-4891-b3d1-4ed9054f54e4 req-a0778ea3-a9ff-4c78-bfb1-82ebb8dfa0a6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:34.786447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c2d5a513-6b3f-4891-b3d1-4ed9054f54e4 req-a0778ea3-a9ff-4c78-bfb1-82ebb8dfa0a6 service nova] Creating event network-changed:cda8f99e-9f5e-4e46-a3e7-26b4cedf3879 for instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 on n-h1-850003-3 Jul 18 13:46:34.791749 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c2d5a513-6b3f-4891-b3d1-4ed9054f54e4 req-a0778ea3-a9ff-4c78-bfb1-82ebb8dfa0a6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071011 Jul 18 13:46:34.792378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3209/6202] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:35.052204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:35.052959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:35.069002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.071898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.073001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.073823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.145433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a4e3ebc4-8061-481a-94b7-057ad09e06ad req-617e38df-6342-46f1-9278-a38b69c5f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09838024-43ca-4930-8cd8-30c2262f96a1", "name": "network-vif-deleted", "tag": "c8444668-0c25-4a41-b2aa-b7ce4d59dde2"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:35.157530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a4e3ebc4-8061-481a-94b7-057ad09e06ad req-617e38df-6342-46f1-9278-a38b69c5f6fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.158432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a4e3ebc4-8061-481a-94b7-057ad09e06ad req-617e38df-6342-46f1-9278-a38b69c5f6fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.173789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a4e3ebc4-8061-481a-94b7-057ad09e06ad req-617e38df-6342-46f1-9278-a38b69c5f6fb service nova] Creating event network-vif-deleted:c8444668-0c25-4a41-b2aa-b7ce4d59dde2 for instance 09838024-43ca-4930-8cd8-30c2262f96a1 on n-h2-850003-3 Jul 18 13:46:35.180244 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a4e3ebc4-8061-481a-94b7-057ad09e06ad req-617e38df-6342-46f1-9278-a38b69c5f6fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041759 Jul 18 13:46:35.180955 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3210/6203] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:35.331416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:35.332196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:35.360428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.361371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.362848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.364122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.378248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:35.391041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b2c7abf-49e0-4b59-83f9-546a4b13271b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.348617 Jul 18 13:46:35.406447 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2994/6204] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:35 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:35.417135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:35.418970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:35.468377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.469163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.477018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.477514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.579957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:35.606700 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-666f589b-48f6-4403-8eb0-1fec6bed59d8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1366 microversion: 2.1 time: 0.196393 Jul 18 13:46:35.608493 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2995/6205] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:35 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:35.651691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:35.661759 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-01de48c6-ba3a-405e-9c4c-3fe0853f9a52 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.335254 Jul 18 13:46:35.662486 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3211/6206] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:35 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:35.717510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:35.718863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:35.729049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.729525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.730374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.730866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.769046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:35.769701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:35.770211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lazy-loading 'fault' on Instance uuid 09838024-43ca-4930-8cd8-30c2262f96a1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:46:35.837939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ba2da02691477b9704c5ddfdcfd2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ef590978a4db0905f5d0d37567af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:35.853791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b0477a7-51b4-4079-8065-729d04246885 tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 200 len: 1303 microversion: 2.1 time: 0.141129 Jul 18 13:46:35.854952 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2996/6207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:35 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:36.409253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:36.409809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:36.417092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.417546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.418982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.419519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.565173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:36.572920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7be43c3-7f4d-4fbd-bd78-c2027ac59dbe tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.167615 Jul 18 13:46:36.573501 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3212/6208] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:36 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:36.636532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:36.637171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:36.644493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.644954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.645753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.646224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.679246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:36.679899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:36.686460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.686913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.687695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.688132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.711622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:36.720357 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4e1a8c9-1344-4ecb-9ec5-16b5f85a75aa tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1366 microversion: 2.1 time: 0.087850 Jul 18 13:46:36.720950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2997/6209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:36 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:36.830064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:36.837607 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a76b87b-a2c0-423b-8f8d-da0daeec7c5a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.162259 Jul 18 13:46:36.838193 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3213/6210] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:36 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:36.878735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:36.879373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] [instance: 09838024-43ca-4930-8cd8-30c2262f96a1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:36.885788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.886299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.887594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:36.888054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:36.901827 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] HTTP exception thrown: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Request method failure captured: Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 HTTP/1.1 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WQbltdi8_RUMeGR73ydSyGwHf-EZvAeejE8L9hBoplDnl7Fdnuw-WE8XSg9f31OfuBqBa5CbAK3Z4WX0BEtHIG5CXlFXPyI210t5G87K8837n08yvX-aQGT6yt2gBq52p4bMA8XotXSLZfsRV-v3_k88u8w6haJy1o8pORqi9Ky3JU Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 413ef590978a4db0905f5d0d37567af6 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestServerAdvancedOps-1352489149 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/413ef590978a4db0905f5d0d37567af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/413ef590978a4db0905f5d0d37567af6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_413ef590978a4db0905f5d0d37567af6", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/413ef590978a4db0905f5d0d37567af6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestServerAdvancedOps-1352489149 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 413ef590978a4db0905f5d0d37567af6 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestServerAdvancedOps-1352489149 Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestServerAdvancedOps-1352489149-project Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e3ba2da02691477b9704c5ddfdcfd2de Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestServerAdvancedOps-1352489149-project Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '09838024-43ca-4930-8cd8-30c2262f96a1'} Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:36.904141 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] Returning 404 to user: Instance 09838024-43ca-4930-8cd8-30c2262f96a1 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ea5f772-25f5-4616-919a-273921a6a00f tempest-TestServerAdvancedOps-1352489149 tempest-TestServerAdvancedOps-1352489149-project] 10.222.0.88 "GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1" status: 404 len: 111 microversion: 2.1 time: 0.031133 Jul 18 13:46:36.909452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2998/6211] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:36 2022] GET /compute/v2.1/servers/09838024-43ca-4930-8cd8-30c2262f96a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:37.215570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-03012d5d-1980-4467-9c7f-1f3ba8b17050 req-5ee6985b-bec1-435d-83b3-f4d08da06bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e738f8-5e58-4db1-9d58-f62180701b94", "name": "network-vif-deleted", "tag": "c5a0d818-e2de-44a5-b7ee-8435ecb58693"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:37.224059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-03012d5d-1980-4467-9c7f-1f3ba8b17050 req-5ee6985b-bec1-435d-83b3-f4d08da06bc4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.224412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-03012d5d-1980-4467-9c7f-1f3ba8b17050 req-5ee6985b-bec1-435d-83b3-f4d08da06bc4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.237147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-03012d5d-1980-4467-9c7f-1f3ba8b17050 req-5ee6985b-bec1-435d-83b3-f4d08da06bc4 service nova] Creating event network-vif-deleted:c5a0d818-e2de-44a5-b7ee-8435ecb58693 for instance 43e738f8-5e58-4db1-9d58-f62180701b94 on n-h1-850003-3 Jul 18 13:46:37.242713 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-03012d5d-1980-4467-9c7f-1f3ba8b17050 req-5ee6985b-bec1-435d-83b3-f4d08da06bc4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Jul 18 13:46:37.243334 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3214/6212] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:37.589939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:37.590809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:37.597028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.597488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.598297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.598746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.738088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:37.738731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:37.754549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.756630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.758044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.758790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.840900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:37.850314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d595e04-c5a4-4568-a3b5-79897b66c69f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.264007 Jul 18 13:46:37.851461 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 2999/6213] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:37 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:37.856831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:37.859662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:37.860550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:37.864318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:37.871332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.872175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:37.873456 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a92b6e6-766b-4cdb-9e43-57fb1f43dc44 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1200 microversion: 2.1 time: 0.139562 Jul 18 13:46:37.874376 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3215/6214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:37 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1200 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:37.874743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:37.875364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:38.195660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:38.206462 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-982aff86-c4d7-4d42-b2cc-6f24a18cefa1 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.353644 Jul 18 13:46:38.208889 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3000/6215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:37 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:38.871373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:38.873058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:38.884109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:38.884860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:38.886140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:38.887364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:38.890987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:38.891616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:38.900978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:38.907491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:38.908656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:38.909303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:38.911483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:39.083677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:39.093552 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d9fb4eb-ee0a-4ccf-9a04-a1a13c2db536 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1200 microversion: 2.1 time: 0.206579 Jul 18 13:46:39.094776 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3001/6216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:38 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1200 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:39.096708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:39.104689 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57a81b1f-033b-45ea-80de-d5d5381a56f7 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.239614 Jul 18 13:46:39.105598 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3216/6217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:38 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:39.225140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:39.226062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:39.235318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:39.237321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:39.239060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:39.242547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:39.314393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-38cab4cf-8e8a-45b4-9fc4-b42c8921a321 req-37d84d20-3144-428c-a3fd-a914563b6e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "name": "network-vif-unplugged", "status": "completed", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:39.337397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-38cab4cf-8e8a-45b4-9fc4-b42c8921a321 req-37d84d20-3144-428c-a3fd-a914563b6e8f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:39.340645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-38cab4cf-8e8a-45b4-9fc4-b42c8921a321 req-37d84d20-3144-428c-a3fd-a914563b6e8f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:39.370633 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-38cab4cf-8e8a-45b4-9fc4-b42c8921a321 req-37d84d20-3144-428c-a3fd-a914563b6e8f service nova] Creating event network-vif-unplugged:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h2-850003-3 Jul 18 13:46:39.380646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-38cab4cf-8e8a-45b4-9fc4-b42c8921a321 req-37d84d20-3144-428c-a3fd-a914563b6e8f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071718 Jul 18 13:46:39.382247 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3217/6218] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:39.506966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:39.516924 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f757134b-dfcf-4210-b99f-4019743ec224 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.295824 Jul 18 13:46:39.518309 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3002/6219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:39 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:40.121604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:40.123355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:40.130735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:40.132368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:40.147836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.150621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.151418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.153063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.157736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.158212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.159201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.159990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.254761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:40.270885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:40.280517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff429420-9a68-4bf8-9d37-dcb8f257976d tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1200 microversion: 2.1 time: 0.164067 Jul 18 13:46:40.281114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3218/6220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:40 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1200 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:40.305926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:40.414562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:40.422697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4953f2b3-fc09-48e2-a9f4-26e9142122b3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1693 microversion: 2.1 time: 0.295942 Jul 18 13:46:40.423384 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3003/6221] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:40 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:40.534772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:40.535339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:40.541848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.542329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.543100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:40.543538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:40.575230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:40.692503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:40.701060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-62d41086-9d5f-4629-880c-bd383ed26745 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.170184 Jul 18 13:46:40.701611 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3219/6222] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:40 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:41.298986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:41.299529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:41.307773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.308341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.309345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.309915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.385848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:41.394675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c757900d-6fa8-4ba3-a35a-337f064a4032 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1200 microversion: 2.1 time: 0.100296 Jul 18 13:46:41.395486 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3004/6223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:41 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:41.441759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:41.442717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:41.451568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.452056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.453097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.453719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.626946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:41.635245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef7634e9-f6e1-4420-aaf5-aabb58d02084 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1683 microversion: 2.1 time: 0.198098 Jul 18 13:46:41.636127 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3220/6224] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:41 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:41.654622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:41.655283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:41.663106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.663582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.664424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.664890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.721252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:41.722051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:41.729206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.729674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.730545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.730989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.842238 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22eee4cc-032c-47d1-b9ef-f7679f04e818 tempest-TestNetworkAdvancedServerOps-1423308297 tempest-TestNetworkAdvancedServerOps-1423308297-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1834 microversion: 2.1 time: 0.191042 Jul 18 13:46:41.842834 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3005/6225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:41 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1834 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:41.868174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:41.869521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:41.878504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.879477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.880530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:41.881470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:41.921101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:41.935918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd10a640-ab90-44d0-a985-e59275fd91ce tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.220551 Jul 18 13:46:41.936537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3221/6226] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:41 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:42.042789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:42.052805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1e68c11-c2c0-4366-8e6a-112aafb35f73 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1683 microversion: 2.1 time: 0.189802 Jul 18 13:46:42.053595 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3006/6227] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:41 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:46:42.412081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:42.412812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:42.419092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:42.420091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:42.420868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:42.421356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:42.486142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:42.494545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d07cbc7a-f0ce-420f-b17f-d15496b18441 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 200 len: 1200 microversion: 2.1 time: 0.086543 Jul 18 13:46:42.495143 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3222/6228] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:42 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:42.952437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bb0ecc62-0407-42af-9286-49471ce4696c req-d2947c4f-234e-42c2-80a8-a2447cf54bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466ebab2-a5ea-4809-8edd-ffa05cc98ba2", "name": "network-vif-plugged", "status": "completed", "tag": "cda8f99e-9f5e-4e46-a3e7-26b4cedf3879"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:42.964603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb0ecc62-0407-42af-9286-49471ce4696c req-d2947c4f-234e-42c2-80a8-a2447cf54bd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:42.965440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bb0ecc62-0407-42af-9286-49471ce4696c req-d2947c4f-234e-42c2-80a8-a2447cf54bd0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:42.983008 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bb0ecc62-0407-42af-9286-49471ce4696c req-d2947c4f-234e-42c2-80a8-a2447cf54bd0 service nova] Creating event network-vif-plugged:cda8f99e-9f5e-4e46-a3e7-26b4cedf3879 for instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 on n-h1-850003-3 Jul 18 13:46:42.989581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bb0ecc62-0407-42af-9286-49471ce4696c req-d2947c4f-234e-42c2-80a8-a2447cf54bd0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041011 Jul 18 13:46:42.990903 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3007/6229] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:43.350385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:43.351425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:43.359173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:43.359884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:43.360896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:43.361491 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:43.513396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:43.514593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:43.523687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:43.525010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:43.525837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:43.526337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:43.541414 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 HTTP/1.1 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '43e738f8-5e58-4db1-9d58-f62180701b94'} Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:43.543328 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:43.549924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:43.551147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:43.551652 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64dab329-21fd-4399-a4a6-783d36a18a21 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 404 len: 111 microversion: 2.1 time: 0.036632 Jul 18 13:46:43.556884 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16e98c07-abd0-4f4b-aabd-96695a7ba449 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.602651 Jul 18 13:46:43.559860 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3223/6230] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:42 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:43.560633 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3008/6231] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:43 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:44.158906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:44.159923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:44.166423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:44.166877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:44.167645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:44.168090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:44.335431 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b10ce28c-7968-49aa-a318-b44d446abe0f tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action" status: 200 len: 38647 microversion: 2.1 time: 0.180143 Jul 18 13:46:44.336110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3224/6232] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:46:44 2022] POST /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467/action => generated 38647 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:46:44.577149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:44.579194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:44.589671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:44.590442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:44.591271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:44.591952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:44.775384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:44.790496 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dbb1b4d6-c48b-4ba2-a330-3f43916e3d7a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1366 microversion: 2.1 time: 0.217457 Jul 18 13:46:44.792195 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3009/6233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:44 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:45.554463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:45.555228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:45.563697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2b056739-08e9-4623-8a7b-be803687b6e6 req-b3978cfa-18c1-4b4f-8b86-c0e9856c36b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:45.576821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2b056739-08e9-4623-8a7b-be803687b6e6 req-b3978cfa-18c1-4b4f-8b86-c0e9856c36b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.579718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.580179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.581096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.581420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.586902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2b056739-08e9-4623-8a7b-be803687b6e6 req-b3978cfa-18c1-4b4f-8b86-c0e9856c36b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.602036 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2b056739-08e9-4623-8a7b-be803687b6e6 req-b3978cfa-18c1-4b4f-8b86-c0e9856c36b3 service nova] Creating event network-changed:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h1-850003-3 Jul 18 13:46:45.618964 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2b056739-08e9-4623-8a7b-be803687b6e6 req-b3978cfa-18c1-4b4f-8b86-c0e9856c36b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059352 Jul 18 13:46:45.619583 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3010/6234] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:45.636660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:46:45.784813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c944530e-7827-4529-85a9-8c905aebefad tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 204 len: 0 microversion: 2.1 time: 0.234349 Jul 18 13:46:45.788116 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3225/6235] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:45 2022] DELETE /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:46:45.812794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:45.814316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:45.833931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:45.841869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:45.851718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.856527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.859445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.863996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.873108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.879114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:45.882027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:45.884666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.139510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:46.158642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80c31ca4-4132-438b-8ab2-b0234c8e697d tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1556 microversion: 2.1 time: 0.351819 Jul 18 13:46:46.160198 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3226/6236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:45 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1556 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:46.180739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:46.181554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:46.197383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.198561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.201467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.203017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.284142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:46.287997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=100 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:46:46.299946 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f9f4f70-ec0a-4ced-a358-6075002af436 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1689 microversion: 2.1 time: 0.506522 Jul 18 13:46:46.301203 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3011/6237] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:45 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1689 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:46.337237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c60cdeec-0d05-4ba1-97a1-1048b3da42a7 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162447 Jul 18 13:46:46.338139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3227/6238] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 13:46:46 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:46:46.883708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:46.884295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:46.898544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.899177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.900336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.901058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.919978 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a HTTP/1.1 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b0f1945d-8a3d-4254-ad69-ed571e343c2a'} Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:46.922877 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:46.928822 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:46.931493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:46.932791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c155783-0bcd-4170-bf95-61acc256f712 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 404 len: 111 microversion: 2.1 time: 0.054020 Jul 18 13:46:46.933643 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3012/6239] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:46 2022] DELETE /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:46.966731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:46.967721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b0f1945d-8a3d-4254-ad69-ed571e343c2a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:46.980356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.981190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:46.985317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:46.986176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.017828 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a HTTP/1.1 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b0f1945d-8a3d-4254-ad69-ed571e343c2a'} Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.022186 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b0f1945d-8a3d-4254-ad69-ed571e343c2a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:47.027011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e518449c-cf13-4498-9ca3-e974f42237f2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a" status: 404 len: 111 microversion: 2.1 time: 0.084297 Jul 18 13:46:47.032417 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3228/6240] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:46 2022] GET /compute/v2.1/servers/b0f1945d-8a3d-4254-ad69-ed571e343c2a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:47.321633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:47.324099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:47.344643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.345120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.346367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.346467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.532638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:46:47.541548 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2742641b-6fab-4234-82b4-e802b7a2bdef tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 200 len: 1570 microversion: 2.1 time: 0.226648 Jul 18 13:46:47.542533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3013/6241] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:47 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:46:47.802082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:47.802780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:47.810580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.811129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.811983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.812502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.827614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 HTTP/1.1 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '43e738f8-5e58-4db1-9d58-f62180701b94'} Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:47.829190 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:47.833239 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9abd527-01c8-42e9-be7f-29078ba04e5c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 404 len: 111 microversion: 2.1 time: 0.032945 Jul 18 13:46:47.834781 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3229/6242] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:46:47 2022] DELETE /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:47.840112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:47.840770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 43e738f8-5e58-4db1-9d58-f62180701b94] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:47.847562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.848046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.848863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.849329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.869747 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 HTTP/1.1 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '43e738f8-5e58-4db1-9d58-f62180701b94'} Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:47.871567 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance 43e738f8-5e58-4db1-9d58-f62180701b94 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d1cbafe8-eae9-45d7-b800-054338e712a7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94" status: 404 len: 111 microversion: 2.1 time: 0.037271 Jul 18 13:46:47.880267 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3014/6243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:47 2022] GET /compute/v2.1/servers/43e738f8-5e58-4db1-9d58-f62180701b94 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:47.933676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f23d3303-c0ed-454f-8d86-45e2de41e59a req-08763d18-b0a5-43ad-ada3-cfe3d6371056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef0c79-8b8f-44f0-a155-5ac8abd51467", "name": "network-vif-deleted", "tag": "d228515c-dbb9-4132-b314-52ffa62bdc7b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:47.949879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f23d3303-c0ed-454f-8d86-45e2de41e59a req-08763d18-b0a5-43ad-ada3-cfe3d6371056 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:47.951182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f23d3303-c0ed-454f-8d86-45e2de41e59a req-08763d18-b0a5-43ad-ada3-cfe3d6371056 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:47.958880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d57f4a91-0a0e-4752-816b-8464c171878b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: .version_select at 0x7f96d79d0e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1982458682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqXL3fzAdEPa2Hz+YCgLmunOLHV2CalcW8gBcm6fTbYUg2y4Ihgcm/pq7a0siVSfeKDV3cVra7J9QEYn5EbaiExFmKwvvcNs2DjAHhyx7+dBDzshh+xo5hpB3TCgwKyCA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:47.965480 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f23d3303-c0ed-454f-8d86-45e2de41e59a req-08763d18-b0a5-43ad-ada3-cfe3d6371056 service nova] Creating event network-vif-deleted:d228515c-dbb9-4132-b314-52ffa62bdc7b for instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 on n-h1-850003-3 Jul 18 13:46:47.971122 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f23d3303-c0ed-454f-8d86-45e2de41e59a req-08763d18-b0a5-43ad-ada3-cfe3d6371056 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044435 Jul 18 13:46:47.972819 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3230/6244] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:47.975529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d57f4a91-0a0e-4752-816b-8464c171878b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:46:47.983324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d57f4a91-0a0e-4752-816b-8464c171878b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:46:48.013159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d57f4a91-0a0e-4752-816b-8464c171878b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.057941 Jul 18 13:46:48.013906 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3015/6245] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:46:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:46:48.561259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:48.562653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: c3ef0c79-8b8f-44f0-a155-5ac8abd51467] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:46:48.570522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:48.571073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:48.572257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:48.572933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:48.590260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] HTTP exception thrown: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Request method failure captured: Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 HTTP/1.1 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WJ65TQS0urSCpFuaN0Emoqp6p_daCZcpkSRzYLEVPOGlQZutHGVcuEBtIZr7Tj0a1G2sNwcfBmElG5R5960SJVP-m7qSDaJ3CnmVSMi_nhf97lCxscPeOj70t2TiV8Pw0RvILRyZrpEnnsAVl6noo5HOXQpgP9buGrNpGVvCXYBBPM Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c38d1ce804d0438bb4387adf316eb065", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 03a79841909d4f259345be53bf4be4aa Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'c3ef0c79-8b8f-44f0-a155-5ac8abd51467'} Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:46:48.592414 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Returning 404 to user: Instance c3ef0c79-8b8f-44f0-a155-5ac8abd51467 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:46:48.596590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9cfcef5c-1b82-4fb0-89f7-00cf186d2004 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467" status: 404 len: 111 microversion: 2.1 time: 0.037489 Jul 18 13:46:48.597946 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3231/6246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:46:48 2022] GET /compute/v2.1/servers/c3ef0c79-8b8f-44f0-a155-5ac8abd51467 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:46:50.022894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b6359705-3b50-4c2f-8f8a-3c5e6da39874 req-ed02f04a-4d06-468a-a799-1c05688fbc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466ebab2-a5ea-4809-8edd-ffa05cc98ba2", "tag": "cda8f99e-9f5e-4e46-a3e7-26b4cedf3879"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:50.038761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b6359705-3b50-4c2f-8f8a-3c5e6da39874 req-ed02f04a-4d06-468a-a799-1c05688fbc4b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:46:50.039756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b6359705-3b50-4c2f-8f8a-3c5e6da39874 req-ed02f04a-4d06-468a-a799-1c05688fbc4b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:46:50.064615 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b6359705-3b50-4c2f-8f8a-3c5e6da39874 req-ed02f04a-4d06-468a-a799-1c05688fbc4b service nova] Creating event network-changed:cda8f99e-9f5e-4e46-a3e7-26b4cedf3879 for instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 on n-h1-850003-3 Jul 18 13:46:50.070253 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b6359705-3b50-4c2f-8f8a-3c5e6da39874 req-ed02f04a-4d06-468a-a799-1c05688fbc4b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053079 Jul 18 13:46:50.071562 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3016/6247] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:46:52.560430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6034d5c-45a1-4a3f-b4ac-cd447f1ab463 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '.version_select at 0x7f96d7208160>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:46:52.583496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6034d5c-45a1-4a3f-b4ac-cd447f1ab463 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-887319191" status: 202 len: 0 microversion: 2.1 time: 0.026992 Jul 18 13:46:52.584339 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3232/6248] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 13:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-887319191 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:46:52.616600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20de04d8-8d17-4afd-9d49-e393be31c6a6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: .version_select at 0x7f96e98a6f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-39135308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXLAY1kE7NiptO4ktPHWPkqneZZ2d0Oq4TKoXM5YL6QRlQHB6NQsUuWPNryX0A9SMIoSxshGzJ21tVrT2oSjuCIxRVAFCPnlDqlJKCOTaULAs+uVknz3Ez7kva7AcKjRQ=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:46:52.635712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-20de04d8-8d17-4afd-9d49-e393be31c6a6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:46:52.642449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-20de04d8-8d17-4afd-9d49-e393be31c6a6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:46:52.670305 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20de04d8-8d17-4afd-9d49-e393be31c6a6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058885 Jul 18 13:46:52.670928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3017/6249] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:46:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:00.533637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:00.540610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-436584715", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "11b8dd73-370b-4b34-b9ff-919987b3310d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-39135308", "security_groups": [{"name": "tempest-secgroup-smoke-551515855"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:00.557604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:00.720293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] validate_networks() for [('11b8dd73-370b-4b34-b9ff-919987b3310d', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:47:01.284935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:47:01.285602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:47:01.286359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:47:01.286770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:47:01.287179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:47:01.302182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:01.302661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:01.303449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:01.303883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:01.325575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:47:01.338780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Getting quotas for user 03a79841909d4f259345be53bf4be4aa and project c38d1ce804d0438bb4387adf316eb065. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:47:01.370902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:47:01.374446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:47:01.442345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe9aa1f1-3fb6-4fe0-bc37-20a1752ae502 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.911452 Jul 18 13:47:01.443343 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3233/6250] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:47:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:47:01.453675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=13 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:01.461156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2be24600-bc89-40aa-b863-64d49678d4c4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:01.462407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2be24600-bc89-40aa-b863-64d49678d4c4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:01.549172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2be24600-bc89-40aa-b863-64d49678d4c4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:01.557397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2be24600-bc89-40aa-b863-64d49678d4c4 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1264 microversion: 2.1 time: 0.107983 Jul 18 13:47:01.561942 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3018/6251] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:01 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1264 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:02.579582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:02.581031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:02.592390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:02.594630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:02.595506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:02.595956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:02.704786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:02.719088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b82c2f6-44a0-43a7-8646-d80062980e37 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1316 microversion: 2.1 time: 0.145226 Jul 18 13:47:02.719978 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3234/6252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:02 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:03.739606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:03.741177 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:03.755868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:03.766028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:03.767161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:03.767755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:03.867973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:03.900438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a34976b2-5d4d-4519-b982-3af9e3d30db6 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1322 microversion: 2.1 time: 0.154713 Jul 18 13:47:03.901787 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3019/6253] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:03 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:04.919373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:04.919992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:04.927448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:04.927908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:04.928680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:04.929312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:05.213169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:05.223780 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63c75a07-96ed-426f-85cc-5cf907d0baf1 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.308822 Jul 18 13:47:05.235301 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3235/6254] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:04 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:05.304609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-75c6e845-9ea5-47da-a27d-c190c8a19c67 req-93656023-0208-4372-aa1d-0fc0595ffe9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:05.326491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-75c6e845-9ea5-47da-a27d-c190c8a19c67 req-93656023-0208-4372-aa1d-0fc0595ffe9a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:05.327775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-75c6e845-9ea5-47da-a27d-c190c8a19c67 req-93656023-0208-4372-aa1d-0fc0595ffe9a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:05.366196 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-75c6e845-9ea5-47da-a27d-c190c8a19c67 req-93656023-0208-4372-aa1d-0fc0595ffe9a service nova] Creating event network-changed:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:47:05.374924 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-75c6e845-9ea5-47da-a27d-c190c8a19c67 req-93656023-0208-4372-aa1d-0fc0595ffe9a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075200 Jul 18 13:47:05.379472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3020/6255] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:06.248221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:06.250127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:06.258013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:06.258636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:06.259500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:06.260027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:06.479734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:06.489308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-34781a52-4055-49f5-9e61-1b221a2a7ccc tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.249199 Jul 18 13:47:06.489917 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3236/6256] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:06 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:07.518732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:07.519767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:07.527220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:07.528721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:07.529589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:07.530059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:07.719088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:07.728275 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3724dd70-a293-400a-906c-140ba9cafb80 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.215462 Jul 18 13:47:07.729050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3021/6257] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:07 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:08.751376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:08.751961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:08.759109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:08.759562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:08.760368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:08.760812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:08.966103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:08.976248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1eb9f84-a682-4f33-96cd-df081946b53b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.227244 Jul 18 13:47:08.976248 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3237/6258] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:08 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:10.004679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:10.006101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:10.029538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:10.034089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:10.035221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:10.037770 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:10.038621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:10.093455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-18eb5898-785b-4669-bff8-e13d54748678 req-22a5f1aa-4fb4-480b-8665-f6cf73459a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "name": "network-vif-plugged", "status": "completed", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:10.119643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-18eb5898-785b-4669-bff8-e13d54748678 req-22a5f1aa-4fb4-480b-8665-f6cf73459a7f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:10.122196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-18eb5898-785b-4669-bff8-e13d54748678 req-22a5f1aa-4fb4-480b-8665-f6cf73459a7f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:10.146493 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-18eb5898-785b-4669-bff8-e13d54748678 req-22a5f1aa-4fb4-480b-8665-f6cf73459a7f service nova] Creating event network-vif-plugged:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:47:10.167023 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-18eb5898-785b-4669-bff8-e13d54748678 req-22a5f1aa-4fb4-480b-8665-f6cf73459a7f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081793 Jul 18 13:47:10.169198 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3238/6259] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:47:10.394275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:10.410124 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-69921611-8c24-4152-b5d7-c445856aec59 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.419044 Jul 18 13:47:10.411920 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3022/6260] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:09 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:11.427203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:11.428497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:11.435347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:11.436307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:11.446217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:11.446737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:11.447640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:11.448145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:11.644365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:11.663520 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-18c30dc5-36ae-4e82-9d4c-bfef407df434 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1389 microversion: 2.1 time: 0.238295 Jul 18 13:47:11.670869 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3239/6261] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:11 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1389 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:11.671127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-643989647", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1982458682", "security_groups": [{"name": "tempest-secgroup-smoke-852450238"}], "block_device_mapping_v2": [{"uuid": "3213f363-a579-4f13-86ca-1076897af4c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:11.689376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:11.870592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:47:12.686399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:12.687302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:12.694219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.694670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.695447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.695904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.726577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:47:12.727085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:47:12.727493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:47:12.727920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:47:12.728492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:47:12.738586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.739101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.739867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.740315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.758674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:47:12.764420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:47:12.826109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:47:12.828327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3213f363-a579-4f13-86ca-1076897af4c4',volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:47:12.833027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:12.841027 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ff84aaa-07bb-45f5-aecd-9d3d14e0e200 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1560 microversion: 2.1 time: 0.159338 Jul 18 13:47:12.841606 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3240/6262] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:12 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:12.857873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:12.858539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:12.864636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.865307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.866294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:12.866518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:12.970296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e529158-f53a-4370-a17e-342c1bd9a16c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.307712 Jul 18 13:47:12.970978 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3023/6263] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:47:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:47:12.982029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45fb5ca8-3866-47e3-a8c3-833b09ff159f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:12.982749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45fb5ca8-3866-47e3-a8c3-833b09ff159f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:13.023261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:13.032799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-441e4b39-647e-427a-a274-bec0fc277ee5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1560 microversion: 2.1 time: 0.179186 Jul 18 13:47:13.033915 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3241/6264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:12 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:13.122061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45fb5ca8-3866-47e3-a8c3-833b09ff159f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:13.130720 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45fb5ca8-3866-47e3-a8c3-833b09ff159f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1094 microversion: 2.1 time: 0.153241 Jul 18 13:47:13.131321 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3024/6265] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:12 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1094 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:14.147683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:14.148303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:14.156284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:14.156742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:14.157576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:14.158020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:14.466563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:14.474834 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-437e4c02-936f-4be9-8377-4ed434fd2324 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1200 microversion: 2.1 time: 0.331034 Jul 18 13:47:14.475431 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3242/6266] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:14 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1200 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:15.494578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:15.495340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:15.504655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:15.505270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:15.506230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:15.506965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:15.742762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:15.752412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c4806cf5-2488-4ac4-a142-c61fe9f74353 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1210 microversion: 2.1 time: 0.262942 Jul 18 13:47:15.753624 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3025/6267] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:15 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1210 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:15.853432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:15.855501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:15.859653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b180efd8-4622-4e7e-b716-05de5be5539c req-0702ece5-eac6-42f6-b81b-2e48ffb53928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:15.864793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:15.866327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:15.867992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:15.868685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:15.877879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b180efd8-4622-4e7e-b716-05de5be5539c req-0702ece5-eac6-42f6-b81b-2e48ffb53928 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:15.878388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b180efd8-4622-4e7e-b716-05de5be5539c req-0702ece5-eac6-42f6-b81b-2e48ffb53928 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:15.897875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b180efd8-4622-4e7e-b716-05de5be5539c req-0702ece5-eac6-42f6-b81b-2e48ffb53928 service nova] Creating event network-changed:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:47:15.903814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b180efd8-4622-4e7e-b716-05de5be5539c req-0702ece5-eac6-42f6-b81b-2e48ffb53928 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051257 Jul 18 13:47:15.905252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3026/6268] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:16.337319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:16.366395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70202a43-47f4-4b12-b930-076bc3fc7f7c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1560 microversion: 2.1 time: 0.517385 Jul 18 13:47:16.367869 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3243/6269] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:15 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1560 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:16.776534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:16.782495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:16.803633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:16.816545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:16.818995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:16.821617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:17.073992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:17.085126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24308d3b-fdad-430b-badc-f873abb5224e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1277 microversion: 2.1 time: 0.316321 Jul 18 13:47:17.086366 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3027/6270] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:16 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:17.926686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f0a107f9-43e9-449b-9bd4-87f4780bbf2a req-74d37a67-f27a-48c7-b631-ca3c24c867a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b220fa86-a045-40a8-a72d-f0402e32d957", "tag": "22620896-fdde-45ba-a257-76bba9e98613"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:17.937196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f0a107f9-43e9-449b-9bd4-87f4780bbf2a req-74d37a67-f27a-48c7-b631-ca3c24c867a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:17.937868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f0a107f9-43e9-449b-9bd4-87f4780bbf2a req-74d37a67-f27a-48c7-b631-ca3c24c867a4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:17.953247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f0a107f9-43e9-449b-9bd4-87f4780bbf2a req-74d37a67-f27a-48c7-b631-ca3c24c867a4 service nova] Creating event network-changed:22620896-fdde-45ba-a257-76bba9e98613 for instance b220fa86-a045-40a8-a72d-f0402e32d957 on n-h1-850003-3 Jul 18 13:47:17.958982 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f0a107f9-43e9-449b-9bd4-87f4780bbf2a req-74d37a67-f27a-48c7-b631-ca3c24c867a4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036192 Jul 18 13:47:17.959613 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3244/6271] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:18.108630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:18.109271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:18.116549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:18.117025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:18.117845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:18.118462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:18.288991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:18.297296 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-635cb66e-7a4a-45c3-a3fa-06a19ea34389 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1277 microversion: 2.1 time: 0.193015 Jul 18 13:47:18.298178 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3028/6272] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:18 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:19.318246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:19.319082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:19.327283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:19.327825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:19.328537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:19.329233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:19.472446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:19.481543 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcd3242d-56ce-409b-96dd-1043252f7d9b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1277 microversion: 2.1 time: 0.168674 Jul 18 13:47:19.482121 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3245/6273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:19 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:20.498857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:20.499417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:20.506626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:20.507100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:20.507896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:20.508357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:20.643233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:20.651528 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d8ed6b1-aa9a-435a-b3a0-2dcbfee785e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.157057 Jul 18 13:47:20.652124 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3029/6274] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:20 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:21.669033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:21.669633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:21.677163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:21.677615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:21.678433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:21.678871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:21.916436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:21.924653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7ae65874-0789-4a3e-90df-6005559e979f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.259947 Jul 18 13:47:21.925207 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3246/6275] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:21 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:22.943526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:22.944178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:22.947252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:22.953043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:22.953511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:22.954337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:22.954793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:23.116311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:23.129313 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a57d426c-f772-4ba0-b2ee-e424c1f5db62 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.191001 Jul 18 13:47:23.130223 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3030/6276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:22 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:24.147729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:24.148617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:24.158910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:24.159805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:24.161213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:24.161728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:24.363430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:24.371754 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f7fa10e0-eb8c-45f6-8d71-3edc93dd7b87 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.228915 Jul 18 13:47:24.372363 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3247/6277] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:24 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:25.389890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:25.390574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:25.392449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:25.398711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:25.399207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:25.400148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:25.400680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:25.555174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:25.563783 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a4b873c-04c8-4bf6-a308-9e8a3f45a1d2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.178594 Jul 18 13:47:25.564386 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3031/6278] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:25 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:26.585773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:26.586985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:26.599770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:26.600227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:26.601013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:26.601450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:26.747528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:26.755634 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-815bef71-b5e9-42b3-a119-e9d5add73566 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.177291 Jul 18 13:47:26.756238 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3248/6279] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:26 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:27.772602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:27.773231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:27.780484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:27.780945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:27.781731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:27.782211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:27.916932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:27.925262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85a3f098-f9f3-4ce4-868f-560c0f5a8400 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.156568 Jul 18 13:47:27.925838 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3032/6280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:27 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:28.943284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:28.944321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:28.952428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:28.952879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:28.953669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:28.954106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:29.100976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:29.110870 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6b91c9f-42d9-48e0-a49b-deeae0a885b5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.171927 Jul 18 13:47:29.111462 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3249/6281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:28 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:30.130674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:30.131265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:30.138419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:30.138891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:30.139729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:30.140163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:30.288629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:30.297033 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fda95e8c-ea3c-453c-9f6e-9e58486c57c2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.172759 Jul 18 13:47:30.297613 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3033/6282] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:30 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:31.088437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-536256f0-2cc3-4df5-ba09-90d12e15cc3c req-30b1548a-764f-4948-9310-306980b7b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b220fa86-a045-40a8-a72d-f0402e32d957", "name": "network-vif-plugged", "status": "completed", "tag": "22620896-fdde-45ba-a257-76bba9e98613"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:31.094346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:31.101463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-536256f0-2cc3-4df5-ba09-90d12e15cc3c req-30b1548a-764f-4948-9310-306980b7b158 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:31.101892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-536256f0-2cc3-4df5-ba09-90d12e15cc3c req-30b1548a-764f-4948-9310-306980b7b158 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:31.107266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=91 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:31.116375 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-536256f0-2cc3-4df5-ba09-90d12e15cc3c req-30b1548a-764f-4948-9310-306980b7b158 service nova] Creating event network-vif-plugged:22620896-fdde-45ba-a257-76bba9e98613 for instance b220fa86-a045-40a8-a72d-f0402e32d957 on n-h1-850003-3 Jul 18 13:47:31.121551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-536256f0-2cc3-4df5-ba09-90d12e15cc3c req-30b1548a-764f-4948-9310-306980b7b158 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038459 Jul 18 13:47:31.122693 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3250/6283] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:31.409574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:31.410485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:31.417550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:31.418102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:31.418958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:31.420431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:31.562812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:31.565051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=77 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:31.571675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2986abe5-56d0-4249-8e09-464616068c6b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.166134 Jul 18 13:47:31.572266 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3034/6284] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:31 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:47:32.590270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:32.590988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:32.598734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:32.599182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:32.599971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:32.600409 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:32.753449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:32.762042 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8439168a-09c2-4b86-afb6-03d1da7d2f89 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1265 microversion: 2.1 time: 0.175908 Jul 18 13:47:32.762745 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3251/6285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:32 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:33.780007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:33.780656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:33.789097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:33.789885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:33.791193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:33.791841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:33.939606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:33.947675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d3ec2f91-37fd-4440-9c9a-0a2ebe96f274 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1453 microversion: 2.1 time: 0.172314 Jul 18 13:47:33.948281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3035/6286] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:33 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:33.964299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:33.965399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:33.973205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:33.973660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:33.974522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:33.975070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:34.123079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:34.131249 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2bb01b5a-b27f-4520-b867-deef9f1ad229 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1453 microversion: 2.1 time: 0.171162 Jul 18 13:47:34.131765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3252/6287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:33 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:36.329808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a0368723-7610-4297-b56e-999f4a77ebaa req-a69a909e-44d0-4cb5-9c81-8735f46fcf48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b220fa86-a045-40a8-a72d-f0402e32d957", "tag": "22620896-fdde-45ba-a257-76bba9e98613"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:36.340459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a0368723-7610-4297-b56e-999f4a77ebaa req-a69a909e-44d0-4cb5-9c81-8735f46fcf48 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:36.340926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a0368723-7610-4297-b56e-999f4a77ebaa req-a69a909e-44d0-4cb5-9c81-8735f46fcf48 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:36.357106 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a0368723-7610-4297-b56e-999f4a77ebaa req-a69a909e-44d0-4cb5-9c81-8735f46fcf48 service nova] Creating event network-changed:22620896-fdde-45ba-a257-76bba9e98613 for instance b220fa86-a045-40a8-a72d-f0402e32d957 on n-h1-850003-3 Jul 18 13:47:36.362944 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a0368723-7610-4297-b56e-999f4a77ebaa req-a69a909e-44d0-4cb5-9c81-8735f46fcf48 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037120 Jul 18 13:47:36.364320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3036/6288] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:38.803201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:38.804135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:38.811384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:38.811838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:38.812632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:38.813075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:38.867853 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-526587f9-505c-40f7-83df-cae6bf1b3da3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action" status: 200 len: 24565 microversion: 2.1 time: 0.068395 Jul 18 13:47:38.868801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3253/6289] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:47:38 2022] POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action => generated 24565 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 13:47:49.800619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:49.801393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=9 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:49.806134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:49.807791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:49.818529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:49.819004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:49.819848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:49.820312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:49.907394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:47:49.907863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:47:49.908354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:47:49.908789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:47:49.909242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:47:49.979293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:49.985883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:49.986412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:49.987550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:49.987741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:50.022012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-affccff8-05dd-47ae-a667-0cee27b0780e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action" status: 202 len: 1136 microversion: 2.1 time: 0.223180 Jul 18 13:47:50.022473 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3037/6290] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:47:49 2022] POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action => generated 1136 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 13:47:50.046077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:50.046986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:50.050798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:50.052050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=17 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:47:50.059313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:50.059773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:50.060826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:50.061279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:50.264544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:50.277418 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-026119e4-207c-4afb-ad88-77204cce706a tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.236179 Jul 18 13:47:50.278421 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3254/6291] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:50 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:51.296923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:51.297601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:51.305116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:51.305579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:51.306409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:51.306862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:51.488472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:51.497393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-226b2e6d-b9cf-4021-a5ee-d4539c96d68d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.205268 Jul 18 13:47:51.497994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3038/6292] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:51 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:52.515527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:52.516125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:52.525149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:52.525746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:52.527376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:52.528002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:52.694065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:52.703609 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6d1767f-1f6e-452b-a0b8-fbecdc507987 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.192511 Jul 18 13:47:52.704227 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3255/6293] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:52 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:53.348701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:53.349593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:53.362185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:53.362384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:53.363423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:53.363895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:53.391965 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a5cd9180-5132-44c1-91f5-9316f08599c2 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/ips" status: 200 len: 150 microversion: 2.1 time: 0.047894 Jul 18 13:47:53.392521 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3039/6294] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 13:47:53 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:53.724804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:53.728254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:53.748246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:53.748246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:53.748246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:53.748246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:54.318381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:54.330349 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-655cbf9a-5bdf-4ad5-90a8-15cfe6775c9d tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.612886 Jul 18 13:47:54.331209 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3256/6295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:53 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:54.944885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "069fcca1-858c-493f-949a-3126da43f691"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:47:54.947778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:54.956743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:54.957187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:54.957985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:54.958466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:55.272724 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-563be255-ad33-44b8-afa4-d9e97a75b9ee tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "POST /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335757 Jul 18 13:47:55.274257 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3040/6296] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 13:47:54 2022] POST /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:47:55.348977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:55.349604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:55.358013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:55.358646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:55.359654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:55.360270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:55.559380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:55.570496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-535bebf2-5d63-4ea1-adca-a749b2227b18 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.225907 Jul 18 13:47:55.571298 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3257/6297] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:55 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:56.593593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:56.594780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:56.603301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:56.603814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:56.605289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:56.605773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:56.771347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:56.785911 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97effbd2-1c87-4bfe-8c41-5422eab245c3 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.199484 Jul 18 13:47:56.787091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3041/6298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:56 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:57.806691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:57.807313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:57.818866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:57.819333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:57.820144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:57.820622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:58.015190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:58.024133 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d2c32d6-3106-4707-b669-bf6ab82334da tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.222623 Jul 18 13:47:58.024800 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3258/6299] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:57 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:47:59.051486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:47:59.052741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:47:59.063215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:59.064461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:59.065717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:47:59.066457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:47:59.252040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:47:59.264682 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26050e9a-10b3-45c5-b436-4040c5597c14 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.224200 Jul 18 13:47:59.266122 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3042/6300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:47:59 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:48:00.295720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:00.296897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:00.308896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:00.309561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:00.310429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:00.310876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:00.486522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:00.497668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b603c520-b6b1-46aa-91b0-270abb31b75c tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.208467 Jul 18 13:48:00.499731 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3259/6301] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:00 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:01.518529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:01.519320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:01.528415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:01.528983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:01.529847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:01.530395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:01.701865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:01.716146 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-328b5d2a-5816-4cba-af46-464bf0134da5 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1688 microversion: 2.1 time: 0.201825 Jul 18 13:48:01.717617 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3043/6302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:01 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:02.737237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:02.737975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:02.747157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:02.747620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:02.748470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:02.748924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:02.927884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:02.942897 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61c6712c-b8da-4057-951d-e6aa2484916b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1694 microversion: 2.1 time: 0.209647 Jul 18 13:48:02.946749 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3260/6303] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:02 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:48:03.964477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:03.965291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:03.974526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:03.974993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:03.975826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:03.976298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:04.172556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:04.181239 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8721a66-3b67-4b3d-9baf-6d7f940a3167 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1694 microversion: 2.1 time: 0.222042 Jul 18 13:48:04.181856 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3044/6304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:03 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:05.207450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:05.208446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:05.216581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:05.216896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:05.217676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:05.218109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:05.395895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:05.404345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a80ed7cc-4a61-4bba-ae6a-5bde516fc0bb tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1679 microversion: 2.1 time: 0.201556 Jul 18 13:48:05.405021 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3261/6305] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:05 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:48:06.533402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fcb5238f-de42-41fe-8c0f-5e1c035d356f req-fbef330a-7de7-4c34-9dc4-292ba3cfa799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "name": "network-vif-plugged", "status": "completed", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:48:06.550192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fcb5238f-de42-41fe-8c0f-5e1c035d356f req-fbef330a-7de7-4c34-9dc4-292ba3cfa799 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:06.550990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fcb5238f-de42-41fe-8c0f-5e1c035d356f req-fbef330a-7de7-4c34-9dc4-292ba3cfa799 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:06.566793 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fcb5238f-de42-41fe-8c0f-5e1c035d356f req-fbef330a-7de7-4c34-9dc4-292ba3cfa799 service nova] Creating event network-vif-plugged:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:48:06.572567 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fcb5238f-de42-41fe-8c0f-5e1c035d356f req-fbef330a-7de7-4c34-9dc4-292ba3cfa799 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110046 Jul 18 13:48:06.573221 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3045/6306] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:48:07.321750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:07.322349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:07.329550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:07.330005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:07.330813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:07.331251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:07.419259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lazy-loading 'services' on Instance uuid 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:48:07.496640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5588e10-7838-4f1e-bec0-73e3c031cc5c tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments/069fcca1-858c-493f-949a-3126da43f691" status: 202 len: 0 microversion: 2.1 time: 0.178658 Jul 18 13:48:07.497256 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3262/6307] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 13:48:07 2022] DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments/069fcca1-858c-493f-949a-3126da43f691 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:48:07.508020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:07.509577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:07.518012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:07.518653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:07.519561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:07.520074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:07.559827 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46ab8122-8adc-4c5a-b106-907915c7f230 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057701 Jul 18 13:48:07.560536 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3046/6308] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:07 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:48:08.579220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:08.580910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:08.588013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:08.588568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:08.589358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:08.589830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:08.625028 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf2405e7-4cb2-4c3b-b91f-b7b451920ab8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052972 Jul 18 13:48:08.625626 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3263/6309] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:08 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:48:09.638134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:09.639056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:09.646795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:09.647265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:09.648072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:09.648535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:09.681720 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b73fd13b-5d53-4c5d-9969-fd2dceffa048 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Jul 18 13:48:09.683173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3047/6310] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:09 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:48:10.696004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:10.696970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:10.706639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:10.707206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:10.708346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:10.709118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:10.762428 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61e85ecc-c6f3-4857-a5d7-197d94976ad4 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070508 Jul 18 13:48:10.763042 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3264/6311] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:10 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:48:11.777997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:11.779209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:11.787827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:11.788296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:11.789134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:11.789591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:11.841894 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98f6807c-5471-4fcc-88f2-b60a92371393 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069244 Jul 18 13:48:11.843183 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3048/6312] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:11 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:48:12.856801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:12.857655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:12.865898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:12.866412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:12.867239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:12.867687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:12.902951 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e742f896-1cba-424b-ae34-ac456db663f6 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050852 Jul 18 13:48:12.903556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3265/6313] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 13:48:12 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 13:48:12.972232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:12.972907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:12.980999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:12.981468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:12.982347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:12.982805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:13.011585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:48:13.065572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:13.117131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a75a25a4-46f0-4931-a877-550fe0525309 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 204 len: 0 microversion: 2.1 time: 0.148631 Jul 18 13:48:13.117651 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3049/6314] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:12 2022] DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:48:13.126925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:13.127540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:13.134874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:13.135335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:13.136129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:13.136569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:13.320662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:13.335020 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d257e272-3203-475d-a1dc-1edcf550a1ad tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1681 microversion: 2.1 time: 0.211658 Jul 18 13:48:13.336038 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3266/6315] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:13 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:14.355280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:14.356162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:14.364358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:14.364819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:14.365629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:14.366078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:14.537198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:14.550209 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-19414846-0314-4af9-a12e-e60554332a74 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1681 microversion: 2.1 time: 0.199794 Jul 18 13:48:14.551200 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3050/6316] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:14 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:15.577039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:15.578194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:15.591449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:15.592289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:15.593734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:15.594589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:16.242827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdc212e7fda4b2cb312aac78f90237e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a06616058ad46af9496acfa5d9b34c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:16.253850 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe4ff86b-571a-4ff8-a8ca-9596a2cadf1f tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 200 len: 1681 microversion: 2.1 time: 0.683671 Jul 18 13:48:16.254754 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3267/6317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:15 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 1681 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:16.774568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-916f9c58-cfe2-4bda-99cb-c68a8b7bf523 req-c356e827-7153-4751-ad9f-81de8b37cb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466ebab2-a5ea-4809-8edd-ffa05cc98ba2", "name": "network-vif-deleted", "tag": "cda8f99e-9f5e-4e46-a3e7-26b4cedf3879"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:48:16.793552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-916f9c58-cfe2-4bda-99cb-c68a8b7bf523 req-c356e827-7153-4751-ad9f-81de8b37cb12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:16.794806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-916f9c58-cfe2-4bda-99cb-c68a8b7bf523 req-c356e827-7153-4751-ad9f-81de8b37cb12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:16.817950 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-916f9c58-cfe2-4bda-99cb-c68a8b7bf523 req-c356e827-7153-4751-ad9f-81de8b37cb12 service nova] Creating event network-vif-deleted:cda8f99e-9f5e-4e46-a3e7-26b4cedf3879 for instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 on n-h1-850003-3 Jul 18 13:48:16.825550 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-916f9c58-cfe2-4bda-99cb-c68a8b7bf523 req-c356e827-7153-4751-ad9f-81de8b37cb12 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193145 Jul 18 13:48:16.826866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3051/6318] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:48:17.278490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:17.279532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:17.293530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:17.294269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:17.295609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:17.296643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:17.330976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 HTTP/1.1 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '466ebab2-a5ea-4809-8edd-ffa05cc98ba2'} Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:17.334440 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-67c3b791-4475-4860-a034-787dfdd8ba76 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 404 len: 111 microversion: 2.1 time: 0.065549 Jul 18 13:48:17.340545 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3268/6319] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:17 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:17.355457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85ef41eb-f5db-41a7-8462-47afba78982e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '.version_select at 0x7f96e41f68b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:17.388271 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85ef41eb-f5db-41a7-8462-47afba78982e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973152092" status: 202 len: 0 microversion: 2.1 time: 0.040681 Jul 18 13:48:17.389539 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3052/6320] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 13:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973152092 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:48:21.692671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:21.693652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:21.702170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=31 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:21.712019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:21.712831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:21.714527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:21.715420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:21.723285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:21.746789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 HTTP/1.1 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '466ebab2-a5ea-4809-8edd-ffa05cc98ba2'} Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:21.749853 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f002f145-bc55-43aa-a6da-e284a0ac022e tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 404 len: 111 microversion: 2.1 time: 0.067760 Jul 18 13:48:21.754569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3269/6321] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:21 2022] DELETE /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:21.767881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:21.769388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 466ebab2-a5ea-4809-8edd-ffa05cc98ba2] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:21.772655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:21.784086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:21.785182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:21.786720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:21.787387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:21.822719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 HTTP/1.1 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '466ebab2-a5ea-4809-8edd-ffa05cc98ba2'} Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:21.826050 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 466ebab2-a5ea-4809-8edd-ffa05cc98ba2 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47cdf374-ac8d-47e6-9416-cfaf45537ba8 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2" status: 404 len: 111 microversion: 2.1 time: 0.069157 Jul 18 13:48:21.834223 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3053/6322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:21 2022] GET /compute/v2.1/servers/466ebab2-a5ea-4809-8edd-ffa05cc98ba2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:48:25.186283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:25.186970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:25.195208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.195665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.196449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.196902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.212142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 HTTP/1.1 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b00d48be-9174-403d-baec-08ac32114865'} Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:25.214445 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6dfcb4bc-a756-4ea5-9b1c-b139b40e3f48 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 404 len: 111 microversion: 2.1 time: 0.034517 Jul 18 13:48:25.219557 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3270/6323] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:25 2022] DELETE /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:25.227207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:25.227743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: b00d48be-9174-403d-baec-08ac32114865] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:25.237953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.238463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.239284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.239747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.255130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 HTTP/1.1 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b00d48be-9174-403d-baec-08ac32114865'} Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.256784 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance b00d48be-9174-403d-baec-08ac32114865 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0339ec1d-5c5e-4583-8fa7-90ca69e3e4e3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865" status: 404 len: 111 microversion: 2.1 time: 0.035434 Jul 18 13:48:25.266931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3054/6324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:25 2022] GET /compute/v2.1/servers/b00d48be-9174-403d-baec-08ac32114865 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:25.271938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:25.272441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:25.280094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.280545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.281337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.281770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.297292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 HTTP/1.1 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '671589ea-d2e7-4b6c-b08f-7d66c9549ec3'} Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:25.298936 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:25.304011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5445c1f-6fa1-4dad-92c3-423dd5ed4177 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 404 len: 111 microversion: 2.1 time: 0.034087 Jul 18 13:48:25.305203 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3271/6325] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:25 2022] DELETE /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:25.311093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:25.311807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 671589ea-d2e7-4b6c-b08f-7d66c9549ec3] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:25.319146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.319426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.320302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:25.320833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:25.339209 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 HTTP/1.1 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '671589ea-d2e7-4b6c-b08f-7d66c9549ec3'} Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:25.341197 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 671589ea-d2e7-4b6c-b08f-7d66c9549ec3 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1c47a10a-dcee-4051-a70c-5c39124cc81a tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3" status: 404 len: 111 microversion: 2.1 time: 0.036789 Jul 18 13:48:25.346733 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3055/6326] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:25 2022] GET /compute/v2.1/servers/671589ea-d2e7-4b6c-b08f-7d66c9549ec3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:48:28.644002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:28.644640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:28.652570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:28.652949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:28.653743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:28.654212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:28.671595 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 HTTP/1.1 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '89755eec-6d0b-4f25-a677-d0be315e96c8'} Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:28.673206 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea8bca4b-d10c-404d-ba68-128566f121f3 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 404 len: 111 microversion: 2.1 time: 0.034704 Jul 18 13:48:28.681060 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3272/6327] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:28 2022] DELETE /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:28.684141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:28.684810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] [instance: 89755eec-6d0b-4f25-a677-d0be315e96c8] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:28.698709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:28.699126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:28.700103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:28.700554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:28.717658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] HTTP exception thrown: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Request method failure captured: Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 HTTP/1.1 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WMWu6RwiHbl_uQ6KrkmUlcbFZNt0xOuu86OH0IA5rgwx0k7Ut_vOJQ_VB6Uq2OCAo5Pp3XtFcr_LfnYCCCVNIFoVFOCi_vkl9queOfhD8JMPZgldpACVSxqKdvp1YVzueE4ltBG8vvVXHI_BKB5EDkJqfSTx16zsWhOzkg5tuoS22s Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1a06616058ad46af9496acfa5d9b34c8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1a06616058ad46af9496acfa5d9b34c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 1a06616058ad46af9496acfa5d9b34c8 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888136278 Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: abdc212e7fda4b2cb312aac78f90237e Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-AttachVolumeNegativeTest-1888136278-project Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '89755eec-6d0b-4f25-a677-d0be315e96c8'} Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:28.719969 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] Returning 404 to user: Instance 89755eec-6d0b-4f25-a677-d0be315e96c8 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b82f9501-0f98-4915-9982-91eb37344c26 tempest-AttachVolumeNegativeTest-1888136278 tempest-AttachVolumeNegativeTest-1888136278-project] 10.222.0.88 "GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8" status: 404 len: 111 microversion: 2.1 time: 0.041936 Jul 18 13:48:28.726851 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3056/6328] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:28 2022] GET /compute/v2.1/servers/89755eec-6d0b-4f25-a677-d0be315e96c8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:35.670498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:48:35.671447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:35.679328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:35.679805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:35.680638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:35.681075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:35.746888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91cff728-6bd8-409f-aa22-bb2ae341414b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action" status: 200 len: 24570 microversion: 2.1 time: 0.080882 Jul 18 13:48:35.753759 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3273/6329] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:48:35 2022] POST /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:48:48.128523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a7039ebd-6486-46c0-b81a-d42d1ce99d7c req-a48eb217-459c-4fc7-b249-054d3a1a20fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:48:48.129525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:48.130521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:48.137466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:48.141212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:48.142324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=9 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:48.143941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=11 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:48:48.154291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a7039ebd-6486-46c0-b81a-d42d1ce99d7c req-a48eb217-459c-4fc7-b249-054d3a1a20fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:48.155069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a7039ebd-6486-46c0-b81a-d42d1ce99d7c req-a48eb217-459c-4fc7-b249-054d3a1a20fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:48.171296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:48.172624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:48.185422 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a7039ebd-6486-46c0-b81a-d42d1ce99d7c req-a48eb217-459c-4fc7-b249-054d3a1a20fd service nova] Creating event network-changed:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:48:48.186444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:48.186990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:48.194705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a7039ebd-6486-46c0-b81a-d42d1ce99d7c req-a48eb217-459c-4fc7-b249-054d3a1a20fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073639 Jul 18 13:48:48.196235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3274/6330] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:48:48.259455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:48:48.440635 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-03aac0a5-4a88-4f63-a0b0-1078699300fd tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 204 len: 0 microversion: 2.1 time: 0.322264 Jul 18 13:48:48.442498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3057/6331] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:48:48 2022] DELETE /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:48:48.457005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:48.459252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:48.470284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:48.471098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:48.473360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:48.474093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:48.694928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:48.705838 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70939359-19e3-4b85-a7e4-d008b505c0df tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1685 microversion: 2.1 time: 0.257043 Jul 18 13:48:48.706573 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3275/6332] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:48 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1685 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:48:49.733261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:49.734256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:49.746365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:49.746973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:49.748143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:49.748739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:50.005169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:50.015146 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-761a20b4-7c6c-4607-af47-8df3490dfa85 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1685 microversion: 2.1 time: 0.289261 Jul 18 13:48:50.016918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3058/6333] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:49 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1685 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:50.925830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a49d7bc1-9848-46a6-b4d4-ba94777439d2 req-1063511a-d1b3-49f6-8625-70bed645ca07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1057b9-d795-4920-85c5-afc914767c35", "name": "network-vif-deleted", "tag": "9db6bbdc-68cd-4d4c-a5d3-74c652bac94a"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:48:50.937163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a49d7bc1-9848-46a6-b4d4-ba94777439d2 req-1063511a-d1b3-49f6-8625-70bed645ca07 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:50.937618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a49d7bc1-9848-46a6-b4d4-ba94777439d2 req-1063511a-d1b3-49f6-8625-70bed645ca07 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:50.951437 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a49d7bc1-9848-46a6-b4d4-ba94777439d2 req-1063511a-d1b3-49f6-8625-70bed645ca07 service nova] Creating event network-vif-deleted:9db6bbdc-68cd-4d4c-a5d3-74c652bac94a for instance bc1057b9-d795-4920-85c5-afc914767c35 on n-h2-850003-3 Jul 18 13:48:50.957575 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a49d7bc1-9848-46a6-b4d4-ba94777439d2 req-1063511a-d1b3-49f6-8625-70bed645ca07 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Jul 18 13:48:50.958037 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3276/6334] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:48:51.043097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:51.043097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:51.049363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:51.049842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:51.050682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:51.051139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:51.093311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:51.094025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:51.094630 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lazy-loading 'fault' on Instance uuid bc1057b9-d795-4920-85c5-afc914767c35 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:48:51.156412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a79841909d4f259345be53bf4be4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d1ce804d0438bb4387adf316eb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:48:51.165366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f31c0b4-8543-4f34-b23f-63c4055aa592 tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 200 len: 1354 microversion: 2.1 time: 0.128734 Jul 18 13:48:51.166280 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3059/6335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:51 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 1354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:48:52.184839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:52.185543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] [instance: bc1057b9-d795-4920-85c5-afc914767c35] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:48:52.192842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:52.194192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:52.195465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:48:52.196168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:48:52.211630 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] HTTP exception thrown: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Request method failure captured: Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 HTTP/1.1 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WJ65TQS0urSCpFuaN0Emoqp6p_daCZcpkSRzYLEVPOGlQZutHGVcuEBtIZr7Tj0a1G2sNwcfBmElG5R5960SJVP-m7qSDaJ3CnmVSMi_nhf97lCxscPeOj70t2TiV8Pw0RvILRyZrpEnnsAVl6noo5HOXQpgP9buGrNpGVvCXYBBPM Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c38d1ce804d0438bb4387adf316eb065", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c38d1ce804d0438bb4387adf316eb065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: c38d1ce804d0438bb4387adf316eb065 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-42584403 Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 03a79841909d4f259345be53bf4be4aa Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkAdvancedServerOps-42584403-project Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bc1057b9-d795-4920-85c5-afc914767c35'} Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:48:52.213185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Returning 404 to user: Instance bc1057b9-d795-4920-85c5-afc914767c35 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-06db023e-affa-461a-9aa1-c52770af3b4b tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35" status: 404 len: 111 microversion: 2.1 time: 0.036078 Jul 18 13:48:52.218807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3277/6336] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:48:52 2022] GET /compute/v2.1/servers/bc1057b9-d795-4920-85c5-afc914767c35 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:48:56.137370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8220f37-35c7-4b68-b8b9-63e505995c0e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] Calling method '.version_select at 0x7f96e4711b80>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:48:56.162968 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8220f37-35c7-4b68-b8b9-63e505995c0e tempest-TestNetworkAdvancedServerOps-42584403 tempest-TestNetworkAdvancedServerOps-42584403-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-39135308" status: 202 len: 0 microversion: 2.1 time: 0.029921 Jul 18 13:48:56.163858 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3060/6337] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 13:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-39135308 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:49:17.341549 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:49:17.342039 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 13:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:49:17.502528 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:49:17.502803 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 13:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:49:33.662297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:33.663217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:33.880307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:33.880814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:33.890934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:33.891396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:33.892175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:33.892618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:33.921330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:49:34.006586 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-694425dc-0ab0-406e-8e47-f5d9968bf8b4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 204 len: 0 microversion: 2.1 time: 0.349504 Jul 18 13:49:34.008582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3278/6338] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:49:33 2022] DELETE /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:49:34.019483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:34.020632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:34.026666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:34.027588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:34.037462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:34.038062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:34.039336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:34.039980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:34.182443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:34.191078 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d46024a-bbf2-4440-aa5d-059a19d6f091 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1578 microversion: 2.1 time: 0.176290 Jul 18 13:49:34.191779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3061/6339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:34 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:35.209579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:35.210344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:35.217593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:35.218052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:35.218874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:35.219317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:35.365521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:35.373482 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a2557d1-5ed7-42d3-838d-4af1e19d9925 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1578 microversion: 2.1 time: 0.168239 Jul 18 13:49:35.374058 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3279/6340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:35 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:36.392350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:36.393836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:36.405767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:36.406678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:36.407789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:36.409076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:36.600198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:36.612607 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13d3ba9c-3924-41c4-81ea-e835561f9c52 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1578 microversion: 2.1 time: 0.225262 Jul 18 13:49:36.613221 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3062/6341] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:36 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:36.888977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0621ec5f-2f77-480f-9d3f-529658553abb req-33832233-4fb0-4885-b2a9-c80f26e0994e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b220fa86-a045-40a8-a72d-f0402e32d957", "name": "network-vif-deleted", "tag": "22620896-fdde-45ba-a257-76bba9e98613"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:49:36.909006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0621ec5f-2f77-480f-9d3f-529658553abb req-33832233-4fb0-4885-b2a9-c80f26e0994e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:36.909714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0621ec5f-2f77-480f-9d3f-529658553abb req-33832233-4fb0-4885-b2a9-c80f26e0994e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:36.943878 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0621ec5f-2f77-480f-9d3f-529658553abb req-33832233-4fb0-4885-b2a9-c80f26e0994e service nova] Creating event network-vif-deleted:22620896-fdde-45ba-a257-76bba9e98613 for instance b220fa86-a045-40a8-a72d-f0402e32d957 on n-h1-850003-3 Jul 18 13:49:36.953237 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0621ec5f-2f77-480f-9d3f-529658553abb req-33832233-4fb0-4885-b2a9-c80f26e0994e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066608 Jul 18 13:49:36.956558 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3280/6342] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:49:37.630875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:37.631821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:37.640903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:37.641375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:37.642767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:37.643347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:37.725735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:37.736048 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83ddbac3-d026-475f-9ff3-00e224dcbb29 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1225 microversion: 2.1 time: 0.109475 Jul 18 13:49:37.746630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3063/6343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:37 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:38.756173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:38.757502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:38.764933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:38.765536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:38.766545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:38.767099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:38.844559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:38.853073 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3fcb3bf7-8b27-4a4c-8e85-27356a53b2f3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1225 microversion: 2.1 time: 0.102267 Jul 18 13:49:38.853778 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3281/6344] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:38 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:39.871650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:39.872776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:39.880771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:39.881239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:39.882036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:39.882764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:39.972591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:39.984170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b73de2a-2f61-4e85-ae78-b72cad24113e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1225 microversion: 2.1 time: 0.117172 Jul 18 13:49:39.985143 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3064/6345] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:39 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:41.003038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:41.003666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:41.012908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:41.013816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:41.015357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:41.016261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:41.102423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:41.111368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c274aadc-e1c1-41ab-b434-330544b61602 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 200 len: 1225 microversion: 2.1 time: 0.112287 Jul 18 13:49:41.111956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3282/6346] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:40 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:42.130278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:42.131112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:42.139201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:42.139667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:42.140467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:42.140919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:42.156105 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 HTTP/1.1 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b220fa86-a045-40a8-a72d-f0402e32d957'} Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:49:42.157982 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3791500e-370e-4e54-a96d-797560f70b4e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 404 len: 111 microversion: 2.1 time: 0.033737 Jul 18 13:49:42.167593 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3065/6347] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:42 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:49:42.215809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571155416", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1982458682", "security_groups": [{"name": "tempest-secgroup-smoke-852450238"}], "block_device_mapping_v2": [{"uuid": "3213f363-a579-4f13-86ca-1076897af4c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:49:42.382430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:49:43.058996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:49:43.059456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:49:43.060606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:49:43.061175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:49:43.061870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:49:43.081157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:43.081702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:43.082958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:43.083471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:43.131932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:49:43.144252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:49:43.232768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:49:43.236800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3213f363-a579-4f13-86ca-1076897af4c4',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:49:43.400967 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da093d60-8337-481a-a15f-98e6aff4790f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.189789 Jul 18 13:49:43.402216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3283/6348] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:49:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:49:43.420972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e19f6be1-01a2-4172-bb08-4eaeaa7b6e51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:43.422129 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e19f6be1-01a2-4172-bb08-4eaeaa7b6e51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:43.485803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e19f6be1-01a2-4172-bb08-4eaeaa7b6e51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:43.498350 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e19f6be1-01a2-4172-bb08-4eaeaa7b6e51 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1094 microversion: 2.1 time: 0.086066 Jul 18 13:49:43.499267 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3066/6349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:43 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:44.516910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:44.517545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:44.525127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:44.526441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:44.526441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:44.526900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:44.615559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:44.627229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d835d78-85d8-470b-8fc3-a7f2c54aa874 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1192 microversion: 2.1 time: 0.114923 Jul 18 13:49:44.628416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3284/6350] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:44 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:45.646406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:45.647722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:45.667405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:45.668193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:45.669274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:45.670678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:45.903901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:45.917885 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ca669df-e8dc-406c-bf49-34e23a4f03ee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1277 microversion: 2.1 time: 0.276396 Jul 18 13:49:45.918925 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3067/6351] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:45 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:46.606633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1db3f181-b1bd-4c34-b753-dfe780060b93 req-622c74d4-8a55-47df-8db9-d8a65978640e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dd6f91-a28c-49d1-ab69-04f4349fb6b1", "tag": "0cf6e7b4-a699-48d5-b5e5-fc286ff20e50"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:49:46.628535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1db3f181-b1bd-4c34-b753-dfe780060b93 req-622c74d4-8a55-47df-8db9-d8a65978640e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:46.630416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1db3f181-b1bd-4c34-b753-dfe780060b93 req-622c74d4-8a55-47df-8db9-d8a65978640e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:46.648765 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1db3f181-b1bd-4c34-b753-dfe780060b93 req-622c74d4-8a55-47df-8db9-d8a65978640e service nova] Creating event network-changed:0cf6e7b4-a699-48d5-b5e5-fc286ff20e50 for instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 on n-h2-850003-3 Jul 18 13:49:46.671800 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1db3f181-b1bd-4c34-b753-dfe780060b93 req-622c74d4-8a55-47df-8db9-d8a65978640e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066016 Jul 18 13:49:46.674478 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3285/6352] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:49:46.949348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:46.951080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:46.968101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:46.968989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:46.969659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:46.970259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:47.169629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:47.178430 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c71e0997-1807-4203-9ba9-2d1b568fc1e9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1277 microversion: 2.1 time: 0.244053 Jul 18 13:49:47.179521 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3068/6353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:46 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:48.204612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:48.205971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:48.224156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:48.230758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:48.231423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:48.231872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:48.428675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:48.438135 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7faf2468-fdc6-472f-99f3-f3a81e4c7912 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1277 microversion: 2.1 time: 0.237737 Jul 18 13:49:48.449076 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3286/6354] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:48 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:49.462455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:49.466252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:49.479302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:49.480132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:49.481532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:49.482362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:49.807882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:49.818634 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-100ef25a-56e5-43e1-ad63-d78a67849ed8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1277 microversion: 2.1 time: 0.364965 Jul 18 13:49:49.819704 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3069/6355] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:49 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:50.837910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:50.839055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:50.851805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:50.852652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:50.854098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:50.855256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:51.132987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:51.152622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09074492-93c8-4e2f-85cd-c2fa45b3f56f tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1277 microversion: 2.1 time: 0.320301 Jul 18 13:49:51.153245 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3287/6356] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:50 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1277 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:49:52.172086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:52.172936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:52.181681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:52.182133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:52.183178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:52.184219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:52.359336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:52.367633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-675a9500-749b-4f8d-9e5c-b1633ab67a83 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.200045 Jul 18 13:49:52.368273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3070/6357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:52 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:49:53.386952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:53.387864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:53.391173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:53.392291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:53.399018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:53.400133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:53.401205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:53.401668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:53.560925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:53.570718 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcd28a55-f5a5-4e4e-84a2-1d31a0ef139c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.189196 Jul 18 13:49:53.572003 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3288/6358] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:53 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:54.589383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:54.590464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:54.593699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:49:54.601346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:54.602056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:54.602971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:54.603512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:54.828848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:54.839020 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7a1e035-7a71-4423-91bd-06479a21ef04 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.254244 Jul 18 13:49:54.839872 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3071/6359] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:54 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:55.863559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:55.864398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:55.872795 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:55.873249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:55.874041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:55.874515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:56.037359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:56.050826 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4da1ed6-a4bb-4576-831a-e5b6a82da7de tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.191149 Jul 18 13:49:56.051439 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3289/6360] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:55 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:57.070576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:57.071872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:57.081523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:57.082029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:57.083144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:57.083726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:57.304677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:57.320257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d57d8d4-5130-4600-af00-75ad4dc89d70 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.254115 Jul 18 13:49:57.321073 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3072/6361] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:57 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:49:58.345222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:58.348166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:58.360259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:58.360970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:58.361571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:58.362003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:58.611769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:58.629278 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-abc2ef11-7a4e-4651-934a-a5fd9b0a6de1 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.292898 Jul 18 13:49:58.632001 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3290/6362] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:58 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:49:59.654610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:49:59.655965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:49:59.667485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:59.668384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:59.669413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:49:59.670119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:49:59.836301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:49:59.851318 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4057a672-c8b4-4d53-aa6c-f5f7f58be7eb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.204575 Jul 18 13:49:59.866056 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3073/6363] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:49:59 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:50:00.879664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:00.881548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:00.897171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:00.898104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:00.900311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:00.901560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:01.116788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-becafdeb-808d-42d7-bbd2-f2e7972a1485 req-ed431b3b-b250-45e3-89dd-fa8d16731c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dd6f91-a28c-49d1-ab69-04f4349fb6b1", "name": "network-vif-plugged", "status": "completed", "tag": "0cf6e7b4-a699-48d5-b5e5-fc286ff20e50"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:01.137348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-becafdeb-808d-42d7-bbd2-f2e7972a1485 req-ed431b3b-b250-45e3-89dd-fa8d16731c11 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:01.139000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-becafdeb-808d-42d7-bbd2-f2e7972a1485 req-ed431b3b-b250-45e3-89dd-fa8d16731c11 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:01.169768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-becafdeb-808d-42d7-bbd2-f2e7972a1485 req-ed431b3b-b250-45e3-89dd-fa8d16731c11 service nova] Creating event network-vif-plugged:0cf6e7b4-a699-48d5-b5e5-fc286ff20e50 for instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 on n-h2-850003-3 Jul 18 13:50:01.170096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:01.182981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-becafdeb-808d-42d7-bbd2-f2e7972a1485 req-ed431b3b-b250-45e3-89dd-fa8d16731c11 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072471 Jul 18 13:50:01.185554 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3074/6364] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:50:01.186306 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d5d7357-c1bc-4687-b452-d094d62ec318 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.315777 Jul 18 13:50:01.199336 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3291/6365] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:00 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:02.218367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:02.219768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:02.231032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:02.231942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:02.233495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:02.234304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:02.530780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:02.547466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2db88177-2e9b-400d-ad6d-c2066e634a12 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1265 microversion: 2.1 time: 0.335732 Jul 18 13:50:02.548351 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3075/6366] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:02 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:03.575360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:03.575360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:03.582871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:03.583774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:03.584582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:03.585038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:03.759466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:03.761844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:03.769459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-475fbeac-1a22-457e-bddb-1f256596a578 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1452 microversion: 2.1 time: 0.199663 Jul 18 13:50:03.770067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3292/6367] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:03 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:03.790412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:03.791695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:03.798928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:03.799391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:03.800201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:03.800661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:03.976445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:03.989604 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5fe5b177-add3-4cf7-a63b-a24e7d8896c8 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1452 microversion: 2.1 time: 0.203938 Jul 18 13:50:03.990265 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3076/6368] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:03 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:07.250835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d1424bb5-3945-4e2c-ab7b-0feb54ecf569 req-4fef52fa-937e-4661-a293-4af97134ba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dd6f91-a28c-49d1-ab69-04f4349fb6b1", "tag": "0cf6e7b4-a699-48d5-b5e5-fc286ff20e50"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:07.253233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:07.262716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1424bb5-3945-4e2c-ab7b-0feb54ecf569 req-4fef52fa-937e-4661-a293-4af97134ba93 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:07.263234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1424bb5-3945-4e2c-ab7b-0feb54ecf569 req-4fef52fa-937e-4661-a293-4af97134ba93 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:07.279316 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d1424bb5-3945-4e2c-ab7b-0feb54ecf569 req-4fef52fa-937e-4661-a293-4af97134ba93 service nova] Creating event network-changed:0cf6e7b4-a699-48d5-b5e5-fc286ff20e50 for instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 on n-h2-850003-3 Jul 18 13:50:07.285658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d1424bb5-3945-4e2c-ab7b-0feb54ecf569 req-4fef52fa-937e-4661-a293-4af97134ba93 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145557 Jul 18 13:50:07.286767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3293/6369] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:50:23.182999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=34 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:23.184225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=82 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:23.321412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1322981995", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "616233e1-2588-438a-8cf7-e7b23023c0a4"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:23.396801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] validate_networks() for [('616233e1-2588-438a-8cf7-e7b23023c0a4', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:50:23.924279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:50:23.924724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:50:23.925209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:50:23.925636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:50:23.926070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:50:23.935818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:23.936287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:23.937118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:23.937572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:23.957620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Getting quotas for project bac5cc19ccdc43dd9f3ddaf5165c5352. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:50:23.963572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Getting quotas for user bbbf218a8d5247bd8c1b1d0017425f0f and project bac5cc19ccdc43dd9f3ddaf5165c5352. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:50:23.976308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:50:23.979202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:50:24.021570 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [18f5e316-9f42-4828-9e54-08c164b05d33] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:50:25.031620 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [18f5e316-9f42-4828-9e54-08c164b05d33] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 60428. Jul 18 13:50:25.037334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73758cd5-ea86-4bac-b8bc-25800391d328 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859946 Jul 18 13:50:25.038273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3077/6370] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:50:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:50:25.047106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:25.047874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:25.052463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ed01966a-83cb-46ab-8db7-54139659b3bd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:25.053207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ed01966a-83cb-46ab-8db7-54139659b3bd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:25.115383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ed01966a-83cb-46ab-8db7-54139659b3bd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:25.123013 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ed01966a-83cb-46ab-8db7-54139659b3bd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1214 microversion: 2.1 time: 0.078044 Jul 18 13:50:25.123535 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3294/6371] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:25 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:26.141568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:26.142381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:26.149240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:26.149704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:26.150544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:26.151036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:26.218083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:26.226135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff33d302-f7b7-4821-9aee-5642fac3fcb8 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1218 microversion: 2.1 time: 0.089857 Jul 18 13:50:26.227621 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3078/6372] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:26 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:27.245874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:27.246644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:27.254598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:27.255345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:27.256413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:27.257009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:27.350963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:27.363562 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f0dbef7-7575-4a5f-ab76-b5f047ac6fe1 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1274 microversion: 2.1 time: 0.123122 Jul 18 13:50:27.365313 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3295/6373] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:27 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:28.387838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:28.388581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:28.395656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:28.396130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:28.396939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:28.397395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:28.544529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:28.555055 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d60d98b-c3c8-436a-872a-5e70222244fd tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.175277 Jul 18 13:50:28.555739 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3079/6374] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:28 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:28.874296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-00ad4aea-597f-43bb-9f50-4c79c90f3dfc req-7783585b-ca97-44df-baf9-239ffabf96a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86ee35c-8522-4482-baec-cca2f8a417a0", "tag": "74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:28.884338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-00ad4aea-597f-43bb-9f50-4c79c90f3dfc req-7783585b-ca97-44df-baf9-239ffabf96a9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:28.884829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-00ad4aea-597f-43bb-9f50-4c79c90f3dfc req-7783585b-ca97-44df-baf9-239ffabf96a9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:28.897215 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-00ad4aea-597f-43bb-9f50-4c79c90f3dfc req-7783585b-ca97-44df-baf9-239ffabf96a9 service nova] Creating event network-changed:74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f for instance b86ee35c-8522-4482-baec-cca2f8a417a0 on n-h1-850003-3 Jul 18 13:50:28.902120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-00ad4aea-597f-43bb-9f50-4c79c90f3dfc req-7783585b-ca97-44df-baf9-239ffabf96a9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034328 Jul 18 13:50:28.902740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3296/6375] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:50:29.574033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:29.574894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:29.582395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:29.582860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:29.583699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:29.584138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:29.736029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:29.744176 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2f1fe13-3898-405b-b999-519e46803a9c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.174826 Jul 18 13:50:29.744831 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3080/6376] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:29 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:50:30.762790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:30.763615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:30.770823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:30.771307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:30.772200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:30.772589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:30.933794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:30.945658 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-420d496a-cf6e-4879-b09f-d98bcfe4ca7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.187314 Jul 18 13:50:30.946390 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3297/6377] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:30 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:31.964878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:31.965505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:31.972652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:31.973115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:31.973948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:31.974456 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:32.110508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:32.118569 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e67874f-ee69-46bc-a551-ae2b6b235fe6 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.157546 Jul 18 13:50:32.119166 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3081/6378] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:31 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:33.136301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:33.136942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:33.144941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:33.145615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:33.146721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:33.147237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:33.291245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:33.299243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b257a384-23ce-4cf4-8f39-4b9937646303 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.167459 Jul 18 13:50:33.299832 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3298/6379] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:33 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:34.316901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:34.317618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:34.320425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:34.321752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:34.327817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:34.328291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:34.329084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:34.329534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:34.467015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:34.474727 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05139457-f228-4b72-bf41-9b02dbdd594d tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.161698 Jul 18 13:50:34.475361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3082/6380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:34 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:35.491968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:35.492619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:35.495170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:50:35.500660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:35.501109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:35.501878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:35.502354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:35.639869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:35.647751 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-848ff2e1-0b66-497e-908a-f348158fcbef tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.159901 Jul 18 13:50:35.648350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3299/6381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:35 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:36.122988 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9ff4ac7e-a964-4a02-901c-b3aeccff19e9 req-8edefe49-5788-40bd-b8e6-c8297549137e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86ee35c-8522-4482-baec-cca2f8a417a0", "name": "network-vif-plugged", "status": "completed", "tag": "74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:36.132920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9ff4ac7e-a964-4a02-901c-b3aeccff19e9 req-8edefe49-5788-40bd-b8e6-c8297549137e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:36.134019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9ff4ac7e-a964-4a02-901c-b3aeccff19e9 req-8edefe49-5788-40bd-b8e6-c8297549137e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:36.146799 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9ff4ac7e-a964-4a02-901c-b3aeccff19e9 req-8edefe49-5788-40bd-b8e6-c8297549137e service nova] Creating event network-vif-plugged:74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f for instance b86ee35c-8522-4482-baec-cca2f8a417a0 on n-h1-850003-3 Jul 18 13:50:36.152242 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9ff4ac7e-a964-4a02-901c-b3aeccff19e9 req-8edefe49-5788-40bd-b8e6-c8297549137e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Jul 18 13:50:36.153091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3083/6382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:50:36.666392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:36.667015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:36.674101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:36.674604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:36.675389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:36.675848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:36.818069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:36.826581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d9cb5c1-0a44-48c7-889d-6742c72f384e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1314 microversion: 2.1 time: 0.164118 Jul 18 13:50:36.827173 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3300/6383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:36 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:37.844331 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:37.845036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:37.853001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:37.853461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:37.854271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:37.854722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:37.990245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:37.998781 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70e9bd85-1838-45bb-a2fb-0ea275d5bc8e tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1498 microversion: 2.1 time: 0.158734 Jul 18 13:50:37.999365 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3084/6384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:37 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:40.247813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:40.248457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:40.256101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:40.256555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:40.257349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:40.257792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:40.288253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:50:40.376872 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-77c02c5b-184a-436e-9f13-576cfd2fc0cc tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 204 len: 0 microversion: 2.1 time: 0.132615 Jul 18 13:50:40.378235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3301/6385] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:50:40 2022] DELETE /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:50:40.389790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:40.390930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:40.400602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:40.400959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:40.401790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:40.402279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:40.549379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:40.558743 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57b16108-5398-429d-b947-e074f40f2919 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1504 microversion: 2.1 time: 0.174570 Jul 18 13:50:40.559366 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3085/6386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:40 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:41.577271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:41.577966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:41.585137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:41.585584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:41.586425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:41.586861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:41.730637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:41.738471 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e3e826d2-b260-4dfc-bcd0-18bc43af7550 tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1504 microversion: 2.1 time: 0.165402 Jul 18 13:50:41.739064 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3302/6387] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:41 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:42.440505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-e39c89b3-c71a-4ecf-ba3e-31afee90137f req-5fe7fcec-c9b1-48c5-98f8-9a9220f73180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86ee35c-8522-4482-baec-cca2f8a417a0", "name": "network-vif-deleted", "tag": "74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:50:42.451956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e39c89b3-c71a-4ecf-ba3e-31afee90137f req-5fe7fcec-c9b1-48c5-98f8-9a9220f73180 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:42.452418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-e39c89b3-c71a-4ecf-ba3e-31afee90137f req-5fe7fcec-c9b1-48c5-98f8-9a9220f73180 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:42.466791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-e39c89b3-c71a-4ecf-ba3e-31afee90137f req-5fe7fcec-c9b1-48c5-98f8-9a9220f73180 service nova] Creating event network-vif-deleted:74bb3a3b-1fd3-4ae6-ad56-e9a1f151ee0f for instance b86ee35c-8522-4482-baec-cca2f8a417a0 on n-h1-850003-3 Jul 18 13:50:42.473883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-e39c89b3-c71a-4ecf-ba3e-31afee90137f req-5fe7fcec-c9b1-48c5-98f8-9a9220f73180 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 Jul 18 13:50:42.474847 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3086/6388] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:50:42.763166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:42.764925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:42.777214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:42.777735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:42.778721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:42.779266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:42.816270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:42.816734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:42.817215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lazy-loading 'fault' on Instance uuid b86ee35c-8522-4482-baec-cca2f8a417a0 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:50:42.866552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbf218a8d5247bd8c1b1d0017425f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac5cc19ccdc43dd9f3ddaf5165c5352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:50:42.875449 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70e7cc72-9618-4271-88d8-923d3973fc7c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 200 len: 1304 microversion: 2.1 time: 0.121645 Jul 18 13:50:42.876450 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3303/6389] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:42 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:50:43.894698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:50:43.895348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] [instance: b86ee35c-8522-4482-baec-cca2f8a417a0] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:50:43.903677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:43.904150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:43.905029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:50:43.905488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:50:43.924339 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] HTTP exception thrown: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Request method failure captured: Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 HTTP/1.1 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WUdyb80s-YozI6o7-4iM7UN8L3tgIp4yl-qEBFw3hm8SB6xcPH5oeHd9QxGYRKJxYslbDHD0n8AFM2eFCLFFF-ASS_ufCSgyBtSTo1TdRb8Cpp4ExNTZ5ncOFpnSlg8whmgmKEfAd3SeunHrpw_5jS7qFbJkT6vCLvcFWTapvWNGj4 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: bac5cc19ccdc43dd9f3ddaf5165c5352 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesActionsTest-1343909935 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bac5cc19ccdc43dd9f3ddaf5165c5352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bac5cc19ccdc43dd9f3ddaf5165c5352"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bac5cc19ccdc43dd9f3ddaf5165c5352", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bac5cc19ccdc43dd9f3ddaf5165c5352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesActionsTest-1343909935 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: bac5cc19ccdc43dd9f3ddaf5165c5352 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesActionsTest-1343909935 Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesActionsTest-1343909935-project Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: bbbf218a8d5247bd8c1b1d0017425f0f Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesActionsTest-1343909935-project Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b86ee35c-8522-4482-baec-cca2f8a417a0'} Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:50:43.926095 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] Returning 404 to user: Instance b86ee35c-8522-4482-baec-cca2f8a417a0 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58eb6593-995b-469d-abc7-19ece256e51c tempest-VolumesActionsTest-1343909935 tempest-VolumesActionsTest-1343909935-project] 10.222.0.88 "GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0" status: 404 len: 111 microversion: 2.1 time: 0.038366 Jul 18 13:50:43.935853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3087/6390] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:50:43 2022] GET /compute/v2.1/servers/b86ee35c-8522-4482-baec-cca2f8a417a0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:51:26.396532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-893379483", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "65d8875f-2b38-420c-9008-6df40bdb53f0"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:26.404392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:26.405056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:26.453956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] validate_networks() for [('65d8875f-2b38-420c-9008-6df40bdb53f0', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:51:26.804823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:51:26.805255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:51:26.805739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:51:26.806183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:51:26.806599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:51:26.815649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:26.816106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:26.816916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:26.817390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:26.835710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Getting quotas for project 48d29f9199e04f58bf0dcd52dac65b65. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:51:26.841205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Getting quotas for user 0e03447a9edf48c0aa5c28a397a8ecff and project 48d29f9199e04f58bf0dcd52dac65b65. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:51:26.861312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:51:26.863752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:51:26.909105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-59d0aa7b-9e87-4a93-b92d-2a69b6f59096 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516202 Jul 18 13:51:26.909915 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3304/6391] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:51:26.920623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-096a46b3-3d03-45ff-9df3-c821a1437fcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:26.921257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-096a46b3-3d03-45ff-9df3-c821a1437fcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:26.923846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:26.924628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=50 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:26.987464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-096a46b3-3d03-45ff-9df3-c821a1437fcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:26.994605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-096a46b3-3d03-45ff-9df3-c821a1437fcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1213 microversion: 2.1 time: 0.077819 Jul 18 13:51:26.995424 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3088/6392] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:26 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:28.013570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:28.014329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:28.021550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:28.022007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:28.023661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:28.024107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:28.127383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:28.135594 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2c53d98c-2f64-4492-9df8-6b6758fc7360 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1271 microversion: 2.1 time: 0.126978 Jul 18 13:51:28.136379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3305/6393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:28 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:29.153469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:29.154934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:29.164420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:29.164891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:29.165697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:29.166169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:29.260691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c2bad8c0-682e-4f3f-9cf0-ec05b24eb1a8 req-531d5d90-bdb9-4825-83b5-ec1a80adbc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f645a2e7-ae4a-41c3-9be2-fa8d88016d50", "tag": "62395a3c-e70f-4253-8b41-a3a9279fd350"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:29.275134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c2bad8c0-682e-4f3f-9cf0-ec05b24eb1a8 req-531d5d90-bdb9-4825-83b5-ec1a80adbc87 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:29.275929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c2bad8c0-682e-4f3f-9cf0-ec05b24eb1a8 req-531d5d90-bdb9-4825-83b5-ec1a80adbc87 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:29.304064 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c2bad8c0-682e-4f3f-9cf0-ec05b24eb1a8 req-531d5d90-bdb9-4825-83b5-ec1a80adbc87 service nova] Creating event network-changed:62395a3c-e70f-4253-8b41-a3a9279fd350 for instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 on n-h1-850003-3 Jul 18 13:51:29.309487 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c2bad8c0-682e-4f3f-9cf0-ec05b24eb1a8 req-531d5d90-bdb9-4825-83b5-ec1a80adbc87 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054939 Jul 18 13:51:29.310378 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3306/6394] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:51:29.317147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:29.326236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d9f4d1fe-a3c0-4b09-9ea9-88c4f149e76e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.177202 Jul 18 13:51:29.326834 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3089/6395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:29 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:30.345148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:30.345854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:30.352990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:30.353442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:30.354248 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:30.354688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:30.486973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:30.495254 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-517aeaa1-005b-4b0e-bec9-60f1c3f6064f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.155240 Jul 18 13:51:30.495822 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3307/6396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:30 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:31.512755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:31.513394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:31.520442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:31.520911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:31.521699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:31.522171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:31.651318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:31.659208 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-25202c04-bb72-4446-84f7-a7896f5c9041 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.150438 Jul 18 13:51:31.659799 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3090/6397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:31 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:32.676953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:32.677560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:32.685295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:32.685752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:32.686564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:32.687011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:32.828394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:32.836433 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90a088a4-5cbf-490b-9428-de5d60ecf254 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.163673 Jul 18 13:51:32.836998 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3308/6398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:32 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:33.854221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:33.854946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:33.861858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:33.862365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:33.863162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:33.863615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:33.995614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:34.003190 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8080e416-2d07-4595-aa67-3909240be07a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.153800 Jul 18 13:51:34.003764 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3091/6399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:33 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:35.020822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:35.021482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:35.028905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:35.029362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:35.030174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:35.030632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:35.165019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:35.172674 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5b3feb5-d8a0-490c-9342-7b419f2fd72e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.155974 Jul 18 13:51:35.173578 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3309/6400] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:35 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:36.189218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:36.189853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:36.197333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:36.197801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:36.198628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:36.199078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:36.360313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:36.370571 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e17b28d-f089-4e91-a6f7-52b3e4fa1b8f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.185257 Jul 18 13:51:36.373811 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3092/6401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:36 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:36.479527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5d74e7f9-dbc7-42cf-b128-85d267d412ed req-a5095e5b-9f8c-41ef-9fd6-4e8fdd485abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f645a2e7-ae4a-41c3-9be2-fa8d88016d50", "name": "network-vif-plugged", "status": "completed", "tag": "62395a3c-e70f-4253-8b41-a3a9279fd350"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:36.491876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5d74e7f9-dbc7-42cf-b128-85d267d412ed req-a5095e5b-9f8c-41ef-9fd6-4e8fdd485abd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:36.492477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5d74e7f9-dbc7-42cf-b128-85d267d412ed req-a5095e5b-9f8c-41ef-9fd6-4e8fdd485abd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:36.505342 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5d74e7f9-dbc7-42cf-b128-85d267d412ed req-a5095e5b-9f8c-41ef-9fd6-4e8fdd485abd service nova] Creating event network-vif-plugged:62395a3c-e70f-4253-8b41-a3a9279fd350 for instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 on n-h1-850003-3 Jul 18 13:51:36.511748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5d74e7f9-dbc7-42cf-b128-85d267d412ed req-a5095e5b-9f8c-41ef-9fd6-4e8fdd485abd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036358 Jul 18 13:51:36.512432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3310/6402] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:51:37.389213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:37.389851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:37.391879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:37.399625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:37.400092 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:37.400891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:37.401343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:37.541743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:37.549631 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6d37e954-37b8-4e1d-9bf5-b9b389d93bbd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1313 microversion: 2.1 time: 0.164317 Jul 18 13:51:37.550319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3093/6403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:37 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:38.564401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:38.565364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:38.571505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:38.572121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:38.579483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:38.579947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:38.580726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:38.581172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:38.726620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:38.735084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2d34f8b-a6ae-413f-9e09-9c5ba532f287 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1496 microversion: 2.1 time: 0.171588 Jul 18 13:51:38.735669 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3311/6404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:38 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:39.316169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:39.316742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:39.324816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:39.325355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:39.326243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:39.326794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:39.356338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:51:39.439517 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13ef1219-15fb-41c0-ba14-529d387e433e tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 204 len: 0 microversion: 2.1 time: 0.127020 Jul 18 13:51:39.440526 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3094/6405] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:51:39 2022] DELETE /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:51:39.450097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:39.450720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:39.456808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:39.457273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:39.458056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:39.458567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:39.609249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:39.617990 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dde360f-6280-4dee-aadb-12d08ab5a8d4 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1502 microversion: 2.1 time: 0.172500 Jul 18 13:51:39.619201 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3312/6406] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:39 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:40.637874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:40.638618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:40.645942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:40.646452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:40.647307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:40.647762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:40.800320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:40.808697 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a8fcd5b-1cf8-4d7a-8769-f2d7ff07ffc0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1502 microversion: 2.1 time: 0.175805 Jul 18 13:51:40.809313 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3095/6407] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:40 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:41.465234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3b3106c3-5cc0-4de5-8abc-6ce0b3f26501 req-b93aba0b-17d4-4885-9e1e-4cce8222301d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f645a2e7-ae4a-41c3-9be2-fa8d88016d50", "name": "network-vif-deleted", "tag": "62395a3c-e70f-4253-8b41-a3a9279fd350"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:41.476589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3b3106c3-5cc0-4de5-8abc-6ce0b3f26501 req-b93aba0b-17d4-4885-9e1e-4cce8222301d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:41.477133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3b3106c3-5cc0-4de5-8abc-6ce0b3f26501 req-b93aba0b-17d4-4885-9e1e-4cce8222301d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:41.490287 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3b3106c3-5cc0-4de5-8abc-6ce0b3f26501 req-b93aba0b-17d4-4885-9e1e-4cce8222301d service nova] Creating event network-vif-deleted:62395a3c-e70f-4253-8b41-a3a9279fd350 for instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 on n-h1-850003-3 Jul 18 13:51:41.496194 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3b3106c3-5cc0-4de5-8abc-6ce0b3f26501 req-b93aba0b-17d4-4885-9e1e-4cce8222301d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 Jul 18 13:51:41.497383 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3313/6408] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:51:41.826769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:41.827409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:41.838647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:41.839119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:41.839926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:41.840960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:41.885912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:41.887882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:41.888666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lazy-loading 'fault' on Instance uuid f645a2e7-ae4a-41c3-9be2-fa8d88016d50 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:51:41.941867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:41.950459 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a00edbf-8f8a-489b-9c36-1e4f3f49609a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 200 len: 1303 microversion: 2.1 time: 0.127528 Jul 18 13:51:41.951384 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3096/6409] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:41 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:42.971008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:42.971972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: f645a2e7-ae4a-41c3-9be2-fa8d88016d50] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:42.981792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:42.982605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:42.983926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:42.984104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:43.013106 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] HTTP exception thrown: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Request method failure captured: Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 HTTP/1.1 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WVcMBTmn4GgNt3eUB6XYyTjSoUj9W2qSfdl5_QVoIMU25iQ3rhNyvIQ-6TVZq5Xv1tmWw_J17z6aUrtQXuSgFpJpd9tUVAqR89TRTdpeWw8-uZJ_INYzNYHaFeErHks8BafEzlnHPFIFoC7l18dibu8OEhwIm-jPtTV5cRigfj2LSc Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 48d29f9199e04f58bf0dcd52dac65b65 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-VolumesActionsTest-1962183549 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_48d29f9199e04f58bf0dcd52dac65b65", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-VolumesActionsTest-1962183549 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 48d29f9199e04f58bf0dcd52dac65b65 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-VolumesActionsTest-1962183549 Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-VolumesActionsTest-1962183549-project Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 0e03447a9edf48c0aa5c28a397a8ecff Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-VolumesActionsTest-1962183549-project Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'f645a2e7-ae4a-41c3-9be2-fa8d88016d50'} Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:51:43.016182 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Returning 404 to user: Instance f645a2e7-ae4a-41c3-9be2-fa8d88016d50 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe8b8856-740f-4f7e-92c7-0f616936a37f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50" status: 404 len: 111 microversion: 2.1 time: 0.057445 Jul 18 13:51:43.035395 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3314/6410] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:42 2022] GET /compute/v2.1/servers/f645a2e7-ae4a-41c3-9be2-fa8d88016d50 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:51:43.114783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2137127036", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "65d8875f-2b38-420c-9008-6df40bdb53f0"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:43.201323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] validate_networks() for [('65d8875f-2b38-420c-9008-6df40bdb53f0', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:51:43.732521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:51:43.732966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:51:43.733482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:51:43.733911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:51:43.734385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:51:43.744750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:43.745321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:43.746684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:43.747810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:43.781836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Getting quotas for project 48d29f9199e04f58bf0dcd52dac65b65. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:51:43.792870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Getting quotas for user 0e03447a9edf48c0aa5c28a397a8ecff and project 48d29f9199e04f58bf0dcd52dac65b65. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:51:43.813780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:51:43.816133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:51:43.892265 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ab203763-8fef-40f9-882b-68b8de4f59e0 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782389 Jul 18 13:51:43.904428 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3097/6411] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:51:43.914197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-790f5754-5d17-4404-acdb-b21d999961e2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:43.915639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-790f5754-5d17-4404-acdb-b21d999961e2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:43.997630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-790f5754-5d17-4404-acdb-b21d999961e2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:44.012321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-790f5754-5d17-4404-acdb-b21d999961e2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1214 microversion: 2.1 time: 0.104195 Jul 18 13:51:44.015216 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3315/6412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:43 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:45.041423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:45.042087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:45.050775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:45.053944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:45.053944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:45.053944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:45.153999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:45.170170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8dd1dfcd-5f58-4768-a919-6baf22f25578 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1266 microversion: 2.1 time: 0.132658 Jul 18 13:51:45.172038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3098/6413] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:45 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:46.190340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:46.191715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:46.199759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:46.200631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:46.201765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:46.202299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:46.683854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:46.692519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1be1dc91-6a67-4f29-be0c-938bff5fc0b2 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.506427 Jul 18 13:51:46.694401 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3316/6414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:46 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:47.053963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0108ee35-f09b-4c7a-ab28-04645c8b2c14 req-584d3011-01f5-4005-a096-385423fe8712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b745cba-2335-4c91-a204-40d0df663421", "tag": "66175c61-e1e9-431b-bc0f-cd162d36ceac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:47.079884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0108ee35-f09b-4c7a-ab28-04645c8b2c14 req-584d3011-01f5-4005-a096-385423fe8712 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:47.080158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0108ee35-f09b-4c7a-ab28-04645c8b2c14 req-584d3011-01f5-4005-a096-385423fe8712 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:47.098030 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0108ee35-f09b-4c7a-ab28-04645c8b2c14 req-584d3011-01f5-4005-a096-385423fe8712 service nova] Creating event network-changed:66175c61-e1e9-431b-bc0f-cd162d36ceac for instance 2b745cba-2335-4c91-a204-40d0df663421 on n-h1-850003-3 Jul 18 13:51:47.104298 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0108ee35-f09b-4c7a-ab28-04645c8b2c14 req-584d3011-01f5-4005-a096-385423fe8712 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058750 Jul 18 13:51:47.105124 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3099/6415] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:51:47.535621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1555616168", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1982458682", "security_groups": [{"name": "tempest-secgroup-smoke-852450238"}], "block_device_mapping_v2": [{"uuid": "c932ae1c-8ab0-4b2c-8c65-602208f3fe1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd515aa0-e303-405b-a3f0-183547e45fd5"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:47.653067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] validate_networks() for [('bd515aa0-e303-405b-a3f0-183547e45fd5', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:51:47.712783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:47.713614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:47.720221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:47.720685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:47.721488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:47.721931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:47.862295 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:47.870241 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d685349-0d8a-457f-ae9f-26b4a306d3f9 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.162126 Jul 18 13:51:47.870835 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3100/6416] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:47 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:51:48.043621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:51:48.044244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:51:48.044753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:51:48.045172 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:51:48.045621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:51:48.055739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:48.056193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:48.057006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:48.057471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:48.075218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:51:48.080516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Getting quotas for user dfc9904768d54c97860e34cc54aee32a and project 2ec0601ae9864b8ba5ebd9557606dc30. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:51:48.138479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:51:48.140575 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c932ae1c-8ab0-4b2c-8c65-602208f3fe1c',volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:51:48.269910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a8aa0de-ee72-4d5e-86fc-0398ac115fee tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738734 Jul 18 13:51:48.270675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3317/6417] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:51:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:51:48.281580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-446abe43-cba4-4801-be86-148e7ee3f39b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:48.282603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-446abe43-cba4-4801-be86-148e7ee3f39b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:48.337281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-446abe43-cba4-4801-be86-148e7ee3f39b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:48.344266 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-446abe43-cba4-4801-be86-148e7ee3f39b tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1095 microversion: 2.1 time: 0.066695 Jul 18 13:51:48.344959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3101/6418] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:48 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:48.891236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:48.892430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:48.900727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:48.901190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:48.902141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:48.902647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:49.045970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:49.054832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c01623e5-6717-4f21-b132-8b8f7883d9dd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.170515 Jul 18 13:51:49.055426 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3318/6419] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:48 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:49.361354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:49.362486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:49.373785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:49.374313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:49.375155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:49.375623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:49.447385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:49.457127 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9aa80b62-110b-4e0d-a6bf-b0a410777368 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1211 microversion: 2.1 time: 0.099606 Jul 18 13:51:49.462268 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3102/6420] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:49 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:50.074298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:50.074930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:50.084282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:50.084780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:50.085571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:50.086838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:50.421004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:50.432669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e7c21e86-f18a-499c-af94-9fb8c9fa7e82 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.362342 Jul 18 13:51:50.436113 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3319/6421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:50 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:50.478769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:50.480195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:50.488660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:50.489424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:50.490544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:50.491728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:50.672896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:50.682053 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c73b303a-a78a-49c2-9079-134482216d40 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1278 microversion: 2.1 time: 0.208489 Jul 18 13:51:50.683812 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3103/6422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:50 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:51.299729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-da55048c-d824-4181-a2cc-9b1fb00798db req-5a503601-f3bf-4a35-ac59-531ca0a2f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a198f74c-6a2e-4f6f-a6da-340969129310", "tag": "2af2d0c4-7b2c-47c0-8e87-064bcd76aa98"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:51.326456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-da55048c-d824-4181-a2cc-9b1fb00798db req-5a503601-f3bf-4a35-ac59-531ca0a2f8b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:51.326920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-da55048c-d824-4181-a2cc-9b1fb00798db req-5a503601-f3bf-4a35-ac59-531ca0a2f8b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:51.344216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-da55048c-d824-4181-a2cc-9b1fb00798db req-5a503601-f3bf-4a35-ac59-531ca0a2f8b1 service nova] Creating event network-changed:2af2d0c4-7b2c-47c0-8e87-064bcd76aa98 for instance a198f74c-6a2e-4f6f-a6da-340969129310 on n-h2-850003-3 Jul 18 13:51:51.355269 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-da55048c-d824-4181-a2cc-9b1fb00798db req-5a503601-f3bf-4a35-ac59-531ca0a2f8b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059767 Jul 18 13:51:51.356235 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3320/6423] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:51:51.452688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:51.453746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:51.460343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:51.461031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:51.461883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:51.462406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:51.618964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:51.627384 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5351cbd5-a742-4dad-8c11-8c5a820abfa5 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.178524 Jul 18 13:51:51.627973 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3104/6424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:51 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:51.700516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:51.701571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:51.708443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:51.709099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:51.710754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:51.711413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:51.901755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:51.910012 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bdbe35f2-8e6a-498e-8759-a596f2914cab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1278 microversion: 2.1 time: 0.213996 Jul 18 13:51:51.910639 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3321/6425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:51 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:52.644861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:52.645518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:52.653362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:52.653825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:52.654656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:52.655111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:52.796751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:52.801831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:52.808414 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c511bb58-b676-4d43-ad47-fb340227735b tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.167758 Jul 18 13:51:52.809016 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3105/6426] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:52 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:51:52.929211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:52.930011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:52.937188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:52.937727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:52.938592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:52.939121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:53.090463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:53.098434 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6262a78a-9847-41e5-a114-996ee956e004 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1278 microversion: 2.1 time: 0.174700 Jul 18 13:51:53.099045 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3322/6427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:52 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:53.825632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:53.826293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:53.829492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:53.837533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:53.838004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:53.838831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:53.839288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:53.972169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:53.980395 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af03306e-7acd-4248-a164-4610e4a26d7a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.158815 Jul 18 13:51:53.980987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3106/6428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:53 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:54.116589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:54.117241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:54.124389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:54.124853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:54.125631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:54.126082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:54.270242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:54.278669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbd8e9b2-a52b-4e8a-af60-9c98f27e8cea tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1278 microversion: 2.1 time: 0.166471 Jul 18 13:51:54.279367 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3323/6429] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:54 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:54.545084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-81153d53-9ec7-49ca-af85-060a61df9297 req-6813f7ea-9623-4cc3-ab89-0fbe4a7883ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b745cba-2335-4c91-a204-40d0df663421", "name": "network-vif-plugged", "status": "completed", "tag": "66175c61-e1e9-431b-bc0f-cd162d36ceac"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:51:54.554542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-81153d53-9ec7-49ca-af85-060a61df9297 req-6813f7ea-9623-4cc3-ab89-0fbe4a7883ef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:54.555130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-81153d53-9ec7-49ca-af85-060a61df9297 req-6813f7ea-9623-4cc3-ab89-0fbe4a7883ef service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:54.568255 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-81153d53-9ec7-49ca-af85-060a61df9297 req-6813f7ea-9623-4cc3-ab89-0fbe4a7883ef service nova] Creating event network-vif-plugged:66175c61-e1e9-431b-bc0f-cd162d36ceac for instance 2b745cba-2335-4c91-a204-40d0df663421 on n-h1-850003-3 Jul 18 13:51:54.573677 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-81153d53-9ec7-49ca-af85-060a61df9297 req-6813f7ea-9623-4cc3-ab89-0fbe4a7883ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Jul 18 13:51:54.574345 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3107/6430] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:51:54.997145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:54.997658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:55.003982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:55.004329 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:55.005108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:55.005548 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:55.147254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:55.155014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a24e6158-0640-4b53-8869-483994d535e1 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.161918 Jul 18 13:51:55.155828 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3324/6431] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:54 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:55.298705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:55.299347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:55.306344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:55.306815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:55.307606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:55.308060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:55.448453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:55.456060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7778f6e4-1053-41e3-aa56-1a1967803c15 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.162721 Jul 18 13:51:55.456643 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3108/6432] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:55 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:56.172619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:56.173262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:56.181004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:56.181454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:56.182252 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:56.182686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:56.353462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:56.361704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b98e2a38-e715-49e7-bc42-9adf2aed8c23 tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1314 microversion: 2.1 time: 0.193212 Jul 18 13:51:56.362877 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3325/6433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:56 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:56.473083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:56.473708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:56.481601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:56.482228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:56.483020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:56.483489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:56.622707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:56.630746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0bdd4b7e-3b46-4f17-99ff-b1b6b6437710 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.161779 Jul 18 13:51:56.631566 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3109/6434] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:56 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:57.379824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:57.380446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:57.383275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:57.389561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.390014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:57.390827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.391270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:57.394471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:57.530008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:57.538124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f0e29cd9-d64c-490b-9216-7baf0caf8bcd tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1496 microversion: 2.1 time: 0.162228 Jul 18 13:51:57.538733 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3326/6435] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:57 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:57.647921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:57.648551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:57.651412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:57.657076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.657606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:57.658471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.659007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:57.815511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:57.824962 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8949a7a-7248-4618-9ed3-5cd47c9863e2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.181086 Jul 18 13:51:57.825672 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3110/6436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:57 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:57.973755 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:57.974373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:57.982303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.982767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:57.983680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:57.984007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:58.015837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:51:58.065774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:58.087608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:58.117224 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63829dca-b0bc-4d10-91d2-b7eae6a405fe tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 204 len: 0 microversion: 2.1 time: 0.147783 Jul 18 13:51:58.117912 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3327/6437] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:51:57 2022] DELETE /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:51:58.127387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:58.128326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:58.135058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:58.135631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:58.136659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:58.137426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:58.307606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:58.317038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94f23e7d-1d06-4b2b-97d6-1ad1009ad24c tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1502 microversion: 2.1 time: 0.193720 Jul 18 13:51:58.317600 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3111/6438] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:58 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:58.844024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:58.844862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:58.852061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:58.852518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:58.853312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:58.853759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:59.005221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:59.014218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c57a5ff-7b65-40f4-96b5-9163ec8780e7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.174497 Jul 18 13:51:59.014846 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3328/6439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:58 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:51:59.335056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:51:59.335911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:51:59.338484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:51:59.344936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:59.345558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:59.346381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:51:59.346915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:51:59.488685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:51:59.499301 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f7df7ff-b131-4e5e-b0c7-ed9db6ea760a tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1502 microversion: 2.1 time: 0.168340 Jul 18 13:51:59.500049 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3112/6440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:51:59 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:00.033146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:00.033707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:00.041678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:00.042167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:00.043063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:00.043503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:00.522200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:00.525320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:00.541838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:00.543476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:00.545958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:00.547495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:00.613983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:00.623940 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ddc979ab-acc9-48c0-a2f8-971458208f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.595371 Jul 18 13:52:00.624777 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3329/6441] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:00 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:52:00.629974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-bbd8ab14-7bb5-48e9-ae80-f4429db73364 req-527cfe3d-3235-4def-8761-e22e15d92b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b745cba-2335-4c91-a204-40d0df663421", "name": "network-vif-deleted", "tag": "66175c61-e1e9-431b-bc0f-cd162d36ceac"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:52:00.639786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bbd8ab14-7bb5-48e9-ae80-f4429db73364 req-527cfe3d-3235-4def-8761-e22e15d92b5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:00.640362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-bbd8ab14-7bb5-48e9-ae80-f4429db73364 req-527cfe3d-3235-4def-8761-e22e15d92b5e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:00.653397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-bbd8ab14-7bb5-48e9-ae80-f4429db73364 req-527cfe3d-3235-4def-8761-e22e15d92b5e service nova] Creating event network-vif-deleted:66175c61-e1e9-431b-bc0f-cd162d36ceac for instance 2b745cba-2335-4c91-a204-40d0df663421 on n-h1-850003-3 Jul 18 13:52:00.661924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e03447a9edf48c0aa5c28a397a8ecff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d29f9199e04f58bf0dcd52dac65b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:00.664197 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-bbd8ab14-7bb5-48e9-ae80-f4429db73364 req-527cfe3d-3235-4def-8761-e22e15d92b5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038047 Jul 18 13:52:00.665200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3330/6442] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:52:00.673812 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7bf8e542-6ceb-4478-917b-3f396d44df1f tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 200 len: 1299 microversion: 2.1 time: 0.159755 Jul 18 13:52:00.674683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3113/6443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:00 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:01.647266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:01.647980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:01.654567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:01.655031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:01.655824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:01.656267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:01.694305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:01.694971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] [instance: 2b745cba-2335-4c91-a204-40d0df663421] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:01.702797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:01.703268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:01.704117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:01.704665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:01.719035 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] HTTP exception thrown: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Request method failure captured: Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 HTTP/1.1 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WVcMBTmn4GgNt3eUB6XYyTjSoUj9W2qSfdl5_QVoIMU25iQ3rhNyvIQ-6TVZq5Xv1tmWw_J17z6aUrtQXuSgFpJpd9tUVAqR89TRTdpeWw8-uZJ_INYzNYHaFeErHks8BafEzlnHPFIFoC7l18dibu8OEhwIm-jPtTV5cRigfj2LSc Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 48d29f9199e04f58bf0dcd52dac65b65 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-VolumesActionsTest-1962183549 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_48d29f9199e04f58bf0dcd52dac65b65", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/48d29f9199e04f58bf0dcd52dac65b65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-VolumesActionsTest-1962183549 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 48d29f9199e04f58bf0dcd52dac65b65 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-VolumesActionsTest-1962183549 Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-VolumesActionsTest-1962183549-project Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 0e03447a9edf48c0aa5c28a397a8ecff Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-VolumesActionsTest-1962183549-project Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2b745cba-2335-4c91-a204-40d0df663421'} Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:52:01.721127 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] Returning 404 to user: Instance 2b745cba-2335-4c91-a204-40d0df663421 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b8d61371-3c13-455d-8231-9d4ce4c713db tempest-VolumesActionsTest-1962183549 tempest-VolumesActionsTest-1962183549-project] 10.222.0.88 "GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421" status: 404 len: 111 microversion: 2.1 time: 0.032465 Jul 18 13:52:01.726511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3114/6444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:01 2022] GET /compute/v2.1/servers/2b745cba-2335-4c91-a204-40d0df663421 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:52:01.828710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:01.839591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db46c8ef-bc6b-475c-9e83-29488c5a2f05 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.197559 Jul 18 13:52:01.840369 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3331/6445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:01 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:02.856665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:02.857300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:02.864547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:02.865023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:02.865828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:02.866330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:03.012052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:03.019938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9ecc441-fead-4230-8289-e2ae288b9ac7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.167167 Jul 18 13:52:03.020545 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3115/6446] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:02 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:03.819015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-093642b3-b34a-498d-86ac-e3a6136da288 req-7caa6b12-119d-47ab-b416-a274a891e749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a198f74c-6a2e-4f6f-a6da-340969129310", "name": "network-vif-plugged", "status": "completed", "tag": "2af2d0c4-7b2c-47c0-8e87-064bcd76aa98"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:52:03.834407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-093642b3-b34a-498d-86ac-e3a6136da288 req-7caa6b12-119d-47ab-b416-a274a891e749 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:03.836328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-093642b3-b34a-498d-86ac-e3a6136da288 req-7caa6b12-119d-47ab-b416-a274a891e749 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:03.865206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-093642b3-b34a-498d-86ac-e3a6136da288 req-7caa6b12-119d-47ab-b416-a274a891e749 service nova] Creating event network-vif-plugged:2af2d0c4-7b2c-47c0-8e87-064bcd76aa98 for instance a198f74c-6a2e-4f6f-a6da-340969129310 on n-h2-850003-3 Jul 18 13:52:03.879086 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-093642b3-b34a-498d-86ac-e3a6136da288 req-7caa6b12-119d-47ab-b416-a274a891e749 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063723 Jul 18 13:52:03.882023 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3332/6447] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:52:04.037805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:04.039336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:04.052188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:04.058674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:04.060072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:04.060788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:04.278226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:04.291170 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9869c31-beb6-4af8-990f-e99f229a86e5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.257779 Jul 18 13:52:04.301465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3116/6448] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:04 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:05.310942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:05.312713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:05.319971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:05.320765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:05.323499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:05.324231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:05.517946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:05.527636 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2cb6f2f7-15d0-410e-bab9-e4eedd2ff4d0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1266 microversion: 2.1 time: 0.222762 Jul 18 13:52:05.539370 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3333/6449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:05 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:06.549333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:06.550626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:06.559613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:06.560619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:06.561862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:06.562352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:06.743362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:06.753820 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8fd16dca-975a-4d82-9bf0-27a3bd52e2b3 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1453 microversion: 2.1 time: 0.209599 Jul 18 13:52:06.754446 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3117/6450] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:06 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:52:06.773461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:52:06.775572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:52:06.785043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:06.785978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:06.786994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:06.787635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:06.963055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:52:06.971342 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b89877af-17d8-42ad-b4bd-ce5a9666a348 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1453 microversion: 2.1 time: 0.202858 Jul 18 13:52:06.971948 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3334/6451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:52:06 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:52:09.063585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-34361110-13e2-4962-97db-2f5cfe41b294 req-55e72391-ba9a-43b2-9e32-5bcd876db8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a198f74c-6a2e-4f6f-a6da-340969129310", "tag": "2af2d0c4-7b2c-47c0-8e87-064bcd76aa98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:52:09.075201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-34361110-13e2-4962-97db-2f5cfe41b294 req-55e72391-ba9a-43b2-9e32-5bcd876db8f5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:52:09.076923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-34361110-13e2-4962-97db-2f5cfe41b294 req-55e72391-ba9a-43b2-9e32-5bcd876db8f5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:52:09.091439 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-34361110-13e2-4962-97db-2f5cfe41b294 req-55e72391-ba9a-43b2-9e32-5bcd876db8f5 service nova] Creating event network-changed:2af2d0c4-7b2c-47c0-8e87-064bcd76aa98 for instance a198f74c-6a2e-4f6f-a6da-340969129310 on n-h2-850003-3 Jul 18 13:52:09.097800 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-34361110-13e2-4962-97db-2f5cfe41b294 req-55e72391-ba9a-43b2-9e32-5bcd876db8f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037915 Jul 18 13:52:09.098930 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3118/6452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:52:37.350553 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:52:37.351198 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 13:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:53:20.804833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:20.805909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:20.812831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-436bcbc2-b620-44c0-af7e-fb42a422b9a6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: .version_select at 0x7f96d7a87430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2036204132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9ktG2Jv/yDSunbudilNkzRSr4C4J+QU9DYP46XoHAAZM97ptpxjgAU1wkh+DXGtCrN0atz23cONHAoijeLSfr20rHg6kNWqf4eA34k4MN3MXwtzq7oIC6CLspGlKJd9A=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:20.831870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-436bcbc2-b620-44c0-af7e-fb42a422b9a6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:53:20.838993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-436bcbc2-b620-44c0-af7e-fb42a422b9a6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:53:20.901635 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-436bcbc2-b620-44c0-af7e-fb42a422b9a6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.095894 Jul 18 13:53:20.907504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3335/6453] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:53:20 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:22.034447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=17 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:22.035461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=66 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:22.041646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-525322286", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "07915f55-f734-4d2e-8ad2-3e46be106716"}], "key_name": "tempest-TestNetworkBasicOps-2036204132", "security_groups": [{"name": "tempest-secgroup-smoke-1455439010"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:22.396571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] validate_networks() for [('07915f55-f734-4d2e-8ad2-3e46be106716', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:53:22.816743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:53:22.817185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:53:22.817672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:53:22.818093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:53:22.818558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:53:22.828476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:22.828936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:22.829765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:22.830242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:22.848935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:53:22.855071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:53:22.868907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:53:22.871446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:53:22.919844 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd8255de-7104-4d34-be8e-658d45464314 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888036 Jul 18 13:53:22.920726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3119/6454] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:53:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:53:22.933057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a27c075a-2da1-4e93-93ed-fca1838bb419 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:22.933749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a27c075a-2da1-4e93-93ed-fca1838bb419 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:23.063481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a27c075a-2da1-4e93-93ed-fca1838bb419 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:23.078622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a27c075a-2da1-4e93-93ed-fca1838bb419 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1248 microversion: 2.1 time: 0.151789 Jul 18 13:53:23.079665 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3336/6455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:22 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:53:24.097087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:24.097763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:24.105114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:24.105651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:24.106502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:24.106960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:24.172926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:24.180971 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e555de7-4117-4a73-bbbb-a44b3ab8d3b1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1306 microversion: 2.1 time: 0.089000 Jul 18 13:53:24.181598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3120/6456] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:24 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:25.198627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:25.199351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:25.207820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:25.208328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:25.209128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:25.209573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:25.490862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:25.499152 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8651fc0-7bf3-4fa6-9f73-2492e4cdd9a5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.304528 Jul 18 13:53:25.499751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3337/6457] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:25 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:25.905082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d7154070-d6cb-44b4-950a-f435c2882f82 req-7b42082a-36d1-45b7-bd8b-7c595df2fe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1832776-8e06-4ace-8e10-7f7a60f02e60", "tag": "568e361b-4162-4951-ae43-96207724a04b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:25.914224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d7154070-d6cb-44b4-950a-f435c2882f82 req-7b42082a-36d1-45b7-bd8b-7c595df2fe73 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:25.914788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d7154070-d6cb-44b4-950a-f435c2882f82 req-7b42082a-36d1-45b7-bd8b-7c595df2fe73 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:25.930113 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d7154070-d6cb-44b4-950a-f435c2882f82 req-7b42082a-36d1-45b7-bd8b-7c595df2fe73 service nova] Creating event network-changed:568e361b-4162-4951-ae43-96207724a04b for instance e1832776-8e06-4ace-8e10-7f7a60f02e60 on n-h1-850003-3 Jul 18 13:53:25.935832 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d7154070-d6cb-44b4-950a-f435c2882f82 req-7b42082a-36d1-45b7-bd8b-7c595df2fe73 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140066 Jul 18 13:53:25.936435 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3121/6458] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:26.516446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:26.516991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:26.524029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:26.524477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:26.525238 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:26.525746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:26.660310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:26.668519 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb2beddc-9de5-4c7b-8e38-f4e7de677fd3 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.156144 Jul 18 13:53:26.669103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3338/6459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:26 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:27.686926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:27.687677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:27.694008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:27.694626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:27.695298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:27.695752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:27.834388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:27.842460 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3224d891-da7e-4a4f-9a3b-9a5111f56516 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.161149 Jul 18 13:53:27.843084 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3122/6460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:27 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:28.860738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:28.862000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:28.871598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:28.872219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:28.873240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:28.873879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:29.008754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:29.017212 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b89307b9-b527-4fed-9c13-3453f24c87ab tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.161437 Jul 18 13:53:29.017796 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3339/6461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:28 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:53:30.034648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:30.035218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:30.042847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:30.043309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:30.044101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:30.044558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:30.189219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:30.197003 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34e2725c-7b0d-4335-b058-cb153050b674 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.166757 Jul 18 13:53:30.197602 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3123/6462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:30 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:31.214349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:31.215270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:31.222983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:31.223437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:31.224215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:31.224648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:31.364585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:31.372846 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5bd7bc0c-1845-4ca6-9382-23cddeba35ec tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.162726 Jul 18 13:53:31.373436 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3340/6463] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:31 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:32.389964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:32.390621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:32.397782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:32.398281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:32.399064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:32.399514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:32.537896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:32.545918 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f21c26b2-d08a-4f2f-aaad-1146b88f4862 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.160001 Jul 18 13:53:32.546547 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3124/6464] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:32 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:33.157903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:33.220422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-57916fa5-ceed-429e-8450-eb4b3f85d5e1 req-7efbb6fb-952a-4d53-a06e-9f6673965970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1832776-8e06-4ace-8e10-7f7a60f02e60", "name": "network-vif-plugged", "status": "completed", "tag": "568e361b-4162-4951-ae43-96207724a04b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:33.229976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-57916fa5-ceed-429e-8450-eb4b3f85d5e1 req-7efbb6fb-952a-4d53-a06e-9f6673965970 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:33.230565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-57916fa5-ceed-429e-8450-eb4b3f85d5e1 req-7efbb6fb-952a-4d53-a06e-9f6673965970 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:33.241909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-57916fa5-ceed-429e-8450-eb4b3f85d5e1 req-7efbb6fb-952a-4d53-a06e-9f6673965970 service nova] Creating event network-vif-plugged:568e361b-4162-4951-ae43-96207724a04b for instance e1832776-8e06-4ace-8e10-7f7a60f02e60 on n-h1-850003-3 Jul 18 13:53:33.247540 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-57916fa5-ceed-429e-8450-eb4b3f85d5e1 req-7efbb6fb-952a-4d53-a06e-9f6673965970 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096323 Jul 18 13:53:33.248157 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3341/6465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:33.563049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:33.563669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:33.565654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:33.566387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:33.573666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:33.574132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:33.574948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:33.575399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:33.723513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:33.731834 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8867f565-64b0-40cf-bafc-c28f75fead09 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1374 microversion: 2.1 time: 0.172747 Jul 18 13:53:33.732419 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3125/6466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:33 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:34.751250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:34.752125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:34.758778 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:34.759237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:34.760049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:34.760489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:34.909217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:34.918368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4682be17-25e5-40ff-9d35-f6c1f7b7f5ac tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1545 microversion: 2.1 time: 0.173159 Jul 18 13:53:34.919009 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3342/6467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:34 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1545 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:34.934675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:34.935348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:34.942531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:34.943001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:34.943794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:34.944284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:35.080743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:35.089192 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c458f9f2-67ff-4281-96c7-31d3ed58231b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1545 microversion: 2.1 time: 0.158628 Jul 18 13:53:35.089780 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3126/6468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:34 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1545 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:36.779840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-44dcd4df-2150-4a22-8592-3c6c2ac517db req-a78a2ed8-61a2-4317-a685-9e7d40d7e15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1832776-8e06-4ace-8e10-7f7a60f02e60", "tag": "568e361b-4162-4951-ae43-96207724a04b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:36.792178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44dcd4df-2150-4a22-8592-3c6c2ac517db req-a78a2ed8-61a2-4317-a685-9e7d40d7e15e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:36.792628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-44dcd4df-2150-4a22-8592-3c6c2ac517db req-a78a2ed8-61a2-4317-a685-9e7d40d7e15e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:36.805937 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-44dcd4df-2150-4a22-8592-3c6c2ac517db req-a78a2ed8-61a2-4317-a685-9e7d40d7e15e service nova] Creating event network-changed:568e361b-4162-4951-ae43-96207724a04b for instance e1832776-8e06-4ace-8e10-7f7a60f02e60 on n-h1-850003-3 Jul 18 13:53:36.812841 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-44dcd4df-2150-4a22-8592-3c6c2ac517db req-a78a2ed8-61a2-4317-a685-9e7d40d7e15e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036017 Jul 18 13:53:36.814641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3343/6469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:39.253292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:39.253852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:39.257241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2d1efa8f-3a72-446d-913b-bb94ace6cd0f req-5c7582c5-59f6-480e-baff-81a86e177fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a198f74c-6a2e-4f6f-a6da-340969129310", "tag": "2af2d0c4-7b2c-47c0-8e87-064bcd76aa98"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:39.262582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:39.263100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:39.263869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:39.264543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:39.269005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d1efa8f-3a72-446d-913b-bb94ace6cd0f req-5c7582c5-59f6-480e-baff-81a86e177fc9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:39.269461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2d1efa8f-3a72-446d-913b-bb94ace6cd0f req-5c7582c5-59f6-480e-baff-81a86e177fc9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:39.290651 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2d1efa8f-3a72-446d-913b-bb94ace6cd0f req-5c7582c5-59f6-480e-baff-81a86e177fc9 service nova] Creating event network-changed:2af2d0c4-7b2c-47c0-8e87-064bcd76aa98 for instance a198f74c-6a2e-4f6f-a6da-340969129310 on n-h2-850003-3 Jul 18 13:53:39.292312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:53:39.296386 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2d1efa8f-3a72-446d-913b-bb94ace6cd0f req-5c7582c5-59f6-480e-baff-81a86e177fc9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043874 Jul 18 13:53:39.297792 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3344/6470] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:53:39.390416 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c63183ca-827b-4da2-8585-2acb332e05dd tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 204 len: 0 microversion: 2.1 time: 0.140752 Jul 18 13:53:39.391188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3127/6471] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:53:39 2022] DELETE /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:39.402028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:39.402028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:39.412760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:39.413225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:39.414018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:39.414718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:39.596209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:39.606715 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f18e86b0-dbd7-4fc3-8dc6-469e08868ec9 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1578 microversion: 2.1 time: 0.210711 Jul 18 13:53:39.607424 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3345/6472] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:39 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:40.625960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:40.626772 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:40.633919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:40.634490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:40.635607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:40.636100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:40.802557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:40.811605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-20325c96-ab44-4c5f-8391-ea47d05a827e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1578 microversion: 2.1 time: 0.190156 Jul 18 13:53:40.812429 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3128/6473] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:40 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:53:41.831110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:41.831732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:41.839014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:41.839463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:41.840251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:41.840688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:41.914121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:41.922660 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b465a381-4316-4e8e-8551-f797c31d0ec2 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1392 microversion: 2.1 time: 0.096575 Jul 18 13:53:41.923258 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3346/6474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:41 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:41.935068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a1f12237-5603-4046-b541-432dfddc1301 req-9ce42ea0-73b1-44af-aed2-8569ae11fbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a198f74c-6a2e-4f6f-a6da-340969129310", "name": "network-vif-deleted", "tag": "2af2d0c4-7b2c-47c0-8e87-064bcd76aa98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:41.943537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a1f12237-5603-4046-b541-432dfddc1301 req-9ce42ea0-73b1-44af-aed2-8569ae11fbb5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:41.943991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a1f12237-5603-4046-b541-432dfddc1301 req-9ce42ea0-73b1-44af-aed2-8569ae11fbb5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:41.955860 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a1f12237-5603-4046-b541-432dfddc1301 req-9ce42ea0-73b1-44af-aed2-8569ae11fbb5 service nova] Creating event network-vif-deleted:2af2d0c4-7b2c-47c0-8e87-064bcd76aa98 for instance a198f74c-6a2e-4f6f-a6da-340969129310 on n-h2-850003-3 Jul 18 13:53:41.961230 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a1f12237-5603-4046-b541-432dfddc1301 req-9ce42ea0-73b1-44af-aed2-8569ae11fbb5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Jul 18 13:53:41.961865 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3129/6475] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:53:42.941568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:42.942233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:42.950301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:42.950767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:42.951579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:42.952024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:43.022887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:43.032978 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6066f714-2bbc-4dfe-8166-291452986cef tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1226 microversion: 2.1 time: 0.096061 Jul 18 13:53:43.033698 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3347/6476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:42 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:44.052403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:44.053169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:44.060822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:44.061529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:44.062417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:44.063246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:44.128478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:44.136567 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bca46b7d-d712-48db-aebe-3d4f2ad16219 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1226 microversion: 2.1 time: 0.089643 Jul 18 13:53:44.137152 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3130/6477] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:44 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:45.153687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:45.154466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:45.162790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:45.163257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:45.164054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:45.164502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:45.238483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:45.246909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-282bb088-3d76-469a-b87b-ef3268301a13 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1226 microversion: 2.1 time: 0.097677 Jul 18 13:53:45.247523 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3348/6478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:45 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:46.266180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:46.266790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:46.274029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:46.274515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:46.275961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:46.276417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:46.345312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:46.355984 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c474d307-7b4d-41d6-af41-50c71ed40bdb tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 200 len: 1226 microversion: 2.1 time: 0.093327 Jul 18 13:53:46.357017 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3131/6479] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:46 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:47.373829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:47.374493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: a198f74c-6a2e-4f6f-a6da-340969129310] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:47.381498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:47.381950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:47.382763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:47.383205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:47.399924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 HTTP/1.1 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a198f74c-6a2e-4f6f-a6da-340969129310'} Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:53:47.401603 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance a198f74c-6a2e-4f6f-a6da-340969129310 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-011c307d-a516-4c2e-bd57-ad568e4750c0 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310" status: 404 len: 111 microversion: 2.1 time: 0.033706 Jul 18 13:53:47.407768 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3349/6480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:47 2022] GET /compute/v2.1/servers/a198f74c-6a2e-4f6f-a6da-340969129310 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:53:53.700602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:53.701994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:53.702915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0c59fd05-ae7a-4a1c-89ca-52c7c2bfe27a req-16d9a7cf-d533-44c7-849e-3309788a2d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dd6f91-a28c-49d1-ab69-04f4349fb6b1", "tag": "0cf6e7b4-a699-48d5-b5e5-fc286ff20e50"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:53.704587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.708273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.710486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:53.711174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:53.712948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:53.713806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:53.716712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0c59fd05-ae7a-4a1c-89ca-52c7c2bfe27a req-16d9a7cf-d533-44c7-849e-3309788a2d91 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:53.717401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0c59fd05-ae7a-4a1c-89ca-52c7c2bfe27a req-16d9a7cf-d533-44c7-849e-3309788a2d91 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:53.719733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.724764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=63 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.734416 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0c59fd05-ae7a-4a1c-89ca-52c7c2bfe27a req-16d9a7cf-d533-44c7-849e-3309788a2d91 service nova] Creating event network-changed:0cf6e7b4-a699-48d5-b5e5-fc286ff20e50 for instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 on n-h2-850003-3 Jul 18 13:53:53.740105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0c59fd05-ae7a-4a1c-89ca-52c7c2bfe27a req-16d9a7cf-d533-44c7-849e-3309788a2d91 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041269 Jul 18 13:53:53.741197 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3350/6481] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:53.747909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:53:53.848220 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e7f4166b-ec43-4315-a60b-f202b85fbd1a tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 204 len: 0 microversion: 2.1 time: 0.150702 Jul 18 13:53:53.852713 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3132/6482] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:53:53 2022] DELETE /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:53.859919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:53.860835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:53.867884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:53.868717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:53.869544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:53.869996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:54.036463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:54.048701 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb4e0dee-9243-48eb-9efa-449e17ab74da tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1577 microversion: 2.1 time: 0.193360 Jul 18 13:53:54.049312 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3351/6483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:53 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:55.069486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:55.070355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:55.077965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:55.079160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:55.080070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:55.080873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:55.286067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:55.294580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-60e4ad36-d705-4916-9aef-c692b0d18ca7 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1577 microversion: 2.1 time: 0.229995 Jul 18 13:53:55.295170 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3133/6484] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:55 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1577 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:56.038303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d6816e6c-2b43-4fcc-9de0-44a52efd4cdd req-18126338-cb4f-418c-a7a6-cfb14fb08fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dd6f91-a28c-49d1-ab69-04f4349fb6b1", "name": "network-vif-deleted", "tag": "0cf6e7b4-a699-48d5-b5e5-fc286ff20e50"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:53:56.049706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d6816e6c-2b43-4fcc-9de0-44a52efd4cdd req-18126338-cb4f-418c-a7a6-cfb14fb08fca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:56.050176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d6816e6c-2b43-4fcc-9de0-44a52efd4cdd req-18126338-cb4f-418c-a7a6-cfb14fb08fca service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:56.064261 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d6816e6c-2b43-4fcc-9de0-44a52efd4cdd req-18126338-cb4f-418c-a7a6-cfb14fb08fca service nova] Creating event network-vif-deleted:0cf6e7b4-a699-48d5-b5e5-fc286ff20e50 for instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 on n-h2-850003-3 Jul 18 13:53:56.070572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d6816e6c-2b43-4fcc-9de0-44a52efd4cdd req-18126338-cb4f-418c-a7a6-cfb14fb08fca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Jul 18 13:53:56.071196 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3352/6485] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:53:56.315222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:56.316813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:56.329583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:56.330080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:56.331055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:56.331433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:56.413287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:56.422362 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72ccbc93-93a4-4918-96dd-857428ee9cc5 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1225 microversion: 2.1 time: 0.111799 Jul 18 13:53:56.422749 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3134/6486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:56 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:57.441544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:57.442275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:57.450118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:57.450608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:57.451386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:57.451821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:57.524653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:57.536411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3143e167-d7f7-4269-b42e-bde183b1aa4c tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1225 microversion: 2.1 time: 0.099904 Jul 18 13:53:57.537094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3353/6487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:57 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:58.564232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:58.565140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:58.573523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:58.573994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:58.574849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:58.575304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:58.660242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:58.673574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5206420d-a0a3-4c10-925f-fa73a64da7c4 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1225 microversion: 2.1 time: 0.124157 Jul 18 13:53:58.674465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3135/6488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:58 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:59.690480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:53:59.691401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:53:59.699609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:59.700059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:59.700844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:53:59.701277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:53:59.776756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:53:59.785699 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33050f37-13e3-4515-897c-9e9b0ca51812 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1225 microversion: 2.1 time: 0.099218 Jul 18 13:53:59.786317 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3354/6489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:53:59 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:00.815614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:00.817175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:00.825521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:00.826067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:00.827010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:00.827471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:00.872459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:00.872933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:00.873495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lazy-loading 'fault' on Instance uuid 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:54:00.929787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc9904768d54c97860e34cc54aee32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec0601ae9864b8ba5ebd9557606dc30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:00.938846 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd4f73d8-c36e-4ff2-9703-900f2cb98d6e tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 200 len: 1230 microversion: 2.1 time: 0.130586 Jul 18 13:54:00.939635 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3136/6490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:00 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 1230 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:01.961733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:01.963015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: 59dd6f91-a28c-49d1-ab69-04f4349fb6b1] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:01.970660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:01.971115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:01.971903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:01.972346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:01.987290 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 HTTP/1.1 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '59dd6f91-a28c-49d1-ab69-04f4349fb6b1'} Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:01.988980 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance 59dd6f91-a28c-49d1-ab69-04f4349fb6b1 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fe590dd2-c438-4954-bdbc-194bacb0aa41 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1" status: 404 len: 111 microversion: 2.1 time: 0.032871 Jul 18 13:54:01.994942 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3355/6491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:01 2022] GET /compute/v2.1/servers/59dd6f91-a28c-49d1-ab69-04f4349fb6b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:54:02.517596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:02.518219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:02.525873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:02.526373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:02.527180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:02.528587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:02.544144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 HTTP/1.1 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'b220fa86-a045-40a8-a72d-f0402e32d957'} Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:54:02.545857 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4a67359f-1e03-481b-b1c6-725ab6ad08ce tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 404 len: 111 microversion: 2.1 time: 0.033882 Jul 18 13:54:02.551364 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3137/6492] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:54:02 2022] DELETE /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:54:02.559976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:02.561164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [instance: b220fa86-a045-40a8-a72d-f0402e32d957] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:02.572405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:02.573194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:02.574622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:02.575438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:02.601260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] HTTP exception thrown: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Request method failure captured: Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 HTTP/1.1 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WNSCcytMK7Oju659qOJbd2M7uX4Np6sVwmMQWi8iQAbqbzEh08hL-_vsfP_CN8BQn_zQgTUu7aG-9Cz_ocGkV5r-x_7EXcIkkcSesLOL8iFYi_gRsAZ3upiUJyYtXF_-EVtg9l2o7zv2yUA-BPH_UKJ4PkLejMh3k_8HzKIKvMWCSM Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2ec0601ae9864b8ba5ebd9557606dc30", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2ec0601ae9864b8ba5ebd9557606dc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 2ec0601ae9864b8ba5ebd9557606dc30 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestVolumeBootPattern-671215682 Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: dfc9904768d54c97860e34cc54aee32a Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestVolumeBootPattern-671215682-project Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b220fa86-a045-40a8-a72d-f0402e32d957'} Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:54:02.603457 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Returning 404 to user: Instance b220fa86-a045-40a8-a72d-f0402e32d957 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fcd03c26-e644-472a-94e8-a77e8008a239 tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957" status: 404 len: 111 microversion: 2.1 time: 0.052326 Jul 18 13:54:02.608283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3356/6493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:02 2022] GET /compute/v2.1/servers/b220fa86-a045-40a8-a72d-f0402e32d957 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:54:06.120701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f18c042b-10d5-4c92-a3a2-2d6fd1cc6bab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] Calling method '.version_select at 0x7f96e4258280>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:06.124403 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f18c042b-10d5-4c92-a3a2-2d6fd1cc6bab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:54:07.133408 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-f18c042b-10d5-4c92-a3a2-2d6fd1cc6bab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 34436. Jul 18 13:54:07.155810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f18c042b-10d5-4c92-a3a2-2d6fd1cc6bab tempest-TestVolumeBootPattern-671215682 tempest-TestVolumeBootPattern-671215682-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1982458682" status: 202 len: 0 microversion: 2.1 time: 1.039149 Jul 18 13:54:07.156655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3138/6494] 10.222.0.88 () {58 vars in 1262 bytes} [Mon Jul 18 13:54:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1982458682 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:54:12.136665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:54:12.137583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:12.145183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:12.145639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:12.146456 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:12.146897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:12.217415 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f5b0426e-93e0-420b-a0ba-cc5a4f5a5c9a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60/action" status: 200 len: 24569 microversion: 2.1 time: 0.084646 Jul 18 13:54:12.218100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3357/6495] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:54:12 2022] POST /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60/action => generated 24569 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:54:17.512977 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:54:17.513778 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 13:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:54:48.454978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.455996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.463218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8227cbdb-945b-4a26-a984-051b6dcb088c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: .version_select at 0x7f96e5251670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1460146803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvTO2fro4DExSnvFbubykzAVBikH1h3GWmW7H2o4pd5oUImVaLl4a/8Nv0m473UWP1skqU8Vb+BpyY5R25tJsAk4IZw8+D++VL3Mt3pvC+pxL86utkSEOoRBJ2eDQuTAA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:54:48.484801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8227cbdb-945b-4a26-a984-051b6dcb088c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:54:48.490938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-8227cbdb-945b-4a26-a984-051b6dcb088c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:54:48.525732 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8227cbdb-945b-4a26-a984-051b6dcb088c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075955 Jul 18 13:54:48.531102 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3139/6496] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:54:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:54:49.746565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2064583253", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "62e3e4f8-e082-49d1-8cee-35399fd86eba"}], "key_name": "tempest-TestNetworkBasicOps-1460146803", "security_groups": [{"name": "tempest-secgroup-smoke-1582289527"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:54:49.754831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=15 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.755478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=29 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.878115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] validate_networks() for [('62e3e4f8-e082-49d1-8cee-35399fd86eba', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:54:50.419999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:54:50.420443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:54:50.420928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:54:50.421347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:54:50.421769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:54:50.442980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:50.443438 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:50.444260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:50.444710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:50.464097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:54:50.470034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:54:50.483959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:54:50.486430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:54:50.537576 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-64581737-c52d-4246-acf3-5a52e373fd60 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798516 Jul 18 13:54:50.538189 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3358/6497] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:54:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:54:50.551967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ba1872fc-0ea5-4528-987d-216bc70eff91 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:50.553277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ba1872fc-0ea5-4528-987d-216bc70eff91 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:50.621950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ba1872fc-0ea5-4528-987d-216bc70eff91 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:50.631358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ba1872fc-0ea5-4528-987d-216bc70eff91 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1249 microversion: 2.1 time: 0.085812 Jul 18 13:54:50.632359 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3140/6498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:50 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:51.649309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:51.650915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:51.658671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:51.659129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:51.659922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:51.660353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:51.762201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:51.775858 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e7d501d-556c-4ce3-8d2e-66eaf3179e7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1309 microversion: 2.1 time: 0.130579 Jul 18 13:54:51.790177 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3359/6499] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:51 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:52.800700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:52.801525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:52.809061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:52.809548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:52.810413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:52.810872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:52.968647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:52.978469 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-29f9ec2e-ecc4-497b-b1d7-ac18dfbaff7a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.181760 Jul 18 13:54:52.979308 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3141/6500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:52 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:53.163845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-46d43bf3-2355-4b3e-afaa-9d076931454a req-94b4bed7-7142-4fab-954b-805241f028ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f", "tag": "497042a4-94db-4501-b064-1d939864035e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:54:53.173825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46d43bf3-2355-4b3e-afaa-9d076931454a req-94b4bed7-7142-4fab-954b-805241f028ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:53.174582 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46d43bf3-2355-4b3e-afaa-9d076931454a req-94b4bed7-7142-4fab-954b-805241f028ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:53.209668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-46d43bf3-2355-4b3e-afaa-9d076931454a req-94b4bed7-7142-4fab-954b-805241f028ff service nova] Creating event network-changed:497042a4-94db-4501-b064-1d939864035e for instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f on n-h2-850003-3 Jul 18 13:54:53.215616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-46d43bf3-2355-4b3e-afaa-9d076931454a req-94b4bed7-7142-4fab-954b-805241f028ff service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056598 Jul 18 13:54:53.216829 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3360/6501] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:54:53.997184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:53.997807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:54.004619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:54.005082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:54.005904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:54.006380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:54.145352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:54.153107 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ddb1629e-e635-46da-ac31-2cec29f875c5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.160661 Jul 18 13:54:54.153699 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3142/6502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:53 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:55.174455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:55.175565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:55.181812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:55.182305 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:55.183786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:55.184244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:55.390052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:55.399380 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ed98e0f-5261-4304-9ac9-632477d360bd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.232504 Jul 18 13:54:55.399969 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3361/6503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:55 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:56.417108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:56.417662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:56.424949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:56.425408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:56.426233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:56.426747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:56.581660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:56.590309 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc1f015e-d433-4b64-a52a-11252d3a31cf tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.177133 Jul 18 13:54:56.591381 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3143/6504] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:56 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:57.607104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:57.607730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:57.614850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:57.615309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:57.616084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:57.616529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:57.749701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:57.757361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fba362d-3dbc-4fcf-bab2-2519720ef999 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.154367 Jul 18 13:54:57.757940 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3362/6505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:57 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:58.460644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c06ad3ca-06e4-452b-921e-0ea7575418ed req-6b88febd-ecd6-4223-82aa-08203b8c1660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f", "name": "network-vif-plugged", "status": "completed", "tag": "497042a4-94db-4501-b064-1d939864035e"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:54:58.471809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c06ad3ca-06e4-452b-921e-0ea7575418ed req-6b88febd-ecd6-4223-82aa-08203b8c1660 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:58.472400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c06ad3ca-06e4-452b-921e-0ea7575418ed req-6b88febd-ecd6-4223-82aa-08203b8c1660 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:58.486519 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c06ad3ca-06e4-452b-921e-0ea7575418ed req-6b88febd-ecd6-4223-82aa-08203b8c1660 service nova] Creating event network-vif-plugged:497042a4-94db-4501-b064-1d939864035e for instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f on n-h2-850003-3 Jul 18 13:54:58.491980 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c06ad3ca-06e4-452b-921e-0ea7575418ed req-6b88febd-ecd6-4223-82aa-08203b8c1660 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035427 Jul 18 13:54:58.492612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3144/6506] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:54:58.774708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:58.775319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:58.783173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:58.783631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:58.784413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:58.784854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:58.930849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:54:58.939571 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fdb822f9-8659-468c-a3c8-016ff885d90c tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1375 microversion: 2.1 time: 0.168756 Jul 18 13:54:58.940162 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3363/6507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:58 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:59.958959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:54:59.959606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:54:59.965917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:59.966413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:54:59.967194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:54:59.967645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:00.102021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:00.110410 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ebd64ba-dcc7-4096-a458-b33c6218d6f1 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1548 microversion: 2.1 time: 0.156661 Jul 18 13:55:00.110991 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3145/6508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:54:59 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:00.127328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:00.127974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:00.134967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:00.135421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:00.136200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:00.136644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:00.283816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:00.292413 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-529f87ef-73e1-4e69-bc7d-67eefcae8897 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1548 microversion: 2.1 time: 0.168913 Jul 18 13:55:00.293018 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3364/6509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:00 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:55:28.649870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:28.650505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:28.656358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.657123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.657831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=26 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.663227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:28.663724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:28.664533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:28.664982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:28.694224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:55:28.781622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-24780179-94fc-4e22-9cb5-dedf6a6be790 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 204 len: 0 microversion: 2.1 time: 0.136602 Jul 18 13:55:28.785654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3146/6510] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:55:28 2022] DELETE /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:28.791497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:28.792427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:28.794610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.795416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.799015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.800935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.810705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:28.811684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:28.812211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:28.812646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:28.991307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:29.001925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee4c4656-c338-45bb-843e-e50138fc0189 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1554 microversion: 2.1 time: 0.214604 Jul 18 13:55:29.005288 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3365/6511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:28 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:30.022415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:30.024495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:30.035067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:30.035602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:30.036448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:30.036990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:30.234371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:30.243996 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b17a82a3-a459-456f-a660-2011def3292a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1554 microversion: 2.1 time: 0.226664 Jul 18 13:55:30.244730 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3147/6512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:30 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:30.818002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6194c022-ad3f-4254-98ae-c004110c7fef req-717b8752-5fa9-461c-bda0-0aafd3f1a45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f", "name": "network-vif-deleted", "tag": "497042a4-94db-4501-b064-1d939864035e"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:30.829839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6194c022-ad3f-4254-98ae-c004110c7fef req-717b8752-5fa9-461c-bda0-0aafd3f1a45e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:30.830232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6194c022-ad3f-4254-98ae-c004110c7fef req-717b8752-5fa9-461c-bda0-0aafd3f1a45e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:30.842529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6194c022-ad3f-4254-98ae-c004110c7fef req-717b8752-5fa9-461c-bda0-0aafd3f1a45e service nova] Creating event network-vif-deleted:497042a4-94db-4501-b064-1d939864035e for instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f on n-h2-850003-3 Jul 18 13:55:30.849050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6194c022-ad3f-4254-98ae-c004110c7fef req-717b8752-5fa9-461c-bda0-0aafd3f1a45e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034782 Jul 18 13:55:30.849660 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3366/6513] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:55:31.262958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:31.263585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:31.271267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:31.272384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:31.273353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:31.273842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:31.309127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:31.309637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:31.310056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lazy-loading 'fault' on Instance uuid 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:55:31.358883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:31.365926 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b88c932b-a5d6-466f-81c4-d46683440be9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 200 len: 1339 microversion: 2.1 time: 0.107610 Jul 18 13:55:31.366559 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3148/6514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:31 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:32.383677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:32.384392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:32.392569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:32.392880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:32.393656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:32.394104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:32.408871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] HTTP exception thrown: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Request method failure captured: Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f HTTP/1.1 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WXKD2QObI36Ubf-P4uh_ECs2k9TMs0lwT0bbFYNP6xkQtfmt4BO4jOInl9VvsvOR6Q0D8zw9wk7yoaL6MvW1_3IMqudXy1Vcfefxq5zu77XQPdIqJ7S5rsGOjBy6Ex9kSWbNarNhyerQnRvawVygPBxuYMYvKfiODmSjUtkhyCgLP8 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5eee8446066243d4bb52a503ed4f5c70", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1b88092e4f544dfaa374b644fd9662e0 Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f'} Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:55:32.410659 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Returning 404 to user: Instance 91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-281ada52-5ae4-4393-ba42-9b698bf4ea1b tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f" status: 404 len: 111 microversion: 2.1 time: 0.032720 Jul 18 13:55:32.416085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3367/6515] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:32 2022] GET /compute/v2.1/servers/91f3ff65-aaa7-4bb7-b3e1-f89a09454a9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:55:32.584693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a408dd2-383f-4453-9531-d0bb18d90c49 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '.version_select at 0x7f96e4547c10>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:32.605507 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a408dd2-383f-4453-9531-d0bb18d90c49 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1460146803" status: 202 len: 0 microversion: 2.1 time: 0.024430 Jul 18 13:55:32.607048 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3149/6516] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 13:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1460146803 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:55:34.349119 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:34.349634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:34.358969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:34.359547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:34.360484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:34.360949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:34.389004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:55:34.478312 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d855c8dc-f0ea-4b7c-9c4e-779760877c6a tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 204 len: 0 microversion: 2.1 time: 0.132733 Jul 18 13:55:34.479726 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3368/6517] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:55:34 2022] DELETE /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:34.491474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:34.492389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:34.499283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:34.499748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:34.500532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:34.500979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:34.507869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-61344a9b-9771-4f95-9e5c-1483a281a569 req-681a7826-de95-4b36-9845-9e6060c89de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1832776-8e06-4ace-8e10-7f7a60f02e60", "tag": "568e361b-4162-4951-ae43-96207724a04b"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:34.518953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-61344a9b-9771-4f95-9e5c-1483a281a569 req-681a7826-de95-4b36-9845-9e6060c89de5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:34.519412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-61344a9b-9771-4f95-9e5c-1483a281a569 req-681a7826-de95-4b36-9845-9e6060c89de5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:34.531299 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-61344a9b-9771-4f95-9e5c-1483a281a569 req-681a7826-de95-4b36-9845-9e6060c89de5 service nova] Creating event network-changed:568e361b-4162-4951-ae43-96207724a04b for instance e1832776-8e06-4ace-8e10-7f7a60f02e60 on n-h1-850003-3 Jul 18 13:55:34.536862 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-61344a9b-9771-4f95-9e5c-1483a281a569 req-681a7826-de95-4b36-9845-9e6060c89de5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189260 Jul 18 13:55:34.537490 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3150/6518] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:55:34.642506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:34.650707 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea143d8f-1f09-4c72-bb0a-8bf1a9e9821e tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1669 microversion: 2.1 time: 0.164244 Jul 18 13:55:34.651299 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3369/6519] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:34 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:55:35.670606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:35.671554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:35.678201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:35.678679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:35.679476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:35.679931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:35.833022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:35.841019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b829583c-4f1d-4a39-8dc5-a8c49bba0c84 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1669 microversion: 2.1 time: 0.175752 Jul 18 13:55:35.841605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3151/6520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:35 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:36.712891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0b003395-e44a-4c78-8d57-fc59764c2c16 req-495f193b-d098-4616-acef-816120032d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1832776-8e06-4ace-8e10-7f7a60f02e60", "name": "network-vif-deleted", "tag": "568e361b-4162-4951-ae43-96207724a04b"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:36.724044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b003395-e44a-4c78-8d57-fc59764c2c16 req-495f193b-d098-4616-acef-816120032d89 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:36.724488 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0b003395-e44a-4c78-8d57-fc59764c2c16 req-495f193b-d098-4616-acef-816120032d89 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:36.736625 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0b003395-e44a-4c78-8d57-fc59764c2c16 req-495f193b-d098-4616-acef-816120032d89 service nova] Creating event network-vif-deleted:568e361b-4162-4951-ae43-96207724a04b for instance e1832776-8e06-4ace-8e10-7f7a60f02e60 on n-h1-850003-3 Jul 18 13:55:36.741652 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0b003395-e44a-4c78-8d57-fc59764c2c16 req-495f193b-d098-4616-acef-816120032d89 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032399 Jul 18 13:55:36.742675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3370/6521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:55:36.858045 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:36.858882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:36.866428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:36.866848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:36.867734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:36.868197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:36.910733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:36.911212 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:36.911736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lazy-loading 'fault' on Instance uuid e1832776-8e06-4ace-8e10-7f7a60f02e60 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:55:36.959917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:36.968328 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-092df0ef-4d9d-407d-ae04-fde29ac9660d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 200 len: 1338 microversion: 2.1 time: 0.114210 Jul 18 13:55:36.968914 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3152/6522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:36 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:37.985604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:37.986247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e1832776-8e06-4ace-8e10-7f7a60f02e60] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:37.993498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:37.993958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:37.994764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:37.995211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:38.008783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] HTTP exception thrown: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Request method failure captured: Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 HTTP/1.1 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WXKD2QObI36Ubf-P4uh_ECs2k9TMs0lwT0bbFYNP6xkQtfmt4BO4jOInl9VvsvOR6Q0D8zw9wk7yoaL6MvW1_3IMqudXy1Vcfefxq5zu77XQPdIqJ7S5rsGOjBy6Ex9kSWbNarNhyerQnRvawVygPBxuYMYvKfiODmSjUtkhyCgLP8 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5eee8446066243d4bb52a503ed4f5c70", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1b88092e4f544dfaa374b644fd9662e0 Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e1832776-8e06-4ace-8e10-7f7a60f02e60'} Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:55:38.010477 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Returning 404 to user: Instance e1832776-8e06-4ace-8e10-7f7a60f02e60 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e65fa2eb-f629-40ef-93ce-fa80c7373317 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60" status: 404 len: 111 microversion: 2.1 time: 0.030750 Jul 18 13:55:38.016695 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3371/6523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:37 2022] GET /compute/v2.1/servers/e1832776-8e06-4ace-8e10-7f7a60f02e60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:55:38.181061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ce879581-0e2a-48e8-adbe-60179ec663aa tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '.version_select at 0x7f96e4256ca0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:38.205606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ce879581-0e2a-48e8-adbe-60179ec663aa tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2036204132" status: 202 len: 0 microversion: 2.1 time: 0.028368 Jul 18 13:55:38.206258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3153/6524] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 13:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2036204132 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:55:46.573495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: .version_select at 0x7f96d78a08b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1939902425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI3yBztD78cwqFS1WwNq1ttN1xEqekZqrZD2NMpLE5f1nTVj08ajzhIi+913ViXoV36ihdXyRkieV75vqAO04o5DESK9NBVZpxlv0NUrFfmWSe74bamGRWvhkZPHQTWCg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:46.590791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:55:46.597599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:55:46.613725 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:55:47.621638 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 34720. Jul 18 13:55:47.645979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-beddaa31-654a-401a-ae67-bd5e53f2fbe6 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.076145 Jul 18 13:55:47.647152 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3372/6525] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:55:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:55:48.935528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.936289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.940500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-421235639", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "b2662e6b-42ec-4cad-982a-2bdc854e3a57"}], "key_name": "tempest-TestNetworkBasicOps-1939902425", "security_groups": [{"name": "tempest-secgroup-smoke-393404369"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:49.055665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] validate_networks() for [('b2662e6b-42ec-4cad-982a-2bdc854e3a57', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:55:49.512480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:55:49.512910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:55:49.513395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:55:49.513819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:55:49.514266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:55:49.523181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:49.523641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:49.524449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:49.524898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:49.543731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:55:49.549070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Getting quotas for user 1b88092e4f544dfaa374b644fd9662e0 and project 5eee8446066243d4bb52a503ed4f5c70. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:55:49.561439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:55:49.563733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:55:49.608468 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [18f5e316-9f42-4828-9e54-08c164b05d33] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 13:55:50.617150 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [18f5e316-9f42-4828-9e54-08c164b05d33] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 34750. Jul 18 13:55:50.621408 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0fe7c1b1-4f3b-4b19-8ce0-7493f5045acd tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.688433 Jul 18 13:55:50.622211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3154/6526] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:55:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:55:50.632264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91d6247f-e7a1-4715-9416-0bb8a8b521e5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:50.632950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91d6247f-e7a1-4715-9416-0bb8a8b521e5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:50.635088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:50.696905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91d6247f-e7a1-4715-9416-0bb8a8b521e5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:50.704486 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91d6247f-e7a1-4715-9416-0bb8a8b521e5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1248 microversion: 2.1 time: 0.076128 Jul 18 13:55:50.705074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3373/6527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:50 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:51.723061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a90402d-fd93-483f-b380-84eebbb70061 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:51.723703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a90402d-fd93-483f-b380-84eebbb70061 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:51.785405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a90402d-fd93-483f-b380-84eebbb70061 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:51.792957 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a90402d-fd93-483f-b380-84eebbb70061 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1248 microversion: 2.1 time: 0.074993 Jul 18 13:55:51.793556 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3155/6528] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:51 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:52.808937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c9984c8d-ade6-4272-b0fe-591702b18c18 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:52.809567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c9984c8d-ade6-4272-b0fe-591702b18c18 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:52.878050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c9984c8d-ade6-4272-b0fe-591702b18c18 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:52.884934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c9984c8d-ade6-4272-b0fe-591702b18c18 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1248 microversion: 2.1 time: 0.079983 Jul 18 13:55:52.885510 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3374/6529] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:52 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:53.903007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:53.903881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:53.911415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:53.911887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:53.912671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:53.913124 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:53.974505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:53.982821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-154093d1-ac9f-4a1e-be71-fbb562f03120 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1252 microversion: 2.1 time: 0.084319 Jul 18 13:55:53.983412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3156/6530] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:53 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:55.000547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:55.001429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:55.009300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:55.009748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:55.010655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:55.011141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:55.107046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:55.114350 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f9711089-c56a-426c-9c98-2efc82b89ba9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1306 microversion: 2.1 time: 0.118947 Jul 18 13:55:55.115642 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3375/6531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:54 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:56.131577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:56.132290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:56.140086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:56.140299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:56.141090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:56.141547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:56.218709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-db85862b-b0d1-4df9-ad5a-ee0aa6d0f61d req-37d6016b-be46-4b44-b5df-43dc6da76cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896becf-b540-41e4-89ef-4103a67eda9b", "tag": "8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:55:56.230995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-db85862b-b0d1-4df9-ad5a-ee0aa6d0f61d req-37d6016b-be46-4b44-b5df-43dc6da76cd5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:56.231972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-db85862b-b0d1-4df9-ad5a-ee0aa6d0f61d req-37d6016b-be46-4b44-b5df-43dc6da76cd5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:56.250345 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-db85862b-b0d1-4df9-ad5a-ee0aa6d0f61d req-37d6016b-be46-4b44-b5df-43dc6da76cd5 service nova] Creating event network-changed:8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea for instance e896becf-b540-41e4-89ef-4103a67eda9b on n-h2-850003-3 Jul 18 13:55:56.260274 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-db85862b-b0d1-4df9-ad5a-ee0aa6d0f61d req-37d6016b-be46-4b44-b5df-43dc6da76cd5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047249 Jul 18 13:55:56.260924 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3376/6532] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:55:56.305041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:56.315443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a1dfd88f-aa88-46ef-815a-c5b6e2b983e0 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.187619 Jul 18 13:55:56.316115 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3157/6533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:56 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:57.335371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:57.336076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:57.343195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:57.343644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:57.344453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:57.344881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:57.494280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:57.502247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4ef4d8f-885a-40bb-9735-14a14e47d569 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.172177 Jul 18 13:55:57.502854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3377/6534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:57 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:58.519925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:58.520599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:58.528175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:58.528922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:58.529722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:58.530203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:58.666213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:58.674269 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c876015a-4157-49f4-99ed-26cda386b3c8 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.158233 Jul 18 13:55:58.674869 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3158/6535] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:58 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:59.691207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:55:59.691775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:55:59.694544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:59.700307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:59.700763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:59.701662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:55:59.702090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:55:59.843148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:55:59.850798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b7e37a4-e5c0-4981-92d0-e6a40c47fc06 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.163720 Jul 18 13:55:59.851367 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3378/6536] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:55:59 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:00.867304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:00.872294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:00.872899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:00.879504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:00.879967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:00.880750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:00.881215 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:01.032370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:01.040533 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5d4ae9d-f951-4c02-8123-cb3374a9d707 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.175096 Jul 18 13:56:01.042037 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3159/6537] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:00 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:02.057352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:02.057978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:02.065237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:02.065694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:02.066542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:02.066984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:02.201021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:02.208590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e9fca3f6-478a-41ce-a861-a0ff94a1513f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.155283 Jul 18 13:56:02.209158 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3379/6538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:02 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:02.725426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a9d4820d-025f-405e-af4f-3d38a330cd5e req-7c7f627b-a43c-4b32-959a-197e943170d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896becf-b540-41e4-89ef-4103a67eda9b", "name": "network-vif-plugged", "status": "completed", "tag": "8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:02.729069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=8 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:02.736826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a9d4820d-025f-405e-af4f-3d38a330cd5e req-7c7f627b-a43c-4b32-959a-197e943170d1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:02.737283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a9d4820d-025f-405e-af4f-3d38a330cd5e req-7c7f627b-a43c-4b32-959a-197e943170d1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:02.750668 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a9d4820d-025f-405e-af4f-3d38a330cd5e req-7c7f627b-a43c-4b32-959a-197e943170d1 service nova] Creating event network-vif-plugged:8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea for instance e896becf-b540-41e4-89ef-4103a67eda9b on n-h2-850003-3 Jul 18 13:56:02.755941 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a9d4820d-025f-405e-af4f-3d38a330cd5e req-7c7f627b-a43c-4b32-959a-197e943170d1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034330 Jul 18 13:56:02.756780 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3160/6539] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:56:03.226487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:03.227152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:03.229367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=8 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:03.246098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:03.246711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:03.247577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:03.248051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:03.389890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:03.397684 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b29603e3-cb03-4f29-9c8e-16c8ed0a3b4f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1373 microversion: 2.1 time: 0.175399 Jul 18 13:56:03.398293 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3380/6540] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:03 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:56:04.417073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:04.418313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:04.424873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:04.425356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:04.426142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:04.426624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:04.560377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:04.568221 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-523e8338-402a-4580-bde4-5af9f875d2ef tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1546 microversion: 2.1 time: 0.156307 Jul 18 13:56:04.568813 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3161/6541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:04 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:04.584320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:04.584947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:04.592275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:04.592734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:04.593514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:04.593962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:04.729618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:04.737770 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6613a6a4-bea7-4db6-ab44-26417e88ad7f tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1546 microversion: 2.1 time: 0.157341 Jul 18 13:56:04.738394 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3381/6542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:04 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:06.650910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2772fd88-7dc3-4fe0-8b11-6dfbe779b492 req-c30812bd-e031-4ebc-986e-3b1b9dd2f1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896becf-b540-41e4-89ef-4103a67eda9b", "tag": "8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:06.661105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2772fd88-7dc3-4fe0-8b11-6dfbe779b492 req-c30812bd-e031-4ebc-986e-3b1b9dd2f1af service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:06.662036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2772fd88-7dc3-4fe0-8b11-6dfbe779b492 req-c30812bd-e031-4ebc-986e-3b1b9dd2f1af service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:06.673966 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2772fd88-7dc3-4fe0-8b11-6dfbe779b492 req-c30812bd-e031-4ebc-986e-3b1b9dd2f1af service nova] Creating event network-changed:8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea for instance e896becf-b540-41e4-89ef-4103a67eda9b on n-h2-850003-3 Jul 18 13:56:06.679334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2772fd88-7dc3-4fe0-8b11-6dfbe779b492 req-c30812bd-e031-4ebc-986e-3b1b9dd2f1af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032151 Jul 18 13:56:06.680277 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3162/6543] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:56:29.911421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:29.912892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:29.915624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:29.916352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=38 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:29.923137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:29.923657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:29.924458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:29.924949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:29.981733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46c61bcc-6461-49ff-b7a7-5c77dde61ed4 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b/action" status: 200 len: 24565 microversion: 2.1 time: 0.074387 Jul 18 13:56:29.982361 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3382/6544] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:56:29 2022] POST /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b/action => generated 24565 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:36.450789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:36.451567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:36.456089 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:36.457119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:36.466102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:36.466600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:36.467399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:36.467855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:36.518809 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c10ec04-89db-4d12-a657-d3bab050b7d9 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "POST /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b/action" status: 200 len: 32639 microversion: 2.1 time: 0.070385 Jul 18 13:56:36.519489 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3163/6545] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:56:36 2022] POST /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:37.598055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e8100226-012a-46a6-bc8a-45b47470bcbe req-e9916fb0-20a4-49c5-8915-bb2ee7dad4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896becf-b540-41e4-89ef-4103a67eda9b", "tag": "8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:37.600522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:37.601117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:37.607770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e8100226-012a-46a6-bc8a-45b47470bcbe req-e9916fb0-20a4-49c5-8915-bb2ee7dad4c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:37.608227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e8100226-012a-46a6-bc8a-45b47470bcbe req-e9916fb0-20a4-49c5-8915-bb2ee7dad4c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:37.609650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:37.610122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:37.611127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:37.611585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:37.622399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e8100226-012a-46a6-bc8a-45b47470bcbe req-e9916fb0-20a4-49c5-8915-bb2ee7dad4c0 service nova] Creating event network-changed:8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea for instance e896becf-b540-41e4-89ef-4103a67eda9b on n-h2-850003-3 Jul 18 13:56:37.627581 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e8100226-012a-46a6-bc8a-45b47470bcbe req-e9916fb0-20a4-49c5-8915-bb2ee7dad4c0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Jul 18 13:56:37.628896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3383/6546] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:56:37.646584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:56:37.755791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-30314682-d237-467e-8ef7-4453dd41bbad tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 204 len: 0 microversion: 2.1 time: 0.157695 Jul 18 13:56:37.757987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3164/6547] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:56:37 2022] DELETE /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 13:56:37.769638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:37.771279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:37.781833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:37.782706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:37.783701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:37.784135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:37.965012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:37.973823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5b1e0093-8c3b-4e88-a84c-a9695ebacea5 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1671 microversion: 2.1 time: 0.209883 Jul 18 13:56:37.974751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3384/6548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:37 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:38.993956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:38.994606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:39.003355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:39.003814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:39.004597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:39.005043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:39.175768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:39.183917 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2faf18a1-eb87-4cc8-9700-748308a5f620 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1671 microversion: 2.1 time: 0.194906 Jul 18 13:56:39.184553 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3165/6549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:38 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:56:39.905592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-78c2f948-bbfa-47ba-b872-5a59dc1208c9 req-24203983-d3bf-4550-ace8-fb49948ed5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896becf-b540-41e4-89ef-4103a67eda9b", "name": "network-vif-deleted", "tag": "8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:39.915650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-78c2f948-bbfa-47ba-b872-5a59dc1208c9 req-24203983-d3bf-4550-ace8-fb49948ed5db service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:39.915994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-78c2f948-bbfa-47ba-b872-5a59dc1208c9 req-24203983-d3bf-4550-ace8-fb49948ed5db service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:39.928695 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-78c2f948-bbfa-47ba-b872-5a59dc1208c9 req-24203983-d3bf-4550-ace8-fb49948ed5db service nova] Creating event network-vif-deleted:8ef3bb17-0b41-4bb1-a82e-f482cc3d7cea for instance e896becf-b540-41e4-89ef-4103a67eda9b on n-h2-850003-3 Jul 18 13:56:39.933798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-78c2f948-bbfa-47ba-b872-5a59dc1208c9 req-24203983-d3bf-4550-ace8-fb49948ed5db service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Jul 18 13:56:39.934451 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3385/6550] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:56:40.207033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:40.207668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:40.216713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:40.217189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:40.218015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:40.218755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:40.255197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:40.255946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:40.256438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lazy-loading 'fault' on Instance uuid e896becf-b540-41e4-89ef-4103a67eda9b {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:56:40.303976 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b88092e4f544dfaa374b644fd9662e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eee8446066243d4bb52a503ed4f5c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:40.312875 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a20004a2-6902-4418-bae3-b9f3777de55d tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 200 len: 1338 microversion: 2.1 time: 0.109646 Jul 18 13:56:40.313891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3166/6551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:40 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:41.332588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:41.333295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] [instance: e896becf-b540-41e4-89ef-4103a67eda9b] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:41.339975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:41.340437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:41.341211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:41.341654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:41.355122 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] HTTP exception thrown: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Request method failure captured: Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b HTTP/1.1 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WXKD2QObI36Ubf-P4uh_ECs2k9TMs0lwT0bbFYNP6xkQtfmt4BO4jOInl9VvsvOR6Q0D8zw9wk7yoaL6MvW1_3IMqudXy1Vcfefxq5zu77XQPdIqJ7S5rsGOjBy6Ex9kSWbNarNhyerQnRvawVygPBxuYMYvKfiODmSjUtkhyCgLP8 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5eee8446066243d4bb52a503ed4f5c70", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee8446066243d4bb52a503ed4f5c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 5eee8446066243d4bb52a503ed4f5c70 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkBasicOps-1317232152 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1b88092e4f544dfaa374b644fd9662e0 Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkBasicOps-1317232152-project Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'e896becf-b540-41e4-89ef-4103a67eda9b'} Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:56:41.357000 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Returning 404 to user: Instance e896becf-b540-41e4-89ef-4103a67eda9b could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-92dce4f5-fb3d-46ec-877d-d331651efb28 tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jul 18 13:56:41.363082 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3386/6552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:41 2022] GET /compute/v2.1/servers/e896becf-b540-41e4-89ef-4103a67eda9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:56:41.526211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34dedcab-6fb4-411b-9207-f5f00df28bbe tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] Calling method '.version_select at 0x7f96e45d64c0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:41.548920 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34dedcab-6fb4-411b-9207-f5f00df28bbe tempest-TestNetworkBasicOps-1317232152 tempest-TestNetworkBasicOps-1317232152-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1939902425" status: 202 len: 0 microversion: 2.1 time: 0.026776 Jul 18 13:56:41.549457 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3167/6553] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 13:56:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1939902425 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:56:56.894394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:56.895121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=16 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:57.006975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1763403947", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:56:57.060881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] validate_networks() for None {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:56:57.299450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:56:57.299882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:56:57.300367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:56:57.300785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:56:57.301218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:56:57.310825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:57.311284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:57.312099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:57.312545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:57.330647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Getting quotas for project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:56:57.336108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Getting quotas for user 1f430905723c43bab2632b0dedfab53d and project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:56:57.349538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:56:57.351844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:56:57.394990 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9a5d001-b067-4a2a-a4ab-778e64e9c83a tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506166 Jul 18 13:56:57.395646 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3387/6554] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:56:57.404954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:57.405845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:57.409916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ca0df58-0206-4323-8bd6-213c6a85e576 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:57.410578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ca0df58-0206-4323-8bd6-213c6a85e576 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:57.469697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ca0df58-0206-4323-8bd6-213c6a85e576 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:57.476584 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ca0df58-0206-4323-8bd6-213c6a85e576 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1222 microversion: 2.1 time: 0.074606 Jul 18 13:56:57.477361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3168/6555] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:57 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:58.492949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:58.493560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:58.501757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:58.502560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:58.503593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:58.504033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:58.576785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:58.584982 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2769e932-7635-4e63-8cc7-9960187fcccf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1280 microversion: 2.1 time: 0.095938 Jul 18 13:56:58.585871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3388/6556] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:58 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:56:59.603113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:56:59.603701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:56:59.611214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:59.611685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:59.612474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:56:59.612935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:56:59.805671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:56:59.814422 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17c23bd1-bf39-4cf6-b622-a2ea944b737b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.215173 Jul 18 13:56:59.815379 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3169/6557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:56:59 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:00.098176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e92cde22-4423-457d-b31e-88588d42a5bb req-d0d34c63-3031-49d0-8c9e-706dc2a5a2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a887c681-ed27-4d52-b170-ef24b2d6418d", "tag": "499e0ba2-a7c3-49a6-82cf-1c166c8c07ba"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:00.109529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e92cde22-4423-457d-b31e-88588d42a5bb req-d0d34c63-3031-49d0-8c9e-706dc2a5a2c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:00.110901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e92cde22-4423-457d-b31e-88588d42a5bb req-d0d34c63-3031-49d0-8c9e-706dc2a5a2c6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:00.134282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e92cde22-4423-457d-b31e-88588d42a5bb req-d0d34c63-3031-49d0-8c9e-706dc2a5a2c6 service nova] Creating event network-changed:499e0ba2-a7c3-49a6-82cf-1c166c8c07ba for instance a887c681-ed27-4d52-b170-ef24b2d6418d on n-h2-850003-3 Jul 18 13:57:00.140965 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e92cde22-4423-457d-b31e-88588d42a5bb req-d0d34c63-3031-49d0-8c9e-706dc2a5a2c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046461 Jul 18 13:57:00.142461 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3389/6558] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:00.832190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:00.832831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:00.840466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:00.840931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:00.841748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:00.842226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:00.977382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:00.985126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7aa62a3-009f-4145-8bc7-a406d54fdd3b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.157104 Jul 18 13:57:00.985761 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3170/6559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:00 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:02.003337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:02.003967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:02.010345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:02.011295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:02.012063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:02.012500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:02.147517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:02.156229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-526ee559-5034-4cfc-ade8-d8675d40faa5 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.158063 Jul 18 13:57:02.156871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3390/6560] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:01 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:03.173619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:03.174288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:03.184495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:03.185099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:03.186050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:03.186699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:03.327498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:03.335568 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f79f402b-cc5e-4135-a6b9-af08d0a4df19 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.165804 Jul 18 13:57:03.336165 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3171/6561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:03 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:04.353664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:04.354829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:04.361761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:04.362244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:04.363022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:04.363464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:04.501521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:04.509414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e5c30e7-d4a2-4e46-ae8e-50af08ec30a0 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.159645 Jul 18 13:57:04.510026 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3391/6562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:04 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:05.528311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:05.528863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:05.536095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:05.536562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:05.537372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:05.537820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:05.696460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:05.709897 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b4fdf27c-8bef-4c2f-9f70-b4be3d5d5cf6 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.186405 Jul 18 13:57:05.710552 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3172/6563] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:05 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:06.729062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:06.729743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:06.737230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:06.737806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:06.738767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:06.739299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:06.876366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:06.884232 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e946cc67-9934-4415-88ae-4064470fc05c tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.159094 Jul 18 13:57:06.884821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3392/6564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:06 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:07.103511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8406cefd-01bc-4d6b-b935-67d2f677580d req-b494ab90-4177-4008-bcac-683d194266e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a887c681-ed27-4d52-b170-ef24b2d6418d", "name": "network-vif-plugged", "status": "completed", "tag": "499e0ba2-a7c3-49a6-82cf-1c166c8c07ba"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:07.113520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8406cefd-01bc-4d6b-b935-67d2f677580d req-b494ab90-4177-4008-bcac-683d194266e6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:07.114079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8406cefd-01bc-4d6b-b935-67d2f677580d req-b494ab90-4177-4008-bcac-683d194266e6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:07.130504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8406cefd-01bc-4d6b-b935-67d2f677580d req-b494ab90-4177-4008-bcac-683d194266e6 service nova] Creating event network-vif-plugged:499e0ba2-a7c3-49a6-82cf-1c166c8c07ba for instance a887c681-ed27-4d52-b170-ef24b2d6418d on n-h2-850003-3 Jul 18 13:57:07.135675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8406cefd-01bc-4d6b-b935-67d2f677580d req-b494ab90-4177-4008-bcac-683d194266e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 Jul 18 13:57:07.136585 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3173/6565] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:07.902197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:07.903484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:07.906353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:07.907063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:07.912255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:07.912707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:07.913490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:07.913925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:08.057740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:08.068436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e489c522-ef36-49c2-a1e6-a55bde51926b tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1322 microversion: 2.1 time: 0.170936 Jul 18 13:57:08.069051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3393/6566] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:07 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:09.082949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:09.089599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.090381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:09.097504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.097985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.098818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.099283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.263774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:09.271502 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1091e25c-2f3f-4cb0-a905-abf181a9867e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1471 microversion: 2.1 time: 0.189648 Jul 18 13:57:09.272097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3174/6567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:09 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:09.343560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f359e1a1-e61c-47ef-8694-f5fa537b5e05 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '.version_select at 0x7f96e9a7e4c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.409265 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f359e1a1-e61c-47ef-8694-f5fa537b5e05 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/41643152308c472ba1ff321bac1214ba" status: 200 len: 371 microversion: 2.1 time: 0.122437 Jul 18 13:57:09.409854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3394/6568] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:57:09 2022] GET /compute/v2.1/os-quota-sets/41643152308c472ba1ff321bac1214ba => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:57:09.420430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad211eb9-48a7-4395-9a88-ea8004db2c58 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1640223791", "id": 1177636484, "os-flavor-access:is_public": "True"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:09.422033 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:57:09.422033 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:57:09.437938 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad211eb9-48a7-4395-9a88-ea8004db2c58 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021277 Jul 18 13:57:09.438584 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3175/6569] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:57:09 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:09.449952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1177636484"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:09.451013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:09.457227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.457686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.458478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.458914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.546133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '964bcf07cbf3436d9ebd5474d47e584a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41643152308c472ba1ff321bac1214ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:09.553267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1640223791 {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:57:09.561348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.561798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.562791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.563233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.586999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Getting quotas for project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:57:09.592867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Getting quotas for user 1f430905723c43bab2632b0dedfab53d and project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:57:09.610761 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] ram quota exceeded for 41643152308c472ba1ff321bac1214ba, tried to resize instance. Jul 18 13:57:09.611306 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Request method failure captured: Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action HTTP/1.1 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 39 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Wao4ZvKV9es8QBnELueXXp4Jh1I7mERGuAGqIl9A72rye9sHdEjMq3AEa3FLCHDRG-myr0nEKzgPG-cNy6atczo6bec4SWADq8zYcymBGkpvvdy3NHDgsrRSc441b2Qs6Pg1GWU5DyMTiwaonNQukwucAaAMoIKIMsswf5TZKe0110 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 41643152308c472ba1ff321bac1214ba Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member,admin Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member,admin Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41643152308c472ba1ff321bac1214ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41643152308c472ba1ff321bac1214ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41643152308c472ba1ff321bac1214ba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41643152308c472ba1ff321bac1214ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 41643152308c472ba1ff321bac1214ba Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersAdminNegativeTestJSON-218358985-project-admin Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 964bcf07cbf3436d9ebd5474d47e584a Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersAdminNegativeTestJSON-218358985-project-admin Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: {"resize": {"flavorRef": "1177636484"}} Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'a887c681-ed27-4d52-b170-ef24b2d6418d', 'body': {'resize': {'flavorRef': '1177636484'}}} Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.613427 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3c6f12b3-190a-42e5-859f-0a28e9f086b9 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action" status: 403 len: 118 microversion: 2.1 time: 0.169398 Jul 18 13:57:09.616929 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3395/6570] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:57:09 2022] POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action => generated 118 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:57:09.624360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ec3d297-7fdc-4788-81b4-08809849a181 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.625115 n-d-850003-3 devstack@n-api.service[131367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:57:09.625115 n-d-850003-3 devstack@n-api.service[131367]: warnings.warn(msg) Jul 18 13:57:09.643125 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ec3d297-7fdc-4788-81b4-08809849a181 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1177636484" status: 202 len: 0 microversion: 2.1 time: 0.022328 Jul 18 13:57:09.643737 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3176/6571] 10.222.0.88 () {58 vars in 1160 bytes} [Mon Jul 18 13:57:09 2022] DELETE /compute/v2.1/flavors/1177636484 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:57:09.652980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ccfd431-e707-478e-aa5e-97d5e86382da tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.671615 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ccfd431-e707-478e-aa5e-97d5e86382da tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023271 Jul 18 13:57:09.672206 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3396/6572] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:57:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:09.688694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed2ba544-44a1-437a-afa2-7d9ac2c0d7b6 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '.version_select at 0x7f96e4604550>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.761954 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed2ba544-44a1-437a-afa2-7d9ac2c0d7b6 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/41643152308c472ba1ff321bac1214ba" status: 200 len: 371 microversion: 2.1 time: 0.077001 Jul 18 13:57:09.762779 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3177/6573] 10.222.0.88 () {58 vars in 1241 bytes} [Mon Jul 18 13:57:09 2022] GET /compute/v2.1/os-quota-sets/41643152308c472ba1ff321bac1214ba => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:09.773511 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7001720c-64a2-4a29-914c-f592a4f78a76 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-685686713", "id": 607149771, "os-flavor-access:is_public": "True"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:09.775349 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:57:09.775349 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:57:09.792159 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7001720c-64a2-4a29-914c-f592a4f78a76 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022309 Jul 18 13:57:09.792765 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3397/6574] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:57:09 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:09.803912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "607149771"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:09.804946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:09.812039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.812511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.813293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.813740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.902455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '964bcf07cbf3436d9ebd5474d47e584a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41643152308c472ba1ff321bac1214ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:09.909731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-685686713 {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:57:09.917374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.917838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.918701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:09.919160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:09.941804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Getting quotas for project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:57:09.947419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Getting quotas for user 1f430905723c43bab2632b0dedfab53d and project 179ea06164a5439bb4ab1af251f0550e. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:57:09.960806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] cores quota exceeded for 41643152308c472ba1ff321bac1214ba, tried to resize instance. Jul 18 13:57:09.961484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Request method failure captured: Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action HTTP/1.1 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 38 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wao4ZvKV9es8QBnELueXXp4Jh1I7mERGuAGqIl9A72rye9sHdEjMq3AEa3FLCHDRG-myr0nEKzgPG-cNy6atczo6bec4SWADq8zYcymBGkpvvdy3NHDgsrRSc441b2Qs6Pg1GWU5DyMTiwaonNQukwucAaAMoIKIMsswf5TZKe0110 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 41643152308c472ba1ff321bac1214ba Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member,admin Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member,admin Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41643152308c472ba1ff321bac1214ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41643152308c472ba1ff321bac1214ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41643152308c472ba1ff321bac1214ba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41643152308c472ba1ff321bac1214ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 41643152308c472ba1ff321bac1214ba Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-218358985 Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersAdminNegativeTestJSON-218358985-project-admin Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 964bcf07cbf3436d9ebd5474d47e584a Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersAdminNegativeTestJSON-218358985-project-admin Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: {"resize": {"flavorRef": "607149771"}} Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a887c681-ed27-4d52-b170-ef24b2d6418d', 'body': {'resize': {'flavorRef': '607149771'}}} Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.963651 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9db5c829-29a0-4a0a-b1c4-9bd3266486a0 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action" status: 403 len: 113 microversion: 2.1 time: 0.165273 Jul 18 13:57:09.967096 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3178/6575] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:57:09 2022] POST /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d/action => generated 113 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:57:09.975524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c31150aa-4091-4d85-b73c-b83982e70123 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:09.976296 n-d-850003-3 devstack@n-api.service[131366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 13:57:09.976296 n-d-850003-3 devstack@n-api.service[131366]: warnings.warn(msg) Jul 18 13:57:09.995637 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c31150aa-4091-4d85-b73c-b83982e70123 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/607149771" status: 202 len: 0 microversion: 2.1 time: 0.023369 Jul 18 13:57:09.996232 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3398/6576] 10.222.0.88 () {58 vars in 1157 bytes} [Mon Jul 18 13:57:09 2022] DELETE /compute/v2.1/flavors/607149771 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 13:57:10.004470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1dcaf5f-d39a-4b1d-ad8c-f4fa978fe289 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:10.026419 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b1dcaf5f-d39a-4b1d-ad8c-f4fa978fe289 tempest-ServersAdminNegativeTestJSON-218358985 tempest-ServersAdminNegativeTestJSON-218358985-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025492 Jul 18 13:57:10.027138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3179/6577] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 18 13:57:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:10.045689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:10.046243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:10.052872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:10.053334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:10.054125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:10.054590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:10.084597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:57:10.164241 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02782a72-3b13-4aea-9fdb-fff6bc9601bc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 204 len: 0 microversion: 2.1 time: 0.122705 Jul 18 13:57:10.165890 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3399/6578] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:57:10 2022] DELETE /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:57:10.175647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:10.176278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:10.184515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:10.184994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:10.186211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:10.186618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:10.327022 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:10.335673 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f66432c2-2742-4937-8290-22bcc9fe6f2e tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1477 microversion: 2.1 time: 0.164178 Jul 18 13:57:10.336270 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3180/6579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:10 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:11.355606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:11.356364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:11.364282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:11.364750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:11.365639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:11.366090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:11.538049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:11.546452 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7609d089-9b22-4010-befb-1a01eb517caf tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1477 microversion: 2.1 time: 0.195590 Jul 18 13:57:11.547067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3400/6580] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:11 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1477 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:12.104859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fae2b320-425e-4728-aebf-6ef181da7ad0 req-de395e60-06c8-4d2a-b0ba-910a62f20299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a887c681-ed27-4d52-b170-ef24b2d6418d", "name": "network-vif-deleted", "tag": "499e0ba2-a7c3-49a6-82cf-1c166c8c07ba"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:12.124855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fae2b320-425e-4728-aebf-6ef181da7ad0 req-de395e60-06c8-4d2a-b0ba-910a62f20299 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:12.125476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fae2b320-425e-4728-aebf-6ef181da7ad0 req-de395e60-06c8-4d2a-b0ba-910a62f20299 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:12.140313 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fae2b320-425e-4728-aebf-6ef181da7ad0 req-de395e60-06c8-4d2a-b0ba-910a62f20299 service nova] Creating event network-vif-deleted:499e0ba2-a7c3-49a6-82cf-1c166c8c07ba for instance a887c681-ed27-4d52-b170-ef24b2d6418d on n-h2-850003-3 Jul 18 13:57:12.146776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fae2b320-425e-4728-aebf-6ef181da7ad0 req-de395e60-06c8-4d2a-b0ba-910a62f20299 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046289 Jul 18 13:57:12.150283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3181/6581] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:12.564167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:12.564796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:12.572169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:12.572631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:12.573964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:12.574396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:12.609688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:12.610160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:12.610637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lazy-loading 'fault' on Instance uuid a887c681-ed27-4d52-b170-ef24b2d6418d {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:57:12.653571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f430905723c43bab2632b0dedfab53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ea06164a5439bb4ab1af251f0550e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:12.660886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2a666494-a7df-4af0-b83d-c18ed3a7b4fc tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 200 len: 1312 microversion: 2.1 time: 0.100723 Jul 18 13:57:12.661480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3401/6582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:12 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:13.678981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:13.679691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] [instance: a887c681-ed27-4d52-b170-ef24b2d6418d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:13.687371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:13.687840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:13.688623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:13.689071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:13.706733 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] HTTP exception thrown: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Request method failure captured: Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d HTTP/1.1 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WaoxSbkXmf3axbM_5lUFIGlkvGOvgbDr8MY_GD3LS8a5fs6S8R8LOw6JumR0IcqwtILZV4n9p-5_5I_FQKRGGXqopYWE8U0vZcw9pasx-0DUfmGXLfwcyQ6rbQ3QsJ3KETz02jpQJiXkGOP4cKudCB7asPRQatP9NbWbRITKZzI-Lo Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 179ea06164a5439bb4ab1af251f0550e Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2030772717 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/179ea06164a5439bb4ab1af251f0550e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/179ea06164a5439bb4ab1af251f0550e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_179ea06164a5439bb4ab1af251f0550e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/179ea06164a5439bb4ab1af251f0550e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2030772717 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 179ea06164a5439bb4ab1af251f0550e Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2030772717 Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersAdminNegativeTestJSON-2030772717-project Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1f430905723c43bab2632b0dedfab53d Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2030772717-project Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'a887c681-ed27-4d52-b170-ef24b2d6418d'} Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:13.708406 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] Returning 404 to user: Instance a887c681-ed27-4d52-b170-ef24b2d6418d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-34260808-21dc-4ac7-8e71-3cd04147a483 tempest-ServersAdminNegativeTestJSON-2030772717 tempest-ServersAdminNegativeTestJSON-2030772717-project] 10.222.0.88 "GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d" status: 404 len: 111 microversion: 2.1 time: 0.035537 Jul 18 13:57:13.715440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3182/6583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:13 2022] GET /compute/v2.1/servers/a887c681-ed27-4d52-b170-ef24b2d6418d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:57:20.404230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:20.405049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:20.537863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-234886290", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "cfe6433e-db4e-4fe5-8c36-0258d22fa76d"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:20.597376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] validate_networks() for [('cfe6433e-db4e-4fe5-8c36-0258d22fa76d', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:57:21.007608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:57:21.008059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:57:21.008536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:57:21.008957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:57:21.009379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:57:21.018859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:21.019320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:21.020133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:21.020579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:21.041125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Getting quotas for project 7b4c3af8726d49c2a4e52d876eb369d5. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:57:21.047643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Getting quotas for user d2cc8208b9a54efca1ab270fed676506 and project 7b4c3af8726d49c2a4e52d876eb369d5. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:57:21.060396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:57:21.062737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:57:21.120905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4fdb07d-2ed1-4ca4-aa49-209dfe8a4e2f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722328 Jul 18 13:57:21.121596 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3402/6584] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:57:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:57:21.132227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-73c07d69-6904-4fec-9531-d7c319561b46 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:21.133286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-73c07d69-6904-4fec-9531-d7c319561b46 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:21.136218 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:21.137160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:21.203358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-73c07d69-6904-4fec-9531-d7c319561b46 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:21.210615 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-73c07d69-6904-4fec-9531-d7c319561b46 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1214 microversion: 2.1 time: 0.082618 Jul 18 13:57:21.211238 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3183/6585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:21 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:22.232201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:22.233445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:22.240901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:22.241550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:22.242395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:22.242846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:22.325577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:22.338016 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42ad3714-2aa9-4958-b471-48f640658a29 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1266 microversion: 2.1 time: 0.110980 Jul 18 13:57:22.348523 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3403/6586] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:22 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:23.357748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:23.358961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:23.367973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:23.368455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:23.369256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:23.370439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:23.969104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:23.977935 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf47ad22-413e-45f3-88f6-d344b1e91b94 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.624537 Jul 18 13:57:23.979487 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3184/6587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:23 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:24.390992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a824a04c-abb6-4412-bb7e-8881ecd7150f req-5c7856b2-1f1a-472e-8071-398075125eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:24.408534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a824a04c-abb6-4412-bb7e-8881ecd7150f req-5c7856b2-1f1a-472e-8071-398075125eeb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:24.409427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a824a04c-abb6-4412-bb7e-8881ecd7150f req-5c7856b2-1f1a-472e-8071-398075125eeb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:24.439064 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a824a04c-abb6-4412-bb7e-8881ecd7150f req-5c7856b2-1f1a-472e-8071-398075125eeb service nova] Creating event network-changed:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h2-850003-3 Jul 18 13:57:24.449155 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a824a04c-abb6-4412-bb7e-8881ecd7150f req-5c7856b2-1f1a-472e-8071-398075125eeb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066881 Jul 18 13:57:24.450060 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3404/6588] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:57:24.997276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:24.997914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:25.005235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:25.005706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:25.006545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:25.007027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:25.152242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:25.163950 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85cfb4ad-aee9-4b14-bdb7-c3bf142536f3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.171414 Jul 18 13:57:25.166424 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3185/6589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:24 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:26.187254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:26.187962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:26.194863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:26.195400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:26.196377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:26.196819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:26.339570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:26.347852 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbd60b17-75a7-4ffa-8d4a-15d09ecce645 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.168205 Jul 18 13:57:26.348449 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3405/6590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:26 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:27.365684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:27.366345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:27.374330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:27.374801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:27.375603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:27.376062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:27.514885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:27.517146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=72 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:27.523987 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1dea2838-ce1a-4a13-81a7-929023d972f5 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.162065 Jul 18 13:57:27.524747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3186/6591] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:27 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:28.541280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:28.541908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:28.544853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:28.550865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:28.551326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:28.552116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:28.552560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:28.556495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:28.707837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:28.719220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ebdc8a6c-3cc5-4a72-bf93-0fb26f40d769 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.181956 Jul 18 13:57:28.719831 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3406/6592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:28 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:29.743102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:29.763242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:29.943547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:29.954111 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-42329a35-d08c-4d90-afa7-85e623a0d508 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.218677 Jul 18 13:57:29.954778 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3187/6593] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:29 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:30.974244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:30.974913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:30.983179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:30.983643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:30.984441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:30.984889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:31.029811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:31.054485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:31.133926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:31.143097 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80435f66-3cec-4547-812f-bc8c5a69528f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.172894 Jul 18 13:57:31.143929 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3407/6594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:30 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:31.236275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9e8d63db-25ef-43ab-ae62-6ae20d2eea24 req-b6443a4a-691c-4397-9b76-ff76498fef24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "name": "network-vif-plugged", "status": "completed", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:31.241399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:31.248418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9e8d63db-25ef-43ab-ae62-6ae20d2eea24 req-b6443a4a-691c-4397-9b76-ff76498fef24 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:31.248896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9e8d63db-25ef-43ab-ae62-6ae20d2eea24 req-b6443a4a-691c-4397-9b76-ff76498fef24 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:31.261264 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9e8d63db-25ef-43ab-ae62-6ae20d2eea24 req-b6443a4a-691c-4397-9b76-ff76498fef24 service nova] Creating event network-vif-plugged:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h2-850003-3 Jul 18 13:57:31.266564 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9e8d63db-25ef-43ab-ae62-6ae20d2eea24 req-b6443a4a-691c-4397-9b76-ff76498fef24 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 Jul 18 13:57:31.267858 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3188/6595] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:57:32.160960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:32.161564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:32.175017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:32.175849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:32.177271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:32.178077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:32.392843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:32.403053 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-155a6d50-afac-488b-8024-738de7ce9f6c tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1314 microversion: 2.1 time: 0.246021 Jul 18 13:57:32.403655 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3408/6596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:32 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:33.431050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:33.432355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:33.439351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.439810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:33.440594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.441052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:33.634058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:33.642622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f62bcc2a-11e0-487c-9463-f959ca6e8f9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1502 microversion: 2.1 time: 0.217373 Jul 18 13:57:33.643235 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3189/6597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:33 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:33.660742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:57:33.661780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:33.669824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.670344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:33.671144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.671588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:33.712200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:33.723764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:57:33.736057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:57:33.736805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:57:33.737390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:57:33.737811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:57:33.738374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:57:33.839351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a786c9df-b436-4ca4-b178-9874c474e4d4 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "POST /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551/action" status: 202 len: 0 microversion: 2.1 time: 0.182813 Jul 18 13:57:33.839980 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3409/6598] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:57:33 2022] POST /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:57:33.848834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:33.849655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:33.858657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.859233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:33.860316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:33.860848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:34.105469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:34.114455 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a0a9ee1e-7651-4a9e-9bea-a7b40e796e39 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1511 microversion: 2.1 time: 0.269966 Jul 18 13:57:34.115078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3190/6599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:33 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:35.135472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:35.136842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:35.149853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:35.150670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:35.151931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:35.152882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:35.359295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:35.368669 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6a6f51f-4fe0-479d-b4d0-aefef1cddf49 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1511 microversion: 2.1 time: 0.239396 Jul 18 13:57:35.369240 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3410/6600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:35 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:36.388656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:36.389560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:36.396673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:36.397348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:36.398383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:36.398885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:36.589321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:36.603692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-610fbf04-62d9-47f9-8e3e-fe76432e9363 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1511 microversion: 2.1 time: 0.220872 Jul 18 13:57:36.604321 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3191/6601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:36 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:37.625461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:37.626578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:37.636410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:37.637104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:37.637553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:37.637986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:37.800499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:37.811248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d20175fa-0f4e-452e-9197-db8298b16049 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.192726 Jul 18 13:57:37.811871 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3411/6602] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:37 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:38.836487 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:38.837150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:38.845239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:38.845707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:38.846554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:38.847009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:39.001865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:39.013605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-85d604ad-08de-4f3d-b5dd-ae10011b592e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.181628 Jul 18 13:57:39.014360 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3192/6603] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:38 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:40.032310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:40.032828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:40.040136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:40.040722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:40.041359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:40.041926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:40.174335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:40.182630 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-137569ba-2c10-4551-ab47-f40eef4d76c7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.154406 Jul 18 13:57:40.183231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3412/6604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:40 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:41.201079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:41.201710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:41.208842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:41.209303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:41.210117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:41.210599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:41.349297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:41.357780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a9162850-a259-456e-a702-ba31ffd154f0 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.160975 Jul 18 13:57:41.358415 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3193/6605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:41 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:42.377267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:42.377892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:42.386262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:42.386728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:42.387525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:42.387975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:42.543392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:42.557706 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40106b24-d831-4438-a578-b8881c407265 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.184473 Jul 18 13:57:42.558893 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3413/6606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:42 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:43.584253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:43.584879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:43.592479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:43.592938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:43.593720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:43.594185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:43.728995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:43.736692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c79c54d-caa5-4607-8abc-71b2f087802b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.156437 Jul 18 13:57:43.737265 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3194/6607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:43 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:44.755401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:44.756135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:44.763898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:44.764344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:44.765106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:44.765544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:44.907156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:44.915150 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b838183-0d90-44a0-b00d-2fe3ef6459ea tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.164965 Jul 18 13:57:44.916262 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3414/6608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:44 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:45.933677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:45.934363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:45.941301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:45.941775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:45.942590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:45.943046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:46.095315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:46.110951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5bbe0b8-a7f8-47a2-a863-3373d9c1c659 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.181233 Jul 18 13:57:46.112046 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3195/6609] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:45 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:47.135523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:47.136155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:47.143716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:47.144173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:47.144963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:47.145407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:47.301016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:47.309875 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-740918fa-e335-4cd3-8c64-3b31ae925a4e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.178749 Jul 18 13:57:47.310504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3415/6610] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:47 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:48.339574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:48.340208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:48.347467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:48.347938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:48.348736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:48.349191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:48.498519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:48.506902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a38f4af-14d1-41a8-a946-c861a4140dce tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.172185 Jul 18 13:57:48.507504 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3196/6611] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:48 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:49.535281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:49.535810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:49.543800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:49.544249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:49.545022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:49.545462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:49.703003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:49.710730 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0fb1741c-2981-4532-b2e3-fafa53fececd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.179492 Jul 18 13:57:49.711321 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3416/6612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:49 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:50.728658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:50.729763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:50.736776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:50.737231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:50.738012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:50.738486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:50.872882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:50.880644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-563d2d89-eccc-4f23-b382-bc1a02e3d775 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.155898 Jul 18 13:57:50.881227 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3197/6613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:50 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:51.898864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:51.899490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:51.906867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:51.907327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:51.908109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:51.908552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:52.042823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:52.050508 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-deda6384-50ab-4e1c-9175-7e8905022d2b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.155582 Jul 18 13:57:52.051089 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3417/6614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:51 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:53.068627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:53.069250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:53.077419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:53.077883 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:53.078719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:53.079180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:53.223518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:53.231267 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b6ea2fde-6db3-4ca0-96bb-a84dc28cbac8 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.166678 Jul 18 13:57:53.231863 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3198/6615] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:53 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:57:54.248966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:54.249593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:54.256959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:54.257401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:54.258211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:54.258657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:54.400814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:54.409440 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f158516a-f8a8-4cde-a5d4-50aac5ede56d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.164385 Jul 18 13:57:54.409954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3418/6616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:54 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:55.427198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:55.427729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:55.435902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:55.436390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:55.437184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:55.437626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:55.574576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:55.583693 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b5611a43-6eae-4cc7-aa0d-82c6fc66c7cb tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.160852 Jul 18 13:57:55.584290 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3199/6617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:55 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:56.601261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:56.601928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:56.609952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:56.610663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:56.611658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:56.612142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:56.768327 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:56.778081 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-944acb3c-febc-4c08-ae4e-e3e337489694 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.181032 Jul 18 13:57:56.778758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3419/6618] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:56 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:57.796628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:57.797257 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:57.804236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:57.804702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:57.805488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:57.805940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:57.943757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:57.952426 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cb1cf79e-23f8-47e7-a269-6078d6b84d26 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.159975 Jul 18 13:57:57.953015 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3200/6619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:57 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:57:58.977071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:57:58.977721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:57:58.981782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=32 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:58.987705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:58.988167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:58.988949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:57:58.989400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:57:58.992646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:59.139705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:57:59.148177 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d1b4a18-fc13-4d22-947e-90877387992b tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.175077 Jul 18 13:57:59.149146 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3420/6620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:57:58 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:00.166368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:00.167613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:00.170609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=28 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:00.176117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:00.176591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:00.177391 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:00.177848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:00.180703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=82 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:00.312238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:00.319941 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b18f8236-f43d-4600-9528-cb76b5c299f2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.157599 Jul 18 13:58:00.320531 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3201/6621] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:00 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:01.339161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:01.339773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:01.346982 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:01.347434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:01.348205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:01.348640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:01.484426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:01.492489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d8e9d14-e05f-4942-9f3c-50d0cc5c1904 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.158197 Jul 18 13:58:01.493086 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3421/6622] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:01 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:02.510302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:02.511134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:02.518214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:02.518688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:02.519482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:02.519941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:02.668395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:02.676248 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6fc50fbd-25bc-4cbb-a393-cfcdfe201e0e tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.170000 Jul 18 13:58:02.676837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3202/6623] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:02 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:03.692917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:03.693576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:03.700661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:03.701114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:03.701889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:03.702471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:03.888130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:03.896325 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0ed54450-d71e-4b5a-b6c7-1fdde1d97fa7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1516 microversion: 2.1 time: 0.207194 Jul 18 13:58:03.897122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3422/6624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:03 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:04.619118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "name": "network-vif-unplugged", "status": "completed", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:04.629711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:04.630234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:04.644240 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] Creating event network-vif-unplugged:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h1-850003-3 Jul 18 13:58:04.651176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:58:04.664304 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9a3ac040-23d6-4d63-9c56-bb013a9ab306 req-ce463a6d-96bf-4c8d-bd2b-9cbf64a8b39d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049134 Jul 18 13:58:04.665098 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3203/6625] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:58:04.915885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:04.917274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:04.933025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:04.933413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:04.934234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:04.935218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:05.086413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:05.094986 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-30bb78c8-ff25-4330-911f-f8831d157ba2 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1515 microversion: 2.1 time: 0.182932 Jul 18 13:58:05.095441 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3423/6626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:04 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:06.113705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:06.114462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:06.122228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:06.122702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:06.123496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:06.123952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:06.254736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:06.263289 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b6819c0d-5677-44fe-93e4-bd4833167d0f tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1513 microversion: 2.1 time: 0.153838 Jul 18 13:58:06.263891 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3204/6627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:06 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:06.680544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:06.689614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:06.690058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:06.702225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] Creating event network-changed:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h1-850003-3 Jul 18 13:58:06.707700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:58:06.719077 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a3f52c28-4ce7-44e7-a5fc-b11138de9cdf req-b1672760-e1be-4dc5-b3a2-46fbd23891bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042229 Jul 18 13:58:06.719705 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3424/6628] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:58:07.281755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:07.282436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:07.289677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:07.290140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:07.290969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:07.291433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:07.428561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:07.436891 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c97a946-37c9-4f5d-8e09-73b63e748d9a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1513 microversion: 2.1 time: 0.159154 Jul 18 13:58:07.437480 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3205/6629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:07 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:08.455532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:08.456231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:08.462680 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:08.463173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:08.463949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:08.464398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:08.613720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:08.622787 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7384ad75-cf24-44e1-8729-d98679cde1cd tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1510 microversion: 2.1 time: 0.172818 Jul 18 13:58:08.623388 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3425/6630] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:08 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:08.639665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:08.640199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:08.647648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:08.648160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:08.648963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:08.649421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:08.676990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:58:08.729762 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.compute.api [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Found an unconfirmed migration during delete, id: 16, status: finished Jul 18 13:58:10.435763 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-936133af-e7b9-42a9-8fcf-b12f6c06f9d7 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 204 len: 0 microversion: 2.1 time: 1.799582 Jul 18 13:58:10.437412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3206/6631] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:58:08 2022] DELETE /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 0 bytes in 1802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:58:10.445375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:10.446185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:10.452814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:10.453242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:10.454006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:10.454489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:10.524075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d8f1f13c-5f4e-47ff-9f56-51a9054bcf2c req-da5b6bc4-6e23-4291-acd0-c2c5ec7b8b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "name": "network-vif-plugged", "status": "completed", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:10.543072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d8f1f13c-5f4e-47ff-9f56-51a9054bcf2c req-da5b6bc4-6e23-4291-acd0-c2c5ec7b8b61 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:10.543938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d8f1f13c-5f4e-47ff-9f56-51a9054bcf2c req-da5b6bc4-6e23-4291-acd0-c2c5ec7b8b61 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:10.565485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d8f1f13c-5f4e-47ff-9f56-51a9054bcf2c req-da5b6bc4-6e23-4291-acd0-c2c5ec7b8b61 service nova] Creating event network-vif-plugged:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h1-850003-3 Jul 18 13:58:10.574889 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d8f1f13c-5f4e-47ff-9f56-51a9054bcf2c req-da5b6bc4-6e23-4291-acd0-c2c5ec7b8b61 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058843 Jul 18 13:58:10.576641 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3207/6632] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:58:10.604164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:10.612683 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7bef1172-0244-4364-811e-647f5582ca7a tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1502 microversion: 2.1 time: 0.171152 Jul 18 13:58:10.613277 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3426/6633] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:10 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:58:11.632273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:11.632994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:11.639520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:11.639983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:11.640771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:11.641230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:11.778965 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:11.786854 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-585d3fe6-65dc-4c71-ae6a-ba49aa2f43b9 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1502 microversion: 2.1 time: 0.159640 Jul 18 13:58:11.787458 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3208/6634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:11 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:12.600146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b8f4882c-ac1d-454a-98ff-dc5208432ab2 req-69e17b36-4de3-451a-9832-ab212cfa13fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755e5cf-8a51-4bf7-a483-4b923cf48551", "name": "network-vif-deleted", "tag": "d990fd69-3536-477c-bb61-4cd2579eb9fa"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:12.609910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b8f4882c-ac1d-454a-98ff-dc5208432ab2 req-69e17b36-4de3-451a-9832-ab212cfa13fa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:12.610386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b8f4882c-ac1d-454a-98ff-dc5208432ab2 req-69e17b36-4de3-451a-9832-ab212cfa13fa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:12.623989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b8f4882c-ac1d-454a-98ff-dc5208432ab2 req-69e17b36-4de3-451a-9832-ab212cfa13fa service nova] Creating event network-vif-deleted:d990fd69-3536-477c-bb61-4cd2579eb9fa for instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 on n-h1-850003-3 Jul 18 13:58:12.629567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b8f4882c-ac1d-454a-98ff-dc5208432ab2 req-69e17b36-4de3-451a-9832-ab212cfa13fa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Jul 18 13:58:12.630612 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3427/6635] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:58:12.809476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:12.810616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:12.822349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:12.823155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:12.824523 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:12.824983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:12.856079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:12.856545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:12.857008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lazy-loading 'fault' on Instance uuid 9755e5cf-8a51-4bf7-a483-4b923cf48551 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 13:58:12.902505 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc8208b9a54efca1ab270fed676506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4c3af8726d49c2a4e52d876eb369d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:12.910083 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b08cc34a-6015-4578-9f9c-7660b7968e6d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 200 len: 1304 microversion: 2.1 time: 0.108871 Jul 18 13:58:12.910683 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3209/6636] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:12 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:13.929194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:13.929954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:13.937405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:13.937851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:13.938647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:13.939084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:13.953871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] HTTP exception thrown: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Request method failure captured: Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 HTTP/1.1 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WbAWbClvpM_HUaHfE5tXSaGcGNmlJR-VpE1-2JNKZ5OC8StYBq2VHPTn4zqaFTl0_dgJO2cE9ZLPK6_8CU0IULZTh1J_Qz52CuG4GW-H3vJzQFxPdVz3ik_spsFt92_4kHoSIne8aVtvxeLoHQW_dAboeF84svtjWNcXOoALGuXb_E Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7b4c3af8726d49c2a4e52d876eb369d5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: d2cc8208b9a54efca1ab270fed676506 Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9755e5cf-8a51-4bf7-a483-4b923cf48551'} Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:13.955636 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Returning 404 to user: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25d26946-d5f6-4177-8f0d-1f18a299d843 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 404 len: 111 microversion: 2.1 time: 0.032447 Jul 18 13:58:13.959185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3428/6637] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:13 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:58:13.975587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:13.976186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:13.983500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:13.983973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:13.984775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:13.985230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:13.999371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] HTTP exception thrown: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Request method failure captured: Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 HTTP/1.1 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WbAWbClvpM_HUaHfE5tXSaGcGNmlJR-VpE1-2JNKZ5OC8StYBq2VHPTn4zqaFTl0_dgJO2cE9ZLPK6_8CU0IULZTh1J_Qz52CuG4GW-H3vJzQFxPdVz3ik_spsFt92_4kHoSIne8aVtvxeLoHQW_dAboeF84svtjWNcXOoALGuXb_E Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7b4c3af8726d49c2a4e52d876eb369d5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: d2cc8208b9a54efca1ab270fed676506 Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '9755e5cf-8a51-4bf7-a483-4b923cf48551'} Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:58:14.001152 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Returning 404 to user: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5aab8ec3-9f23-49cd-b272-09971f0f459d tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 404 len: 111 microversion: 2.1 time: 0.031336 Jul 18 13:58:14.007617 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3210/6638] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:58:13 2022] DELETE /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 13:58:14.012228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:14.012846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] [instance: 9755e5cf-8a51-4bf7-a483-4b923cf48551] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:14.019130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:14.019588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:14.020370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:14.020809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:14.035836 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] HTTP exception thrown: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Request method failure captured: Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 HTTP/1.1 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WbAWbClvpM_HUaHfE5tXSaGcGNmlJR-VpE1-2JNKZ5OC8StYBq2VHPTn4zqaFTl0_dgJO2cE9ZLPK6_8CU0IULZTh1J_Qz52CuG4GW-H3vJzQFxPdVz3ik_spsFt92_4kHoSIne8aVtvxeLoHQW_dAboeF84svtjWNcXOoALGuXb_E Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7b4c3af8726d49c2a4e52d876eb369d5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7b4c3af8726d49c2a4e52d876eb369d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 7b4c3af8726d49c2a4e52d876eb369d5 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1622285995 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: d2cc8208b9a54efca1ab270fed676506 Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-DeleteServersTestJSON-1622285995-project Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '9755e5cf-8a51-4bf7-a483-4b923cf48551'} Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 13:58:14.037392 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] Returning 404 to user: Instance 9755e5cf-8a51-4bf7-a483-4b923cf48551 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b974fa1-525d-46d2-a2e3-96a0669c52e3 tempest-DeleteServersTestJSON-1622285995 tempest-DeleteServersTestJSON-1622285995-project] 10.222.0.88 "GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551" status: 404 len: 111 microversion: 2.1 time: 0.031116 Jul 18 13:58:14.041827 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3429/6639] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:14 2022] GET /compute/v2.1/servers/9755e5cf-8a51-4bf7-a483-4b923cf48551 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 13:58:22.607585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-992421662", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "85831d0b-6c54-4fa0-bac0-97d09dc274b7"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:22.770955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] validate_networks() for [('85831d0b-6c54-4fa0-bac0-97d09dc274b7', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:58:23.495920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:58:23.496362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:58:23.496880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:58:23.497305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:58:23.497735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:58:23.508522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:23.508986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:23.509803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:23.510287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:23.528793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:58:23.534458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for user e8e838e4d7d6402f93957c8fbc1ec3f6 and project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:58:23.547679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:58:23.549972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:58:23.595543 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd076ddb-2201-41ae-8aa2-842f6d4a8af2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138800 Jul 18 13:58:23.596208 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3211/6640] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 13:58:23.607255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0e2c0e2a-d7d0-4faf-9c33-763ede2305d1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:23.607888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0e2c0e2a-d7d0-4faf-9c33-763ede2305d1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:23.733486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0e2c0e2a-d7d0-4faf-9c33-763ede2305d1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:23.740809 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0e2c0e2a-d7d0-4faf-9c33-763ede2305d1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1217 microversion: 2.1 time: 0.138231 Jul 18 13:58:23.741394 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3430/6641] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:23 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:24.759077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:24.759743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:24.767896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:24.768345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:24.769171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:24.769622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:24.841008 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:24.849608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d6fc64b-9d6a-45a2-978d-f356e56827cd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1275 microversion: 2.1 time: 0.094615 Jul 18 13:58:24.859649 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3212/6642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:24 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:25.867502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:25.868437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:25.872236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=45 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:25.893351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:25.894220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:25.895335 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:25.896076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:26.086241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:26.101369 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-eb9c8832-4915-41d4-85ae-5fddbefa8ecc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.237676 Jul 18 13:58:26.102874 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3431/6643] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:25 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:58:26.336966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-72744d5e-ff9c-4a14-ac57-f2390db75936 req-23f02659-d96a-4bb7-a9af-5604a5647964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:26.352847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-72744d5e-ff9c-4a14-ac57-f2390db75936 req-23f02659-d96a-4bb7-a9af-5604a5647964 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:26.353308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-72744d5e-ff9c-4a14-ac57-f2390db75936 req-23f02659-d96a-4bb7-a9af-5604a5647964 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:26.372687 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-72744d5e-ff9c-4a14-ac57-f2390db75936 req-23f02659-d96a-4bb7-a9af-5604a5647964 service nova] Creating event network-changed:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h1-850003-3 Jul 18 13:58:26.380013 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-72744d5e-ff9c-4a14-ac57-f2390db75936 req-23f02659-d96a-4bb7-a9af-5604a5647964 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049027 Jul 18 13:58:26.381119 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3213/6644] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:58:27.119701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:27.120367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:27.127428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:27.127901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:27.128712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:27.129156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:27.266403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:27.273985 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fdb01519-55eb-41c4-8828-b4acd3ec54a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.158241 Jul 18 13:58:27.274612 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3432/6645] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:27 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:28.293010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:28.293730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:28.300104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:28.300574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:28.301362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:28.301818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:28.437711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:28.445473 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eeb41e4d-85f0-4644-8bbe-0fd8551fe4be tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.158167 Jul 18 13:58:28.446051 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3214/6646] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:28 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:29.462550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:29.463093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:29.465782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=28 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:29.471615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:29.472069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:29.472844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:29.473284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:29.608954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:29.616772 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d0d1f6a-4da5-4851-8484-0186e6cbadad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.158305 Jul 18 13:58:29.617350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3433/6647] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:29 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:30.634409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:30.635040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:30.639168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:30.644677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:30.645141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:30.645990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:30.646459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:30.649929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:30.783054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:30.791883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7757e3cb-8b31-4c71-8779-45d4420e6df7 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.161451 Jul 18 13:58:30.792465 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3215/6648] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:30 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:31.808822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:31.809476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:31.816853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:31.817091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:31.817882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:31.818367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:31.950509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:31.958082 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b239bff6-f154-48ca-a901-5bc23f120d2c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.153269 Jul 18 13:58:31.958682 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3434/6649] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:31 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:32.762450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d7f51673-94f5-4349-a76e-040ee94adc39 req-3b4c18f0-e08e-4be1-9074-af2fb32fe5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "name": "network-vif-plugged", "status": "completed", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:32.771898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d7f51673-94f5-4349-a76e-040ee94adc39 req-3b4c18f0-e08e-4be1-9074-af2fb32fe5c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:32.772351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d7f51673-94f5-4349-a76e-040ee94adc39 req-3b4c18f0-e08e-4be1-9074-af2fb32fe5c0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:32.787742 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d7f51673-94f5-4349-a76e-040ee94adc39 req-3b4c18f0-e08e-4be1-9074-af2fb32fe5c0 service nova] Creating event network-vif-plugged:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h1-850003-3 Jul 18 13:58:32.793315 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d7f51673-94f5-4349-a76e-040ee94adc39 req-3b4c18f0-e08e-4be1-9074-af2fb32fe5c0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092758 Jul 18 13:58:32.793934 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3216/6650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:58:32.976048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:32.976671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:32.984134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:32.984585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:32.985377 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:32.985820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:33.120521 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:33.128363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-548d9c4b-0b21-4435-bd89-d50982a6841f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.156290 Jul 18 13:58:33.128957 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3435/6651] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:32 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:34.146448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:34.147193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:34.149274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:34.150566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:34.159157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:34.159628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:34.160433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:34.160891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:34.297587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:34.305347 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e21330f-dd60-498e-9790-0b4d9eb1b534 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1317 microversion: 2.1 time: 0.163213 Jul 18 13:58:34.305931 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3217/6652] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:34 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:35.322921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:35.323642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:35.325646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:35.331812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.332259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.333026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.333454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.471005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:35.478593 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-32c89937-9a39-43a9-a4c7-398f968f764c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1507 microversion: 2.1 time: 0.160035 Jul 18 13:58:35.479807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3436/6653] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:35 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:35.496672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:35.497307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:35.504268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.504734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.505805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.506297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.638884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:35.646922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-787e581f-0523-4d74-a948-e78d5431ed28 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1507 microversion: 2.1 time: 0.154225 Jul 18 13:58:35.647580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3218/6654] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:35 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:35.663790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:35.664932 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:35.671226 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.671629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.672417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.672864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.740916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-686f9d87-fd39-4633-8a94-556205d28e87 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "PUT /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1079 microversion: 2.1 time: 0.081414 Jul 18 13:58:35.741554 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3437/6655] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 18 13:58:35 2022] PUT /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1079 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:35.755401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:35.756043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:35.762846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.763315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.764120 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.764577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.906752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:35.914379 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bb45cc2-4094-4e59-b781-101eb5057e9a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1505 microversion: 2.1 time: 0.162835 Jul 18 13:58:35.914965 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3219/6656] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:35 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:35.930634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:35.931195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:35.937991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.938485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:35.939255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:35.939697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:36.072127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:36.080468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-811237e8-0692-4ad2-85dc-1e6edc0d312a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1505 microversion: 2.1 time: 0.153759 Jul 18 13:58:36.081051 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3438/6657] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:35 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:36.096334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:58:36.097327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:36.103500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:36.103959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:36.104783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:36.105233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:36.134650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:36.141442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Old instance type m1.heat2, new instance type m1.heat {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:58:36.147765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:58:36.148225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:58:36.148708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:58:36.149130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:58:36.149549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:58:36.212916 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1e0e64f1-fa42-4bc6-ab41-e733757abe51 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c/action" status: 202 len: 0 microversion: 2.1 time: 0.120331 Jul 18 13:58:36.213481 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3220/6658] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:58:36 2022] POST /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:58:36.221781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:36.222518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:36.229062 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:36.229532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:36.230336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:36.230780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:36.375909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:36.383650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5147b9f3-229a-4ac6-8e0c-913a83e63578 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1516 microversion: 2.1 time: 0.165890 Jul 18 13:58:36.384237 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3439/6659] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:36 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:37.401517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:37.402228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:37.408936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:37.409396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:37.410247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:37.410692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:37.585226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:37.592858 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e29eb3d6-8367-4837-89ba-146da5c87a98 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1516 microversion: 2.1 time: 0.196383 Jul 18 13:58:37.593446 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3221/6660] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:37 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:38.610994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:38.611642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:38.619371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:38.619821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:38.620579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:38.621013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:38.754444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:38.762703 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f268d22-6150-405b-8d04-44dbe9b8104f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.155327 Jul 18 13:58:38.763268 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3440/6661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:38 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:39.780923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:39.781575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:39.789324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:39.789787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:39.791108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:39.791286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:39.931439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:39.939532 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2fd9b442-0319-40ae-8d70-44b265a3132e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.163388 Jul 18 13:58:39.940103 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3222/6662] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:39 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:40.956467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:40.957087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:40.964088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:40.964535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:40.965892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:40.966368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:41.098633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:41.106306 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-03132d57-290d-44fd-9403-ebfbcf1bbaa8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.153735 Jul 18 13:58:41.106887 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3441/6663] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:40 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:42.123557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:42.124182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:42.131213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:42.131678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:42.132506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:42.132979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:42.266673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:42.274776 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1216cf8d-4e0c-4009-a4f8-4b5c6c8d9111 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.155215 Jul 18 13:58:42.275369 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3223/6664] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:42 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:43.293912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:43.294570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:43.301654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:43.302100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:43.302911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:43.303344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:43.442115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:43.450875 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6232bee-d93f-456e-b78b-a9d60b26255f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.161455 Jul 18 13:58:43.451474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3442/6665] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:43 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:44.468775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:44.469288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:44.476380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:44.476839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:44.477628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:44.478084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:44.616920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:44.624810 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-84782373-f46a-4f83-8759-74aa7b9ad7c1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.160565 Jul 18 13:58:44.625411 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3224/6666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:44 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:45.642422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:45.643037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:45.650134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:45.650594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:45.651606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:45.652063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:45.790914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:45.799292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-222906d4-0a6f-49c3-b7ad-5cea6c890dca tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.160784 Jul 18 13:58:45.799878 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3443/6667] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:45 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:46.816878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:46.817544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:46.824652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:46.825121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:46.825917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:46.826393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:46.967148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:46.975618 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-45f20eeb-2ba8-4794-a81c-d29867efeb8a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.162726 Jul 18 13:58:46.976223 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3225/6668] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:46 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:47.993023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:47.993648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:48.000729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:48.001190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:48.001977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:48.002451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:48.140886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:48.149102 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-843295fc-cfd2-41b2-aa96-bdc3babde19f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.160015 Jul 18 13:58:48.149695 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3444/6669] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:47 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:58:49.167306 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:49.167972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:49.175532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:49.175995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:49.176790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:49.177248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:49.311902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:49.319558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-94a03d56-e385-4e47-83ea-dba51a84eaa6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.156240 Jul 18 13:58:49.320142 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3226/6670] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:49 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:50.337112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:50.337869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:50.345506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:50.346025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:50.346906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:50.347454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:50.479191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:50.487294 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4caa78d4-d489-4722-a547-34349d8f3d43 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.154296 Jul 18 13:58:50.487875 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3445/6671] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:50 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:51.505519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:51.506303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:51.513246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:51.513710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:51.514531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:51.514975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:51.646878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:51.655284 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9005e9ec-3f3c-475f-bf5e-7d41bc765cdd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.154229 Jul 18 13:58:51.655867 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3227/6672] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:51 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:52.672933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:52.673563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:52.681146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:52.681605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:52.682417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:52.682866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:52.820138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:52.823595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:52.828614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f0ea575-b862-4374-8297-fce26f48515e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.159669 Jul 18 13:58:52.829200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3446/6673] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:52 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:53.845520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:53.846172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:53.853094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:53.853561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:53.854386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:53.854848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:53.987442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:53.995353 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05804526-8f73-4bb1-a221-cd3853426672 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.153718 Jul 18 13:58:53.995935 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3228/6674] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:53 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:55.013048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:55.013671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:55.023831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:55.024294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:55.025083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:55.025530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:55.157638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:55.165989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a75001c-823d-4a5d-9f46-6d2276d6415a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.156995 Jul 18 13:58:55.166634 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3447/6675] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:55 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:56.183520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:56.184665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:56.191702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:56.192162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:56.192937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:56.193384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:56.330599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:56.338379 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5adbb60a-56c6-4e88-b294-09bfda775cfb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.158661 Jul 18 13:58:56.339063 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3229/6676] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:56 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:57.356320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:57.357242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:57.364403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:57.364856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:57.365626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:57.366069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:57.497560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:57.505196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4864899e-c9fa-4f70-8714-cb67a3370468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.153183 Jul 18 13:58:57.505773 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3448/6677] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:57 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:58.522889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:58.523522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:58.531298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:58.531758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:58.532543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:58.533019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:58.667005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:58.675742 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec335835-32f5-4df6-a40d-3ac66cd21e72 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.156804 Jul 18 13:58:58.676357 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3230/6678] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:58 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:58:59.692830 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:58:59.693459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:58:59.696221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=32 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:59.701821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:59.702316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:59.703094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:58:59.703539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:58:59.844858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:58:59.852711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c74aa465-8690-4801-83ce-815f964abc02 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.163798 Jul 18 13:58:59.853332 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3449/6679] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:58:59 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:00.870632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:00.871953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:00.874958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:00.880673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:00.881137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:00.882626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:00.882626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:00.885429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:01.030162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:01.038226 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3552d029-76f9-4975-9029-dc90d5c5ca81 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.171664 Jul 18 13:59:01.038842 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3231/6680] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:00 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:02.057246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:02.057862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:02.065653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:02.066106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:02.066909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:02.067344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:02.198081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:02.206319 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2701375f-e959-48a7-ab78-4ccca7e97bb5 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.152989 Jul 18 13:59:02.206896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3450/6681] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:02 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:03.224377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:03.225272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:03.232419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:03.232888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:03.233691 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:03.234157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:03.369797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:03.378369 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-324465ed-6b00-49ab-9898-7b0c640ac274 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.158066 Jul 18 13:59:03.378964 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3232/6682] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:03 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:04.396950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:04.397570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:04.407086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:04.407437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:04.408219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:04.408661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:04.547007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:04.554716 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf80d162-844a-4ef2-91ba-4c7a8af5a414 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1521 microversion: 2.1 time: 0.161692 Jul 18 13:59:04.555304 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3451/6683] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:04 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:05.573019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:05.573690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:05.581622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:05.581975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:05.582820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:05.583280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:05.748754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "name": "network-vif-unplugged", "status": "completed", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:05.758837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:05.759281 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:05.772600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] Creating event network-vif-unplugged:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h2-850003-3 Jul 18 13:59:05.782681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] Instance 0e3f975a-5388-432c-9f36-a327dce1583c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:59:05.789623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:05.801823 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-864e15fc-3f1e-4e75-9b33-df33a6fc9aac tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1520 microversion: 2.1 time: 0.232497 Jul 18 13:59:05.806264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-04f3d3eb-f139-4611-ba49-d5cc5bb08992 req-8948045e-ca05-45c9-be3e-a6b199b1674b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061210 Jul 18 13:59:05.807771 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3452/6684] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:05.815154 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3233/6685] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:05 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:06.822790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:06.823517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:06.830512 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:06.830969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:06.831762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:06.832209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:07.000716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:07.009523 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aff69a23-4c5c-45dc-9f63-57da77ec8ec3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1518 microversion: 2.1 time: 0.192070 Jul 18 13:59:07.010243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3453/6686] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:06 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:07.830305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:07.840819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:07.841313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:07.854134 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] Creating event network-changed:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h2-850003-3 Jul 18 13:59:07.860808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] Instance 0e3f975a-5388-432c-9f36-a327dce1583c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:59:07.872558 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-21ef9505-d364-42b6-ba09-ff38095290d3 req-b7ff8e4c-21aa-4c97-b802-05a06c0e6f7f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046122 Jul 18 13:59:07.873188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3234/6687] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:08.029588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:08.031448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:08.039612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:08.040055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:08.040851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:08.041451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:08.212124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:08.221399 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a7fb7fe4-02d5-484b-85eb-e148fada06a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1518 microversion: 2.1 time: 0.196903 Jul 18 13:59:08.222233 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3454/6688] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:08 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:09.241417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:09.242170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:09.249527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.249991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.250819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.251274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.399817 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:09.408396 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cdc8ceb-9b39-4b0e-95f9-ef95dcab7155 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1515 microversion: 2.1 time: 0.172296 Jul 18 13:59:09.409007 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3235/6689] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:09 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:59:09.426088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:09.426781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:09.434222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.434967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.435746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.436211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.503832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-21f0847d-a1ef-487e-a5ab-b7f967bbbc37 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c/action" status: 204 len: 0 microversion: 2.1 time: 0.081472 Jul 18 13:59:09.504643 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3455/6690] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:59:09 2022] POST /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:59:09.515928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:09.516731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:09.524838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.526494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.526793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:09.527399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:09.792445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:09.809443 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dff7a2cb-42c9-49ab-8ef8-fc0859968395 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1515 microversion: 2.1 time: 0.298758 Jul 18 13:59:09.810684 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3236/6691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:09 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:10.832268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:10.832984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:10.839819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:10.840293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:10.841067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:10.841667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:10.994538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:11.008271 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a73246a9-0aa4-4adc-81d3-c44f0cd10fb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1507 microversion: 2.1 time: 0.181033 Jul 18 13:59:11.009115 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3456/6692] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:10 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:11.027070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:11.028570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:11.037095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:11.037599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:11.038455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:11.038915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:11.178720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:11.186524 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98d92ce0-58cf-445d-97e0-3dbe13842096 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1507 microversion: 2.1 time: 0.164283 Jul 18 13:59:11.187122 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3237/6693] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:11 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:11.205876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1cdf4db1-fcae-4b5a-8f07-1425c80a89b0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'create', calling method: .version_select at 0x7f96e4b84550>, body: {"keypair": {"name": "tempest-keypair-1697903400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHezqIDP3WfnwVGTDJ10MJ+QZ8hJ5hekxHD+jtgC6+QjYQ9PCYJWiud/nrSxNGdxvcg8yl2CkxmRDic1t4XK1v2C7rCxhjfgeXb4YAd13z1qOKGmbGb49El53fBNeDc3vg=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:11.220988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1cdf4db1-fcae-4b5a-8f07-1425c80a89b0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:59:11.226392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-1cdf4db1-fcae-4b5a-8f07-1425c80a89b0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for user e8e838e4d7d6402f93957c8fbc1ec3f6 and project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:59:11.253749 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1cdf4db1-fcae-4b5a-8f07-1425c80a89b0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051754 Jul 18 13:59:11.254310 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3457/6694] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 13:59:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:11.740437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2fec31f4-fdae-4347-b3e8-117c4f64027e req-299bbcae-6960-44a5-b6c3-f79043104d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "name": "network-vif-plugged", "status": "completed", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:11.750716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2fec31f4-fdae-4347-b3e8-117c4f64027e req-299bbcae-6960-44a5-b6c3-f79043104d9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:11.751182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2fec31f4-fdae-4347-b3e8-117c4f64027e req-299bbcae-6960-44a5-b6c3-f79043104d9e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:11.768551 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2fec31f4-fdae-4347-b3e8-117c4f64027e req-299bbcae-6960-44a5-b6c3-f79043104d9e service nova] Creating event network-vif-plugged:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h2-850003-3 Jul 18 13:59:11.774354 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2fec31f4-fdae-4347-b3e8-117c4f64027e req-299bbcae-6960-44a5-b6c3-f79043104d9e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Jul 18 13:59:11.775667 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3238/6695] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:12.640837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:12.641621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:12.648771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:12.649362 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:12.650018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:12.650543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:12.807790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:12.815989 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-942e29f4-94a1-42ef-9f08-60857bcb6efd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 200 len: 1507 microversion: 2.1 time: 0.180033 Jul 18 13:59:12.816582 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3458/6696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:12 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:12.833977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:12.834595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:12.841374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:12.841818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:12.843156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:12.843615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:12.871819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 13:59:12.957005 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76c88bb0-6fdf-4eb5-8470-252993ca7504 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 204 len: 0 microversion: 2.1 time: 0.127828 Jul 18 13:59:12.957766 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3239/6697] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 13:59:12 2022] DELETE /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:59:13.028287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-270247704", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "85831d0b-6c54-4fa0-bac0-97d09dc274b7"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:13.098735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] validate_networks() for [('85831d0b-6c54-4fa0-bac0-97d09dc274b7', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 13:59:13.606673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:59:13.607274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:59:13.607754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:59:13.608440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:59:13.608860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:59:13.622864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:13.624039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:13.625005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:13.625727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:13.650635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 13:59:13.661080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Getting quotas for user e8e838e4d7d6402f93957c8fbc1ec3f6 and project 0401ce4bbf4448a1a6edb0a1e0a9019e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 13:59:13.687387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 13:59:13.689878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 13:59:13.743991 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ef56df8e-5798-4680-ac9a-ae63769215ad tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719784 Jul 18 13:59:13.744891 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3459/6698] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 13:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 13:59:13.757700 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-71840cb3-fe59-48c4-8b1b-359003373f01 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:13.759316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-71840cb3-fe59-48c4-8b1b-359003373f01 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:13.847685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-71840cb3-fe59-48c4-8b1b-359003373f01 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:13.857103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-71840cb3-fe59-48c4-8b1b-359003373f01 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1217 microversion: 2.1 time: 0.104412 Jul 18 13:59:13.857605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3240/6699] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:13 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:59:14.878787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:14.879553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:14.887471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:14.888182 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:14.888974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:14.889985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:14.960561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:14.973247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-da777b73-6cda-403b-855b-9442d6601e5c tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1269 microversion: 2.1 time: 0.099802 Jul 18 13:59:14.973958 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3460/6700] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:14 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:15.638674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8c42cdfa-260c-4930-b017-fb146f43aa44 req-a34a6bbf-e52e-40c8-ba55-6b6d442152bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f975a-5388-432c-9f36-a327dce1583c", "name": "network-vif-deleted", "tag": "f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:15.651474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c42cdfa-260c-4930-b017-fb146f43aa44 req-a34a6bbf-e52e-40c8-ba55-6b6d442152bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:15.652370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8c42cdfa-260c-4930-b017-fb146f43aa44 req-a34a6bbf-e52e-40c8-ba55-6b6d442152bf service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:15.667287 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8c42cdfa-260c-4930-b017-fb146f43aa44 req-a34a6bbf-e52e-40c8-ba55-6b6d442152bf service nova] Creating event network-vif-deleted:f5ed7f7c-e4d3-4bed-95e9-5f82d5aaef98 for instance 0e3f975a-5388-432c-9f36-a327dce1583c on n-h2-850003-3 Jul 18 13:59:15.674131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8c42cdfa-260c-4930-b017-fb146f43aa44 req-a34a6bbf-e52e-40c8-ba55-6b6d442152bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038815 Jul 18 13:59:15.675384 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3241/6701] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:15.992517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:15.993123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:16.000797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:16.001292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:16.002088 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:16.003060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:16.081882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:16.090917 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dedc77ad-322b-4f9e-939a-c70a82fb41bd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1275 microversion: 2.1 time: 0.102767 Jul 18 13:59:16.091511 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3461/6702] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:15 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:17.114588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:17.115364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:17.121910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:17.122327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:17.123126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:17.123587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:17.355618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:17.364159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7f98d076-eb3f-47a1-8d16-542c9b9148d2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.254750 Jul 18 13:59:17.364864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3242/6703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:17 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:17.711815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b63b7177-055b-447c-9b78-bbc301a12772 req-1be0e75a-eb52-4d0e-a9c3-a5fd90048dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:17.721644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b63b7177-055b-447c-9b78-bbc301a12772 req-1be0e75a-eb52-4d0e-a9c3-a5fd90048dad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:17.722118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b63b7177-055b-447c-9b78-bbc301a12772 req-1be0e75a-eb52-4d0e-a9c3-a5fd90048dad service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:17.733531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b63b7177-055b-447c-9b78-bbc301a12772 req-1be0e75a-eb52-4d0e-a9c3-a5fd90048dad service nova] Creating event network-changed:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h1-850003-3 Jul 18 13:59:17.738720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b63b7177-055b-447c-9b78-bbc301a12772 req-1be0e75a-eb52-4d0e-a9c3-a5fd90048dad service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030585 Jul 18 13:59:17.739337 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3462/6704] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:18.381135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:18.381776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:18.389427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:18.389902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:18.390749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:18.391203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:18.550584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:18.559134 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4d069c03-0d7f-4651-9bac-a9196b6b0468 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.181866 Jul 18 13:59:18.559872 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3243/6705] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:18 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:18.986552 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 13:59:18.986815 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 13:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 13:59:19.578554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:19.579266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:19.587141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:19.587823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:19.588971 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:19.589641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:19.770645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:19.779111 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1f44991-d562-4366-a3a9-abacb01905a9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.206871 Jul 18 13:59:19.779769 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3463/6706] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:19 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:20.807469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:20.808107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:20.816119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:20.816584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:20.817417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:20.817877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:20.976208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:20.984387 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ec4f269-1d11-4564-9d59-000fd903be67 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.180876 Jul 18 13:59:20.985022 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3244/6707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:20 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:22.003217 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:22.004019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:22.013596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:22.014592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:22.015391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:22.015832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:22.167528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:22.175598 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4cc4f704-7057-479e-afd0-5ade09b4d396 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.176283 Jul 18 13:59:22.176228 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3464/6708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:21 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:59:22.847821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-65c383ae-e87f-4d72-9767-d93165bee9f1 req-40870cb3-54de-41a9-8868-bf79d3cf6e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "name": "network-vif-plugged", "status": "completed", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:22.859322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-65c383ae-e87f-4d72-9767-d93165bee9f1 req-40870cb3-54de-41a9-8868-bf79d3cf6e60 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:22.859842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-65c383ae-e87f-4d72-9767-d93165bee9f1 req-40870cb3-54de-41a9-8868-bf79d3cf6e60 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:22.871699 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-65c383ae-e87f-4d72-9767-d93165bee9f1 req-40870cb3-54de-41a9-8868-bf79d3cf6e60 service nova] Creating event network-vif-plugged:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h1-850003-3 Jul 18 13:59:22.877735 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-65c383ae-e87f-4d72-9767-d93165bee9f1 req-40870cb3-54de-41a9-8868-bf79d3cf6e60 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Jul 18 13:59:22.878418 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3245/6709] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:23.193522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:23.194405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:23.202513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:23.203122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:23.204104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:23.204599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:23.207935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:23.367901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:23.376599 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4afd27c8-902e-4c5c-9c20-a8d4fd092744 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.187270 Jul 18 13:59:23.377295 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3465/6710] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:23 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:24.390669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:24.395898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:24.396605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:24.403797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:24.404268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:24.405116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:24.405517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:24.548112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:24.555668 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7adb26ed-9dc1-45aa-a4bf-b064d52455e6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1317 microversion: 2.1 time: 0.166035 Jul 18 13:59:24.556240 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3246/6711] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:24 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:25.572736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:25.573365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:25.575269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:25.575950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=10 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:25.584758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.585214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.585991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.586466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.718712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:25.726567 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-60facde9-6644-4798-af1d-50a0e8403583 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1507 microversion: 2.1 time: 0.157703 Jul 18 13:59:25.727145 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3466/6712] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:25 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:25.743076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:25.743709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:25.751383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.751857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.752650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.753103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.895600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:25.903552 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5746d82c-2c96-46ce-829e-51812124ff2d tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1507 microversion: 2.1 time: 0.164319 Jul 18 13:59:25.904139 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3247/6713] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:25 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:25.920022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:25.921605 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:25.927867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.928321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.929089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:25.929540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:25.958413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:25.964705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 13:59:25.970960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 13:59:25.971387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 13:59:25.971863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 13:59:25.972275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 13:59:25.972688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 13:59:26.040485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90d82924-1dbd-4733-9394-d9262e529bcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390/action" status: 202 len: 0 microversion: 2.1 time: 0.124184 Jul 18 13:59:26.044471 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3467/6714] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:59:25 2022] POST /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 13:59:26.051998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:26.053997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:26.065079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:26.065079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:26.065079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:26.065079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:26.245288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:26.254276 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cfd2cc61-7615-450d-afc6-d550c1f35fcd tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1514 microversion: 2.1 time: 0.208405 Jul 18 13:59:26.254876 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3248/6715] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:26 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:27.272889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:27.273654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:27.280477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:27.280942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:27.281736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:27.282215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:27.450261 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:27.458083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56a1cf96-32ad-4e5f-b3ea-61e3c3b7debc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1514 microversion: 2.1 time: 0.190137 Jul 18 13:59:27.458700 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3468/6716] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:27 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:28.476742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:28.477277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:28.484580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:28.485880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:28.486747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:28.487423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:28.504911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:28.653173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:28.663508 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a7aeed7-fde4-44ba-9a69-bd34bbf35b78 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.190968 Jul 18 13:59:28.664116 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3249/6717] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:28 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:29.681940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:29.682604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:29.690394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:29.690851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:29.691663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:29.692134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:29.832303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:29.840218 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72548446-58dd-4e03-b4ef-6a693cf844ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.162553 Jul 18 13:59:29.840805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3469/6718] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:29 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:30.857944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:30.858599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:30.865842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:30.866354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:30.867146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:30.867602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:30.999551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:31.007149 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c09843de-e152-4372-b540-6312a51ff1d9 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.153169 Jul 18 13:59:31.007733 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3250/6719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:30 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:32.024523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:32.025075 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:32.028146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:32.035847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:32.036303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:32.037090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:32.037528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:32.173551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:32.181585 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5e92f9a-30f5-4ca9-acb7-32eb93f98c55 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.161184 Jul 18 13:59:32.182199 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3470/6720] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:32 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:33.199173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:33.199806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:33.203044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:33.208594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:33.209062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:33.209856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:33.210409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:33.344508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:33.352477 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-40057d72-7d81-4dc8-822c-5a92964789fa tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.157221 Jul 18 13:59:33.353091 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3251/6721] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:33 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:34.370421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:34.371053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:34.378804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:34.379233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:34.380013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:34.380458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:34.520330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:34.528421 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e6ce514f-9259-4749-8cdf-608a0b39d4da tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.161996 Jul 18 13:59:34.528997 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3471/6722] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:34 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:35.545514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:35.546255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:35.553589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:35.554055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:35.554879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:35.555334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:35.696081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:35.703841 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-af69cfbd-4ae2-4a2c-b675-56fc482f2aa2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.162831 Jul 18 13:59:35.704434 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3252/6723] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:35 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:36.721043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:36.721665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:36.729508 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:36.729966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:36.730786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:36.731233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:36.886739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:36.895397 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37fdbd47-2bc9-4d64-9989-f5ea312bfaf6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.178280 Jul 18 13:59:36.895995 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3472/6724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:36 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:37.915810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:37.917029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:37.929798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:37.930694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:37.932178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:37.933016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:38.078361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:38.086606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8abf8c21-6d58-4567-a324-fe42f49caf52 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.177363 Jul 18 13:59:38.087206 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3253/6725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:37 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:39.104384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:39.105011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:39.112156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:39.112615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:39.113387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:39.113829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:39.248699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:39.256424 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e5bc56f-b919-440a-8368-9e07104f7c95 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.156033 Jul 18 13:59:39.257010 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3473/6726] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:39 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:40.273716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:40.274481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:40.281764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:40.282271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:40.283063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:40.283522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:40.425695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:40.433331 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88b9948d-98f4-4879-868f-0af36c8821d3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.163712 Jul 18 13:59:40.433924 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3254/6727] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:40 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:41.451001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:41.451874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:41.459323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:41.459770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:41.460529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:41.460966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:41.598207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:41.605843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4c60e21c-e9ef-4727-b43d-40bfb5838546 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.158753 Jul 18 13:59:41.606461 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3474/6728] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:41 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:42.623633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:42.624256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:42.632174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:42.632655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:42.633420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:42.633873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:42.772195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:42.780303 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc5b0bfe-d333-4313-b9ce-227a1feab7ae tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.160549 Jul 18 13:59:42.780904 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3255/6729] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:42 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:43.799128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:43.799732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:43.807404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:43.807864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:43.808648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:43.809121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:43.945275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:43.952862 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1b8113af-df14-4e20-b91e-1a15b14f76a6 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.158956 Jul 18 13:59:43.953480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3475/6730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:43 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:44.970907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:44.971531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:44.978199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:44.978757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:44.979546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:44.979999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:45.115104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:45.122987 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1e587585-abfa-4605-b3a9-d6fd04e59a76 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.156787 Jul 18 13:59:45.123541 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3256/6731] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:44 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:46.141574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:46.142104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:46.149276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:46.149736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:46.150804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:46.151246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:46.290780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:46.299348 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14adbc1a-47fd-4f45-b9da-ff77a7907bc2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.162298 Jul 18 13:59:46.299939 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3476/6732] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:46 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:47.317179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:47.317803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:47.324911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:47.325386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:47.326193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:47.326693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:47.465076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:47.472850 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56cffcd4-54f7-463c-9acb-791c9bcbf710 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.160312 Jul 18 13:59:47.473439 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3257/6733] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:47 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:48.490011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:48.490598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:48.497705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:48.498188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:48.498973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:48.499419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:48.635349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:48.643963 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fca75b8c-2590-4da0-9332-fd2ba08dd211 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.157974 Jul 18 13:59:48.644748 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3477/6734] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:48 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:49.661489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:49.662185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:49.669367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.669825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.670650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.671097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.806288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:49.814283 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-917389b6-74bf-4f4a-999e-c19e092b4841 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.156626 Jul 18 13:59:49.814868 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3258/6735] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:49 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:50.832361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:50.832984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:50.839732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:50.840185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:50.840961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:50.841395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:50.975958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:50.983654 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-705795aa-f44f-4b49-bc9b-c7ffca2e6bb8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.156893 Jul 18 13:59:50.984275 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3478/6736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:50 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:52.000845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:52.001466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:52.008840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:52.009301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:52.010084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:52.010560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:52.154014 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:52.162463 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51c2c3f3-e2ae-4ccd-9fca-383b9fa5a704 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.165497 Jul 18 13:59:52.163042 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3259/6737] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:51 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:53.179585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:53.180215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:53.187590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:53.188044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:53.188822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:53.189260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:53.319503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:53.321741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:53.329373 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e8768087-485e-4a0c-8a7d-59409448850e tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.153185 Jul 18 13:59:53.329971 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3479/6738] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:53 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:54.346898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:54.347525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:54.354703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:54.355166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:54.355957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:54.356407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:54.492909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:54.500530 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10dbb52c-d2d0-487a-8d93-d029b7c970a8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1519 microversion: 2.1 time: 0.157704 Jul 18 13:59:54.501129 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3260/6739] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:54 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:55.522990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:55.524134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:55.539583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:55.540427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:55.541679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:55.542504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:55.697465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:55.705688 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4335312a-0cd4-4990-bc91-91c220b52d10 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1518 microversion: 2.1 time: 0.191442 Jul 18 13:59:55.706427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3480/6740] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:55 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:55.845042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "name": "network-vif-unplugged", "status": "completed", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:55.853963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:55.855512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:55.868398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] Creating event network-vif-unplugged:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h2-850003-3 Jul 18 13:59:55.874469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] Instance 223ffeca-82cc-49bf-be80-c42515ef6390 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:59:55.886177 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-46d62a8b-2251-4721-8954-6a76b831595f req-806dfcbf-ef7d-4ebd-957e-07c8a1cb730c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044925 Jul 18 13:59:55.887114 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3261/6741] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:56.723628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:56.724243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:56.731420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:56.731827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:56.732652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:56.733132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:56.870872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:56.879313 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-01fc0397-1c4b-4c51-b06a-72220334acf1 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1516 microversion: 2.1 time: 0.159838 Jul 18 13:59:56.879897 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3481/6742] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:56 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 13:59:57.899355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:57.900338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:57.903232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:57.907822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:57.908522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:57.909117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:57.909577 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:57.912370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:57.912814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:57.928783 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] Creating event network-changed:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h2-850003-3 Jul 18 13:59:57.936477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] Instance 223ffeca-82cc-49bf-be80-c42515ef6390 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 13:59:57.947623 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f06f7e70-e34c-400c-a870-1073571b22b8 req-83b5cb33-2673-4c0d-ac85-61f7400b8e1c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049294 Jul 18 13:59:57.948243 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3482/6743] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 13:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 13:59:58.248055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:58.264631 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2ce7f62-99d5-4ef8-a04d-749adf74a60f tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1516 microversion: 2.1 time: 0.370230 Jul 18 13:59:58.266724 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3262/6744] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:57 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1516 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:59.295884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:59.296607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:59.303696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.304185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.304905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.305340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.449375 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:59.457611 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0dc7fa0d-f97c-4e94-9110-074504da2edb tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1513 microversion: 2.1 time: 0.167101 Jul 18 13:59:59.458219 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3483/6745] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:59 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 13:59:59.475544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 13:59:59.476076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:59.483090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.483556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.484345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.484836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.488943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=80 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:59.543217 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b789a64-c520-4429-b5bb-5e39fc791191 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "POST /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390/action" status: 204 len: 0 microversion: 2.1 time: 0.071391 Jul 18 13:59:59.543855 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3263/6746] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 13:59:59 2022] POST /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 13:59:59.553652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:59.553652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 13:59:59.559160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.559621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.560458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:59.560853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:59.701141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 13:59:59.709447 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5810f76c-b1aa-4f30-a017-9d7494873e61 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1513 microversion: 2.1 time: 0.161288 Jul 18 13:59:59.710040 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3484/6747] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 13:59:59 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:00.728448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:00.729574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:00.736901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:00.737518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:00.738377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:00.738838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:00.880054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:00.888468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22b6196f-eded-4c51-9a0f-862a02a29707 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1513 microversion: 2.1 time: 0.165385 Jul 18 14:00:00.889079 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3264/6748] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:00 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:01.909316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:01.910356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:01.917916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:01.918402 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:01.919190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:01.919634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:01.989276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-f14ea1dd-c350-46f6-9364-605de640909f req-3e62ae89-5987-49bc-afa5-96e15e8ad0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "name": "network-vif-plugged", "status": "completed", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:02.002314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f14ea1dd-c350-46f6-9364-605de640909f req-3e62ae89-5987-49bc-afa5-96e15e8ad0b6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.002930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-f14ea1dd-c350-46f6-9364-605de640909f req-3e62ae89-5987-49bc-afa5-96e15e8ad0b6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.016757 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-f14ea1dd-c350-46f6-9364-605de640909f req-3e62ae89-5987-49bc-afa5-96e15e8ad0b6 service nova] Creating event network-vif-plugged:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h2-850003-3 Jul 18 14:00:02.022995 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-f14ea1dd-c350-46f6-9364-605de640909f req-3e62ae89-5987-49bc-afa5-96e15e8ad0b6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Jul 18 14:00:02.024512 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3265/6749] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:00:02.061794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:02.069807 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-08d714d1-6029-4eb7-a753-f017fd53d96b tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1505 microversion: 2.1 time: 0.165425 Jul 18 14:00:02.070442 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3485/6750] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:01 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:02.086884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:02.087701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:02.094885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.095356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.096149 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.096603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.237043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:02.254313 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e217f5e4-e217-420d-8ce8-af5946be4ad2 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1505 microversion: 2.1 time: 0.171755 Jul 18 14:00:02.255281 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3266/6751] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:02 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:02.272989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:02.273620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:02.275922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=32 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:02.282073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.282572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.283351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.284035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.428344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:02.437124 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d1874b0d-eb5b-4e0b-aeb8-7eff3e435edc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1505 microversion: 2.1 time: 0.168021 Jul 18 14:00:02.437752 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3486/6752] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:02 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:02.460461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:02.461076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:02.468260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.468894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.470873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.470873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.503539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:00:02.597537 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d96d8ac4-d42c-498a-86fc-416ca3701da0 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 204 len: 0 microversion: 2.1 time: 0.140921 Jul 18 14:00:02.598260 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3267/6753] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:00:02 2022] DELETE /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:00:02.616761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:02.617291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:02.624175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.624831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.625583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.625800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.653237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:00:02.703105 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.compute.api [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Instance is already in deleting state, ignoring this request Jul 18 14:00:02.704507 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e00d3ab0-e39c-4323-9290-c9834182bdf3 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 204 len: 0 microversion: 2.1 time: 0.093970 Jul 18 14:00:02.705103 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3487/6754] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:00:02 2022] DELETE /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:00:02.713850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:02.714596 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:02.720997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.721388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.722189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:02.722636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:02.876767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:02.884625 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ea03f61-733f-46aa-af0c-2361db1e8047 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1511 microversion: 2.1 time: 0.175034 Jul 18 14:00:02.885228 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3268/6755] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:02 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:00:03.902301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:03.902889 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:03.911102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:03.911556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:03.912334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:03.912787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:04.053933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:04.061600 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-839f071e-027a-44a4-b7ba-9874e8c18cbc tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1511 microversion: 2.1 time: 0.163587 Jul 18 14:00:04.062427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3488/6756] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:03 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:04.603291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-35c378e7-88ae-4d21-b2f1-43c4ffdae973 req-57c8542a-5c85-4c0e-8455-58cf78626f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223ffeca-82cc-49bf-be80-c42515ef6390", "name": "network-vif-deleted", "tag": "e93683d3-aa09-4028-b2dc-9d72b608e6f4"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:04.607764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:04.614843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-35c378e7-88ae-4d21-b2f1-43c4ffdae973 req-57c8542a-5c85-4c0e-8455-58cf78626f92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:04.616109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-35c378e7-88ae-4d21-b2f1-43c4ffdae973 req-57c8542a-5c85-4c0e-8455-58cf78626f92 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:04.628922 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-35c378e7-88ae-4d21-b2f1-43c4ffdae973 req-57c8542a-5c85-4c0e-8455-58cf78626f92 service nova] Creating event network-vif-deleted:e93683d3-aa09-4028-b2dc-9d72b608e6f4 for instance 223ffeca-82cc-49bf-be80-c42515ef6390 on n-h2-850003-3 Jul 18 14:00:04.634046 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-35c378e7-88ae-4d21-b2f1-43c4ffdae973 req-57c8542a-5c85-4c0e-8455-58cf78626f92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Jul 18 14:00:04.634928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3269/6757] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:05.078505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:05.079135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:05.086399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:05.087266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:05.088086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:05.088554 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:05.126670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:05.127206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:05.128096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lazy-loading 'fault' on Instance uuid 223ffeca-82cc-49bf-be80-c42515ef6390 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:00:05.188896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e838e4d7d6402f93957c8fbc1ec3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0401ce4bbf4448a1a6edb0a1e0a9019e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:05.196252 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7b27d492-8bf7-4eec-bfc0-4ee1665bc606 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 200 len: 1305 microversion: 2.1 time: 0.121885 Jul 18 14:00:05.197094 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3489/6758] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:05 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:06.215125 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:06.215840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 223ffeca-82cc-49bf-be80-c42515ef6390] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:06.222850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.223320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.224113 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.224571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.238680 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] HTTP exception thrown: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Request method failure captured: Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 HTTP/1.1 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wb-YHLr8Fn11e26efP2QCWjcmg01XAP2jW30ztLqIZ1G-UJsSaAwf-RDFFhHpPBNOlaibSxpD_jXW61CFL7zOdDLfurUDLNoY1wGsAObKxIVmtMpaUqHqFQVT1O2OzLVJ5LZ3PDgQnGnJf0SQFi66e8Y6Es-csCHc7zxwIZk-Y2PIs Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0401ce4bbf4448a1a6edb0a1e0a9019e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e8e838e4d7d6402f93957c8fbc1ec3f6 Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '223ffeca-82cc-49bf-be80-c42515ef6390'} Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.240325 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Returning 404 to user: Instance 223ffeca-82cc-49bf-be80-c42515ef6390 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62bdecfc-2837-4f8b-b404-37f402b2fe41 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390" status: 404 len: 111 microversion: 2.1 time: 0.032329 Jul 18 14:00:06.244580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3270/6759] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:06 2022] GET /compute/v2.1/servers/223ffeca-82cc-49bf-be80-c42515ef6390 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:00:06.250481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc3a61ce-c255-491c-b75a-d2db769613d8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '.version_select at 0x7f96e43cc670>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:06.282915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc3a61ce-c255-491c-b75a-d2db769613d8 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697903400" status: 202 len: 0 microversion: 2.1 time: 0.036210 Jul 18 14:00:06.283511 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3490/6760] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 14:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697903400 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:00:06.899033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:06.899554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:06.906040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.906614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.907395 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.907846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.921415 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] HTTP exception thrown: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Request method failure captured: Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c HTTP/1.1 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wb-YHLr8Fn11e26efP2QCWjcmg01XAP2jW30ztLqIZ1G-UJsSaAwf-RDFFhHpPBNOlaibSxpD_jXW61CFL7zOdDLfurUDLNoY1wGsAObKxIVmtMpaUqHqFQVT1O2OzLVJ5LZ3PDgQnGnJf0SQFi66e8Y6Es-csCHc7zxwIZk-Y2PIs Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0401ce4bbf4448a1a6edb0a1e0a9019e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: e8e838e4d7d6402f93957c8fbc1ec3f6 Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '0e3f975a-5388-432c-9f36-a327dce1583c'} Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:00:06.923556 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Returning 404 to user: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-de632013-e17a-4048-a3ae-0c8524afb600 tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 404 len: 111 microversion: 2.1 time: 0.029843 Jul 18 14:00:06.927581 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3271/6761] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:00:06 2022] DELETE /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:00:06.933759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:06.934414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] [instance: 0e3f975a-5388-432c-9f36-a327dce1583c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:06.943687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.944148 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.944945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:06.945389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:06.962381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] HTTP exception thrown: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Request method failure captured: Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c HTTP/1.1 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Wb-YHLr8Fn11e26efP2QCWjcmg01XAP2jW30ztLqIZ1G-UJsSaAwf-RDFFhHpPBNOlaibSxpD_jXW61CFL7zOdDLfurUDLNoY1wGsAObKxIVmtMpaUqHqFQVT1O2OzLVJ5LZ3PDgQnGnJf0SQFi66e8Y6Es-csCHc7zxwIZk-Y2PIs Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0401ce4bbf4448a1a6edb0a1e0a9019e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0401ce4bbf4448a1a6edb0a1e0a9019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 0401ce4bbf4448a1a6edb0a1e0a9019e Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1180627158 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: e8e838e4d7d6402f93957c8fbc1ec3f6 Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerDiskConfigTestJSON-1180627158-project Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0e3f975a-5388-432c-9f36-a327dce1583c'} Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:00:06.964071 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] Returning 404 to user: Instance 0e3f975a-5388-432c-9f36-a327dce1583c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ba5d6d83-7830-4a9d-8689-469a35af892a tempest-ServerDiskConfigTestJSON-1180627158 tempest-ServerDiskConfigTestJSON-1180627158-project] 10.222.0.88 "GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c" status: 404 len: 111 microversion: 2.1 time: 0.035730 Jul 18 14:00:06.968340 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3491/6762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:06 2022] GET /compute/v2.1/servers/0e3f975a-5388-432c-9f36-a327dce1583c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:00:15.902814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c001368-c70f-4933-94a8-f2f2eadbb3e9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: .version_select at 0x7f96e54f2040>, body: {"keypair": {"name": "tempest-keypair-968017985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAD3Sog/hohvi7ADti38yPoZmehRa2LG97wBw7RkKIqwmxNwsXZntvfbZ3A+OPJUI2tjkC0dNrNmtg9vhfcSTuWxNiLxrnbUwO4CG3EOvh5NHN9C5TYCnMXqoEyTJxfWg=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:15.917186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5c001368-c70f-4933-94a8-f2f2eadbb3e9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:00:15.923332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5c001368-c70f-4933-94a8-f2f2eadbb3e9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:00:15.955300 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c001368-c70f-4933-94a8-f2f2eadbb3e9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204448 Jul 18 14:00:15.956016 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3272/6763] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:00:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:17.330270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2099819944", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4ace286-a2be-4bd4-8bb4-72bd2d82cf14"}], "security_groups": [{"name": "tempest-securitygroup--1686720155"}], "key_name": "tempest-keypair-968017985", "user_data": "}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:17.339804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:17.340843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:17.457861 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] validate_networks() for [('c4ace286-a2be-4bd4-8bb4-72bd2d82cf14', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:00:17.931504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:00:17.931936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:00:17.932415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:00:17.933031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:00:17.933460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:00:17.942870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:17.943662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:17.944739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:17.945183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:17.964001 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:00:17.970390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:00:17.985667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:00:17.988027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:00:18.037143 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd4bcc56-cdaf-4ee8-8483-2f4b4f71aaad tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.712966 Jul 18 14:00:18.038295 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3492/6764] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:00:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:00:18.045677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:18.050816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-27ce61f2-7f54-4dce-b9c0-1e405009b0bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:18.051459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-27ce61f2-7f54-4dce-b9c0-1e405009b0bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:18.114955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-27ce61f2-7f54-4dce-b9c0-1e405009b0bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:18.121867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-27ce61f2-7f54-4dce-b9c0-1e405009b0bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1238 microversion: 2.1 time: 0.077953 Jul 18 14:00:18.122864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3273/6765] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:18 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:19.139622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:19.140868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:19.148567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:19.149034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:19.150316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:19.150740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:19.230766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:19.240847 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-61a66729-c012-4f11-bbca-bed03a3ea12e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1298 microversion: 2.1 time: 0.105407 Jul 18 14:00:19.241445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3493/6766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:19 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:20.258666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:20.259330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:20.267234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:20.267810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:20.268667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:20.269127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:20.487214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:20.496131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f08d0b12-5698-45cd-b89c-72ab5d6e61da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.241711 Jul 18 14:00:20.496738 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3274/6767] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:20 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:20.722225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-76ee18ae-a30c-4e24-8dce-c594d116ca7a req-57c71496-c4c7-4552-845e-732e90238b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:20.736616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76ee18ae-a30c-4e24-8dce-c594d116ca7a req-57c71496-c4c7-4552-845e-732e90238b78 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:20.736983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-76ee18ae-a30c-4e24-8dce-c594d116ca7a req-57c71496-c4c7-4552-845e-732e90238b78 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:20.749395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-76ee18ae-a30c-4e24-8dce-c594d116ca7a req-57c71496-c4c7-4552-845e-732e90238b78 service nova] Creating event network-changed:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h1-850003-3 Jul 18 14:00:20.756200 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-76ee18ae-a30c-4e24-8dce-c594d116ca7a req-57c71496-c4c7-4552-845e-732e90238b78 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038410 Jul 18 14:00:20.757930 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3494/6768] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:21.515701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:21.516420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:21.525066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:21.525541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:21.526377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:21.526844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:21.664166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:21.671826 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1d745e14-8dda-4994-b412-be3959025836 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.160840 Jul 18 14:00:21.672413 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3275/6769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:21 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:22.690860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:22.691568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:22.698048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:22.698536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:22.699311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:22.699753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:22.833378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:22.841467 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c4ce3b2c-4b78-40f2-b87d-c951d2ba8701 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.156179 Jul 18 14:00:22.842062 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3495/6770] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:22 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:23.858710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:23.859520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:23.866594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:23.867067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:23.867870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:23.868322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:24.002740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:24.010369 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-781af31f-3b25-472d-9177-1f41256858c6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.155499 Jul 18 14:00:24.010944 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3276/6771] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:23 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:25.028082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:25.028715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:25.036738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:25.037024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:25.037815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:25.038283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:25.180149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:25.187910 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-74aad8d9-9a56-4303-8c0d-a2c03886b54a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.164092 Jul 18 14:00:25.188492 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3496/6772] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:25 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:26.204793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:26.205427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:26.212565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:26.213047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:26.213875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:26.214368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:26.345305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:26.353273 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6919ca04-8ffa-4713-a8ab-07317430bf95 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.152411 Jul 18 14:00:26.353853 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3277/6773] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:26 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:27.109436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-208385b1-88b2-4b32-8675-ad5639d3508d req-de804f95-e260-4d85-91f2-6e04f393a4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "name": "network-vif-plugged", "status": "completed", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:27.119360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-208385b1-88b2-4b32-8675-ad5639d3508d req-de804f95-e260-4d85-91f2-6e04f393a4a2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:27.119851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-208385b1-88b2-4b32-8675-ad5639d3508d req-de804f95-e260-4d85-91f2-6e04f393a4a2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:27.135892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-208385b1-88b2-4b32-8675-ad5639d3508d req-de804f95-e260-4d85-91f2-6e04f393a4a2 service nova] Creating event network-vif-plugged:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h1-850003-3 Jul 18 14:00:27.142626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-208385b1-88b2-4b32-8675-ad5639d3508d req-de804f95-e260-4d85-91f2-6e04f393a4a2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036786 Jul 18 14:00:27.143350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3497/6774] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:27.370614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:27.371250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:27.379209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:27.379489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:27.380474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:27.380902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:27.512327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:27.519883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-999e0453-4184-44ed-b77a-d567093cac62 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.153174 Jul 18 14:00:27.520463 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3278/6775] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:27 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:28.535036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:28.535843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:28.540903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:28.541618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:28.548961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:28.549427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:28.550259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:28.550706 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:28.685089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:28.693869 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b1776de6-57ca-4cd6-bfd0-72b9a5aa4e00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1364 microversion: 2.1 time: 0.159700 Jul 18 14:00:28.694532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3498/6776] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:28 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:29.711197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:29.711826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:29.713741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:29.721377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:29.721773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:29.722606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:29.723065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:29.861715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:00:29.869563 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-541bdf96-f5c5-4d42-ad53-65bc9aefee71 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1551 microversion: 2.1 time: 0.162328 Jul 18 14:00:29.870128 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3279/6777] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:00:29 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:00:29.885789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:00:29.886344 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:00:29.893640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:29.894086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:29.895077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:29.895313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:29.977753 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c53dec80-c174-466f-958b-10edf3f543eb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095736 Jul 18 14:00:29.978410 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3499/6778] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 14:00:29 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:31.320410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-eb238320-672e-4608-8d4c-9a6938e1889c req-a51001d2-7d85-4413-ab29-f1c9ff406298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:00:31.328740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-eb238320-672e-4608-8d4c-9a6938e1889c req-a51001d2-7d85-4413-ab29-f1c9ff406298 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:00:31.329813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-eb238320-672e-4608-8d4c-9a6938e1889c req-a51001d2-7d85-4413-ab29-f1c9ff406298 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:00:31.341261 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-eb238320-672e-4608-8d4c-9a6938e1889c req-a51001d2-7d85-4413-ab29-f1c9ff406298 service nova] Creating event network-changed:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h1-850003-3 Jul 18 14:00:31.347753 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-eb238320-672e-4608-8d4c-9a6938e1889c req-a51001d2-7d85-4413-ab29-f1c9ff406298 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088927 Jul 18 14:00:31.348384 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3280/6779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:00:56.857136 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:00:56.857839 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:01:35.872879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:35.873650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:35.878620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:35.879276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:35.886944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:35.887400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:35.888183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:35.888677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.026628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:36.034536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23154d4a-1927-464e-9402-e077c65d1a20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.164117 Jul 18 14:01:36.035133 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3500/6780] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:35 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:36.050216 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:36.050991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=38 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:36.056942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:36.056942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:36.065288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.065749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.066591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.067046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.201933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:36.209529 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2f69f733-5d40-4657-b76c-f6118c449375 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.162484 Jul 18 14:01:36.210090 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3281/6781] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:36 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:36.225314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:36.225928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:36.231986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.232431 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.233188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.233622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.372914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:36.381911 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db1183d6-a2ab-4466-b1f2-006aa74aa4d0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.160388 Jul 18 14:01:36.382606 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3501/6782] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:36 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:36.399925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:36.400830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:36.407963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.408425 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.409222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.409679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.439507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:36.445731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Old instance type m1.heat2, new instance type m1.heat {{(pid=131367) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 14:01:36.452195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:01:36.452627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:01:36.453223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:01:36.453707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:01:36.454127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:01:36.525059 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fa59f08d-3eb6-4f31-b901-5c6a049a1bca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/action" status: 202 len: 0 microversion: 2.1 time: 0.129599 Jul 18 14:01:36.525693 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3282/6783] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:01:36 2022] POST /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:01:36.534669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:36.535440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:36.541629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.542078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.542884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:36.543345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:36.680367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:36.688133 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b7cb2c72-3a20-46b4-b931-6f510b772fd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1679 microversion: 2.1 time: 0.157838 Jul 18 14:01:36.688768 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3502/6784] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:36 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:37.706453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:37.707087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:37.715359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:37.715827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:37.716622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:37.717074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:37.911013 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:37.918864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f2b90fd8-fd4c-4e6a-9ca9-30f17a5148db tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1679 microversion: 2.1 time: 0.217156 Jul 18 14:01:37.919454 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3283/6785] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:37 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:38.937529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:38.938085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:38.945868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:38.946372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:38.947145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:38.947586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:39.078620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:39.087188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e550d076-e719-4367-9124-2952f9e1120a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.153614 Jul 18 14:01:39.087769 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3503/6786] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:38 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:40.104972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:40.105522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:40.113103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:40.113576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:40.114399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:40.114859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:40.248514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:40.256245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3aadf9a4-2f13-4530-a0df-1897d0d5deeb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.155307 Jul 18 14:01:40.256825 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3284/6787] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:40 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:41.274292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:41.274920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:41.288152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:41.288602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:41.289380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:41.289816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:41.425214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:41.432825 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-442c1016-73f1-4f4c-951b-618389f89706 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.162737 Jul 18 14:01:41.433415 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3504/6788] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:41 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:42.450695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:42.451240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:42.459020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:42.459490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:42.460287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:42.460746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:42.591107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:42.598910 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93e7507a-3b34-4a7e-bbd9-f7773e6218fd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.152613 Jul 18 14:01:42.599485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3285/6789] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:42 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:43.617190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:43.617890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:43.624970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:43.625463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:43.626285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:43.626735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:43.760577 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:43.768617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d099e14c-c7de-4d73-a7fb-cd64a6465c34 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.154861 Jul 18 14:01:43.769190 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3505/6790] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:43 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:44.786683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:44.787321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:44.794187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:44.794658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:44.795452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:44.795902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:44.926908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:44.934388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-38095a8d-4e20-4887-ae5a-17188d19dd28 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.152164 Jul 18 14:01:44.934956 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3286/6791] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:44 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:45.951212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:45.951835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:45.959179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:45.959635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:45.960420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:45.960862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:46.104304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:46.112980 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d7b0a93-df90-41bd-860a-f227182ad6b9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.165668 Jul 18 14:01:46.113581 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3506/6792] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:45 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:47.131112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:47.131739 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:47.139202 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:47.139679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:47.140510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:47.140938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:47.282946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:47.291421 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-41432421-026a-4974-9178-8eebac925673 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.164750 Jul 18 14:01:47.291943 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3287/6793] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:47 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:48.308700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:48.309321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:48.317573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:48.318034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:48.318886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:48.319336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:48.453154 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:48.460741 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9eac9d0a-89b0-402f-9471-03c087c96751 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.156096 Jul 18 14:01:48.461316 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3507/6794] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:48 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:49.477992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:49.478638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:49.485776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:49.486264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:49.487536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:49.487981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:49.619761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:49.627933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cad5161-61d7-4d44-b479-9d08d4fdad51 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1684 microversion: 2.1 time: 0.153204 Jul 18 14:01:49.628511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3288/6795] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:49 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:50.646024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:50.646980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:50.653986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:50.654494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:50.655291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:50.655740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:50.800681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:50.808646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-02b11768-b61f-47f3-8baf-e3c8548fbcba tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1683 microversion: 2.1 time: 0.167556 Jul 18 14:01:50.809248 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3508/6796] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:50 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:51.316843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "name": "network-vif-unplugged", "status": "completed", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:51.325503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:51.326109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:51.339527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] Creating event network-vif-unplugged:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h2-850003-3 Jul 18 14:01:51.345419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:01:51.360363 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7d630e88-2a2e-41fe-accb-8bb57b95a255 req-5d6552dd-8b9b-4412-af13-6bcf44bdd909 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108519 Jul 18 14:01:51.361605 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3289/6797] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:51.827106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:51.827769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:51.835652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:51.836115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:51.836880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:51.837317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:51.983081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:51.991906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4696bebc-aec6-43a3-9cb4-201586de75b1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1683 microversion: 2.1 time: 0.168621 Jul 18 14:01:51.992418 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3509/6798] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:51 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:53.009740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:53.010542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:53.018371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:53.018848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:53.019659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:53.020117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:53.177654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:53.185482 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9898756-6a1f-467b-a2ee-51e246d0c853 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1681 microversion: 2.1 time: 0.180030 Jul 18 14:01:53.186063 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3290/6799] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:53 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:53.385728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:53.394910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:53.395359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:53.407263 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] Creating event network-changed:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h2-850003-3 Jul 18 14:01:53.412859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:01:53.431733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f09416e9-677f-4de2-b92b-0fe709182f26 req-ff4f995b-c6d6-4280-826e-27c2113c8ceb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049293 Jul 18 14:01:53.432722 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3510/6800] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:54.204349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:54.204981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:54.212605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.213073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.213869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.214447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.432029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:54.441136 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-730f93be-e43c-4fd6-a682-89e63f27a3ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1678 microversion: 2.1 time: 0.240791 Jul 18 14:01:54.441736 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3291/6801] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:54 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:54.459225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:54.460086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:54.466611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.467166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.468011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.468520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.530461 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a692d548-9489-49a4-b248-bf0a3b335afc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/action" status: 204 len: 0 microversion: 2.1 time: 0.076272 Jul 18 14:01:54.531129 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3511/6802] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:01:54 2022] POST /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:01:54.539847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:54.540473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:54.546960 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.547426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.548208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:54.548661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:54.770517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:54.778982 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc062474-f040-4af4-b860-e5df449c1758 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1678 microversion: 2.1 time: 0.242842 Jul 18 14:01:54.779508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3292/6803] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:54 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:55.798549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:55.799868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:55.807123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:55.807584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:55.808380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:55.808820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:55.948446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:55.956949 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ac148ec-3f17-4095-93fa-e26ad9aef537 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.163780 Jul 18 14:01:55.957648 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3512/6804] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:55 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:55.975122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:55.975847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:55.983197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:55.983743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:55.984631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:55.985095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.123497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:56.131430 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e06fecb-21f5-498d-aee1-c759d4308620 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.160619 Jul 18 14:01:56.132056 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3293/6805] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:55 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:56.147968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:56.148886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:56.155204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.155664 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.156473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.156919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.296751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:56.304403 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17ca4e44-1162-46e8-a45a-af06d6eb0a4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1670 microversion: 2.1 time: 0.160482 Jul 18 14:01:56.304972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3513/6806] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:56 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:56.320371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:56.320802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:56.327182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.327643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.328429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.328871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.356276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:01:56.411290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:56.444040 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9706d2a3-af99-409a-8827-aeaccfdf5394 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 204 len: 0 microversion: 2.1 time: 0.127089 Jul 18 14:01:56.445093 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3294/6807] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:01:56 2022] DELETE /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:01:56.454610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:56.455685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:56.463273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.463770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.464574 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:56.465052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:56.615579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:56.623646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9277bc51-5d30-4bc4-a4b6-d53b2931658e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1676 microversion: 2.1 time: 0.173549 Jul 18 14:01:56.624132 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3514/6808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:56 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:57.644504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:57.645243 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:57.652787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:57.653246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:57.654029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:57.654525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:57.803102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:57.810761 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e0ab004c-8d38-45ae-b696-2c81426106d3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1676 microversion: 2.1 time: 0.170649 Jul 18 14:01:57.811331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3295/6809] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:57 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:58.828464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:58.829107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:58.836805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:58.837258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:58.838083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:58.838553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:58.909810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:01:58.912564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:58.919830 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4b11919b-f48c-48d9-8bfc-2e92f653ebcc tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 200 len: 1608 microversion: 2.1 time: 0.095350 Jul 18 14:01:58.920432 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3515/6810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:58 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:59.186936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b4c3c87b-3571-42de-8656-1464bb705bea req-0c296d91-869d-4a4f-afa3-d9804eac83b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c1274f-359a-44b6-b5a1-50a1734b6d45", "name": "network-vif-deleted", "tag": "09b99487-dec9-4dd9-9b30-36cd2419b64d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:59.196850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b4c3c87b-3571-42de-8656-1464bb705bea req-0c296d91-869d-4a4f-afa3-d9804eac83b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:59.197228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b4c3c87b-3571-42de-8656-1464bb705bea req-0c296d91-869d-4a4f-afa3-d9804eac83b3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:59.213060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b4c3c87b-3571-42de-8656-1464bb705bea req-0c296d91-869d-4a4f-afa3-d9804eac83b3 service nova] Creating event network-vif-deleted:09b99487-dec9-4dd9-9b30-36cd2419b64d for instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 on n-h2-850003-3 Jul 18 14:01:59.218595 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b4c3c87b-3571-42de-8656-1464bb705bea req-0c296d91-869d-4a4f-afa3-d9804eac83b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035193 Jul 18 14:01:59.224212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3296/6811] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:59.937717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:59.938433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:59.947892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:59.948481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:59.949322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:59.949845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:59.965725 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 HTTP/1.1 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '01c1274f-359a-44b6-b5a1-50a1734b6d45'} Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:59.967496 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:01:59.971891 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:01:59.972347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:01:59.973270 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3ebde72d-a184-42b4-bf3c-9e6350ab6c50 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 404 len: 111 microversion: 2.1 time: 0.039820 Jul 18 14:01:59.973859 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3516/6812] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:59 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:01:59.987078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:59.987793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:01:59.994377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:59.994839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:01:59.995645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:01:59.996160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:00.014069 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 HTTP/1.1 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '01c1274f-359a-44b6-b5a1-50a1734b6d45'} Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.015823 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd72555d-7bf0-4901-b35a-b8f7c23e7dfa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 404 len: 111 microversion: 2.1 time: 0.034868 Jul 18 14:02:00.020150 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3297/6813] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:01:59 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:02:00.066925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-851225451", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "c4ace286-a2be-4bd4-8bb4-72bd2d82cf14"}], "security_groups": [{"name": "tempest-securitygroup--1686720155"}], "key_name": "tempest-keypair-968017985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:00.180604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] validate_networks() for [('c4ace286-a2be-4bd4-8bb4-72bd2d82cf14', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:02:00.571996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:02:00.572454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:02:00.572998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:02:00.573352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:02:00.573769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:02:00.584005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:00.584460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:00.585268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:00.585729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:00.602877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:02:00.608199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:02:00.620769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:02:00.623042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:02:00.670359 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70f5cf23-60b2-40e0-9c5f-3f031851d2b0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.607200 Jul 18 14:02:00.671220 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3517/6814] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:02:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:02:00.681285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10d16bd4-4c9b-4c94-b258-af2146ba2b9a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:00.681910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10d16bd4-4c9b-4c94-b258-af2146ba2b9a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:00.741355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10d16bd4-4c9b-4c94-b258-af2146ba2b9a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:00.749114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10d16bd4-4c9b-4c94-b258-af2146ba2b9a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1237 microversion: 2.1 time: 0.071608 Jul 18 14:02:00.749680 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3298/6815] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:00 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:01.769078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.769697 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:01.777920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:01.778419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:01.779209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:01.780185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:01.849221 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:01.857018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b90f2eb-88ea-4877-b950-8070092bed25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1307 microversion: 2.1 time: 0.093734 Jul 18 14:02:01.857601 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3518/6816] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:02.874442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:02.875688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:02.882990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:02.883468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:02.884273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:02.884728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:03.124905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:03.133751 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8ba8d1f7-466f-4519-ac23-c81daf431e77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.263223 Jul 18 14:02:03.144423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3299/6817] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:02 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:03.272191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2b8572cd-d47b-455a-a183-8dfc0cee0eaa req-8f8be4cf-97c4-4fec-903e-76f34f331e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:03.284500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b8572cd-d47b-455a-a183-8dfc0cee0eaa req-8f8be4cf-97c4-4fec-903e-76f34f331e2f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:03.285225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2b8572cd-d47b-455a-a183-8dfc0cee0eaa req-8f8be4cf-97c4-4fec-903e-76f34f331e2f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:03.297353 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2b8572cd-d47b-455a-a183-8dfc0cee0eaa req-8f8be4cf-97c4-4fec-903e-76f34f331e2f service nova] Creating event network-changed:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h1-850003-3 Jul 18 14:02:03.303638 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2b8572cd-d47b-455a-a183-8dfc0cee0eaa req-8f8be4cf-97c4-4fec-903e-76f34f331e2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035243 Jul 18 14:02:03.304488 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3519/6818] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:04.152341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:04.152872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:04.160764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:04.161261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:04.162069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:04.162591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:04.293068 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:04.302373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ff189c98-9ee8-449d-97e2-9cd57b1fe276 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.154201 Jul 18 14:02:04.302960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3300/6819] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:04 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:05.321823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:05.322663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:05.329326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:05.329772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:05.330562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:05.330999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:05.464828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:05.472604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a3d1cba-867a-44bd-9d6e-1f0f571aeef7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.155960 Jul 18 14:02:05.473188 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3520/6820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:05 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:06.490429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:06.490978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:06.493832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:06.499492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:06.499953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:06.500757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:06.501190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:06.641925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:06.650450 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59e95e11-12b7-44df-9cc8-7a376434dbdb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.164159 Jul 18 14:02:06.651038 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3301/6821] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:06 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:07.668387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:07.668797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:07.671812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:07.677871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:07.678378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:07.679224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:07.679663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:07.821304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:07.828925 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-963a4693-45fe-4ed7-be75-5a8131f30440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.164977 Jul 18 14:02:07.829514 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3521/6822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:07 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:08.848074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:08.848698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:08.855784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:08.856284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:08.857058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:08.857506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:08.992841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:09.000398 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47823d7f-63e4-4435-819b-8659a005f4e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.156432 Jul 18 14:02:09.000989 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3302/6823] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:08 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:09.433437 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-02faf3e8-db76-43b5-8f98-594c4a927a81 req-4a2172ff-e8f9-43ef-a981-9cb1613b7a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "name": "network-vif-plugged", "status": "completed", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:09.442729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-02faf3e8-db76-43b5-8f98-594c4a927a81 req-4a2172ff-e8f9-43ef-a981-9cb1613b7a12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:09.443127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-02faf3e8-db76-43b5-8f98-594c4a927a81 req-4a2172ff-e8f9-43ef-a981-9cb1613b7a12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:09.455845 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-02faf3e8-db76-43b5-8f98-594c4a927a81 req-4a2172ff-e8f9-43ef-a981-9cb1613b7a12 service nova] Creating event network-vif-plugged:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h1-850003-3 Jul 18 14:02:09.460719 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-02faf3e8-db76-43b5-8f98-594c4a927a81 req-4a2172ff-e8f9-43ef-a981-9cb1613b7a12 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Jul 18 14:02:09.461599 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3522/6824] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:10.018864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:10.019496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:10.026889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:10.027357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:10.028188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:10.028645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:10.166592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:10.174121 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a282cda0-918b-4803-b255-23170eb7fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1363 microversion: 2.1 time: 0.159773 Jul 18 14:02:10.174716 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3303/6825] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:10 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:11.189215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:11.190028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:11.194114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:11.194844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:11.202186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:11.202642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:11.203422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:11.203868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:11.337215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:02:11.345150 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d73da671-a633-4a44-a7b2-cca64fe7a328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1549 microversion: 2.1 time: 0.157735 Jul 18 14:02:11.346340 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3523/6826] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:02:11 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:02:11.362857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:11.363423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:02:11.365265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:11.373099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:11.373570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:11.375209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:11.375209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:11.452353 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c0277fd-4811-4343-a718-9f7e13585a89 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093336 Jul 18 14:02:11.452949 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3304/6827] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 14:02:11 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:12.434694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e16c7438-53f9-48d3-9b4c-52fb390862ca req-15645289-cba0-4f33-b213-93cfaa1af1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:12.444510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e16c7438-53f9-48d3-9b4c-52fb390862ca req-15645289-cba0-4f33-b213-93cfaa1af1cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:02:12.445322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e16c7438-53f9-48d3-9b4c-52fb390862ca req-15645289-cba0-4f33-b213-93cfaa1af1cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:02:12.458253 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e16c7438-53f9-48d3-9b4c-52fb390862ca req-15645289-cba0-4f33-b213-93cfaa1af1cc service nova] Creating event network-changed:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h1-850003-3 Jul 18 14:02:12.464902 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e16c7438-53f9-48d3-9b4c-52fb390862ca req-15645289-cba0-4f33-b213-93cfaa1af1cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 Jul 18 14:02:12.465989 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3524/6828] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:38.996014 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:02:38.996632 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:02:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:03:24.420673 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=7 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.421512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=44 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.426238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5382e97b-ce02-444f-b873-19846a6b25b2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:24.433994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5382e97b-ce02-444f-b873-19846a6b25b2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:24.434504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5382e97b-ce02-444f-b873-19846a6b25b2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:24.467258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5382e97b-ce02-444f-b873-19846a6b25b2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Going to try to stop instance {{(pid=131367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:03:24.514807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5382e97b-ce02-444f-b873-19846a6b25b2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action" status: 202 len: 0 microversion: 2.1 time: 0.096778 Jul 18 14:03:24.515431 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3305/6829] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:03:24 2022] POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:03:24.523090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.524274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=35 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.529642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:24.530429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:24.538296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:24.538751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:24.539543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:24.539990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:24.732529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:24.740113 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c422ff97-7b83-4135-bd34-3a77768f8961 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.220111 Jul 18 14:03:24.740693 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3525/6830] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:24 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:25.758887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:25.759546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:25.766788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:25.767253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:25.768036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:25.768485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:25.956196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:25.963979 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-867c7a9d-c27e-44ee-9e4f-2a2c30fb0e53 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.209589 Jul 18 14:03:25.965054 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3306/6831] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:25 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:26.981791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:26.982440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:26.989495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:26.989950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:26.990750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:26.991200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:27.123037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:27.130951 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-057a416a-9bf9-44ec-a305-162ec693361c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.153846 Jul 18 14:03:27.131555 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3526/6832] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:26 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:28.149084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:28.149714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:28.157005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:28.157473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:28.158302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:28.158759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:28.294182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:28.301889 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-475d2e56-5a39-4431-9a3e-b40162461874 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.156960 Jul 18 14:03:28.302506 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3307/6833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:28 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:29.319213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:29.319835 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:29.327679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:29.328138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:29.328914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:29.329361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:29.463127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:29.471071 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9129703a-bd99-4639-93fd-c3239a66d40e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.155846 Jul 18 14:03:29.471652 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3527/6834] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:29 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:30.488954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:30.489608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:30.497222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:30.497687 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:30.498761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:30.499223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:30.646917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:30.655453 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-516c20cb-e121-4ba8-a741-e1c19428d108 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.170707 Jul 18 14:03:30.656053 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3308/6835] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:30 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:31.673267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:31.673886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:31.681055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:31.681507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:31.682301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:31.682769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:31.818393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:31.826322 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2ef12eab-5aba-42a3-bc9f-a5acab6174c3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.156841 Jul 18 14:03:31.826767 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3528/6836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:31 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:32.843333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:32.843941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:32.851109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:32.851572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:32.852348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:32.852801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:32.997656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:33.006387 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-850b118d-4d56-44e5-b220-48c69c2a20a4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.167380 Jul 18 14:03:33.006985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3309/6837] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:32 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:34.033627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:34.034271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:34.041296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:34.041747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:34.042557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:34.043053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:34.177150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:34.185721 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9fafa6fb-ace0-4986-918f-1276b7d7bc09 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.156797 Jul 18 14:03:34.186353 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3529/6838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:34 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:35.203432 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:35.204083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:35.211617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.212081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.212873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.213319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.356808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:35.366324 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7a8623ab-f2ab-414d-abf5-4f11852c999a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1655 microversion: 2.1 time: 0.166868 Jul 18 14:03:35.366926 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3310/6839] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:35 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:35.383222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:35.384204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:35.392339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.392805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.393593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.394038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.425445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:35.432037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 14:03:35.438909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:03:35.439336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:03:35.439816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:03:35.440416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:03:35.440839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:03:35.513806 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6e27cbb9-48e0-4709-9a26-5c5955d7f230 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action" status: 202 len: 0 microversion: 2.1 time: 0.134410 Jul 18 14:03:35.515020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3530/6840] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:03:35 2022] POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:03:35.524626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:35.525324 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:35.532624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.533103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.533938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:35.534436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:35.719103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:35.727879 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3054456e-57de-416c-b7fd-1c1b13184292 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.207645 Jul 18 14:03:35.728921 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3311/6841] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:35 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:36.747404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:36.748030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:36.754419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:36.754879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:36.755669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:36.756121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:36.925966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:36.935501 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-84fc5c0c-81fb-45a5-99c9-b5b2031e75f9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.192821 Jul 18 14:03:36.936431 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3531/6842] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:36 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:37.955857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:37.956808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:37.965352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:37.965822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:37.966659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:37.967121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:38.111591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:38.119774 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-053848ca-6bd8-4a4f-a9e8-ba92c4a3bc1a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1678 microversion: 2.1 time: 0.168754 Jul 18 14:03:38.120364 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3312/6843] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:37 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:39.137958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:39.138816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:39.146564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:39.147059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:39.148102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:39.148556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:39.305728 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:39.314333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c28fd61f-1bff-4c11-bc92-5baa77a2f131 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1683 microversion: 2.1 time: 0.180983 Jul 18 14:03:39.314952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3532/6844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:39 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:40.338446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:40.340141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:40.349266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:40.349741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:40.350599 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:40.351057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:40.589385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:40.598054 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e5dca851-96d2-48bb-b668-ae3c936a4ea2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1682 microversion: 2.1 time: 0.267090 Jul 18 14:03:40.598715 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3313/6845] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:40 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:40.704825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "name": "network-vif-unplugged", "status": "completed", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:40.718998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:40.719606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:40.733206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] Creating event network-vif-unplugged:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h2-850003-3 Jul 18 14:03:40.739218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:03:40.753950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-826a40da-6f01-4bb3-904b-f368cbfb6a49 req-3eaaf83d-608a-4bf9-af1f-2d0c31639931 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053397 Jul 18 14:03:40.755071 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3533/6846] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:41.617647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:41.618315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:41.626301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:41.626869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:41.627688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:41.628144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:41.861252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:41.869322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f7220bd1-5374-44e5-bf6c-979087362d0f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1682 microversion: 2.1 time: 0.255592 Jul 18 14:03:41.869910 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3314/6847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:41 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:42.771659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:42.781454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:42.781902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:42.798475 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] Creating event network-changed:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h2-850003-3 Jul 18 14:03:42.805030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:03:42.819225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5e01e698-93ab-4b9e-a367-e22dc7f19c23 req-79f7cb1c-002d-4767-acf4-5856b290708f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052747 Jul 18 14:03:42.819849 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3534/6848] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:42.888890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:42.889956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:42.901468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:42.902208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:42.903392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:42.903857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:43.193169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:43.205223 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d7f52aa7-afea-43f3-b421-e9d9314a5cc2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1680 microversion: 2.1 time: 0.321387 Jul 18 14:03:43.206533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3315/6849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:42 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:44.236191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:44.236907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:44.243918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.244379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.245171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.245620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.426769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:44.440788 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-035ea88d-c0e7-40c2-a649-53f461c69b94 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1676 microversion: 2.1 time: 0.209344 Jul 18 14:03:44.441792 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3535/6850] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:44 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:44.458496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:44.459328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:44.466501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.466974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.467792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.468265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.541550 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-681b508e-b336-4b04-8eae-6c28d9ba2d31 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action" status: 204 len: 0 microversion: 2.1 time: 0.086950 Jul 18 14:03:44.542375 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3316/6851] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:03:44 2022] POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:44.551322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:44.551953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:44.559432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.559892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.560529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:44.560975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:44.717600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:44.732072 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-57464583-801b-4702-a52a-9ba3a235e563 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1676 microversion: 2.1 time: 0.184295 Jul 18 14:03:44.733757 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3536/6852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:44 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:45.760005 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:45.760935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:45.770636 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:45.771193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:45.772646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:45.774003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:45.982109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:45.993608 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58d8c9dd-6c27-40cb-bcd2-1dba6a2d30e3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1676 microversion: 2.1 time: 0.239086 Jul 18 14:03:45.994398 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3317/6853] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:45 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:47.016592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:47.017294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:47.025493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.025957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.026792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.027730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.181461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:47.190107 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a8abf74-fc6f-4380-afd8-0011966d3465 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1655 microversion: 2.1 time: 0.177994 Jul 18 14:03:47.191074 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3537/6854] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:47 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:47.211598 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:47.212238 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:47.221719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.222370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.223531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.224058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.333646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-20c01bac-c3c6-45f9-bff2-2df1fd088192 req-3f2ad7bc-0cc0-4ae3-af07-5f17b25dfa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "name": "network-vif-plugged", "status": "completed", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:47.349893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-20c01bac-c3c6-45f9-bff2-2df1fd088192 req-3f2ad7bc-0cc0-4ae3-af07-5f17b25dfa86 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.351041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-20c01bac-c3c6-45f9-bff2-2df1fd088192 req-3f2ad7bc-0cc0-4ae3-af07-5f17b25dfa86 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.374468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-20c01bac-c3c6-45f9-bff2-2df1fd088192 req-3f2ad7bc-0cc0-4ae3-af07-5f17b25dfa86 service nova] Creating event network-vif-plugged:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h2-850003-3 Jul 18 14:03:47.383765 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-20c01bac-c3c6-45f9-bff2-2df1fd088192 req-3f2ad7bc-0cc0-4ae3-af07-5f17b25dfa86 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137997 Jul 18 14:03:47.384911 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3538/6855] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:47.423370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:47.431075 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbf835d7-484e-4b68-924e-b37dcb84d238 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1655 microversion: 2.1 time: 0.224536 Jul 18 14:03:47.431669 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3318/6856] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:47 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:47.448411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0609c91a-81c9-495c-beee-85edecbdbb3c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:47.456966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0609c91a-81c9-495c-beee-85edecbdbb3c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.457429 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0609c91a-81c9-495c-beee-85edecbdbb3c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.482332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0609c91a-81c9-495c-beee-85edecbdbb3c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Going to try to start instance {{(pid=131366) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:03:47.531764 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0609c91a-81c9-495c-beee-85edecbdbb3c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action" status: 202 len: 0 microversion: 2.1 time: 0.087274 Jul 18 14:03:47.532241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3539/6857] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:03:47 2022] POST /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:03:47.541383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:47.542030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:47.550597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.551118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.552099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:47.552757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:47.576161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.795650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:47.803866 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8c001f3-3efd-4ea3-8ceb-412e80623c7c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1664 microversion: 2.1 time: 0.266495 Jul 18 14:03:47.804443 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3319/6858] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:47 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1664 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:48.825473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:48.826302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:48.833989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:48.834494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:48.835297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:48.835732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:48.866007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.018382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:49.031107 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afe227c6-f4c8-47d1-983c-21c1d20c5e3a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1668 microversion: 2.1 time: 0.210989 Jul 18 14:03:49.032128 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3540/6859] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:48 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:49.054398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:49.055263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:49.062336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:49.062808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:49.063614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:49.064067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:49.092735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:03:49.206720 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-53fea800-28b0-445a-8a81-7a1fa0856e08 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 204 len: 0 microversion: 2.1 time: 0.155882 Jul 18 14:03:49.210761 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3320/6860] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:03:49 2022] DELETE /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:49.217619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:49.218779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:49.228197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:49.228473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:49.229458 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:49.230023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:49.402832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:49.412499 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-10ad4eef-08de-43df-800b-e3b5d94f9300 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1674 microversion: 2.1 time: 0.200311 Jul 18 14:03:49.413073 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3541/6861] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:49 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:50.434416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:50.435062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:50.445407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:50.445873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:50.446867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:50.447316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:50.622686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:50.637358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6c175037-8d66-4989-96e5-0763eed77664 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1674 microversion: 2.1 time: 0.208950 Jul 18 14:03:50.637881 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3321/6862] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:50 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:51.665913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:51.666563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:51.676259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:51.676720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:51.677501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:51.678113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:51.732235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d55af4ec-86d3-4d50-ae47-277f42629102 req-a81871b7-ddce-444e-969d-fef409e1a182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aabe64-f333-4832-99b3-64ecdd02bc1d", "name": "network-vif-deleted", "tag": "20ed5cea-c659-4f55-8660-ffcfc0e3a1c9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:51.745491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d55af4ec-86d3-4d50-ae47-277f42629102 req-a81871b7-ddce-444e-969d-fef409e1a182 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:51.746491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d55af4ec-86d3-4d50-ae47-277f42629102 req-a81871b7-ddce-444e-969d-fef409e1a182 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:51.759197 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d55af4ec-86d3-4d50-ae47-277f42629102 req-a81871b7-ddce-444e-969d-fef409e1a182 service nova] Creating event network-vif-deleted:20ed5cea-c659-4f55-8660-ffcfc0e3a1c9 for instance d8aabe64-f333-4832-99b3-64ecdd02bc1d on n-h2-850003-3 Jul 18 14:03:51.765670 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d55af4ec-86d3-4d50-ae47-277f42629102 req-a81871b7-ddce-444e-969d-fef409e1a182 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036913 Jul 18 14:03:51.766614 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3322/6863] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:51.788783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:51.797961 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-304f9245-b396-41f4-b88a-8ed21836e04b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 200 len: 1606 microversion: 2.1 time: 0.137785 Jul 18 14:03:51.799257 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3542/6864] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:51 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 1606 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:52.818029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:52.818874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:52.826419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:52.826806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:52.827715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:52.828220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:52.842493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d HTTP/1.1 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'd8aabe64-f333-4832-99b3-64ecdd02bc1d'} Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:03:52.844187 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0b0762ee-2249-481e-9daa-46deab9dc45e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 404 len: 111 microversion: 2.1 time: 0.033411 Jul 18 14:03:52.848397 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3323/6865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:52 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:03:52.864504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:52.865109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:52.872035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:52.872487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:52.873280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:52.873718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:52.887605 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d HTTP/1.1 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd8aabe64-f333-4832-99b3-64ecdd02bc1d'} Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:03:52.889239 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c1eac955-3076-43cb-94a4-5021133111ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 404 len: 111 microversion: 2.1 time: 0.030751 Jul 18 14:03:52.893699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3543/6866] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:52 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:03:52.938757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477298974", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "c4ace286-a2be-4bd4-8bb4-72bd2d82cf14"}], "security_groups": [{"name": "tempest-securitygroup--1686720155"}], "key_name": "tempest-keypair-968017985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:53.043738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] validate_networks() for [('c4ace286-a2be-4bd4-8bb4-72bd2d82cf14', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:03:53.494731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:03:53.495172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:03:53.495654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:03:53.496876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:03:53.497300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:03:53.506471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:53.506938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:53.507737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:53.508183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:53.526084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:03:53.531649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:03:53.545158 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:03:53.547502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:03:53.595358 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6149bb9-8dc0-49a9-b55a-b8e7bad1b034 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.660624 Jul 18 14:03:53.596021 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3324/6867] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:03:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:03:53.606944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b071e737-1b30-471f-94cd-6428e08378f8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:53.607567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b071e737-1b30-471f-94cd-6428e08378f8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:53.664496 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b071e737-1b30-471f-94cd-6428e08378f8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:53.676970 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b071e737-1b30-471f-94cd-6428e08378f8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1238 microversion: 2.1 time: 0.074080 Jul 18 14:03:53.678022 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3544/6868] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:53 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:54.696227 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:54.696886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:54.700919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.707268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:54.707728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:54.708583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:54.709312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:54.784525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:54.792057 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74915d88-bde9-466b-8e97-9300b2aba1fe tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1296 microversion: 2.1 time: 0.100839 Jul 18 14:03:54.792820 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3325/6869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:54 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:55.810021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:55.810759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:55.813934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=47 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.827676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:55.828145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:55.829177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:55.829624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:55.990759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:56.001172 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6cc90397-b7d9-42be-bfe7-9893b1c7c553 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.195753 Jul 18 14:03:56.001902 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3545/6870] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:55 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:56.388247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-276f0726-1b0b-48c5-ba75-2cda28d825c9 req-27c10be6-0b76-401b-9ae6-e9ceebd3f9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:03:56.406214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-276f0726-1b0b-48c5-ba75-2cda28d825c9 req-27c10be6-0b76-401b-9ae6-e9ceebd3f9d8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:56.406752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-276f0726-1b0b-48c5-ba75-2cda28d825c9 req-27c10be6-0b76-401b-9ae6-e9ceebd3f9d8 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:56.419218 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-276f0726-1b0b-48c5-ba75-2cda28d825c9 req-27c10be6-0b76-401b-9ae6-e9ceebd3f9d8 service nova] Creating event network-changed:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:03:56.428798 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-276f0726-1b0b-48c5-ba75-2cda28d825c9 req-27c10be6-0b76-401b-9ae6-e9ceebd3f9d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045324 Jul 18 14:03:56.429287 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3326/6871] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:57.019074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:57.019685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:57.029394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:57.029841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:57.030640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:57.031079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:57.170702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:57.178432 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a02575e4-383d-4df0-a642-3bf485f1e316 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.163210 Jul 18 14:03:57.179010 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3546/6872] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:57 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:58.198352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:58.199106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:58.206433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:58.206901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:58.207705 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:58.208168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:58.345921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:58.353533 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c0382c22-f82e-4872-88d3-753712c932ae tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.160480 Jul 18 14:03:58.354106 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3327/6873] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:58 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:59.371048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:59.371666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:03:59.378735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:59.379191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:59.379974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:03:59.380415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:03:59.513050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:03:59.520633 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd224708-2d6b-436d-bad2-f2992def4da0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.153522 Jul 18 14:03:59.521211 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3547/6874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:03:59 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:00.539046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:00.539571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:00.547504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:00.548316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:00.549134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:00.549593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:00.694198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:00.702095 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d4ab858-1bda-459a-b467-64956d4a2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.167073 Jul 18 14:04:00.702742 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3328/6875] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:00 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:01.721450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:01.722103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:01.729361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:01.729827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:01.731144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:01.731584 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:01.874124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:01.882104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb9b9acc-c20f-4ba2-bfb5-52def69f279b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.164980 Jul 18 14:04:01.882729 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3548/6876] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:01 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:02.903100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:02.903920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:02.911428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:02.911902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:02.912717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:02.913180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:03.073465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:03.081592 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c806dffc-f995-47ad-998d-4f1b7ff22595 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.184405 Jul 18 14:04:03.082476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3329/6877] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:02 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:04.028688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-51be3ea5-1272-4faf-9864-f8c4acbf1fcd req-c91426d5-70a1-4db5-9daa-b1aec05f3bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "name": "network-vif-plugged", "status": "completed", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:04:04.033503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:04.040211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-51be3ea5-1272-4faf-9864-f8c4acbf1fcd req-c91426d5-70a1-4db5-9daa-b1aec05f3bbd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:04.040717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-51be3ea5-1272-4faf-9864-f8c4acbf1fcd req-c91426d5-70a1-4db5-9daa-b1aec05f3bbd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:04.053515 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-51be3ea5-1272-4faf-9864-f8c4acbf1fcd req-c91426d5-70a1-4db5-9daa-b1aec05f3bbd service nova] Creating event network-vif-plugged:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:04:04.058523 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-51be3ea5-1272-4faf-9864-f8c4acbf1fcd req-c91426d5-70a1-4db5-9daa-b1aec05f3bbd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Jul 18 14:04:04.059821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3549/6878] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:04:04.099950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:04.101164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:04.103622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:04.105011 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:04.113421 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:04.114010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:04.115131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:04.115660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:04.308286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:04.315992 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ed378a8-2234-48d5-9586-8aba407c5958 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.220498 Jul 18 14:04:04.316664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3330/6879] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:04 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:05.334705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:05.335417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:05.341944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:05.342435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:05.343220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:05.343668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:05.485811 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:05.493496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80300642-9ae4-4638-9fdd-31249bbbffe7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1364 microversion: 2.1 time: 0.163983 Jul 18 14:04:05.494087 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3550/6880] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:05 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:06.511054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:06.511690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:06.519392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:06.519865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:06.520667 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:06.521117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:06.651427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:04:06.659152 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0777c1b1-3baa-4fec-b929-d697f0092cd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1550 microversion: 2.1 time: 0.152148 Jul 18 14:04:06.659742 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3331/6881] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:04:06 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:06.675888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:04:06.676452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:04:06.683416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:06.684364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:06.685136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:06.685578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:06.763906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0bf26108-05bc-44b4-9852-4443b56b30f4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091909 Jul 18 14:04:06.764504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3551/6882] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 14:04:06 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:04:07.717755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6e5a1992-a120-47e9-884d-02e334d2f753 req-32f0727e-f62e-4a44-a1a1-7c76937c55fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:04:07.727157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e5a1992-a120-47e9-884d-02e334d2f753 req-32f0727e-f62e-4a44-a1a1-7c76937c55fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:04:07.727728 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6e5a1992-a120-47e9-884d-02e334d2f753 req-32f0727e-f62e-4a44-a1a1-7c76937c55fb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:04:07.739748 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6e5a1992-a120-47e9-884d-02e334d2f753 req-32f0727e-f62e-4a44-a1a1-7c76937c55fb service nova] Creating event network-changed:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:04:07.744859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6e5a1992-a120-47e9-884d-02e334d2f753 req-32f0727e-f62e-4a44-a1a1-7c76937c55fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 Jul 18 14:04:07.745566 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3332/6883] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:05:19.722285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=13 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:19.723048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=52 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:19.806829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:19.807805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:19.814428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:19.814888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:19.815698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:19.816145 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:19.847655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:19.854430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 14:05:19.861457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:05:19.861881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:05:19.862506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:05:19.862831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:05:19.863246 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:05:19.936146 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd5f673c-b7b1-4f02-b8e6-50f4a69f06b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.216444 Jul 18 14:05:19.936751 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3552/6884] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:05:19 2022] POST /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:05:19.945417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=15 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:19.946362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:19.952010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:19.952862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:19.961767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:19.962280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:19.963076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:19.963538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:20.124143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:20.132987 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c898b37c-78bc-4557-859e-fbba3c15792f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1678 microversion: 2.1 time: 0.191786 Jul 18 14:05:20.133831 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3333/6885] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:19 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:21.153095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:21.154312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:21.161905 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:21.162974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:21.164627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:21.165347 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:21.312396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:21.320498 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e791b33-4150-4801-b255-7cc978e4a233 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1678 microversion: 2.1 time: 0.173136 Jul 18 14:05:21.321091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3553/6886] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:21 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:22.338571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:22.339235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:22.346363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:22.346829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:22.347615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:22.348066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:22.485650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:22.493435 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf76c27c-31ca-4a52-9039-ea91fde5b9ca tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.159195 Jul 18 14:05:22.494028 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3334/6887] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:22 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:23.511083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:23.511614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:23.518886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:23.519340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:23.520126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:23.520570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:23.655539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:23.665523 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-542c9f72-2860-4915-8ee9-ef1583842e60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.158471 Jul 18 14:05:23.666350 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3554/6888] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:23 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:24.683311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:24.683930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:24.690661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:24.691123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:24.691900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:24.692346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:24.830207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:24.839012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-285584b1-c999-460d-8ddd-39eabb15346e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.160356 Jul 18 14:05:24.839630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3335/6889] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:24 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:25.857171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:25.857790 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:25.865038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:25.865527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:25.866342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:25.866788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:25.999556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:26.008704 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13d7bf85-85f9-4d09-b0dd-8713e7598f85 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.155108 Jul 18 14:05:26.009063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3555/6890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:25 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:27.027095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:27.027731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:27.034080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:27.034588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:27.035383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:27.035835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:27.167753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:27.176692 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1050bb4d-7c56-4444-ac8e-0f5d1d3b3c40 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.154636 Jul 18 14:05:27.177286 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3336/6891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:27 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:28.195263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:28.195882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:28.202888 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:28.203343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:28.204137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:28.204572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:28.344280 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:28.352288 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5578da3b-28c2-4899-850e-828c8f6b0a60 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.161305 Jul 18 14:05:28.353204 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3556/6892] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:28 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:29.370297 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:29.370930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:29.378080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:29.378562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:29.379352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:29.379809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:29.514905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:29.523470 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50a3c981-c566-4031-88eb-b3fa99ba18a0 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.157197 Jul 18 14:05:29.525059 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3337/6893] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:29 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:30.540771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:30.541378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:30.548513 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:30.548962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:30.549779 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:30.550169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:30.683825 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:30.692347 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3e61492f-827c-44da-9582-60fc1a828479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.155449 Jul 18 14:05:30.692998 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3557/6894] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:30 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:31.710597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:31.711230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:31.718384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:31.718858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:31.719654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:31.720108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:31.853357 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:31.862213 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-83e3f70a-24aa-4f2b-8ebc-359882f00dc3 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.155493 Jul 18 14:05:31.862817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3338/6895] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:31 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:32.881780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:32.882449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:32.889365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:32.889907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:32.890754 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:32.891187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:33.027568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:33.035551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcea8f0c-4a6d-41d7-bb14-b903ad4494ce tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1683 microversion: 2.1 time: 0.158189 Jul 18 14:05:33.036144 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3558/6896] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:32 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:34.053190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:34.053926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:34.061930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:34.062445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:34.063344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:34.063856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:34.347318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:34.355830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a4354f1-6bca-47d3-ae30-f9eebffad63b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1682 microversion: 2.1 time: 0.306412 Jul 18 14:05:34.356538 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3339/6897] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:34 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1682 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:34.459143 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "name": "network-vif-unplugged", "status": "completed", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:34.468890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:34.469337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:34.483614 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] Creating event network-vif-unplugged:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h2-850003-3 Jul 18 14:05:34.489297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] Instance 22c661ce-588c-4d87-9794-751be6cd1f3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:05:34.500573 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-947e2012-e73c-496d-9308-eae0c1e5e223 req-65e3d1fc-ea71-495f-ac3d-c2b96f32ee6b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045202 Jul 18 14:05:34.501157 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3559/6898] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:05:35.373071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:35.373852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:35.382051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:35.382601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:35.383435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:35.383919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:35.613625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:35.622206 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76256835-8438-4516-9287-e6515469db33 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1682 microversion: 2.1 time: 0.253046 Jul 18 14:05:35.623367 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3340/6899] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:35 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:36.641940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:36.642713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:36.650233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:36.650796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:36.651695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:36.652396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:36.797465 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:36.806959 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4e87c5a-42b9-4a76-a3b4-e5d441d7375d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1680 microversion: 2.1 time: 0.170015 Jul 18 14:05:36.807708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3560/6900] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:36 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:36.852821 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:36.863376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:36.863940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:36.880140 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] Creating event network-changed:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h2-850003-3 Jul 18 14:05:36.886958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] Instance 22c661ce-588c-4d87-9794-751be6cd1f3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:05:36.903274 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-fef578d6-15eb-4243-9ff9-8fd8e445696a req-80a73173-bec5-4e15-a784-1660914e75bd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053416 Jul 18 14:05:36.904302 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3341/6901] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:05:37.825716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:37.826405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:37.834121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:37.834606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:37.835387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:37.836510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:37.980007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:37.989010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d70b9812-5bc9-4041-ad4f-abde374aa6da tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1677 microversion: 2.1 time: 0.167089 Jul 18 14:05:37.989280 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3561/6902] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:37 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:05:38.007944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:38.008688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:38.021150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.021150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.021150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.021150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.059198 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.059735 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.060826 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.061413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.087304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:05:38.093406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:05:38.217205 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58da5873-42e5-45fa-aac3-8db8ac166ebf tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.215116 Jul 18 14:05:38.217824 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3342/6903] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:05:38 2022] POST /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:05:38.227128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:38.228403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:38.236587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.237051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.237853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:38.238342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:38.389286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:38.397574 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81d79677-dff4-4a11-957b-56aa8de3209a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.174845 Jul 18 14:05:38.397733 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3562/6904] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:38 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:05:39.418133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:39.418939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:39.427472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:39.427938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:39.428751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:39.429226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:39.582299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:39.593919 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-99ec966b-f956-42fe-9bdc-c1e9e4842db1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.181535 Jul 18 14:05:39.594557 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3343/6905] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:39 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:05:40.612360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:40.612879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:40.621291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:40.621745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:40.622592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:40.623565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:40.769722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:40.777890 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-84e0cc84-8b4d-49ea-be0b-9399f3f8ba77 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.169580 Jul 18 14:05:40.778520 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3563/6906] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:40 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:41.755628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:41.768435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:41.769657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:41.786887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] Creating event network-changed:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:05:41.795922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:41.796714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:41.798930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] Instance 22c661ce-588c-4d87-9794-751be6cd1f3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:05:41.809192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:41.809698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:41.810659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:41.811120 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:41.813019 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-38c2a91f-03b8-45e7-b02e-74b71fe72062 req-9cd38b61-405c-4cdc-8e05-591a3ae9b3c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061655 Jul 18 14:05:41.817898 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3344/6907] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:05:41.992719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:42.002018 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-acb3f704-5b5e-46e2-a116-ac9d51b3f479 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.210039 Jul 18 14:05:42.002676 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3564/6908] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:41 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:05:43.020137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:43.020846 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:43.029083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:43.029540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:43.030368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:43.030815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:43.169884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:43.177734 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd07fdcb-11b3-4eeb-8cbf-fd320830961d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.161908 Jul 18 14:05:43.178355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3345/6909] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:43 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:44.194418 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:44.195033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:44.202084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:44.202633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:44.203394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:44.203841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:44.336422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:44.344539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d28ca14-0e38-4587-b76c-a110e59bb7ec tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.154087 Jul 18 14:05:44.345124 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3565/6910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:44 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:45.362686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:45.363516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:45.370388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:45.370852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:45.371638 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:45.372081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:45.521080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:45.530752 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-565825a9-1f5a-4d85-8d91-a830c0e34aea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1676 microversion: 2.1 time: 0.171931 Jul 18 14:05:45.531362 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3346/6911] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:45 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:46.547708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:46.548355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:46.556091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.556559 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.557339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.557777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.694052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:46.702414 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d23ddac4-ece0-4393-82d2-d8398e7f0d39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1669 microversion: 2.1 time: 0.158859 Jul 18 14:05:46.702987 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3566/6912] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:46 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:46.718645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:46.719278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:46.726348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.726819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.727622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.728073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.732354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:46.870550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:46.878314 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62563925-07d1-46c3-9900-29b625aef88c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1669 microversion: 2.1 time: 0.163512 Jul 18 14:05:46.878903 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3347/6913] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:46 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:46.894323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:46.894866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:46.901044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.901495 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.902538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:46.902972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:46.921472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:47.039142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:47.047340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98cd74c3-452c-4fcb-abc2-7df7167c7a2d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1669 microversion: 2.1 time: 0.156892 Jul 18 14:05:47.048063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3567/6914] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:46 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:47.064027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:47.064541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:47.070931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:47.071443 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:47.072235 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:47.072683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:47.097464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:05:47.172557 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd78bc60-77d2-41b8-b512-4d4edde620e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 204 len: 0 microversion: 2.1 time: 0.112274 Jul 18 14:05:47.173173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3348/6915] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:05:47 2022] DELETE /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:05:47.181734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:47.182561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:47.188729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:47.189177 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:47.189941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:47.190400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:47.319769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:47.327799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80206d31-8627-4167-8469-1080cd317b20 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1675 microversion: 2.1 time: 0.149754 Jul 18 14:05:47.328229 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3568/6916] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:47 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:48.345650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:48.346402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:48.349281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:48.355765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:48.356229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:48.357026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:48.357475 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:48.498582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:48.506961 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9727caa6-b6a4-4dc2-8817-48f5b08422c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1675 microversion: 2.1 time: 0.165575 Jul 18 14:05:48.507575 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3349/6917] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:48 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:05:48.548264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4057f26c-dbbf-4b4c-97fb-78e14598a55b req-bed01442-357b-46d7-9656-745f31d66913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "name": "network-vif-plugged", "status": "completed", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:48.560192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4057f26c-dbbf-4b4c-97fb-78e14598a55b req-bed01442-357b-46d7-9656-745f31d66913 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:48.560836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4057f26c-dbbf-4b4c-97fb-78e14598a55b req-bed01442-357b-46d7-9656-745f31d66913 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:48.575923 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4057f26c-dbbf-4b4c-97fb-78e14598a55b req-bed01442-357b-46d7-9656-745f31d66913 service nova] Creating event network-vif-plugged:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:05:48.581216 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4057f26c-dbbf-4b4c-97fb-78e14598a55b req-bed01442-357b-46d7-9656-745f31d66913 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037212 Jul 18 14:05:48.582020 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3569/6918] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:05:49.524942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:49.525575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:49.533142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:49.533616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:49.534450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:49.534909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:49.628065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:49.637484 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-29109cc7-f8f3-4b47-96ef-25911a7c0143 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 200 len: 1607 microversion: 2.1 time: 0.116436 Jul 18 14:05:49.647382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ce1dd348-e6be-4f51-969a-55a3bf4101b7 req-fd3d108c-43ec-41e2-8789-c2a22eb17579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c661ce-588c-4d87-9794-751be6cd1f3a", "name": "network-vif-deleted", "tag": "ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:49.648166 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3350/6919] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:49 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 1607 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:49.652585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ce1dd348-e6be-4f51-969a-55a3bf4101b7 req-fd3d108c-43ec-41e2-8789-c2a22eb17579 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:49.653042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ce1dd348-e6be-4f51-969a-55a3bf4101b7 req-fd3d108c-43ec-41e2-8789-c2a22eb17579 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:49.666994 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ce1dd348-e6be-4f51-969a-55a3bf4101b7 req-fd3d108c-43ec-41e2-8789-c2a22eb17579 service nova] Creating event network-vif-deleted:ab8f7ffd-c3b5-4b31-bc27-a295c5a9313f for instance 22c661ce-588c-4d87-9794-751be6cd1f3a on n-h1-850003-3 Jul 18 14:05:49.672655 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ce1dd348-e6be-4f51-969a-55a3bf4101b7 req-fd3d108c-43ec-41e2-8789-c2a22eb17579 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Jul 18 14:05:49.673289 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3570/6920] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:05:50.654803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:50.655422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:50.658187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:50.663328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:50.663790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:50.664576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:50.665513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:50.681475 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a HTTP/1.1 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '22c661ce-588c-4d87-9794-751be6cd1f3a'} Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:05:50.683382 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e34e637-4047-4b60-b525-8240eaba872c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 404 len: 111 microversion: 2.1 time: 0.034157 Jul 18 14:05:50.687551 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3351/6921] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:50 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:05:50.702695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:50.703393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:50.705595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=43 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:50.711676 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:50.712170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:50.712950 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:50.713399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:50.728497 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a HTTP/1.1 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '22c661ce-588c-4d87-9794-751be6cd1f3a'} Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:05:50.730188 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:05:50.734381 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a7b4ef1-4597-464a-87bd-adac7e1907b8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 404 len: 111 microversion: 2.1 time: 0.034480 Jul 18 14:05:50.740444 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3571/6922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:50 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:05:50.780206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-524699354", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "c4ace286-a2be-4bd4-8bb4-72bd2d82cf14"}], "security_groups": [{"name": "tempest-securitygroup--1686720155"}], "key_name": "tempest-keypair-968017985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:50.887547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] validate_networks() for [('c4ace286-a2be-4bd4-8bb4-72bd2d82cf14', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:05:51.259206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:05:51.259922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:05:51.260657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:05:51.261167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:05:51.261652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:05:51.270944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:51.271417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:51.272242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:51.272723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:51.290800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:05:51.296170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:05:51.308678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:05:51.310995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:05:51.356456 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-383cd9fd-661e-44e0-bb4a-7d432e571c2c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.580654 Jul 18 14:05:51.357287 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3352/6923] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:05:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:05:51.367542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a41f3c3-8119-4f11-975f-dee4ab2fa3c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:51.368197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0a41f3c3-8119-4f11-975f-dee4ab2fa3c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:51.426991 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0a41f3c3-8119-4f11-975f-dee4ab2fa3c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:51.433769 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a41f3c3-8119-4f11-975f-dee4ab2fa3c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1237 microversion: 2.1 time: 0.070216 Jul 18 14:05:51.434366 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3572/6924] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:51 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:52.452930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:52.453574 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:52.461664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:52.462685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:52.463496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:52.463952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:52.564145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:52.571899 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a51c28a-323c-47b6-a268-2adc4d81c7ee tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1295 microversion: 2.1 time: 0.123832 Jul 18 14:05:52.572500 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3353/6925] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:52 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:53.593350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:53.594164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:53.601708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:53.602363 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:53.603762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:53.604299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:53.713810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d8eeee24-b44e-45ba-be08-ef419242c6c9 req-eb344212-cdd2-4ccf-8c47-940f3330cd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:53.729249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d8eeee24-b44e-45ba-be08-ef419242c6c9 req-eb344212-cdd2-4ccf-8c47-940f3330cd2e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:53.729922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d8eeee24-b44e-45ba-be08-ef419242c6c9 req-eb344212-cdd2-4ccf-8c47-940f3330cd2e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:53.750902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d8eeee24-b44e-45ba-be08-ef419242c6c9 req-eb344212-cdd2-4ccf-8c47-940f3330cd2e service nova] Creating event network-changed:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:05:53.757022 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d8eeee24-b44e-45ba-be08-ef419242c6c9 req-eb344212-cdd2-4ccf-8c47-940f3330cd2e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047087 Jul 18 14:05:53.757708 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3354/6926] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:05:53.779935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:53.789326 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3d25fe65-9063-4f70-8a0c-b2da8c55d5a9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.200815 Jul 18 14:05:53.791001 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3573/6927] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:53 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:54.809126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:54.809913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:54.816484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:54.816952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:54.817758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:54.818230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:55.308234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:55.315830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c781725d-7a37-42be-a98f-1c3495766339 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.511805 Jul 18 14:05:55.316491 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3355/6928] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:54 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:56.337211 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:56.338467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:56.349773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:56.350386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:56.351161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:56.351603 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:56.481945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:56.489517 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a62cb8b6-6ddc-4a3d-9de3-21d572f0530d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.160010 Jul 18 14:05:56.490092 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3574/6929] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:56 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:57.375222 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:05:57.375858 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:05:57.507292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:57.507916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:57.514986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:57.515454 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:57.516239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:57.516694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:57.651062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:57.658908 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63c3eb99-2af3-4663-a79a-97538d59c608 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.155488 Jul 18 14:05:57.659488 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3356/6930] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:57 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:58.677008 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:58.677611 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:58.685777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:58.686258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:58.687058 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:58.687507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:58.829793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:05:58.837591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-24a5b749-5e0b-41af-a4e4-f2f2753edb8b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.164500 Jul 18 14:05:58.838176 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3575/6931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:58 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:05:59.004960 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:05:59.005474 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:05:59.855881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:05:59.860004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:05:59.867959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:59.869162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:59.870061 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:59.870559 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:59.968406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0afd3622-72db-4be1-8d56-e341763f2cd5 req-8948a2c6-a55d-4144-9e80-5ac7d475291a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "name": "network-vif-plugged", "status": "completed", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:05:59.978604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0afd3622-72db-4be1-8d56-e341763f2cd5 req-8948a2c6-a55d-4144-9e80-5ac7d475291a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:05:59.979059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0afd3622-72db-4be1-8d56-e341763f2cd5 req-8948a2c6-a55d-4144-9e80-5ac7d475291a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:05:59.993838 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0afd3622-72db-4be1-8d56-e341763f2cd5 req-8948a2c6-a55d-4144-9e80-5ac7d475291a service nova] Creating event network-vif-plugged:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:05:59.999192 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0afd3622-72db-4be1-8d56-e341763f2cd5 req-8948a2c6-a55d-4144-9e80-5ac7d475291a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035516 Jul 18 14:06:00.000070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3576/6932] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:00.009612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:00.017883 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-50fc9ee6-63d4-4f5e-9c21-c30fe86807c4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.166311 Jul 18 14:06:00.019060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3357/6933] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:05:59 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:01.037668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:01.038308 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:01.045984 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:01.046463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:01.047241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:01.047710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:01.198247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:01.207260 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ded90a36-bad5-4058-a624-514180daa95a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1363 microversion: 2.1 time: 0.173860 Jul 18 14:06:01.208507 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3577/6934] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:01 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:02.225608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:02.226261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:02.228993 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:02.229679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:02.237221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:02.237816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:02.238875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:02.239390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:02.372740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:02.380321 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74a8887f-773b-4d9f-878d-5338cf1cadd4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1550 microversion: 2.1 time: 0.158692 Jul 18 14:06:02.380896 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3358/6935] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:02 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:02.396419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:02.401759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:02.402862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:02.409757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:02.410166 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:02.410946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:02.411390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:02.495979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aacdb3af-25bd-473f-b65f-910dc0b6af7f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100316 Jul 18 14:06:02.496636 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3578/6936] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 14:06:02 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:06:03.445854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-79dd35df-ef87-4f9b-9dc2-5c2b1c877138 req-0f67790d-1ccd-488b-bc72-f23fa242bc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:06:03.455668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-79dd35df-ef87-4f9b-9dc2-5c2b1c877138 req-0f67790d-1ccd-488b-bc72-f23fa242bc15 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:03.456131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-79dd35df-ef87-4f9b-9dc2-5c2b1c877138 req-0f67790d-1ccd-488b-bc72-f23fa242bc15 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:03.468266 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-79dd35df-ef87-4f9b-9dc2-5c2b1c877138 req-0f67790d-1ccd-488b-bc72-f23fa242bc15 service nova] Creating event network-changed:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:06:03.473373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-79dd35df-ef87-4f9b-9dc2-5c2b1c877138 req-0f67790d-1ccd-488b-bc72-f23fa242bc15 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Jul 18 14:06:03.473992 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3359/6937] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:37.772994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=17 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:37.773866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=44 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:37.779130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:37.779788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:37.787477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:37.787960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:37.788788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:37.789295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:37.939373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:37.948317 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ec28f4aa-c4ac-4aae-96f1-5ae4d2076518 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1669 microversion: 2.1 time: 0.177365 Jul 18 14:06:37.948918 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3579/6938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:37 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:06:37.970114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:37.971093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:37.976850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3e77b1e-b17d-476b-8c1f-865419d8909c"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:06:37.978393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:37.987595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:37.988339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:37.989434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:37.989928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:38.277647 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-91507d3f-0669-4326-bf48-53d17930c1e5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310559 Jul 18 14:06:38.279233 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3360/6939] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 14:06:37 2022] POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:49.017772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:06:49.019153 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:49.022138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:49.022854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:49.031024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:49.031477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:49.032277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:49.032712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:49.064556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:49.071426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 14:06:49.079354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:06:49.079777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:06:49.080251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:06:49.080655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:06:49.081066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:06:49.151527 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9f7b9839-1b12-4a2f-84a4-84a36fd455ac tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/action" status: 202 len: 0 microversion: 2.1 time: 0.137767 Jul 18 14:06:49.152151 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3580/6940] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:06:49 2022] POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:06:49.162241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:49.163047 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:49.167174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:49.168570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:49.176746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:49.177467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:49.178594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:49.179039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:49.388169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:49.397701 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81e46dd2-5fc4-4294-8942-71a21efde67c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1724 microversion: 2.1 time: 0.239887 Jul 18 14:06:49.398331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3361/6941] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:49 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:50.420606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:50.421195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:50.427975 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:50.428439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:50.429240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:50.429687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:50.578371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:50.587916 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65ce118a-8dd2-4e72-8de9-f0ac425ce10c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1724 microversion: 2.1 time: 0.173068 Jul 18 14:06:50.588525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3581/6942] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:50 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:51.611554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:51.612757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:51.626830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:51.627666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:51.628898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:51.629719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:51.826473 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:51.841728 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ace83dd5-3ee0-42ce-9a38-38423dd69b3f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.237944 Jul 18 14:06:51.842833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3362/6943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:51 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:52.870797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:52.871703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:52.881323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:52.881773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:52.882639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:52.883068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:53.054111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:53.067014 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0350c82c-8969-4a57-a8e8-c5982a3632df tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.201441 Jul 18 14:06:53.067879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3582/6944] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:52 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:06:54.085535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:54.086217 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:54.094931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:54.095688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:54.096932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:54.097682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:54.261439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:54.271326 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-aa0d56de-26e9-46d8-87e2-555c22edfe15 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.189941 Jul 18 14:06:54.272004 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3363/6945] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:54 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:55.292129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:55.292749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:55.300486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:55.300926 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:55.301724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:55.302187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:55.453391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:55.461970 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51112360-bb8e-4281-bf6a-f198fa3d3440 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.173798 Jul 18 14:06:55.462587 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3583/6946] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:55 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:06:56.479879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:56.480465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:56.487975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:56.488447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:56.489278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:56.489761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:56.623248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:56.631334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2acd13b1-faca-44ca-b6ec-51f2f697d7c5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.155517 Jul 18 14:06:56.631910 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3364/6947] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:56 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:57.648960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:57.649588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:57.657298 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:57.657752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:57.658561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:57.658999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:57.795322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:57.803457 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e2144505-c6a6-45e7-bd89-ecbf661f298b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.158428 Jul 18 14:06:57.804042 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3584/6948] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:57 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:58.822797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:58.823451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:06:58.831101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:58.831590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:58.832407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:58.832862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:58.984006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:06:58.992512 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a02be6cc-0fac-459e-bc84-0e292ebd36a8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.175076 Jul 18 14:06:58.993127 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3365/6949] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:06:58 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:00.010457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:00.011098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:00.018609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:00.019069 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:00.019879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:00.020317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:00.158428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:00.166603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6b5a13e6-425e-47ec-a936-e61eefbb2f6b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.160081 Jul 18 14:07:00.167283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3585/6950] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:00 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:01.185618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:01.186270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:01.193560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:01.194019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:01.194845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:01.195293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:01.346813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:01.357387 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8edaa5a-b0e4-4f3a-acdb-f43661204f39 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.175995 Jul 18 14:07:01.357975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3366/6951] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:01 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:02.376787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:02.377564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:02.384572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:02.385035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:02.385845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:02.386318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:02.521929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:02.530485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a07172b3-c65a-47c0-acd2-516a47e23c3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.157812 Jul 18 14:07:02.531076 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3586/6952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:02 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:03.548624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:03.549200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:03.556446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:03.556921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:03.557736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:03.558220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:03.693641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:03.702600 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5fc5f709-d324-4625-84a9-4053c71b2f00 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.158657 Jul 18 14:07:03.703188 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3367/6953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:03 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:04.721036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:04.721689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:04.728469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:04.728920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:04.729700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:04.730159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:04.872396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:04.880551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2d807886-37b8-40aa-8c5a-ef64e5c08892 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.164177 Jul 18 14:07:04.881144 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3587/6954] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:04 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:05.898056 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:05.898699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:05.906644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:05.907117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:05.907925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:05.908381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:06.051811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:06.060902 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da81ee63-0522-4902-bf4a-efaec4d2b192 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.166185 Jul 18 14:07:06.060902 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3368/6955] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:05 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:07.078090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:07.079044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:07.090452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:07.092024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:07.093158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:07.093998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:07.253282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:07.268888 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5ecbb39f-1719-4205-bf09-e96ce722f2dd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.194619 Jul 18 14:07:07.269985 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3588/6956] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:07 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:08.287900 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:08.288611 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:08.300909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:08.301379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:08.302240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:08.302704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:08.466086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:08.475351 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79dd00c5-de33-4d8b-8f69-47515b56b9bd tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.191448 Jul 18 14:07:08.476040 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3369/6957] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:08 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:09.496555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:09.497256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:09.504819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:09.505275 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:09.506051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:09.506549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:09.657073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:09.665749 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e8e9e4e-371d-455e-81c2-cc5e8cf2c749 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1729 microversion: 2.1 time: 0.173255 Jul 18 14:07:09.676114 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3589/6958] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:09 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:10.683737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:10.684465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:10.692653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:10.693181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:10.693981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:10.694459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:10.895253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:10.903806 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-080a7e2e-bd33-475c-a8f7-1adc93f516ea tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1728 microversion: 2.1 time: 0.223757 Jul 18 14:07:10.904391 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3370/6959] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:10 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:11.283126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "name": "network-vif-unplugged", "status": "completed", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:11.293773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:11.294346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:11.311354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] Creating event network-vif-unplugged:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h1-850003-3 Jul 18 14:07:11.317915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:07:11.330791 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-57316b9f-f1cd-4752-b0b8-b82805806eb0 req-84e0e5f2-06cb-444d-a1d8-02a6679989c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106107 Jul 18 14:07:11.331433 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3590/6960] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:07:11.921533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:11.922133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:11.929463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:11.929928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:11.930741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:11.931189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:12.148948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:12.162551 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc8b9a6e-6226-47e8-8b00-a2326e45fe7b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1728 microversion: 2.1 time: 0.245505 Jul 18 14:07:12.163163 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3371/6961] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:11 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:13.181245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:13.181945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:13.190435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:13.190891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:13.191677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:13.192116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:13.330494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:13.338826 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9d25eba4-a6c4-4407-924d-b578f589fab4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.161943 Jul 18 14:07:13.339405 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3591/6962] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:13 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:13.347643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:13.356868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:13.357951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:13.369871 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] Creating event network-changed:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h1-850003-3 Jul 18 14:07:13.376397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:07:13.387932 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a08ce8ad-7ac8-48ef-bfd9-e8ddbe1ee7d2 req-6f178d7d-0421-44f7-a4b5-85ccc4d55116 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044182 Jul 18 14:07:13.388616 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3372/6963] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:07:14.360836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:14.361550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:14.369750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:14.370229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:14.371459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:14.371459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:14.510686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:14.519245 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c785b9b-a24e-4623-98dc-a8b55f6e2ddb tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.163122 Jul 18 14:07:14.519878 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3592/6964] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:14 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:15.538547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:15.539264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:15.545689 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:15.546191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:15.546971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:15.547606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:16.031209 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:16.039612 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a235213f-11dc-4703-8aa6-e359acca811d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.506352 Jul 18 14:07:16.040204 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3373/6965] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:15 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:17.057027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:17.057623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:17.067243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:17.067985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:17.068781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:17.069216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:17.208847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:17.217122 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f26f4c22-b8ab-4b66-aaa3-24591bb46b5c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.164104 Jul 18 14:07:17.217708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3593/6966] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:17 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:18.234885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:18.235516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:18.242627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:18.243102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:18.243892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:18.244349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:18.379526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:18.388401 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-84b1612f-ae0c-4f2c-b5df-e705fcd8b462 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.157421 Jul 18 14:07:18.389668 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3374/6967] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:18 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:19.407859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:19.408381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:19.411070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=33 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:19.416515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:19.416977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:19.417762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:19.418289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:19.422484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:19.550810 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:19.558896 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a0f8ff89-9f24-40d3-b503-b83ae38de42f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.156033 Jul 18 14:07:19.559472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3594/6968] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:19 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:20.576153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:20.576778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:20.579745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=29 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.585203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:20.585664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:20.586469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:20.586919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:20.589668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=83 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.722508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:20.730682 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c04629d-03ca-4963-a5da-0a919c11e56e tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.158453 Jul 18 14:07:20.731260 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3375/6969] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:20 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:21.748788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:21.749526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:21.756739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:21.757192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:21.757979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:21.758436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:21.897920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:21.906430 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-20d08f74-375c-47d2-abc2-390ff7b79183 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.162209 Jul 18 14:07:21.907014 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3595/6970] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:21 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:22.924025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:22.924648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:22.932001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:22.932472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:22.933266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:22.933725 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:23.065860 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:23.074021 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-96b1b66e-0f1e-43e1-b7f5-477d2cd35f05 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.153991 Jul 18 14:07:23.074632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3376/6971] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:22 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:24.092933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:24.093555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:24.100586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:24.101036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:24.101805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:24.102284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:24.236201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:24.244405 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7256f40d-a37f-4302-8851-f99ca1686c4a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.156018 Jul 18 14:07:24.244987 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3596/6972] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:24 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:25.262830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:25.263549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:25.270310 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:25.270785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:25.271578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:25.272035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:25.409450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:25.417788 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6897ba4-f1ce-44a2-8f5a-10db94a338aa tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1726 microversion: 2.1 time: 0.158907 Jul 18 14:07:25.418412 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3377/6973] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:25 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:26.435113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:26.436212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:26.443128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.443594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.444352 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.444781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.577271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:26.585576 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-14c88f1c-7243-44bc-bc22-fcd5a0b92cf1 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1723 microversion: 2.1 time: 0.154454 Jul 18 14:07:26.586164 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3597/6974] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:26 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:26.602647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:26.603339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:26.611009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.611481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.612268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.612723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.649491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.649961 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.650814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.651275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.673318 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:07:26.679361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Getting quotas for user 450f3bb407784fa681819cdc25cbb16b and project f73b27e2d111479d8488301e641ca931. Resources: {'cores', 'ram'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:07:26.782774 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-56c65abf-9007-419c-8876-462100ea1cb8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/action" status: 202 len: 0 microversion: 2.1 time: 0.184138 Jul 18 14:07:26.783470 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3378/6975] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:07:26 2022] POST /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:07:26.792674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:26.793597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:26.801004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.801705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.802638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:26.803486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:26.952868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:26.961536 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-88494c53-6ea6-4e62-a617-b3443eeb3328 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.173622 Jul 18 14:07:26.972141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3598/6976] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:26 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:27.981528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:27.983004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:27.990334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:27.990803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:27.991594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:27.992049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:28.134842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:28.143442 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d22e2d7b-e146-4630-80b7-53c98a84908b tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.167037 Jul 18 14:07:28.144037 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3379/6977] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:27 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:28.902658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "name": "network-vif-plugged", "status": "completed", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:28.913192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:28.913670 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:28.926635 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] Creating event network-vif-plugged:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h1-850003-3 Jul 18 14:07:28.932823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:07:28.947646 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-89144649-d508-4d50-a948-c12e0716da9c req-71ce495b-00ce-47ff-b8b8-e7ec6f97027e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048667 Jul 18 14:07:28.948504 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3599/6978] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:07:29.161234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:29.161855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:29.168908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:29.169368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:29.170159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:29.170625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:29.305279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:29.313648 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb4d6075-6e3e-4af4-81bc-235ac4514f17 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.156272 Jul 18 14:07:29.314285 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3380/6979] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:29 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:30.332707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:30.333336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:30.340021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:30.340481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:30.341306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:30.342271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:30.485847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:30.494411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0073b3d-7b96-48f8-9895-1631a22b996a tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.167032 Jul 18 14:07:30.495003 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3600/6980] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:30 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:31.512261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:31.512799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:31.519952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:31.520427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:31.521339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:31.521679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:31.658255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:31.668081 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ed698acb-86e4-46c4-9b91-358069ff8a6c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.159595 Jul 18 14:07:31.679076 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3381/6981] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:31 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:32.348576 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "name": "network-vif-unplugged", "status": "completed", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:32.357958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:32.358524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:32.371724 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] Creating event network-vif-unplugged:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:07:32.377348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:07:32.388915 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c7dac1a3-c07c-47bd-aafa-268a9f2eed37 req-e4b2b1f0-c57e-49f1-91b9-933c4af88dc4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043852 Jul 18 14:07:32.389592 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3601/6982] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:07:32.687708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:32.688261 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:32.695225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:32.695694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:32.696498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:32.696950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:32.934866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:32.944912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c0f959d-a116-483a-9400-08849c959191 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.261601 Jul 18 14:07:32.945518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3382/6983] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:32 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:33.966034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:33.966826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:33.973652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:33.974103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:33.974927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:33.975376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:34.121101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:34.130491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-731d9522-829d-48c3-939e-ac2fbb490119 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.169498 Jul 18 14:07:34.131083 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3602/6984] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:33 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:34.404087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:34.413080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:34.413545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:34.426292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] Creating event network-changed:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:07:34.432613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:07:34.447050 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-06211d24-9f5f-4c6a-a114-86af5fd15032 req-75ecef46-6dba-410a-9ddc-5a0d31cb2a90 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046825 Jul 18 14:07:34.447926 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3383/6985] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:07:35.149965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:35.151564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:35.160478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:35.161373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:35.162374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:35.162847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:35.302067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:35.310905 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0a530c40-a151-4bfe-ad57-150b85b45fc9 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.166041 Jul 18 14:07:35.311589 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3603/6986] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:35 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:36.330617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:36.331333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:36.337853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:36.338292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:36.339084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:36.339539 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:36.486548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:36.495461 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-642ab8f0-d3c3-4074-bf49-5b5145712142 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.170598 Jul 18 14:07:36.496078 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3384/6987] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:36 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:37.513914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:37.514539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:37.522257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:37.522725 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:37.523520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:37.523967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:37.664617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:37.673458 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e47460cd-4411-4c24-ac56-087855bd0a72 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.164052 Jul 18 14:07:37.674048 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3604/6988] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:37 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:38.691430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:38.692082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:38.694169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.701193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:38.701655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:38.702489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:38.702941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:38.839420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:38.848540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c49a6af-9d23-4866-98e8-c4164eab7ae6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.161365 Jul 18 14:07:38.849138 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3385/6989] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:38 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:39.866624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:39.867302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:39.875710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:39.876169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:39.876997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:39.877468 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:40.008142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:40.016222 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d5e8794b-e5ee-4bf2-a57f-2b4e7fed7eda tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.154171 Jul 18 14:07:40.016799 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3605/6990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:39 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:41.033885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:41.034544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:41.041704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:41.042193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:41.042998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:41.043453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:41.181258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:41.190393 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c3a964b4-001b-4dc5-8e6e-479d379dfcf5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.160429 Jul 18 14:07:41.190985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3386/6991] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:41 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:42.208715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:42.209318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:42.218011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:42.218571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:42.219357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:42.219809 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:42.357126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:42.365490 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8c5947d8-45e2-4c9d-b87a-8d3875ed8ef2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.160722 Jul 18 14:07:42.366076 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3606/6992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:42 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:43.383549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:43.384208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:43.392703 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.393170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.393979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.394469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.533934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:43.542838 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8895970f-4f9b-4233-bf05-7e4812700526 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.163398 Jul 18 14:07:43.543426 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3387/6993] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:43 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:44.560460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:44.561099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:44.568553 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:44.569012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:44.569800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:44.570270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:44.709681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:44.718666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee817317-528b-4cf6-a9e7-14618d79d1a5 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1722 microversion: 2.1 time: 0.162128 Jul 18 14:07:44.719476 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3607/6994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:44 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:45.736819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:45.737461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:45.744387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:45.744891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:45.745969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:45.746468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:45.882379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:45.890962 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b8bffae-35f0-4f83-bd11-b44a311b5c92 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1715 microversion: 2.1 time: 0.158695 Jul 18 14:07:45.891548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3388/6995] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:45 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:45.912353 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:45.912965 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:45.920854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:45.921078 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:45.921797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:45.922268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.052761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:46.060841 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8a0dc38b-f477-4200-95d0-4f2379d21c27 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1715 microversion: 2.1 time: 0.152363 Jul 18 14:07:46.061410 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3608/6996] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:45 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:46.077339 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:46.077969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:46.084087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.084561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.085343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.085798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.090090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.231907 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:46.241039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-28d69a32-95d3-4211-923e-e9f1a309b636 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1715 microversion: 2.1 time: 0.167814 Jul 18 14:07:46.241630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3389/6997] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:46 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:46.257401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:46.257839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:46.264534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.264692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.265451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.265893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.292469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:07:46.348197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.383098 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cb18566e-5d47-4ba1-af2e-8dc6a136f377 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 204 len: 0 microversion: 2.1 time: 0.129105 Jul 18 14:07:46.386252 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3609/6998] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:07:46 2022] DELETE /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:07:46.393319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:46.394130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:46.401018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.401758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.403544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:46.403544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:46.558086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:46.574719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-64e1d2c3-9d72-49c4-921b-9c89afe51cd7 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1721 microversion: 2.1 time: 0.185933 Jul 18 14:07:46.575518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3390/6999] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:46 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:47.597870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:47.598624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:47.607006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:47.607798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:47.609018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:47.609464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:47.760613 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:47.769363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-407cfe4f-14b1-4be9-b993-a3243fd958ab tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1721 microversion: 2.1 time: 0.175730 Jul 18 14:07:47.769963 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3610/7000] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:47 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:48.786797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:48.787503 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:48.796605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:48.797102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:48.797994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:48.798482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:48.871871 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:48.881574 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8adb9482-7346-43ac-b4fa-43f46bdab9c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1653 microversion: 2.1 time: 0.098782 Jul 18 14:07:48.882215 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3391/7001] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:48 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:49.369048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e1574576-809a-4a0a-ab4b-d1db881832fe req-9658ec27-bd67-4f93-8502-d3f50accb9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfeac87-c7f2-4179-ba30-e2d9f09d2494", "name": "network-vif-deleted", "tag": "5e1c98cc-7c6d-4873-b82d-59f48d457fd1"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:07:49.379268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1574576-809a-4a0a-ab4b-d1db881832fe req-9658ec27-bd67-4f93-8502-d3f50accb9b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:49.379735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1574576-809a-4a0a-ab4b-d1db881832fe req-9658ec27-bd67-4f93-8502-d3f50accb9b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:49.392569 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e1574576-809a-4a0a-ab4b-d1db881832fe req-9658ec27-bd67-4f93-8502-d3f50accb9b1 service nova] Creating event network-vif-deleted:5e1c98cc-7c6d-4873-b82d-59f48d457fd1 for instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 on n-h2-850003-3 Jul 18 14:07:49.398460 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e1574576-809a-4a0a-ab4b-d1db881832fe req-9658ec27-bd67-4f93-8502-d3f50accb9b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 Jul 18 14:07:49.399406 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3611/7002] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:07:49.899027 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:49.899813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:49.908758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:49.909157 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:49.910193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:49.910814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:49.978244 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:49.987333 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3f9df71e-e981-48d9-80f0-d5d1eda2ffe4 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1368 microversion: 2.1 time: 0.092158 Jul 18 14:07:49.988101 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3392/7003] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:49 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:51.005636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:51.006373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:51.008417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:51.015236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:51.015721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:51.016493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:51.016942 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:51.084921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:51.094485 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7be2b476-abb3-48d1-b3f1-3df8a1dad747 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1368 microversion: 2.1 time: 0.094015 Jul 18 14:07:51.095049 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3612/7004] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:50 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:52.113309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:52.113939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:52.116715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:52.122361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:52.122857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:52.123663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:52.124121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:52.187712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:52.196458 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46ba7d1d-03d2-47ee-b652-b9da4ed7efff tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1368 microversion: 2.1 time: 0.087420 Jul 18 14:07:52.197052 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3393/7005] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:52 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:07:53.213637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:53.214312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:53.222843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:53.223302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:53.224083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:53.224527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:53.289051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450f3bb407784fa681819cdc25cbb16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73b27e2d111479d8488301e641ca931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:07:53.297371 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-efd15bde-1591-476a-8747-1f2a73b51f3d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 200 len: 1368 microversion: 2.1 time: 0.087722 Jul 18 14:07:53.297960 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3613/7006] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:53 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:07:54.315256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:54.315881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:54.322866 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:54.323455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:54.324301 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:54.324802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:54.339108 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 HTTP/1.1 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bbfeac87-c7f2-4179-ba30-e2d9f09d2494'} Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:54.340775 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2641b731-9c1b-4d3f-95f0-6d4edda0ed9c tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jul 18 14:07:54.345504 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3394/7007] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:54 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:54.399776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:54.400717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:54.407879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:54.408336 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:54.409107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:54.409571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:54.422489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-volume_attachments HTTP/1.1 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': 'bbfeac87-c7f2-4179-ba30-e2d9f09d2494'} Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:54.424175 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b32db15c-8467-45d2-9d54-501195257d4d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 18 14:07:54.428052 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3614/7008] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:07:54 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.728090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.728607 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.736180 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.736654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.737449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.737913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.753244 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 HTTP/1.1 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'bbfeac87-c7f2-4179-ba30-e2d9f09d2494'} Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.754880 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76f9c5ed-ca13-4e1d-ab82-506e68784451 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 404 len: 111 microversion: 2.1 time: 0.032177 Jul 18 14:07:57.758437 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3395/7009] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:07:57 2022] DELETE /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.765452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.766079 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: bbfeac87-c7f2-4179-ba30-e2d9f09d2494] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.773358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.773819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.774652 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.775094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.789379 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 HTTP/1.1 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'bbfeac87-c7f2-4179-ba30-e2d9f09d2494'} Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.790947 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance bbfeac87-c7f2-4179-ba30-e2d9f09d2494 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90ddacd3-ca7d-4b9d-b479-fcf2177d01d8 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494" status: 404 len: 111 microversion: 2.1 time: 0.031249 Jul 18 14:07:57.795657 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3615/7010] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:57 2022] GET /compute/v2.1/servers/bbfeac87-c7f2-4179-ba30-e2d9f09d2494 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.801584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.802087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.808142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.808602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.809375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.809829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.824044 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a HTTP/1.1 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '22c661ce-588c-4d87-9794-751be6cd1f3a'} Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.825601 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97f0e3d7-8c1b-451e-91ee-bdc275dbad25 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 404 len: 111 microversion: 2.1 time: 0.029382 Jul 18 14:07:57.830246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3396/7011] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:07:57 2022] DELETE /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.837384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.838002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 22c661ce-588c-4d87-9794-751be6cd1f3a] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.845816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.846522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.847354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.847800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.863666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a HTTP/1.1 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '22c661ce-588c-4d87-9794-751be6cd1f3a'} Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.865237 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 22c661ce-588c-4d87-9794-751be6cd1f3a could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-330af72d-e439-4d4f-9844-4a0a176c79e6 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a" status: 404 len: 111 microversion: 2.1 time: 0.033201 Jul 18 14:07:57.870139 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3616/7012] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:57 2022] GET /compute/v2.1/servers/22c661ce-588c-4d87-9794-751be6cd1f3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.876672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.877346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.884050 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.884617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.885486 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.886006 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.901113 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d HTTP/1.1 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'd8aabe64-f333-4832-99b3-64ecdd02bc1d'} Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.902773 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2130a4e2-1091-4536-813f-4236e5bcf75f tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 404 len: 111 microversion: 2.1 time: 0.032204 Jul 18 14:07:57.907135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3397/7013] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:07:57 2022] DELETE /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.913919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.914658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: d8aabe64-f333-4832-99b3-64ecdd02bc1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.921637 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.922091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.923636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.923636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.939088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d HTTP/1.1 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'd8aabe64-f333-4832-99b3-64ecdd02bc1d'} Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.940765 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance d8aabe64-f333-4832-99b3-64ecdd02bc1d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.945213 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-37d1ea36-bc73-4550-91a2-a9b73ac64f9d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d" status: 404 len: 111 microversion: 2.1 time: 0.033564 Jul 18 14:07:57.946233 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3617/7014] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:57 2022] GET /compute/v2.1/servers/d8aabe64-f333-4832-99b3-64ecdd02bc1d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.957171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.957628 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.963912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.964377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.965169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:57.965625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:57.980045 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 HTTP/1.1 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '01c1274f-359a-44b6-b5a1-50a1734b6d45'} Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:57.981621 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9f26f118-455a-42a7-ab8c-f142f9453002 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 404 len: 111 microversion: 2.1 time: 0.033572 Jul 18 14:07:57.986337 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3398/7015] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:07:57 2022] DELETE /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:57.992423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:57.993128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] [instance: 01c1274f-359a-44b6-b5a1-50a1734b6d45] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:07:57.999992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:58.000528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:58.001420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:58.001897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:58.019030 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] HTTP exception thrown: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Request method failure captured: Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 HTTP/1.1 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WdviEmribV-gWQmsr3st9-wo63sv0z-Wh8czDnZK2Vt0K2b9ojc17DVgFmXCynvXAYyVnR4h7q6zS72oIpkMzralzsVyankbDRWTwbDkiauHHTINqHbysNsqsSBapRhgmRs9LQi8tg0-7UMosWbEMi1eXPxUqisW1b6jFJmkGQQeUw Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f73b27e2d111479d8488301e641ca931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f73b27e2d111479d8488301e641ca931", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f73b27e2d111479d8488301e641ca931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f73b27e2d111479d8488301e641ca931 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServerActionsTestJSON-964817379 Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 450f3bb407784fa681819cdc25cbb16b Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServerActionsTestJSON-964817379-project Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '01c1274f-359a-44b6-b5a1-50a1734b6d45'} Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:07:58.021026 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Returning 404 to user: Instance 01c1274f-359a-44b6-b5a1-50a1734b6d45 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-53f8a6f8-35fe-4a5e-ac61-23fe3904ee6d tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45" status: 404 len: 111 microversion: 2.1 time: 0.034493 Jul 18 14:07:58.024654 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3618/7016] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:07:57 2022] GET /compute/v2.1/servers/01c1274f-359a-44b6-b5a1-50a1734b6d45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:07:58.033420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9754a02-9437-4b8b-aa78-c93cc7a880c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] Calling method '.version_select at 0x7f96d740a310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:07:58.057156 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9754a02-9437-4b8b-aa78-c93cc7a880c2 tempest-ServerActionsTestJSON-964817379 tempest-ServerActionsTestJSON-964817379-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968017985" status: 202 len: 0 microversion: 2.1 time: 0.028769 Jul 18 14:07:58.057990 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3399/7017] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 14:07:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968017985 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:08:07.420704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1929252320", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "c233dc8c-72c9-4d62-a0ba-d2b1c86752df"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:07.497014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] validate_networks() for [('c233dc8c-72c9-4d62-a0ba-d2b1c86752df', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:07.983269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:07.983696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:07.984170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:07.984757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:07.985176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:07.995053 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:07.995372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:07.996180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:07.996622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:08.015201 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Getting quotas for project a6904d539a054af980cb21d230a17441. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:08.020954 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Getting quotas for user 1fd5d97e14474ba382f36e874495650e and project a6904d539a054af980cb21d230a17441. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:08.036534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:08.038974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:08.087899 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e080edbb-c0f8-4a62-a6dc-8d75fdd74139 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796529 Jul 18 14:08:08.088949 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3619/7018] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:08.097429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=39 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:08.098221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:08.103207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9774b89c-91eb-4bbf-a2fe-b267b5c12949 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:08.115254 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9774b89c-91eb-4bbf-a2fe-b267b5c12949 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:08.205207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9774b89c-91eb-4bbf-a2fe-b267b5c12949 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:08.215887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9774b89c-91eb-4bbf-a2fe-b267b5c12949 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1217 microversion: 2.1 time: 0.120128 Jul 18 14:08:08.216832 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3400/7019] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:08 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:09.236931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:09.237653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:09.244313 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:09.244769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:09.245567 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:09.246012 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:09.318659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:09.327912 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-750468ee-d82d-4529-9a51-094f2a6ac6af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1269 microversion: 2.1 time: 0.097341 Jul 18 14:08:09.328498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3620/7020] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:09 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:10.346558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:10.347195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:10.362531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:10.363276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:10.364291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:10.364899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:11.020304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:11.035012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-13e65778-e165-4c78-997e-44e2a91749d3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.693532 Jul 18 14:08:11.035943 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3401/7021] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:10 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:11.430854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-493a4d9f-7120-4ac8-ae67-fc77024214e9 req-fec54286-a5bd-4509-bc4b-ce3b41fd117e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac7435d2-21bf-4024-b641-ec6a831f937f", "tag": "7b10d330-4ac0-4b71-8c27-d4de1ed0d035"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:11.443370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-493a4d9f-7120-4ac8-ae67-fc77024214e9 req-fec54286-a5bd-4509-bc4b-ce3b41fd117e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:11.444103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-493a4d9f-7120-4ac8-ae67-fc77024214e9 req-fec54286-a5bd-4509-bc4b-ce3b41fd117e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:11.462432 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-493a4d9f-7120-4ac8-ae67-fc77024214e9 req-fec54286-a5bd-4509-bc4b-ce3b41fd117e service nova] Creating event network-changed:7b10d330-4ac0-4b71-8c27-d4de1ed0d035 for instance ac7435d2-21bf-4024-b641-ec6a831f937f on n-h2-850003-3 Jul 18 14:08:11.468564 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-493a4d9f-7120-4ac8-ae67-fc77024214e9 req-fec54286-a5bd-4509-bc4b-ce3b41fd117e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 Jul 18 14:08:11.469840 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3621/7022] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:12.053282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:12.053824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:12.061535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:12.061996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:12.062830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:12.063284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:12.215065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:12.223721 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e50fb703-03bc-4b03-8492-504f431e3acc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.174515 Jul 18 14:08:12.224893 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3402/7023] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:12 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:13.245595 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:13.246457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:13.254774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:13.255225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:13.256105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:13.256546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:13.392394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:13.399871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-19c55d0a-2909-4740-9ad4-328def7b9b86 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.159859 Jul 18 14:08:13.400438 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3622/7024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:13 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:14.416982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:14.417522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:14.425479 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:14.425934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:14.426742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:14.427196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:14.559112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:14.566864 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fdb2ee3c-d82e-4c30-b546-f0875187bdb6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.154011 Jul 18 14:08:14.567508 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3403/7025] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:14 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:15.583149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:15.583805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:15.590904 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:15.591360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:15.592146 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:15.592586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:15.727110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:15.735229 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9293322-f189-4b4d-bf33-ebf55f2d2042 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.156038 Jul 18 14:08:15.735813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3623/7026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:15 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:16.723512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-803e6641-e1f0-4530-a244-895891937de6 req-94a2e58d-5ed7-462c-9e14-c90f2fc624c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7435d2-21bf-4024-b641-ec6a831f937f", "name": "network-vif-plugged", "status": "completed", "tag": "7b10d330-4ac0-4b71-8c27-d4de1ed0d035"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:16.735951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-803e6641-e1f0-4530-a244-895891937de6 req-94a2e58d-5ed7-462c-9e14-c90f2fc624c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:16.735951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-803e6641-e1f0-4530-a244-895891937de6 req-94a2e58d-5ed7-462c-9e14-c90f2fc624c5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:16.750851 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-803e6641-e1f0-4530-a244-895891937de6 req-94a2e58d-5ed7-462c-9e14-c90f2fc624c5 service nova] Creating event network-vif-plugged:7b10d330-4ac0-4b71-8c27-d4de1ed0d035 for instance ac7435d2-21bf-4024-b641-ec6a831f937f on n-h2-850003-3 Jul 18 14:08:16.754094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:16.755113 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:16.756132 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-803e6641-e1f0-4530-a244-895891937de6 req-94a2e58d-5ed7-462c-9e14-c90f2fc624c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Jul 18 14:08:16.757728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3404/7027] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:08:16.767547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:16.767774 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:16.769195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:16.769958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:16.775109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=53 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:16.928171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:16.939816 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-06aa1c51-31ca-4c75-88f1-f4f0c18ed980 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.189938 Jul 18 14:08:16.940715 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3624/7028] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:16 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:17.964234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:17.964989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:17.973662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:17.974133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:17.975026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:17.975437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:18.125915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:18.133709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-02caee6d-8ccb-4a8c-b1fd-1e2ec6f16442 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1317 microversion: 2.1 time: 0.173816 Jul 18 14:08:18.134361 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3405/7029] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:17 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:19.151632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:19.152425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:19.156694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:19.157684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:19.165212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:19.165665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:19.166484 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:19.167142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:19.306949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:19.314570 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3c4b4c2-e98e-46e4-8713-0ddcf1bca587 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.167663 Jul 18 14:08:19.315158 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3625/7030] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:19 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:19.370220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1913179576", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "c233dc8c-72c9-4d62-a0ba-d2b1c86752df"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:19.376973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:19.425140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] validate_networks() for [('c233dc8c-72c9-4d62-a0ba-d2b1c86752df', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:19.801841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:19.802309 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:19.802801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:19.803225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:19.803652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:19.813480 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:19.813983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:19.814847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:19.815298 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:19.833190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Getting quotas for project a6904d539a054af980cb21d230a17441. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:19.838934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Getting quotas for user 1fd5d97e14474ba382f36e874495650e and project a6904d539a054af980cb21d230a17441. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:19.851626 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:19.853937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:19.899547 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-08ef92c7-ce0e-4bb5-b4a2-3dd61e6b5fc6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533208 Jul 18 14:08:19.900215 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3406/7031] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:19.910420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4f3eb218-8033-4b6e-89fa-42e772411617 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:19.911028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4f3eb218-8033-4b6e-89fa-42e772411617 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:19.967499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4f3eb218-8033-4b6e-89fa-42e772411617 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:19.974343 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4f3eb218-8033-4b6e-89fa-42e772411617 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1217 microversion: 2.1 time: 0.067769 Jul 18 14:08:19.974935 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3626/7032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:19 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:20.992442 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:20.993287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:21.002072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:21.002578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:21.003375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:21.003824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:21.107784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:21.115490 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d85ad43b-eb17-402f-a3fb-3392e366b56a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1287 microversion: 2.1 time: 0.127178 Jul 18 14:08:21.124864 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3407/7033] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:20 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:22.132973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:22.133602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:22.136716 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:22.155759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:22.156241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:22.157130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:22.157490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:22.307011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:22.315727 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ccd8ce0e-9b5c-4c8c-92b7-d9b21ec609af tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.186751 Jul 18 14:08:22.316320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3627/7034] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:22 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:22.381816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a6e26394-67c4-4a4f-a91c-ba78a617c165 req-59dd2898-0433-4e6f-8bf5-c2e80696168e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795acc47-48fb-42a4-aca7-7ea5167cbd1d", "tag": "df0a4341-2981-433d-a3e8-944064af23f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:22.393713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6e26394-67c4-4a4f-a91c-ba78a617c165 req-59dd2898-0433-4e6f-8bf5-c2e80696168e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:22.394450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6e26394-67c4-4a4f-a91c-ba78a617c165 req-59dd2898-0433-4e6f-8bf5-c2e80696168e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:22.408167 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a6e26394-67c4-4a4f-a91c-ba78a617c165 req-59dd2898-0433-4e6f-8bf5-c2e80696168e service nova] Creating event network-changed:df0a4341-2981-433d-a3e8-944064af23f7 for instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d on n-h1-850003-3 Jul 18 14:08:22.413661 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a6e26394-67c4-4a4f-a91c-ba78a617c165 req-59dd2898-0433-4e6f-8bf5-c2e80696168e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037290 Jul 18 14:08:22.414319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3408/7035] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:23.333557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:23.334194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:23.341556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:23.341989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:23.342834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:23.343255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:23.485838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:23.493403 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca674347-1774-477e-8e58-2d0f44753a76 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.164451 Jul 18 14:08:23.493982 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3628/7036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:23 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:24.511959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:24.512713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:24.519808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:24.520283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:24.521075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:24.521537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:24.658955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:24.666536 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-578e75be-8493-4fca-b06c-5c37808104fb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.159830 Jul 18 14:08:24.667132 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3409/7037] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:24 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:25.684165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:25.684791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:25.692867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:25.693326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:25.694118 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:25.694597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:25.895863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:25.904823 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50d7734a-13a0-4527-ba92-23679b9a16a7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.224221 Jul 18 14:08:25.905422 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3629/7038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:25 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:26.922204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:26.923145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:26.930110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:26.930621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:26.931428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:26.931882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:27.132010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:27.140266 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-280fa0ad-a28c-4fbb-86d5-5898d5020c73 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.222150 Jul 18 14:08:27.140882 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3410/7039] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:26 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:28.157816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:28.158505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:28.165870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:28.166369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:28.167155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:28.167598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:28.314112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:28.324462 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-11fd19b0-a6b7-4e54-9ed2-b041cf029bfb tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.170972 Jul 18 14:08:28.325279 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3630/7040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:28 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:29.251569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-26fc2341-c62b-429d-b74f-5150067c6a75 req-84c0b2fc-7c01-4032-81c5-793343fa190d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795acc47-48fb-42a4-aca7-7ea5167cbd1d", "name": "network-vif-plugged", "status": "completed", "tag": "df0a4341-2981-433d-a3e8-944064af23f7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:29.261424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-26fc2341-c62b-429d-b74f-5150067c6a75 req-84c0b2fc-7c01-4032-81c5-793343fa190d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:29.261726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-26fc2341-c62b-429d-b74f-5150067c6a75 req-84c0b2fc-7c01-4032-81c5-793343fa190d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:29.274945 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-26fc2341-c62b-429d-b74f-5150067c6a75 req-84c0b2fc-7c01-4032-81c5-793343fa190d service nova] Creating event network-vif-plugged:df0a4341-2981-433d-a3e8-944064af23f7 for instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d on n-h1-850003-3 Jul 18 14:08:29.281412 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-26fc2341-c62b-429d-b74f-5150067c6a75 req-84c0b2fc-7c01-4032-81c5-793343fa190d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Jul 18 14:08:29.282187 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3411/7041] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:29.346528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:29.347277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:29.355256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:29.356451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:29.356451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:29.357364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:29.509739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:29.524279 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db665602-3b27-4f32-bda2-8fc34ac6dd9a tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.182060 Jul 18 14:08:29.525309 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3631/7042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:29 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:30.539191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.539994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.546183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.546926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:30.555103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:30.555581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:30.556388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:30.556842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:30.703054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:30.711221 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8688280-0868-48cd-9dff-50e1bb51e93e tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1317 microversion: 2.1 time: 0.173142 Jul 18 14:08:30.711883 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3412/7043] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:30 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:31.731873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:31.732641 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:31.735642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:31.742929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:31.743393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:31.744192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:31.744635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:31.909272 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:31.918709 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0b8c175e-9eb6-40a6-a6de-4b452142d14c tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1505 microversion: 2.1 time: 0.192760 Jul 18 14:08:31.919323 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3632/7044] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:31 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:31.935019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:31.936228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:31.943682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:31.944153 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:31.945002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:31.945495 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:31.973019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:08:32.070949 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-63bca711-71e0-407d-8ec3-0b40db7d0055 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 204 len: 0 microversion: 2.1 time: 0.139273 Jul 18 14:08:32.073565 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3413/7045] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:08:31 2022] DELETE /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:08:32.083247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:32.083865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:32.090394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:32.090851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:32.091644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:32.092082 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:32.273371 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:32.282610 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a7acc65-0f31-40a6-8486-0ec0193692da tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1511 microversion: 2.1 time: 0.204239 Jul 18 14:08:32.283226 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3633/7046] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:32 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:33.302317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:33.303044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:33.312351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:33.312820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:33.313612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:33.314067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:33.461067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:33.471322 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f55112c1-5fb9-469b-8090-1c6f01738fe7 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1511 microversion: 2.1 time: 0.173553 Jul 18 14:08:33.471916 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3414/7047] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:33 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:34.224373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f6746f31-bd48-4537-abbc-6497391af5cd req-92893a0e-a01e-4479-990b-f61f0753961a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795acc47-48fb-42a4-aca7-7ea5167cbd1d", "name": "network-vif-deleted", "tag": "df0a4341-2981-433d-a3e8-944064af23f7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:34.236184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f6746f31-bd48-4537-abbc-6497391af5cd req-92893a0e-a01e-4479-990b-f61f0753961a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:34.237360 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f6746f31-bd48-4537-abbc-6497391af5cd req-92893a0e-a01e-4479-990b-f61f0753961a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:34.251292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f6746f31-bd48-4537-abbc-6497391af5cd req-92893a0e-a01e-4479-990b-f61f0753961a service nova] Creating event network-vif-deleted:df0a4341-2981-433d-a3e8-944064af23f7 for instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d on n-h1-850003-3 Jul 18 14:08:34.259339 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f6746f31-bd48-4537-abbc-6497391af5cd req-92893a0e-a01e-4479-990b-f61f0753961a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040650 Jul 18 14:08:34.260785 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3634/7048] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:34.491717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:34.492552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:34.505565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:34.506107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:34.507368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:34.508169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:34.551842 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:34.552379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:34.552959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lazy-loading 'fault' on Instance uuid 795acc47-48fb-42a4-aca7-7ea5167cbd1d {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:08:34.598115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:34.606082 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7bdedf69-137d-4b95-a67d-f7710f3669a1 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 200 len: 1307 microversion: 2.1 time: 0.119580 Jul 18 14:08:34.606718 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3415/7049] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:34 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:35.631074 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:35.632048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:35.639549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.640044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:35.640729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.641169 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:35.656539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d HTTP/1.1 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '795acc47-48fb-42a4-aca7-7ea5167cbd1d'} Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:35.658259 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 404 to user: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-028d2431-6cc5-465f-88a0-f2e196566dde tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 404 len: 111 microversion: 2.1 time: 0.035542 Jul 18 14:08:35.662668 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3635/7050] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:35 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:35.670711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:35.671595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:35.679233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.679704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:35.680526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.680986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:35.845519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:35.855310 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c8f4cd5d-7450-40bd-baf8-e61ea58674b3 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.189286 Jul 18 14:08:35.855928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3416/7051] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:35 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:35.873530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:35.874864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:35.881248 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4/action HTTP/1.1 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 32 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: {"resize": {"flavorRef": "452"}} Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4', 'body': {'resize': {'flavorRef': '452'}}} Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:08:35.882831 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 404 to user: Instance 0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00a1f5f9-d65d-4106-8ec4-104e24859222 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "POST /compute/v2.1/servers/0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4/action" status: 404 len: 111 microversion: 2.1 time: 0.015340 Jul 18 14:08:35.887645 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3636/7052] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:08:35 2022] POST /compute/v2.1/servers/0a553c46-59ab-4bcf-bf3a-f01c35c1e8c4/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:35.893790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:35.894501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:35.901916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.902438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:35.903245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:35.903697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.117012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:36.127012 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bb37d0ca-34be-4d2e-83ce-8715ee911344 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.236793 Jul 18 14:08:36.128099 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3417/7053] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:35 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:36.150631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:36.151523 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:36.160902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.160902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.161666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.162108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.330870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:36.339720 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc160a3c-22c5-42a8-bcee-22495fec72b4 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.197058 Jul 18 14:08:36.340482 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3637/7054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:36 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:36.359256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bb9f9086-7a17-4054-96cf-75880c391744"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:36.360305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:36.368702 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.369415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.370422 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.370887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.375779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:36.421119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:36.427983 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: request: POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action HTTP/1.1 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 65 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: {"resize": {"flavorRef": "bb9f9086-7a17-4054-96cf-75880c391744"}} Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: exception: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ac7435d2-21bf-4024-b641-ec6a831f937f', 'body': {'resize': {'flavorRef': 'bb9f9086-7a17-4054-96cf-75880c391744'}}} Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:08:36.448232 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 400 to user: Flavor bb9f9086-7a17-4054-96cf-75880c391744 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c31f81bb-0954-41fa-a78a-d5cfb49245de tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action" status: 400 len: 107 microversion: 2.1 time: 0.096085 Jul 18 14:08:36.456196 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3418/7055] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:08:36 2022] POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action => generated 107 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:08:36.460666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:36.461426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:36.469903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.472555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.472555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.472555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.627538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:36.636338 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4fd8ee43-84c0-4b8d-a575-44af8926c143 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.180600 Jul 18 14:08:36.639886 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3638/7056] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:36 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:36.655065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:36.655697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:36.663388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.663850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.664639 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.665085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.843417 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:36.851740 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd8aef9f-fa29-4ce5-b6a6-6dca53fa1f7d tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.201217 Jul 18 14:08:36.852338 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3419/7057] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:36 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:36.868448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7fb65ec-66f8-4973-aaab-761abcc933d9 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7fb65ec-66f8-4973-aaab-761abcc933d9 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: request: POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action HTTP/1.1 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 29 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: {"resize": {"flavorRef": ""}} Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'ac7435d2-21bf-4024-b641-ec6a831f937f', 'body': {'resize': {'flavorRef': ''}}} Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi '' Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:36.870843 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c7fb65ec-66f8-4973-aaab-761abcc933d9 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c7fb65ec-66f8-4973-aaab-761abcc933d9 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action" status: 400 len: 113 microversion: 2.1 time: 0.007812 Jul 18 14:08:36.875019 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3639/7058] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:08:36 2022] POST /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:08:36.881311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:36.881945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:36.889015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.889583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:36.890434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:36.890905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.071618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:37.080760 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-17c05d44-8ae4-4eaa-97d5-dd805c4f6473 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1506 microversion: 2.1 time: 0.203340 Jul 18 14:08:37.081449 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3420/7059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:36 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:37.102804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:37.102804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:37.110711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.111263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.112332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.112873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.129138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d HTTP/1.1 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '795acc47-48fb-42a4-aca7-7ea5167cbd1d'} Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:08:37.130870 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 404 to user: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d2cacbc8-e75c-48ea-8050-92d46fca7a28 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 404 len: 111 microversion: 2.1 time: 0.034279 Jul 18 14:08:37.135385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3640/7060] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:08:37 2022] DELETE /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:08:37.142268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:37.142905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: 795acc47-48fb-42a4-aca7-7ea5167cbd1d] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:37.149924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.150460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.151300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.151766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.168099 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d HTTP/1.1 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '795acc47-48fb-42a4-aca7-7ea5167cbd1d'} Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:37.169729 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 404 to user: Instance 795acc47-48fb-42a4-aca7-7ea5167cbd1d could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-47163d71-c8ad-4cd0-b7b8-826ea523cae2 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d" status: 404 len: 111 microversion: 2.1 time: 0.034140 Jul 18 14:08:37.175211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3421/7061] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:37 2022] GET /compute/v2.1/servers/795acc47-48fb-42a4-aca7-7ea5167cbd1d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:37.182140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:37.182686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:37.190214 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.190668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.191449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.191884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.226057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:08:37.316775 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0bca23c3-4dbc-4dc8-af86-7ea949df2672 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 204 len: 0 microversion: 2.1 time: 0.138654 Jul 18 14:08:37.317698 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3641/7062] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:08:37 2022] DELETE /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:08:37.328252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:37.328905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:37.335927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.336402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.337220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:37.337672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:37.510880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:37.519497 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-982ecd6e-23f4-4862-bc4d-8cce20e5b8ad tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1512 microversion: 2.1 time: 0.195503 Jul 18 14:08:37.520117 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3422/7063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:37 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:38.538580 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:38.539220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:38.547581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:38.548068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:38.549257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:38.549703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:38.716140 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:38.724988 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1c95bc3-4c3b-46f9-95ad-4a2d6d3310d6 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1512 microversion: 2.1 time: 0.190830 Jul 18 14:08:38.725588 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3642/7064] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:38 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:39.384184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-db7f1bff-5c67-49fb-a19e-4d75faf3e432 req-cdd6ab76-1b88-427d-9868-33ffdfb5d879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7435d2-21bf-4024-b641-ec6a831f937f", "name": "network-vif-deleted", "tag": "7b10d330-4ac0-4b71-8c27-d4de1ed0d035"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:39.393978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:39.400266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-db7f1bff-5c67-49fb-a19e-4d75faf3e432 req-cdd6ab76-1b88-427d-9868-33ffdfb5d879 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:39.401010 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-db7f1bff-5c67-49fb-a19e-4d75faf3e432 req-cdd6ab76-1b88-427d-9868-33ffdfb5d879 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:39.426912 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-db7f1bff-5c67-49fb-a19e-4d75faf3e432 req-cdd6ab76-1b88-427d-9868-33ffdfb5d879 service nova] Creating event network-vif-deleted:7b10d330-4ac0-4b71-8c27-d4de1ed0d035 for instance ac7435d2-21bf-4024-b641-ec6a831f937f on n-h2-850003-3 Jul 18 14:08:39.433769 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-db7f1bff-5c67-49fb-a19e-4d75faf3e432 req-cdd6ab76-1b88-427d-9868-33ffdfb5d879 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053395 Jul 18 14:08:39.435789 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3423/7065] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:39.744925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:39.745455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:39.754124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:39.754618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:39.755462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:39.756017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:39.791962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:39.792425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:39.792893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lazy-loading 'fault' on Instance uuid ac7435d2-21bf-4024-b641-ec6a831f937f {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:08:39.847035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd5d97e14474ba382f36e874495650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6904d539a054af980cb21d230a17441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:39.850581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:39.861322 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-81bb0dad-01e8-4bc1-ae16-4d51e1ed9efc tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 200 len: 1307 microversion: 2.1 time: 0.121107 Jul 18 14:08:39.861932 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3643/7066] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:39 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:40.880193 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:40.881170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] [instance: ac7435d2-21bf-4024-b641-ec6a831f937f] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:40.889556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:40.890018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:40.890852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:40.891303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:40.906831 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] HTTP exception thrown: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Request method failure captured: Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f HTTP/1.1 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WlHhKBerKKGxjyrTDLW8F2wklT2OHP40hN9jTeCH3mOtK2Prqitp2lyyOJ_L-ClxOsOGzXkpRHo0bjgpFrbiWGacC5deqm3OdmzjF_oBdfn7m60MadBqR8GgJU2nN8sWMLiqlJ4onej2l-RBB4-kgPUq0XRMOuo-7MnffOHQR9120o Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a6904d539a054af980cb21d230a17441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a6904d539a054af980cb21d230a17441", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a6904d539a054af980cb21d230a17441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: a6904d539a054af980cb21d230a17441 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-559156154 Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 1fd5d97e14474ba382f36e874495650e Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-ServersNegativeTestJSON-559156154-project Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ac7435d2-21bf-4024-b641-ec6a831f937f'} Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:40.908540 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] Returning 404 to user: Instance ac7435d2-21bf-4024-b641-ec6a831f937f could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-70f3ec09-d958-468e-a93f-c017092bd163 tempest-ServersNegativeTestJSON-559156154 tempest-ServersNegativeTestJSON-559156154-project] 10.222.0.88 "GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f" status: 404 len: 111 microversion: 2.1 time: 0.034806 Jul 18 14:08:40.915664 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3424/7067] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:40 2022] GET /compute/v2.1/servers/ac7435d2-21bf-4024-b641-ec6a831f937f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:15.144978 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:15.309970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: .version_select at 0x7f96d7995ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1606687704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1TeOAfsj2AjCFBA1/bcPHijpq/OFR1CmtVnDi8CVl+OJ+AFHKOvR2crIkZrqFAjbcf+L3oKMG6kRd8MIcUWMq2khKg09xmxtPyZtIbG0flJlRQ5rWuVP6JYNaHfO8sFA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:15.324447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for project 466a1fc78be64601b7baeff998863762. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:09:15.330425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for user faadd0eb8f8447e5a94a24a07fac4439 and project 466a1fc78be64601b7baeff998863762. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:09:15.344332 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:09:16.352777 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37072. Jul 18 14:09:16.371798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-35aefbdd-0460-4c60-b72d-bc99dc028f7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.232192 Jul 18 14:09:16.374097 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3644/7068] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:09:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:16.434664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-481642783", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1606687704", "networks": [{"uuid": "512a99cf-ad95-4ab5-812a-40dcbb847d3e"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:16.448502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:16.449520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=26 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:16.499346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] validate_networks() for [('512a99cf-ad95-4ab5-812a-40dcbb847d3e', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:09:17.022393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:09:17.022872 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:09:17.023375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:09:17.023811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:09:17.024245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:09:17.036354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.036354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.036354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.036785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.057291 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for project 466a1fc78be64601b7baeff998863762. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:09:17.063358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for user faadd0eb8f8447e5a94a24a07fac4439 and project 466a1fc78be64601b7baeff998863762. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:09:17.076811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:09:17.079156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:09:17.125399 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cd6a32ef-b9f8-41d5-b7e7-88b42eb6b474 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695182 Jul 18 14:09:17.126069 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3425/7069] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:09:17.136389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-476f3bee-3b81-4ea0-963f-ae7ae59c0f75 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:17.137087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-476f3bee-3b81-4ea0-963f-ae7ae59c0f75 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:17.199109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-476f3bee-3b81-4ea0-963f-ae7ae59c0f75 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:17.207134 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-476f3bee-3b81-4ea0-963f-ae7ae59c0f75 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1262 microversion: 2.1 time: 0.075050 Jul 18 14:09:17.207761 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3645/7070] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:17 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:18.229885 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:18.233777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:18.247024 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.248423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.250078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.251187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.383784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:18.394696 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-df5662f5-f4a6-429c-b299-0ae6e5e87700 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1322 microversion: 2.1 time: 0.173220 Jul 18 14:09:18.395998 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3426/7071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:18 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:19.413792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:19.415087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:19.422091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.422786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.424116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.424713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.575507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:19.586715 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d6ac1dd0-97b3-4caa-bf5a-16a4b73c0af4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.175853 Jul 18 14:09:19.587379 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3646/7072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:19 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:19.809095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-520184e3-0db1-4a6a-ad33-85e3fba6d689 req-3801799b-91e9-430c-9fe8-fef0f87ca76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bc25eb-82c0-435c-972a-6a444a2d97e9", "tag": "ca39a0a2-41da-43f7-bbf8-a428ad17d63d"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:19.820290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-520184e3-0db1-4a6a-ad33-85e3fba6d689 req-3801799b-91e9-430c-9fe8-fef0f87ca76e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.820675 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-520184e3-0db1-4a6a-ad33-85e3fba6d689 req-3801799b-91e9-430c-9fe8-fef0f87ca76e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.843919 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-520184e3-0db1-4a6a-ad33-85e3fba6d689 req-3801799b-91e9-430c-9fe8-fef0f87ca76e service nova] Creating event network-changed:ca39a0a2-41da-43f7-bbf8-a428ad17d63d for instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 on n-h2-850003-3 Jul 18 14:09:19.851124 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-520184e3-0db1-4a6a-ad33-85e3fba6d689 req-3801799b-91e9-430c-9fe8-fef0f87ca76e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046955 Jul 18 14:09:19.851743 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3427/7073] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:20.605231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:20.605933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:20.615618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.616351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.617235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.617756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.781999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:20.790220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-956d3282-33fe-4e6f-a102-d7a2bf42328c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.188942 Jul 18 14:09:20.790810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3647/7074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:20 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:21.809592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:21.810831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:21.817364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:21.817778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:21.818655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:21.819107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:21.958565 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:21.966174 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae71e010-436c-4bdd-b847-32958561475a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.162110 Jul 18 14:09:21.966802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3428/7075] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:21 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:22.984051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:22.984687 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:22.993222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.993698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.994526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.994967 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.149579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:23.158817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-50faf944-1a9f-4550-96e4-c354aa69edd5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.179183 Jul 18 14:09:23.159409 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3648/7076] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:22 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:24.176049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:24.176680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:24.183335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.183808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.184591 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.185604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.317631 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:24.325526 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-da0fc059-5120-495e-a7fd-2424eb49468c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.153525 Jul 18 14:09:24.326239 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3429/7077] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:24 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:25.093602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7f51f590-6750-42c2-8b98-76e6a38690f1 req-019874a6-c321-420b-a71e-fdb8d4b48500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bc25eb-82c0-435c-972a-6a444a2d97e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca39a0a2-41da-43f7-bbf8-a428ad17d63d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:25.102061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7f51f590-6750-42c2-8b98-76e6a38690f1 req-019874a6-c321-420b-a71e-fdb8d4b48500 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.102467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7f51f590-6750-42c2-8b98-76e6a38690f1 req-019874a6-c321-420b-a71e-fdb8d4b48500 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.113868 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7f51f590-6750-42c2-8b98-76e6a38690f1 req-019874a6-c321-420b-a71e-fdb8d4b48500 service nova] Creating event network-vif-plugged:ca39a0a2-41da-43f7-bbf8-a428ad17d63d for instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 on n-h2-850003-3 Jul 18 14:09:25.119297 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7f51f590-6750-42c2-8b98-76e6a38690f1 req-019874a6-c321-420b-a71e-fdb8d4b48500 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110224 Jul 18 14:09:25.120025 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3649/7078] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:25.342877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:25.343506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:25.350649 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.351123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.351935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.352423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.490867 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:25.500690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49fec2a4-3538-49b0-a056-dd4bcdf3bf97 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1362 microversion: 2.1 time: 0.161903 Jul 18 14:09:25.501316 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3430/7079] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:25 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:26.519235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:26.519937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:26.526441 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.526886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.527647 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.528089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.666473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:26.674277 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-3373322d-f286-46d6-aa5a-ffd4b3cbc523 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1553 microversion: 2.1 time: 0.161040 Jul 18 14:09:26.674863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3650/7080] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:26 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:26.690651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:26.691284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:26.698380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.698857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.699653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.700108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.835594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:26.843771 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-452a48e0-e9e3-4af0-8772-e15adf4e4a8b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1553 microversion: 2.1 time: 0.156940 Jul 18 14:09:26.844379 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3431/7081] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:26 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:28.473225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:28.478415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69723616-8399-41d4-a5b0-6212be3e0046"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:28.479504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:28.486170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:28.486644 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:28.487425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:28.487871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:28.736489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0326145d-5068-468a-aa4d-48a2cc274fe9 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263647 Jul 18 14:09:28.737152 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3651/7082] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 14:09:28 2022] POST /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:39.434715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:39.435894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:39.438093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.438955 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.440697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.441418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=34 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.449151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.449625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.450458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.450916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.534604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lazy-loading 'services' on Instance uuid 86bc25eb-82c0-435c-972a-6a444a2d97e9 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:09:39.612126 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fe3dab94-ff32-4bda-b611-8051d0610db3 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments/69723616-8399-41d4-a5b0-6212be3e0046" status: 202 len: 0 microversion: 2.1 time: 0.180985 Jul 18 14:09:39.613116 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3432/7083] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:09:39 2022] DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments/69723616-8399-41d4-a5b0-6212be3e0046 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:09:39.623167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:39.624293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:39.627107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.627910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:39.635286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.635923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.636717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.637165 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.674336 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-15c58b18-74c3-40b3-b743-0a9522cb6d0a tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056392 Jul 18 14:09:39.675069 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3652/7084] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:39 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:40.688412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:40.689508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:40.696062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:40.696527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:40.697335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:40.697802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:40.729173 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ee4d3c2c-619c-442b-bad4-942991a4ad60 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Jul 18 14:09:40.729757 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3433/7085] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:40 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:41.753027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:41.753996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:41.761606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:41.762788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:41.763557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:41.764002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:41.797566 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-df91c3b2-00ca-4b09-af7b-18de3a1a3c92 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057687 Jul 18 14:09:41.798246 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3653/7086] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:41 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:42.810096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:42.811237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:42.818181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.818662 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.819489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.819924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.857565 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b958d5c2-9989-49e3-8339-20aaf5b0b5e7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051709 Jul 18 14:09:42.858499 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3434/7087] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:42 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:43.869206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:43.870315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:43.878619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.879158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.880031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.880537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.911333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fcc5862a-1542-4922-9b1a-1479a8719f74 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Jul 18 14:09:43.912022 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3654/7088] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:43 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:44.923214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.924166 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.931001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.931467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.932253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.932710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.964265 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-200c9b2b-f4b3-4e27-89c9-f9daca82c499 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045069 Jul 18 14:09:44.964868 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3435/7089] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:44 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:09:44.975022 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.975581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.982804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.983259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.984034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.984472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:45.073971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] HTTP exception thrown: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 is not attached to volume 69723616-8399-41d4-a5b0-6212be3e0046 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Request method failure captured: Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments/69723616-8399-41d4-a5b0-6212be3e0046 HTTP/1.1 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WmFWBgv6KZaafO5E-L2NhQjGEGrPM6p80SKvGSx77vb_0rkCGAS-oQ87KgR98R8UlCzQXjOUGR54BGUCob1z6Xj69ZeJZ-YrWaymBj8AUzwLgPE-e6kBfsAwuBVRdA4XSbRI6B_OstZdW-kSFX72PfQVof24ZUlyjbqGsYIh-ymBBg Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/466a1fc78be64601b7baeff998863762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_466a1fc78be64601b7baeff998863762", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: faadd0eb8f8447e5a94a24a07fac4439 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 is not attached to volume 69723616-8399-41d4-a5b0-6212be3e0046 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '86bc25eb-82c0-435c-972a-6a444a2d97e9', 'id': '69723616-8399-41d4-a5b0-6212be3e0046'} Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 69723616-8399-41d4-a5b0-6212be3e0046. Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 is not attached to volume 69723616-8399-41d4-a5b0-6212be3e0046 Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:45.094326 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 is not attached to volume 69723616-8399-41d4-a5b0-6212be3e0046 Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Returning 404 to user: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 is not attached to volume 69723616-8399-41d4-a5b0-6212be3e0046 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0fa5a58-da93-42d1-9748-f0c565cefe3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments/69723616-8399-41d4-a5b0-6212be3e0046" status: 404 len: 154 microversion: 2.1 time: 0.124985 Jul 18 14:09:45.099242 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3655/7090] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:09:44 2022] DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9/os-volume_attachments/69723616-8399-41d4-a5b0-6212be3e0046 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:48.449939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:48.451035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:48.458012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.458506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.459296 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.462372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.490800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:09:48.578764 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5e07dbf-b89b-4a5a-9697-5c33f687bc17 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 204 len: 0 microversion: 2.1 time: 0.132459 Jul 18 14:09:48.579841 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3436/7091] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:09:48 2022] DELETE /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:09:48.588865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:48.590472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:48.599208 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.600542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.601883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.602892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.779935 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:48.795590 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc9232d4-6ebd-4959-84b5-88a43cc036fb tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1559 microversion: 2.1 time: 0.210415 Jul 18 14:09:48.796665 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3656/7092] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:48 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:49.816775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:49.817497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:49.825273 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.826434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:49.827236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.827714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:49.987122 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:49.996867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-87f70154-851f-405c-8732-e4a217b92f3f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1559 microversion: 2.1 time: 0.184295 Jul 18 14:09:49.997511 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3437/7093] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:49 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:50.759498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e1dabd5b-cb29-4491-8941-4104f97085d7 req-09bbacd2-817f-444b-a19c-d3bf88e28f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bc25eb-82c0-435c-972a-6a444a2d97e9", "name": "network-vif-deleted", "tag": "ca39a0a2-41da-43f7-bbf8-a428ad17d63d"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:50.772068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1dabd5b-cb29-4491-8941-4104f97085d7 req-09bbacd2-817f-444b-a19c-d3bf88e28f43 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:50.772651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1dabd5b-cb29-4491-8941-4104f97085d7 req-09bbacd2-817f-444b-a19c-d3bf88e28f43 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:50.786549 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e1dabd5b-cb29-4491-8941-4104f97085d7 req-09bbacd2-817f-444b-a19c-d3bf88e28f43 service nova] Creating event network-vif-deleted:ca39a0a2-41da-43f7-bbf8-a428ad17d63d for instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 on n-h2-850003-3 Jul 18 14:09:50.793182 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e1dabd5b-cb29-4491-8941-4104f97085d7 req-09bbacd2-817f-444b-a19c-d3bf88e28f43 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Jul 18 14:09:50.794617 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3657/7094] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:51.015917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:51.016467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:51.023813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:51.024284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.025082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:51.025544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.060327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:51.060799 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.061344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lazy-loading 'fault' on Instance uuid 86bc25eb-82c0-435c-972a-6a444a2d97e9 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:09:51.105388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:51.113816 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9195c271-08aa-4621-8f46-2ca948b280da tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 200 len: 1352 microversion: 2.1 time: 0.101956 Jul 18 14:09:51.114452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3438/7095] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:51 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:52.133293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:52.134003 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 86bc25eb-82c0-435c-972a-6a444a2d97e9] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:52.141389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.141849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.142815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.143263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.159662 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] HTTP exception thrown: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Request method failure captured: Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 HTTP/1.1 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WmFWBgv6KZaafO5E-L2NhQjGEGrPM6p80SKvGSx77vb_0rkCGAS-oQ87KgR98R8UlCzQXjOUGR54BGUCob1z6Xj69ZeJZ-YrWaymBj8AUzwLgPE-e6kBfsAwuBVRdA4XSbRI6B_OstZdW-kSFX72PfQVof24ZUlyjbqGsYIh-ymBBg Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/466a1fc78be64601b7baeff998863762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_466a1fc78be64601b7baeff998863762", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: faadd0eb8f8447e5a94a24a07fac4439 Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '86bc25eb-82c0-435c-972a-6a444a2d97e9'} Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:52.161334 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Returning 404 to user: Instance 86bc25eb-82c0-435c-972a-6a444a2d97e9 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ffed3b0b-bb3b-45b2-9172-6aa6df532c9f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9" status: 404 len: 111 microversion: 2.1 time: 0.033902 Jul 18 14:09:52.166045 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3658/7096] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:52 2022] GET /compute/v2.1/servers/86bc25eb-82c0-435c-972a-6a444a2d97e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:52.172147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7e7b40f5-93e7-4d2d-8790-200bf823bcef tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '.version_select at 0x7f96d4247820>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:52.193042 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7e7b40f5-93e7-4d2d-8790-200bf823bcef tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1606687704" status: 202 len: 0 microversion: 2.1 time: 0.025294 Jul 18 14:09:52.193636 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3439/7097] 10.222.0.88 () {58 vars in 1277 bytes} [Mon Jul 18 14:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1606687704 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:09:52.214859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73133f94-76b5-4272-8d6e-bc3067ad9b6b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: .version_select at 0x7f96e4140670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-157576545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIpSo20ergp5mAwGAqAVPkL/2xsu2X3xemOh2c1vQwn9HCO0EQhesAhHQqchfBbrc+ElJOJJ+7YWX26K3yM6wYho1TTv68VBlU9CdRf9VkuqIm6QHmMPYl3IponwI7jHQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:52.229424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-73133f94-76b5-4272-8d6e-bc3067ad9b6b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for project 466a1fc78be64601b7baeff998863762. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:09:52.235483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-73133f94-76b5-4272-8d6e-bc3067ad9b6b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for user faadd0eb8f8447e5a94a24a07fac4439 and project 466a1fc78be64601b7baeff998863762. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:09:52.259807 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73133f94-76b5-4272-8d6e-bc3067ad9b6b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048969 Jul 18 14:09:52.260412 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3659/7098] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:09:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:52.309258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1779339799", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-157576545", "networks": [{"uuid": "512a99cf-ad95-4ab5-812a-40dcbb847d3e"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:52.361233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] validate_networks() for [('512a99cf-ad95-4ab5-812a-40dcbb847d3e', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:09:52.737734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:09:52.738207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:09:52.738710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:09:52.739143 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:09:52.739572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:09:52.748819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.749305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.750139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.750627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.767880 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for project 466a1fc78be64601b7baeff998863762. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:09:52.773346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Getting quotas for user faadd0eb8f8447e5a94a24a07fac4439 and project 466a1fc78be64601b7baeff998863762. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:09:52.787075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:09:52.789401 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:09:52.834811 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6e7312d2-d7ee-49ff-b85f-a45bf6e81689 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529433 Jul 18 14:09:52.835477 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3440/7099] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:09:52.846183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-09d6c02e-fde0-47b9-aa0a-cd48d4d593dc tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:52.846929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-09d6c02e-fde0-47b9-aa0a-cd48d4d593dc tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:52.901481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-09d6c02e-fde0-47b9-aa0a-cd48d4d593dc tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:52.910363 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-09d6c02e-fde0-47b9-aa0a-cd48d4d593dc tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1262 microversion: 2.1 time: 0.068867 Jul 18 14:09:52.910972 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3660/7100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:52 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:53.928952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:53.929594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:53.937345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.937828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:53.938825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.939292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:54.017696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:54.025797 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c064d79-b194-449d-9aa7-114e537483b5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1320 microversion: 2.1 time: 0.101974 Jul 18 14:09:54.026437 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3441/7101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:53 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1320 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:55.045898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:55.046629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:55.053705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.054297 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.055158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.055604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.176184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-025e34e7-d667-4765-b8f4-b4305490215c req-621ff03f-5de8-40cd-b26d-1c55947b711e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141", "tag": "9828a244-ffbd-43d4-b84c-6d5dacf2fc72"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:55.194266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-025e34e7-d667-4765-b8f4-b4305490215c req-621ff03f-5de8-40cd-b26d-1c55947b711e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.199414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-025e34e7-d667-4765-b8f4-b4305490215c req-621ff03f-5de8-40cd-b26d-1c55947b711e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.211578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:55.220471 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-025e34e7-d667-4765-b8f4-b4305490215c req-621ff03f-5de8-40cd-b26d-1c55947b711e service nova] Creating event network-changed:9828a244-ffbd-43d4-b84c-6d5dacf2fc72 for instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 on n-h2-850003-3 Jul 18 14:09:55.225952 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-025e34e7-d667-4765-b8f4-b4305490215c req-621ff03f-5de8-40cd-b26d-1c55947b711e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059103 Jul 18 14:09:55.226650 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3442/7102] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:55.229477 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9a552f45-3c9f-4ab1-a57b-b35a30463936 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.187908 Jul 18 14:09:55.230100 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3661/7103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:55 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:56.249446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:56.250338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:56.257490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:56.257957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:56.258882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:56.259389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:56.400802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:56.409431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8be6f188-6840-4413-baae-359cc85e7571 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.165707 Jul 18 14:09:56.409951 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3443/7104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:56 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:57.426355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:57.426997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:57.433702 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:57.434174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.435598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:57.436033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.567775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:57.575354 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05374da8-83de-46be-aa90-e7ce5b05a990 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.153035 Jul 18 14:09:57.575934 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3662/7105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:57 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:58.593046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:58.593670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:58.601206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.601668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.602497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.602947 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.743123 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:58.751808 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-33ef4200-9287-47c8-b0a3-271496be8645 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.162758 Jul 18 14:09:58.752440 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3444/7106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:58 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:59.772388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:59.773092 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:59.785633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.786076 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.786877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.787323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.928784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:59.938000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a8bce579-fb5e-436c-89a1-6996bcb4200c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.172339 Jul 18 14:09:59.938709 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3663/7107] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:59 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:00.955328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:00.956566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:00.963652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.964112 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.964889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.965338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.102861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:01.110791 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-72d78052-d5cb-49cf-b525-1795b99d4c7c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.159427 Jul 18 14:10:01.111410 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3445/7108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:00 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:01.182614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fab35054-49a3-4330-858c-5e129cddb19a req-6bba3db1-d5ad-48a5-93c7-23956c24a0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141", "name": "network-vif-plugged", "status": "completed", "tag": "9828a244-ffbd-43d4-b84c-6d5dacf2fc72"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:01.192968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fab35054-49a3-4330-858c-5e129cddb19a req-6bba3db1-d5ad-48a5-93c7-23956c24a0b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.193668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fab35054-49a3-4330-858c-5e129cddb19a req-6bba3db1-d5ad-48a5-93c7-23956c24a0b7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.206191 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fab35054-49a3-4330-858c-5e129cddb19a req-6bba3db1-d5ad-48a5-93c7-23956c24a0b7 service nova] Creating event network-vif-plugged:9828a244-ffbd-43d4-b84c-6d5dacf2fc72 for instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 on n-h2-850003-3 Jul 18 14:10:01.211147 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fab35054-49a3-4330-858c-5e129cddb19a req-6bba3db1-d5ad-48a5-93c7-23956c24a0b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Jul 18 14:10:01.211783 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3664/7109] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:10:02.128064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:02.128677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:02.135847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.136247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.137046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.137500 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.292755 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:02.301360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3fe7b7ef-fab8-4060-866e-41b80dbdbfec tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1362 microversion: 2.1 time: 0.177194 Jul 18 14:10:02.301980 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3446/7110] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:02 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:03.315659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:03.319921 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:03.320629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:03.327372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.327832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.328608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.329050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.465903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:03.475794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c03194d6-9d1c-4cba-892f-4afeb310f66e tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1553 microversion: 2.1 time: 0.161931 Jul 18 14:10:03.476298 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3665/7111] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:03 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:03.492697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:03.493341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:03.495398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:03.496288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:03.503686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.504146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.504923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.505369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.638090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:03.645821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c974d19-81ba-494b-a5c0-2878ea140d79 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1553 microversion: 2.1 time: 0.157058 Jul 18 14:10:03.646441 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3447/7112] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:03 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:05.121773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "884c7ff1-9bd9-4f82-ae63-ddce52288955"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:05.123084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:05.129824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.130332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.131108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.131551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.376529 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc0e0642-7e5d-4e5c-becf-38cf320cb782 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "POST /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258427 Jul 18 14:10:05.377076 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3666/7113] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 14:10:05 2022] POST /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:16.090197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:16.090709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:16.093901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.094724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.100964 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.101430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.102236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.102685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.187380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lazy-loading 'services' on Instance uuid 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:10:16.266961 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-79f76412-4c2c-496c-aed0-0808da2a079c tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments/884c7ff1-9bd9-4f82-ae63-ddce52288955" status: 202 len: 0 microversion: 2.1 time: 0.180460 Jul 18 14:10:16.268034 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3448/7114] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:10:16 2022] DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments/884c7ff1-9bd9-4f82-ae63-ddce52288955 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:10:16.276980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.277762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.283278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:16.284306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:16.294391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.295620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.296435 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.297309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.331444 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c063efb5-44a5-4d3b-ac24-dbe46c8a2857 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056366 Jul 18 14:10:16.332040 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3667/7115] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:16 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:17.349328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:17.350406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:17.356882 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.357345 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.358181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.358640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.390486 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-76b09e3d-1b7e-4c45-a201-127aec7f6dea tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050124 Jul 18 14:10:17.391071 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3449/7116] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:17 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:18.402988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:18.403934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:18.412045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.412497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.413265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.413913 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.446062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c3317376-d65d-4e89-bb75-db115168c94f tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Jul 18 14:10:18.446676 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3668/7117] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:18 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:10:19.458260 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:19.459236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:19.468148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.468718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:19.469654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.470167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:19.503005 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8e154262-ba99-41c1-addc-4445da098796 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049605 Jul 18 14:10:19.503598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3450/7118] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:19 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:20.515616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:20.517189 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:20.524748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:20.525194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:20.525995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:20.526497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:20.559448 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-33d06d00-486e-4017-bb19-59e67054d281 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048523 Jul 18 14:10:20.560073 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3669/7119] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:20 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:21.572681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:21.574026 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:21.581945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.582444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.583248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.583707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.616485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e1148405-8633-417b-bef5-1d8c55457cf7 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049808 Jul 18 14:10:21.617060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3451/7120] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:10:21 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:10:21.628260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:21.628792 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:21.636049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.636503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.637292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.637732 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.725351 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] HTTP exception thrown: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 is not attached to volume 884c7ff1-9bd9-4f82-ae63-ddce52288955 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Request method failure captured: Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments/884c7ff1-9bd9-4f82-ae63-ddce52288955 HTTP/1.1 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WmFWBgv6KZaafO5E-L2NhQjGEGrPM6p80SKvGSx77vb_0rkCGAS-oQ87KgR98R8UlCzQXjOUGR54BGUCob1z6Xj69ZeJZ-YrWaymBj8AUzwLgPE-e6kBfsAwuBVRdA4XSbRI6B_OstZdW-kSFX72PfQVof24ZUlyjbqGsYIh-ymBBg Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/466a1fc78be64601b7baeff998863762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_466a1fc78be64601b7baeff998863762", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: faadd0eb8f8447e5a94a24a07fac4439 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 is not attached to volume 884c7ff1-9bd9-4f82-ae63-ddce52288955 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': '0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141', 'id': '884c7ff1-9bd9-4f82-ae63-ddce52288955'} Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 884c7ff1-9bd9-4f82-ae63-ddce52288955. Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 is not attached to volume 884c7ff1-9bd9-4f82-ae63-ddce52288955 Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:21.727005 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 is not attached to volume 884c7ff1-9bd9-4f82-ae63-ddce52288955 Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Returning 404 to user: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 is not attached to volume 884c7ff1-9bd9-4f82-ae63-ddce52288955 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-79c757f4-0a4e-4a60-9423-fe2e434bf4e8 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments/884c7ff1-9bd9-4f82-ae63-ddce52288955" status: 404 len: 154 microversion: 2.1 time: 0.104939 Jul 18 14:10:21.735420 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3670/7121] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:10:21 2022] DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141/os-volume_attachments/884c7ff1-9bd9-4f82-ae63-ddce52288955 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:10:25.124869 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:25.125424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:25.134185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.134652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.135671 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.136127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.169332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:10:25.266602 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93343555-8a21-40e2-a214-c876e6cb73d4 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 204 len: 0 microversion: 2.1 time: 0.145125 Jul 18 14:10:25.271833 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3452/7122] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:10:25 2022] DELETE /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:10:25.277977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:25.280011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:25.289081 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.290632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.291615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.292454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.480876 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:25.494591 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a019cac-7f6d-484a-bfd9-412b739e58d5 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1559 microversion: 2.1 time: 0.220886 Jul 18 14:10:25.495734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3671/7123] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:25 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:26.515783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:26.516512 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:26.524589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:26.525102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:26.526003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:26.526532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:26.684901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:26.693905 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4e9c0fd7-c62c-4719-a451-6a7a69082e7b tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1559 microversion: 2.1 time: 0.182908 Jul 18 14:10:26.694569 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3453/7124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:26 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:27.571316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e1c4bbde-7eb6-47cc-ae42-d0562c8bcebb req-9f8d20e4-836b-404d-b13d-e37f677eec1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141", "name": "network-vif-deleted", "tag": "9828a244-ffbd-43d4-b84c-6d5dacf2fc72"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:27.590493 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1c4bbde-7eb6-47cc-ae42-d0562c8bcebb req-9f8d20e4-836b-404d-b13d-e37f677eec1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.590945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e1c4bbde-7eb6-47cc-ae42-d0562c8bcebb req-9f8d20e4-836b-404d-b13d-e37f677eec1a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:27.604114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e1c4bbde-7eb6-47cc-ae42-d0562c8bcebb req-9f8d20e4-836b-404d-b13d-e37f677eec1a service nova] Creating event network-vif-deleted:9828a244-ffbd-43d4-b84c-6d5dacf2fc72 for instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 on n-h2-850003-3 Jul 18 14:10:27.609920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e1c4bbde-7eb6-47cc-ae42-d0562c8bcebb req-9f8d20e4-836b-404d-b13d-e37f677eec1a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042161 Jul 18 14:10:27.610821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3672/7125] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:27.711228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:27.711891 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:27.719927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.720583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:27.721462 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.721887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:27.755850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.756340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:27.756796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lazy-loading 'fault' on Instance uuid 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:10:28.160538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faadd0eb8f8447e5a94a24a07fac4439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466a1fc78be64601b7baeff998863762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:28.167603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-617b37bb-a212-4cf2-b7ec-5979d4df71ba tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 200 len: 1352 microversion: 2.1 time: 0.460477 Jul 18 14:10:28.168179 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3454/7126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:27 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 1352 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:29.186181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:29.187093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] [instance: 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:29.193564 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:29.194026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:29.194891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:29.195469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:29.209650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] HTTP exception thrown: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Request method failure captured: Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 HTTP/1.1 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WmFWBgv6KZaafO5E-L2NhQjGEGrPM6p80SKvGSx77vb_0rkCGAS-oQ87KgR98R8UlCzQXjOUGR54BGUCob1z6Xj69ZeJZ-YrWaymBj8AUzwLgPE-e6kBfsAwuBVRdA4XSbRI6B_OstZdW-kSFX72PfQVof24ZUlyjbqGsYIh-ymBBg Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/466a1fc78be64601b7baeff998863762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_466a1fc78be64601b7baeff998863762", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/466a1fc78be64601b7baeff998863762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 466a1fc78be64601b7baeff998863762 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1031964896 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: faadd0eb8f8447e5a94a24a07fac4439 Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestEncryptedCinderVolumes-1031964896-project Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141'} Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:29.211346 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Returning 404 to user: Instance 0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b321add7-a936-4e78-addb-8066d9b01e85 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141" status: 404 len: 111 microversion: 2.1 time: 0.031869 Jul 18 14:10:29.216312 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3673/7127] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:29 2022] GET /compute/v2.1/servers/0ad4d7d0-4993-4f5a-a23e-a1fc3e73f141 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:10:29.222587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8d761da1-d00f-49f4-b3bf-5cfca55350f6 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] Calling method '.version_select at 0x7f96d77a8310>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:29.243629 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8d761da1-d00f-49f4-b3bf-5cfca55350f6 tempest-TestEncryptedCinderVolumes-1031964896 tempest-TestEncryptedCinderVolumes-1031964896-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-157576545" status: 202 len: 0 microversion: 2.1 time: 0.025419 Jul 18 14:10:29.244245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3455/7128] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 14:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-157576545 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:10:56.210061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b5a4d782-6a6a-4d69-8e3f-4170cf8569b0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: .version_select at 0x7f96e4140c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1508591421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKUEqlqh7g1icjB0g3sVsfPPhHlqD8Z1pITatBlFgs14+zcfVHEyPHZSfIl8CTGv3Fiqjeekw09PcFtDaWxgPyoUWIMCQ9vcZpWKvmLkbx5FMUIQTUkZhvJxjq4GfF+XA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:56.214262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.214915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.227164 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b5a4d782-6a6a-4d69-8e3f-4170cf8569b0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:10:56.233110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-b5a4d782-6a6a-4d69-8e3f-4170cf8569b0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for user a7fb5b01f9824279be3d0c58e027ebde and project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:10:56.260473 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b5a4d782-6a6a-4d69-8e3f-4170cf8569b0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054668 Jul 18 14:10:56.261091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3674/7129] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:10:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:56.307915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.308713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.313658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1980709042", "imageRef": "ce1f2bae-477a-47a9-8e8a-606d7e65d601", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1508591421", "networks": [{"uuid": "4288b10e-6213-413a-8b5f-ac74f6de6797"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:56.369313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] validate_networks() for [('4288b10e-6213-413a-8b5f-ac74f6de6797', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:10:56.757389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:10:56.757824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:10:56.758342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:10:56.758764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:10:56.759187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:10:56.769190 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.769655 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.770535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.770990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.789018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:10:56.794663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for user a7fb5b01f9824279be3d0c58e027ebde and project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:10:56.806910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:10:56.809106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce1f2bae-477a-47a9-8e8a-606d7e65d601',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:10:56.854605 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fd22ece-c1b7-42bc-a39b-6b99ea8ce64b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548570 Jul 18 14:10:56.855264 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3456/7130] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:10:56.865772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-411197a1-4520-49d4-bfbc-0572f4ac8f51 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:56.866428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-411197a1-4520-49d4-bfbc-0572f4ac8f51 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:56.924004 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-411197a1-4520-49d4-bfbc-0572f4ac8f51 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:56.930971 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-411197a1-4520-49d4-bfbc-0572f4ac8f51 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1259 microversion: 2.1 time: 0.069315 Jul 18 14:10:56.931564 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3675/7131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:56 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:57.545351 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:10:57.546002 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:10:57.949741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:57.951044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:57.959187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.959656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:57.960455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.960908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:58.053981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:58.071340 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a64a2901-d33a-4673-8f42-a77104525c75 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1329 microversion: 2.1 time: 0.125775 Jul 18 14:10:58.081574 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3457/7132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:57 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1329 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:59.090579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:59.091212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:59.102612 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:59.103320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:59.104542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:59.105245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:59.332428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:59.340908 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ca77cf82-f826-4a1a-ba7c-da694e313ca5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.254436 Jul 18 14:10:59.343056 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3676/7133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:59 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:00.361641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:00.362307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:00.368489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.368957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.369748 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.370231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.534174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:00.542510 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1125a94-8b32-43ee-9f1b-f3f5d8927932 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.186286 Jul 18 14:11:00.543211 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3458/7134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:00 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:01.560838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:01.561672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:01.569031 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.569473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.570277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.570707 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.717179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:01.726562 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f69f581b-d1bd-49aa-9010-9dd1d53316a4 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.169514 Jul 18 14:11:01.727165 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3677/7135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:01 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:02.744423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:02.745350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:02.752650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:02.753119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:02.753940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:02.754431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:02.887644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:02.897807 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e60ee125-1e0e-4455-aa4e-962d14d346be tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.157513 Jul 18 14:11:02.908951 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3459/7136] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:02 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:03.915919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:03.916658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:03.924854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.925424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:03.926334 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.926839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:04.075848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:04.090385 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-49ee282d-d387-42a3-9a92-ca20a8ee49db tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.178036 Jul 18 14:11:04.090987 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3678/7137] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:03 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:05.108912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:05.111351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:05.120094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.120553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.121351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.121812 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.312958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:05.321172 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9768cb87-0081-4b47-9895-ef1077859dc7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.217415 Jul 18 14:11:05.321763 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3460/7138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:05 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:06.338821 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:06.339463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:06.347033 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.347494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:06.348276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.348724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:06.493770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:06.502513 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b8cbda07-8911-4149-8336-d819d7d7b2a9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.167662 Jul 18 14:11:06.512028 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3679/7139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:06 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:07.522844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:07.523654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:07.533121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:07.534091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:07.536572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.537176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.538000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.538490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.677241 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:07.684910 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3aa0e8fe-7974-4ea8-a930-3b0a3cede98d tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.168093 Jul 18 14:11:07.685516 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3461/7140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:07 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:08.701968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:08.702679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:08.704552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:08.710740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.711192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:08.711963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.712411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:08.845323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:08.853227 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea43e8e5-88a4-4ce5-a40e-03f9a3c33fa7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.155172 Jul 18 14:11:08.853812 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3680/7141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:08 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:09.876589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:09.877806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:09.888317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:09.889107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:09.890808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:09.891384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:10.033210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:10.040880 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4edd2bde-3fd1-4780-a9e9-f4c9519358ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.172528 Jul 18 14:11:10.041459 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3462/7142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:09 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:10.979452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-c0d91820-1322-497b-973c-26f690d1ee45 req-88612b29-f446-4e72-8762-8af6fa484dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:10.989796 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c0d91820-1322-497b-973c-26f690d1ee45 req-88612b29-f446-4e72-8762-8af6fa484dac service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:10.990268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-c0d91820-1322-497b-973c-26f690d1ee45 req-88612b29-f446-4e72-8762-8af6fa484dac service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.005011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-c0d91820-1322-497b-973c-26f690d1ee45 req-88612b29-f446-4e72-8762-8af6fa484dac service nova] Creating event network-changed:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:11:11.010266 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-c0d91820-1322-497b-973c-26f690d1ee45 req-88612b29-f446-4e72-8762-8af6fa484dac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035182 Jul 18 14:11:11.011472 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3681/7143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:11.058726 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:11.060053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:11.067620 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.068155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.069427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.070099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.305709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:11.313560 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-98624c38-5cda-44bc-8d77-dd79b27cee40 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.259190 Jul 18 14:11:11.314173 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3463/7144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:11 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:12.332009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:12.332748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:12.339144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:12.339598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:12.340365 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:12.341128 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:12.473948 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:12.481648 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-42964d4f-4d13-4df0-8e1a-58c5aaf1a3f6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.154835 Jul 18 14:11:12.482244 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3682/7145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:12 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:13.500588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:13.501146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:13.508233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:13.508701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:13.509493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:13.509957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:13.644470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:13.652089 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8951f273-3ab5-436c-8c87-df18f55641ff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.156127 Jul 18 14:11:13.652695 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3464/7146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:13 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:14.669264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:14.669871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:14.677233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:14.677675 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:14.678450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:14.678883 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:14.810445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:14.817924 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4082ddf0-870b-404e-ab0c-38ba5be91f49 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.152551 Jul 18 14:11:14.818558 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3683/7147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:14 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:15.835042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:15.835696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:15.842478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:15.843595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:15.844407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:15.844853 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:15.977977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:15.985639 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-32679f90-d323-4221-b99b-0e51fbf275b3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.154759 Jul 18 14:11:15.986258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3465/7148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:15 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:17.003156 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:17.003762 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:17.010842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:17.011289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:17.012051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:17.012486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:17.146114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:17.153913 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ae42683e-8e6e-4f5a-bc39-976b671631ee tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.155360 Jul 18 14:11:17.154536 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3684/7149] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:16 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:17.883815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-baf8cbd6-7abc-4d0c-86f4-f8609dddb6fe req-01f736cf-dab8-49f3-a865-b0933c857772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "name": "network-vif-plugged", "status": "completed", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:17.895160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-baf8cbd6-7abc-4d0c-86f4-f8609dddb6fe req-01f736cf-dab8-49f3-a865-b0933c857772 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:17.895774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-baf8cbd6-7abc-4d0c-86f4-f8609dddb6fe req-01f736cf-dab8-49f3-a865-b0933c857772 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:17.910485 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-baf8cbd6-7abc-4d0c-86f4-f8609dddb6fe req-01f736cf-dab8-49f3-a865-b0933c857772 service nova] Creating event network-vif-plugged:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:11:17.915855 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-baf8cbd6-7abc-4d0c-86f4-f8609dddb6fe req-01f736cf-dab8-49f3-a865-b0933c857772 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036420 Jul 18 14:11:17.916711 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3466/7150] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:18.171869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:18.172497 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:18.179609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:18.180064 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:18.180845 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:18.181284 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:18.315586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:18.323368 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d62dd5e0-5389-471d-bb1c-d8e2d149e818 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.156111 Jul 18 14:11:18.323949 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3685/7151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:18 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:19.341094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:19.341787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:19.349034 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:19.349549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:19.350341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:19.350802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:19.485447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:19.493068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-864bcd31-245a-4f1f-b16e-29a35696f3ac tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1359 microversion: 2.1 time: 0.156381 Jul 18 14:11:19.493662 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3467/7152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:19 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:20.511244 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:20.511780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:20.519068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.519526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.520338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.520782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.657227 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:20.664974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36777461-ba25-41f7-bf20-577a7cfee099 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1547 microversion: 2.1 time: 0.157776 Jul 18 14:11:20.665475 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3686/7153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:20 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:20.681589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:20.682250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:20.689303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.689767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.690580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.691035 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.820745 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:20.828990 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b2d2d159-3a67-4c9c-9297-d3ba04d046ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1547 microversion: 2.1 time: 0.151319 Jul 18 14:11:20.829572 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3468/7154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:20 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:20.844908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:20.848258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:20.849050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Searching by: {'deleted': False, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 14:11:20.854475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.854927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.855710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.856147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.881753 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 14:11:20.908826 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8567a54-9f51-4d40-addd-b7280708fefa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067774 Jul 18 14:11:20.909416 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3687/7155] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 14:11:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:20.919657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:20.920316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:20.926551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.927017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.927798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.928249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:21.061404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:21.069653 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd6255f8-c3ce-4f1e-a21c-b1fb9e3fdc6c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1547 microversion: 2.1 time: 0.153803 Jul 18 14:11:21.070254 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3469/7156] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:20 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:22.588660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d83e0276-3cb7-4a26-8e16-7fffc0ebe33c"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:22.589734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:22.597571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:22.598021 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:22.598833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:22.599276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:22.855647 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a090d324-2c22-4a76-9eb0-8c7b552181bb tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270848 Jul 18 14:11:22.856288 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3688/7157] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 14:11:22 2022] POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:35.841267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:35.841981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:35.845334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:35.846200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=76 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:35.853044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:35.853506 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:35.854431 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:35.854887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:35.990070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:35.998553 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-49097999-fcf7-45ca-a30c-3a31db8d0e8f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1593 microversion: 2.1 time: 0.161666 Jul 18 14:11:35.999146 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3470/7158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:35 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:38.001719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:38.002620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:38.003228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:38.198763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-a1e6c994-8ce5-4dfb-8f01-b2bbaf9a0603 req-34d92ec5-088f-4744-86cc-3d1ad1b431c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:38.208781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a1e6c994-8ce5-4dfb-8f01-b2bbaf9a0603 req-34d92ec5-088f-4744-86cc-3d1ad1b431c1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:38.209392 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-a1e6c994-8ce5-4dfb-8f01-b2bbaf9a0603 req-34d92ec5-088f-4744-86cc-3d1ad1b431c1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:38.223817 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-a1e6c994-8ce5-4dfb-8f01-b2bbaf9a0603 req-34d92ec5-088f-4744-86cc-3d1ad1b431c1 service nova] Creating event network-changed:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:11:38.231292 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-a1e6c994-8ce5-4dfb-8f01-b2bbaf9a0603 req-34d92ec5-088f-4744-86cc-3d1ad1b431c1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235156 Jul 18 14:11:38.232308 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3689/7159] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:39.171080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1978338189"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:39.172794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:39.179949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.180468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.181258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.181707 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.320060 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Adding security group 3afd7c40-9910-4ffd-b415-fa83e183a947 to port df6de496-7cb6-4f8d-b631-504cc5cbf28c Jul 18 14:11:39.679249 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8f562230-263b-4ea6-aa15-5685d29f2876 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action" status: 202 len: 0 microversion: 2.1 time: 0.512600 Jul 18 14:11:39.682747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3471/7160] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:11:39 2022] POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:11:39.687806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-e7fee7e1-b5f7-4e52-b9ec-58a26ea72b16 req-7ad68271-b01c-435e-af24-4334a9fa9406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:39.690302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:39.690935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:39.697270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.697731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.698751 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.699203 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.715207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e7fee7e1-b5f7-4e52-b9ec-58a26ea72b16 req-7ad68271-b01c-435e-af24-4334a9fa9406 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.715988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-e7fee7e1-b5f7-4e52-b9ec-58a26ea72b16 req-7ad68271-b01c-435e-af24-4334a9fa9406 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.736632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-e7fee7e1-b5f7-4e52-b9ec-58a26ea72b16 req-7ad68271-b01c-435e-af24-4334a9fa9406 service nova] Creating event network-changed:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:11:39.742308 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-e7fee7e1-b5f7-4e52-b9ec-58a26ea72b16 req-7ad68271-b01c-435e-af24-4334a9fa9406 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062272 Jul 18 14:11:39.743061 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3690/7161] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:40.332299 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:40.341139 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5cd9d8b7-a014-4428-a1a0-4d2937c95247 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1759 microversion: 2.1 time: 0.656541 Jul 18 14:11:40.341852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3472/7162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:39 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1759 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:13:52.681319 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 14:13:52.682173 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:13:52.682775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:52.683530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:52.688355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:52.689482 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:52.697915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:52.698463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:52.699823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:52.700550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:52.781500 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [f9cd522c-4ab7-4905-af9d-0312d6f26b97] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:13:53.689441 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37764. Jul 18 14:13:53.690964 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37766. Jul 18 14:13:53.788215 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [f9cd522c-4ab7-4905-af9d-0312d6f26b97] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37768. Jul 18 14:13:53.792025 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc32de0d-996a-4080-af06-cd37f82240d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action" status: 202 len: 0 microversion: 2.1 time: 1.112478 Jul 18 14:13:53.792814 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3691/7163] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:13:52 2022] POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:13:53.799506 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:13:53.800922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:53.801600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:53.806797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:53.807386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:53.815090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:53.815547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:53.816360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:53.816819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:54.131889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:54.140688 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1b4c9a98-e3fc-4148-b833-3c8837a6e451 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1761 microversion: 2.1 time: 0.343510 Jul 18 14:13:54.141303 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3473/7164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:53 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1761 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:55.161147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:55.162713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:55.173506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:55.175295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:55.175868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:55.177194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:55.389134 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:55.397297 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e182e26-fc34-451c-a2b0-961f4f5543b7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1759 microversion: 2.1 time: 0.242049 Jul 18 14:13:55.397863 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3692/7165] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:55 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1759 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:17.554056 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:14:17.555352 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:14:36.812312 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:14:36.812918 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:15:39.307270 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:15:39.308580 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:39.309346 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:39.313731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1978338189"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:39.314315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:39.322921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.323436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.324173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.325534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.331166 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37814. Jul 18 14:15:39.460208 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Removing security group 3afd7c40-9910-4ffd-b415-fa83e183a947 from port df6de496-7cb6-4f8d-b631-504cc5cbf28c Jul 18 14:15:39.806567 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-78994e28-a1ed-458d-894f-60cb27387705 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action" status: 202 len: 0 microversion: 2.1 time: 0.500848 Jul 18 14:15:39.810791 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3474/7166] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:39 2022] POST /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:39.826917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:39.827915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:39.969711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0c4e9c00-aebc-4092-b877-9bd04fad2629 req-f5646b65-29b5-4ebd-92e5-04f395aa179b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:39.986320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0c4e9c00-aebc-4092-b877-9bd04fad2629 req-f5646b65-29b5-4ebd-92e5-04f395aa179b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.990451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0c4e9c00-aebc-4092-b877-9bd04fad2629 req-f5646b65-29b5-4ebd-92e5-04f395aa179b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.009264 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0c4e9c00-aebc-4092-b877-9bd04fad2629 req-f5646b65-29b5-4ebd-92e5-04f395aa179b service nova] Creating event network-changed:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:15:40.016712 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0c4e9c00-aebc-4092-b877-9bd04fad2629 req-f5646b65-29b5-4ebd-92e5-04f395aa179b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202591 Jul 18 14:15:40.023110 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3693/7167] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:41.669573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:41.670138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:41.679832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.680317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.681105 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.681560 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.685778 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37838. Jul 18 14:15:41.766681 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lazy-loading 'services' on Instance uuid 3c81e2c3-caa2-4f24-a840-78ec87feb225 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:41.841285 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3e11b68d-1cc6-4dc0-a710-7a1fa1f732e5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments/d83e0276-3cb7-4a26-8e16-7fffc0ebe33c" status: 202 len: 0 microversion: 2.1 time: 0.176832 Jul 18 14:15:41.842294 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3475/7168] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:15:41 2022] DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments/d83e0276-3cb7-4a26-8e16-7fffc0ebe33c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:41.852343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:41.853451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:41.860765 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.861726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.862740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.863452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.895943 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-82c3635d-273f-431c-a1e5-fc7d73ebd984 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048970 Jul 18 14:15:41.896633 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3694/7169] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:41 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:42.035811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-deb2c502-2adb-452b-87c4-eb6b2f77896d req-1faf4ecc-7a7c-4a34-84aa-1c3b55ac4842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:42.045910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-deb2c502-2adb-452b-87c4-eb6b2f77896d req-1faf4ecc-7a7c-4a34-84aa-1c3b55ac4842 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.046485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-deb2c502-2adb-452b-87c4-eb6b2f77896d req-1faf4ecc-7a7c-4a34-84aa-1c3b55ac4842 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.061029 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-deb2c502-2adb-452b-87c4-eb6b2f77896d req-1faf4ecc-7a7c-4a34-84aa-1c3b55ac4842 service nova] Creating event network-changed:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:15:42.066226 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-deb2c502-2adb-452b-87c4-eb6b2f77896d req-1faf4ecc-7a7c-4a34-84aa-1c3b55ac4842 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035286 Jul 18 14:15:42.067023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3476/7170] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:42.909569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:42.910807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:42.919042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.919501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.920282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.920724 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.956575 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-69c201b4-573f-4429-9499-f1c047fe6eb9 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052470 Jul 18 14:15:42.957159 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3695/7171] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:42 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:15:43.970750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:43.971778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:43.978669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.979139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.979940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.980402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:44.013686 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46dc7bd5-2173-43e3-b8b5-1615d36a0aaa tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048867 Jul 18 14:15:44.014331 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3477/7172] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:43 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:45.025257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:45.026245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:45.033549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:45.034018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:45.034834 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:45.035302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:45.069511 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f41c8cb1-df15-4bd0-8f20-91488648ae8e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Jul 18 14:15:45.070097 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3696/7173] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:45 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:46.134822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:46.135602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:46.142524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.143057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.143956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.144471 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.175473 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd8a61f5-d668-4be9-9616-64d345e62019 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097883 Jul 18 14:15:46.176155 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3478/7174] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:46 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:47.186973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.187890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.194841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.195296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.196051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.196474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.226062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2f75f7da-0bdd-4f6c-b832-11b4a427cb72 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043354 Jul 18 14:15:47.226702 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3697/7175] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:47 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:15:47.237130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.237664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.244654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.245126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.245916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.246409 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.325821 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] HTTP exception thrown: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 is not attached to volume d83e0276-3cb7-4a26-8e16-7fffc0ebe33c Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Request method failure captured: Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: request: DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments/d83e0276-3cb7-4a26-8e16-7fffc0ebe33c HTTP/1.1 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WnhgeDBdp0hOT-YQorbI6ftQj0MQ7ggB8L6xA-3mV_URzfMIP8lwPvgTZ9t6YDT5WbUduloxxcJqFaIc98Orr5pXFaHp8d2ADdQCdAyQILV49xh6Xq96hUBjd7YjFhq5WUCVOCbSWZsmyk5VdsCmfH4MWbuax1x-F7eC45vAHKzOM8 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_97fa1774cc3e49d2adb742da43e0e3df", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: a7fb5b01f9824279be3d0c58e027ebde Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 is not attached to volume d83e0276-3cb7-4a26-8e16-7fffc0ebe33c Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'server_id': '3c81e2c3-caa2-4f24-a840-78ec87feb225', 'id': 'd83e0276-3cb7-4a26-8e16-7fffc0ebe33c'} Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d83e0276-3cb7-4a26-8e16-7fffc0ebe33c. Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 is not attached to volume d83e0276-3cb7-4a26-8e16-7fffc0ebe33c Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:47.327861 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 is not attached to volume d83e0276-3cb7-4a26-8e16-7fffc0ebe33c Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Returning 404 to user: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 is not attached to volume d83e0276-3cb7-4a26-8e16-7fffc0ebe33c {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6bf7005c-74de-49c1-9122-f777ce598a26 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments/d83e0276-3cb7-4a26-8e16-7fffc0ebe33c" status: 404 len: 154 microversion: 2.1 time: 0.096339 Jul 18 14:15:47.332589 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3479/7176] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:15:47 2022] DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225/os-volume_attachments/d83e0276-3cb7-4a26-8e16-7fffc0ebe33c => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:15:50.568891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:50.569411 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:50.577056 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.577535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.578427 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.578875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.605090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:15:50.679848 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-13952212-92d4-4a62-9caa-7f0fb45dc2d7 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 204 len: 0 microversion: 2.1 time: 0.114408 Jul 18 14:15:50.680469 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3698/7177] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:15:50 2022] DELETE /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:15:50.690224 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:50.690980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:50.698699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.699669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.700501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.700954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.841493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:50.849283 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8775b6d9-e85a-4a99-8394-ed34144c6d23 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1553 microversion: 2.1 time: 0.164087 Jul 18 14:15:50.849867 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3480/7178] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:50 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:51.867592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:51.868386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:51.876070 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:51.876529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:51.877301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:51.877739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:52.010709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:52.018872 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-22800557-0a31-4ca1-9c16-6e0a59262781 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1553 microversion: 2.1 time: 0.155655 Jul 18 14:15:52.019664 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3699/7179] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:51 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:53.037189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:53.037804 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:53.045680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.046138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.046957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.047407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.235731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:53.244338 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3fd5544-23f8-47ec-aac5-b59bd912f5ab tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 200 len: 1553 microversion: 2.1 time: 0.211353 Jul 18 14:15:53.245255 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3481/7180] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:53 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:53.334476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-255a211f-e503-43fb-9fad-e5c990db6bd1 req-37b3ef6b-4e15-4a29-8ee5-9a9c1bd7f8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c81e2c3-caa2-4f24-a840-78ec87feb225", "name": "network-vif-deleted", "tag": "df6de496-7cb6-4f8d-b631-504cc5cbf28c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:53.345269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-255a211f-e503-43fb-9fad-e5c990db6bd1 req-37b3ef6b-4e15-4a29-8ee5-9a9c1bd7f8be service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.345711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-255a211f-e503-43fb-9fad-e5c990db6bd1 req-37b3ef6b-4e15-4a29-8ee5-9a9c1bd7f8be service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.358178 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-255a211f-e503-43fb-9fad-e5c990db6bd1 req-37b3ef6b-4e15-4a29-8ee5-9a9c1bd7f8be service nova] Creating event network-vif-deleted:df6de496-7cb6-4f8d-b631-504cc5cbf28c for instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 on n-h1-850003-3 Jul 18 14:15:53.364726 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-255a211f-e503-43fb-9fad-e5c990db6bd1 req-37b3ef6b-4e15-4a29-8ee5-9a9c1bd7f8be service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033876 Jul 18 14:15:53.365342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3700/7181] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:15:54.261232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:54.261859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: 3c81e2c3-caa2-4f24-a840-78ec87feb225] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:54.269031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.269496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:54.270312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.270765 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:54.284507 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] HTTP exception thrown: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Request method failure captured: Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 HTTP/1.1 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1WnhgeDBdp0hOT-YQorbI6ftQj0MQ7ggB8L6xA-3mV_URzfMIP8lwPvgTZ9t6YDT5WbUduloxxcJqFaIc98Orr5pXFaHp8d2ADdQCdAyQILV49xh6Xq96hUBjd7YjFhq5WUCVOCbSWZsmyk5VdsCmfH4MWbuax1x-F7eC45vAHKzOM8 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_97fa1774cc3e49d2adb742da43e0e3df", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: a7fb5b01f9824279be3d0c58e027ebde Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '3c81e2c3-caa2-4f24-a840-78ec87feb225'} Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:54.286053 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Returning 404 to user: Instance 3c81e2c3-caa2-4f24-a840-78ec87feb225 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eb0d1f6c-3b53-4542-9535-40c858bef145 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jul 18 14:15:54.290259 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3482/7182] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:54 2022] GET /compute/v2.1/servers/3c81e2c3-caa2-4f24-a840-78ec87feb225 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:15:54.297698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-af11e3f4-d079-4bfc-b829-fb285ac76a95 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '.version_select at 0x7f96d73024c0>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:54.300873 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af11e3f4-d079-4bfc-b829-fb285ac76a95 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:15:55.307888 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-af11e3f4-d079-4bfc-b829-fb285ac76a95 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37888. Jul 18 14:15:55.329566 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-af11e3f4-d079-4bfc-b829-fb285ac76a95 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1508591421" status: 202 len: 0 microversion: 2.1 time: 1.036668 Jul 18 14:15:55.330226 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3701/7183] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 14:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1508591421 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:56.878794 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:15:56.879570 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:15:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:15:59.022590 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:15:59.023414 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:16:04.348234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51512d15-98a8-43ca-8bd5-e9c4a9ceb100 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: .version_select at 0x7f96d7ab9040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1416769922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwig2Nmz2hn0wg0WWqXZUP2gFg7ELgjFD1TNgXjB4LPHwt+oef6cyJKSXULiW8s4aWcaZqmCj2TX9De7LhWaft6wp29ZcXa0RDyGeOK+kXIIrH1ojwPi0ynqKRwC6DYw=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:04.354108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=18 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:04.354848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:04.367320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-51512d15-98a8-43ca-8bd5-e9c4a9ceb100 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:16:04.373167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-51512d15-98a8-43ca-8bd5-e9c4a9ceb100 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for user a7fb5b01f9824279be3d0c58e027ebde and project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:16:04.399706 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51512d15-98a8-43ca-8bd5-e9c4a9ceb100 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055319 Jul 18 14:16:04.400339 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3483/7184] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:16:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:04.448051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:04.452824 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1519397919", "imageRef": "2fb2e31a-3aa2-432d-b97f-37151d09c224", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1416769922", "networks": [{"uuid": "4288b10e-6213-413a-8b5f-ac74f6de6797"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:04.503788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] validate_networks() for [('4288b10e-6213-413a-8b5f-ac74f6de6797', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:16:04.924871 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:16:04.925294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:16:04.925770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:16:04.926283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:16:04.926731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:16:04.936758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:04.937207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:04.938007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:04.938466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:04.956342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:16:04.961974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Getting quotas for user a7fb5b01f9824279be3d0c58e027ebde and project 97fa1774cc3e49d2adb742da43e0e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:16:04.974442 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:16:04.976764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fb2e31a-3aa2-432d-b97f-37151d09c224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:16:05.022909 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ea7245f3-c0fa-4f28-a8c6-243520f70f5a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577232 Jul 18 14:16:05.023569 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3702/7185] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:16:05.034016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-77b98dcc-69d4-4a29-9c64-dd90c8579c31 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:05.034685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-77b98dcc-69d4-4a29-9c64-dd90c8579c31 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:05.097402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-77b98dcc-69d4-4a29-9c64-dd90c8579c31 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:05.106655 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-77b98dcc-69d4-4a29-9c64-dd90c8579c31 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1259 microversion: 2.1 time: 0.074731 Jul 18 14:16:05.107242 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3484/7186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:05 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:06.124481 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:06.125142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:06.133963 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:06.134444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:06.135737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:06.135737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:06.215332 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:06.225385 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90d337d9-3f31-4a3b-9bef-cfe1e26827e1 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1329 microversion: 2.1 time: 0.105470 Jul 18 14:16:06.226283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3703/7187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:06 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:07.243354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:07.244635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:07.253913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:07.254414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:07.255572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:07.256066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:07.399870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:07.413141 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-acb8fa2b-6e15-4c9a-a2ba-1d7a322c616e tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.173306 Jul 18 14:16:07.414476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3485/7188] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:07 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:08.432962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:08.433561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:08.441970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:08.442448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:08.443237 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:08.443674 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:08.602823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:08.612656 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-94743e61-eb99-4a46-8035-376e3881c426 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.183570 Jul 18 14:16:08.613276 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3704/7189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:08 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:09.630686 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:09.631315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:09.639372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:09.640199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:09.641266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:09.641938 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:09.811378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:09.820031 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c6c2b2b-2e60-47fd-bd89-6056430656e3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.193452 Jul 18 14:16:09.820887 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3486/7190] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:09 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:10.838915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:10.839743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:10.842875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:10.849115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:10.849571 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:10.850412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:10.850850 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:10.995345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:11.003813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b714481d-ff7f-43d7-a436-aa775f946eff tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.168679 Jul 18 14:16:11.004468 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3705/7191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:10 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:12.021824 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:12.022546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:12.030286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:12.031102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:12.031918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:12.032379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:12.192661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:12.200824 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-323d9b7b-c05a-49c2-b9b9-e63c6dfd8772 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.183105 Jul 18 14:16:12.201638 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3487/7192] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:12 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:16:13.219390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:13.220225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:13.227929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:13.228514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:13.229383 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:13.229893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:13.390649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:13.398955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bcaf87a1-bd9c-48d3-8520-86fb61178b34 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.185145 Jul 18 14:16:13.399758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3706/7193] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:13 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:14.417194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:14.417831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:14.426902 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:14.427369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:14.428184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:14.428641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:14.603698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:14.611689 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5a4578c8-191c-476a-b430-6dd59d403d8a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.198546 Jul 18 14:16:14.612280 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3488/7194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:14 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:15.219799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-baf0b72b-5cb5-4c0f-b777-7d662f761876 req-f4d4b8f3-21a1-4a7d-b672-19b7fbca58ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:15.225102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:15.226927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:15.235556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-baf0b72b-5cb5-4c0f-b777-7d662f761876 req-f4d4b8f3-21a1-4a7d-b672-19b7fbca58ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:15.236002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-baf0b72b-5cb5-4c0f-b777-7d662f761876 req-f4d4b8f3-21a1-4a7d-b672-19b7fbca58ff service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:15.249211 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-baf0b72b-5cb5-4c0f-b777-7d662f761876 req-f4d4b8f3-21a1-4a7d-b672-19b7fbca58ff service nova] Creating event network-changed:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:16:15.254580 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-baf0b72b-5cb5-4c0f-b777-7d662f761876 req-f4d4b8f3-21a1-4a7d-b672-19b7fbca58ff service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039235 Jul 18 14:16:15.255813 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3707/7195] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:15.629252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:15.630104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:15.632114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:15.638901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:15.639367 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:15.640151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:15.640606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:15.798733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:15.807011 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b492b59f-cc22-4ce5-bced-1f7bc5251d1b tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.182002 Jul 18 14:16:15.807689 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3489/7196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:15 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:16.827133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:16.828066 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:16.834898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:16.835797 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:16.837600 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:16.838285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:17.020698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:17.034544 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-39905dcc-8c9a-42db-b308-99d69472126f tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.213113 Jul 18 14:16:17.035592 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3708/7197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:16 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:18.051911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:18.052561 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:18.060117 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:18.060583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:18.061366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:18.061814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:18.199017 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:18.207357 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82c9fabd-c359-4d32-ae9c-8aabd561b4a2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.159419 Jul 18 14:16:18.207947 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3490/7198] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:18 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:19.078807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-eaab1fe9-a499-45ac-855c-dc8705180122 req-fb42de5e-df9d-487f-945a-53b8bffbc572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "name": "network-vif-plugged", "status": "completed", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:19.087174 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eaab1fe9-a499-45ac-855c-dc8705180122 req-fb42de5e-df9d-487f-945a-53b8bffbc572 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:19.087712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-eaab1fe9-a499-45ac-855c-dc8705180122 req-fb42de5e-df9d-487f-945a-53b8bffbc572 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:19.099552 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-eaab1fe9-a499-45ac-855c-dc8705180122 req-fb42de5e-df9d-487f-945a-53b8bffbc572 service nova] Creating event network-vif-plugged:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:16:19.104607 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-eaab1fe9-a499-45ac-855c-dc8705180122 req-fb42de5e-df9d-487f-945a-53b8bffbc572 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090303 Jul 18 14:16:19.105241 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3709/7199] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:19.224493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:19.225251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:19.232782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:19.233271 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:19.234278 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:19.234741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:19.377991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:19.385623 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2ed961bc-6933-4ced-ad95-05444cb577a0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1359 microversion: 2.1 time: 0.165339 Jul 18 14:16:19.386346 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3491/7200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:19 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:20.405368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:20.406568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:20.412868 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.413319 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.414099 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.414622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.548844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:20.556496 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d2c9ed2-63be-41ef-977b-95f90b9755c5 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1547 microversion: 2.1 time: 0.156955 Jul 18 14:16:20.557067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3710/7201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:20 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:20.573935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:20.574633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:20.583274 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.583805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.584645 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.585142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.715972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:20.723667 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-88f8e242-fa67-48cf-b921-e8a4e11beffd tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1547 microversion: 2.1 time: 0.153853 Jul 18 14:16:20.724258 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3492/7202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:20 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:20.740303 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:20.743768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:20.744604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Searching by: {'deleted': False, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df'} {{(pid=131366) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 14:16:20.750285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.750727 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.751510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.751936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.778282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.multi_cell_list [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 14:16:20.805793 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f88933b4-4224-42fc-80df-1e776cad4b66 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069491 Jul 18 14:16:20.806425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3711/7203] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 14:16:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:20.816865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:20.817501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:20.823840 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.824313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.825239 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:20.825696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:20.960528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:20.968801 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ecf5e6d2-b2f7-458f-b378-f2e78cbe0d02 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1547 microversion: 2.1 time: 0.155826 Jul 18 14:16:20.969422 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3493/7204] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:20 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:22.485294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a0f9076-f20d-43e6-8b09-a2aec87e1d44"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:22.486534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:22.493635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:22.494093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:22.494900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:22.495343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:22.730070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-72d88fc1-d405-42fb-84fc-287b6888afd0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248544 Jul 18 14:16:22.730954 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3712/7205] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 14:16:22 2022] POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:33.488445 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:33.489065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:33.492043 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:33.492710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=54 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:33.500267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.500658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.501440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.501898 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.643025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:33.651183 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0cf9b1fb-b348-4394-9de7-50537e3351c3 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1593 microversion: 2.1 time: 0.166690 Jul 18 14:16:33.651777 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3494/7206] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:33 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:35.318416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-caa71c1a-b9c4-4f32-bade-103157e6bbe3 req-8926915e-a9cb-431b-bffe-b53310c43e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:35.325010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:35.326331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=15 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:35.327405 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:35.340326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-caa71c1a-b9c4-4f32-bade-103157e6bbe3 req-8926915e-a9cb-431b-bffe-b53310c43e17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:35.341801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-caa71c1a-b9c4-4f32-bade-103157e6bbe3 req-8926915e-a9cb-431b-bffe-b53310c43e17 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:35.361188 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-caa71c1a-b9c4-4f32-bade-103157e6bbe3 req-8926915e-a9cb-431b-bffe-b53310c43e17 service nova] Creating event network-changed:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:16:35.368115 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-caa71c1a-b9c4-4f32-bade-103157e6bbe3 req-8926915e-a9cb-431b-bffe-b53310c43e17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053389 Jul 18 14:16:35.369647 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3713/7207] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:36.596795 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1228217305"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:36.597361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:36.604573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:36.605055 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:36.605829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:36.606316 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:36.748515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.network.security_group_api [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Adding security group da064993-b830-4c0b-95cc-b9f889747952 to port 6d13f9bf-3317-49c3-919d-a2563ff611ff Jul 18 14:16:37.121228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ad795406-0363-476a-99b2-01d7777474f0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action" status: 202 len: 0 microversion: 2.1 time: 0.528140 Jul 18 14:16:37.127452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3495/7208] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:16:36 2022] POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:16:37.132672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-017810bc-3243-4205-8db9-0ce10b6926c0 req-d4c7dc29-aaeb-4b58-a223-87290a6621df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:37.133256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:37.133508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:37.144607 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-017810bc-3243-4205-8db9-0ce10b6926c0 req-d4c7dc29-aaeb-4b58-a223-87290a6621df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.146048 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-017810bc-3243-4205-8db9-0ce10b6926c0 req-d4c7dc29-aaeb-4b58-a223-87290a6621df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.148470 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.149698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.150783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.151916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.184191 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-017810bc-3243-4205-8db9-0ce10b6926c0 req-d4c7dc29-aaeb-4b58-a223-87290a6621df service nova] Creating event network-changed:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:16:37.200088 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-017810bc-3243-4205-8db9-0ce10b6926c0 req-d4c7dc29-aaeb-4b58-a223-87290a6621df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073300 Jul 18 14:16:37.201427 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3714/7209] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:37.426901 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:37.437942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-847f648a-61c8-42e8-ae5e-200545861963 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1759 microversion: 2.1 time: 0.308878 Jul 18 14:16:37.439018 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3496/7210] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:37 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1759 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:54.418514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.419307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.423781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:54.424893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:54.433266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.433722 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:54.435094 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.435539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:54.518118 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-63960761-e057-4696-9162-023c6a9271a6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action" status: 202 len: 0 microversion: 2.1 time: 0.101589 Jul 18 14:16:54.519091 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3715/7211] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:16:54 2022] POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:16:54.529144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:54.529936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:54.532319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.532994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=16 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.539032 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.539597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:54.540390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.540841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:55.177481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:55.186029 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d785b931-48ee-426c-b2c9-14adeb216ca0 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1751 microversion: 2.1 time: 0.661199 Jul 18 14:16:55.186660 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3497/7212] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:54 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1751 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:56.206630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:56.207341 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:56.214256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:56.214719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:56.215499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:56.216504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:56.376645 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:56.386247 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70ec6f9e-5844-41cf-90ac-6093c0d9ef52 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.184931 Jul 18 14:16:56.386984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3716/7213] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:56 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:57.406808 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:57.407358 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:57.414879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.415350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.416154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.416612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.582183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:57.591411 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1f7ba1cc-e822-40b7-a7b9-d85fc87aa756 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.188897 Jul 18 14:16:57.592024 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3498/7214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:57 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:58.609691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:58.610384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:58.619007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.619451 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:58.620224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.620656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:58.801388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:58.810033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d36df6f4-3475-4935-8961-4102546b88b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.204735 Jul 18 14:16:58.810695 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3717/7215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:58 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:16:59.832351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:59.833103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:59.840163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:59.840632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:59.841420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:59.841878 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.008678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:00.017144 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9b700f6-ada6-4c4c-80f5-a6a45586fc61 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.188710 Jul 18 14:17:00.018274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3499/7216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:59 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:17:01.039736 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:01.040419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:01.047730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.048175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.048960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.049391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.206542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:01.214842 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a95423a7-a99d-4998-bdd5-3c55d6f2f930 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.178987 Jul 18 14:17:01.215466 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3718/7217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:01 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:02.232734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:02.233302 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:02.240390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:02.240856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:02.241648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:02.242103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:02.393463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:02.402227 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2d31978-7e03-47fd-a4b7-314b3fbc4e77 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.173493 Jul 18 14:17:02.402823 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3500/7218] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:02 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:03.421032 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:03.421569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:03.428471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:03.428914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:03.429672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:03.430107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:03.574446 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:03.582759 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-87c9f3c7-bc8c-4898-a986-10284212d3ca tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.166351 Jul 18 14:17:03.583345 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3719/7219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:03 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:04.600507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:04.601154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:04.609991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:04.610532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:04.611348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:04.611803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:04.764447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:04.772859 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-59e431fc-2cae-46a1-9b90-203a030a8322 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.176170 Jul 18 14:17:04.773462 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3501/7220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:04 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:05.791006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:05.791624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:05.798858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:05.799315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:05.800086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:05.800526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:05.961915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:05.972179 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2efda76a-d594-404c-8014-6528c9f56f5c tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1756 microversion: 2.1 time: 0.185031 Jul 18 14:17:05.972774 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3720/7221] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:05 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:06.989810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:06.990469 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:06.998440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:06.998910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:06.999719 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:07.000168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:07.147088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:07.156251 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7c240975-df4a-4aca-aecc-c891037e5a90 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1759 microversion: 2.1 time: 0.170157 Jul 18 14:17:07.156850 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3502/7222] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:06 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:39.523188 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1228217305"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:39.523804 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:39.526260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:39.526928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:39.533422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:39.533880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:39.534693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:39.535142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:39.672545 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.network.security_group_api [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Removing security group da064993-b830-4c0b-95cc-b9f889747952 from port 6d13f9bf-3317-49c3-919d-a2563ff611ff Jul 18 14:17:40.346931 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ef2e9b9-55c8-4bf4-94cc-ce4528d55527 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action" status: 202 len: 0 microversion: 2.1 time: 0.827704 Jul 18 14:17:40.351425 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3721/7223] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:17:39 2022] POST /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:17:40.381613 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.383405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.458778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-7a61b8ef-3a1b-43b3-be15-99054c53f4ae req-b6c98d04-a98a-4d82-9200-161f31de65aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:40.471051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7a61b8ef-3a1b-43b3-be15-99054c53f4ae req-b6c98d04-a98a-4d82-9200-161f31de65aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:40.471927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-7a61b8ef-3a1b-43b3-be15-99054c53f4ae req-b6c98d04-a98a-4d82-9200-161f31de65aa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:40.489337 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-7a61b8ef-3a1b-43b3-be15-99054c53f4ae req-b6c98d04-a98a-4d82-9200-161f31de65aa service nova] Creating event network-changed:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:17:40.495236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-7a61b8ef-3a1b-43b3-be15-99054c53f4ae req-b6c98d04-a98a-4d82-9200-161f31de65aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128921 Jul 18 14:17:40.496218 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3503/7224] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:41.599531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:41.600086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:41.606426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:41.606962 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:41.608533 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:41.609049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:41.690864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lazy-loading 'services' on Instance uuid b1705f5a-374c-4e9c-9714-1196dd39d161 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:41.766481 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f07e5c6d-01ec-41f2-8901-f960fff744bf tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments/3a0f9076-f20d-43e6-8b09-a2aec87e1d44" status: 202 len: 0 microversion: 2.1 time: 0.171340 Jul 18 14:17:41.767791 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3722/7225] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:17:41 2022] DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments/3a0f9076-f20d-43e6-8b09-a2aec87e1d44 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:17:41.778119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:41.779237 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:41.791171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:41.792069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:41.792975 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:41.793517 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:41.828554 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-74e6dc74-7d7d-4498-a725-fcd3d55e7415 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055906 Jul 18 14:17:41.829632 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3504/7226] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:41 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:42.517563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4fd2b045-8edd-4512-87ec-2353768c8623 req-34b48b51-ecc4-446b-9989-9aef6b154469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:42.527688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4fd2b045-8edd-4512-87ec-2353768c8623 req-34b48b51-ecc4-446b-9989-9aef6b154469 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:42.528285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4fd2b045-8edd-4512-87ec-2353768c8623 req-34b48b51-ecc4-446b-9989-9aef6b154469 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:42.544920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4fd2b045-8edd-4512-87ec-2353768c8623 req-34b48b51-ecc4-446b-9989-9aef6b154469 service nova] Creating event network-changed:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:17:42.550728 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4fd2b045-8edd-4512-87ec-2353768c8623 req-34b48b51-ecc4-446b-9989-9aef6b154469 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042835 Jul 18 14:17:42.551505 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3723/7227] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:42.841481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:42.843375 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:42.851474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:42.852378 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:42.853208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:42.853676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:42.888262 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f9ed0dea-ab22-4e42-8c92-f80e5ea5117a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051164 Jul 18 14:17:42.889426 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3505/7228] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:42 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:43.903151 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:43.904212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:43.911794 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:43.912274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:43.913061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:43.913501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:43.946642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-29929634-b3d0-44e7-959c-33fcda8fe186 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048932 Jul 18 14:17:43.947238 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3724/7229] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:43 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:44.958788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:44.960793 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:44.969060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:44.969525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:44.970377 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:44.970863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:45.000477 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2c7f3a40-4ad9-402f-91bd-f3c9aefc035a tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045675 Jul 18 14:17:45.001050 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3506/7230] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:44 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:46.013770 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:46.015744 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:46.022234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.022703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.023501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.023936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.056972 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-596abf0d-f7c5-4ef2-a994-24b474833cf6 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048361 Jul 18 14:17:46.057568 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3725/7231] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:46 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:47.069051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:47.070012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:47.077831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.078333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.079137 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.079600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.109295 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-97567cb8-945a-4968-9c28-2f626fdf6971 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Jul 18 14:17:47.109866 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3507/7232] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:47 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:17:47.119784 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:47.120323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:47.127808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.128263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.129054 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.129501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.208515 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] HTTP exception thrown: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 is not attached to volume 3a0f9076-f20d-43e6-8b09-a2aec87e1d44 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Request method failure captured: Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: request: DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments/3a0f9076-f20d-43e6-8b09-a2aec87e1d44 HTTP/1.1 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WnhgeDBdp0hOT-YQorbI6ftQj0MQ7ggB8L6xA-3mV_URzfMIP8lwPvgTZ9t6YDT5WbUduloxxcJqFaIc98Orr5pXFaHp8d2ADdQCdAyQILV49xh6Xq96hUBjd7YjFhq5WUCVOCbSWZsmyk5VdsCmfH4MWbuax1x-F7eC45vAHKzOM8 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_97fa1774cc3e49d2adb742da43e0e3df", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: a7fb5b01f9824279be3d0c58e027ebde Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 is not attached to volume 3a0f9076-f20d-43e6-8b09-a2aec87e1d44 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'server_id': 'b1705f5a-374c-4e9c-9714-1196dd39d161', 'id': '3a0f9076-f20d-43e6-8b09-a2aec87e1d44'} Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3a0f9076-f20d-43e6-8b09-a2aec87e1d44. Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 is not attached to volume 3a0f9076-f20d-43e6-8b09-a2aec87e1d44 Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:47.210220 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 is not attached to volume 3a0f9076-f20d-43e6-8b09-a2aec87e1d44 Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Returning 404 to user: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 is not attached to volume 3a0f9076-f20d-43e6-8b09-a2aec87e1d44 {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0d1ffdea-65c2-4ffe-88c3-6923436ecc81 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments/3a0f9076-f20d-43e6-8b09-a2aec87e1d44" status: 404 len: 154 microversion: 2.1 time: 0.096013 Jul 18 14:17:47.214677 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3726/7233] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 14:17:47 2022] DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161/os-volume_attachments/3a0f9076-f20d-43e6-8b09-a2aec87e1d44 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:17:50.449372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:50.449895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:50.457225 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.458355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.458529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.458989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.485073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:17:50.566898 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bd6a2a4d-dca7-44d0-8601-9fd36d38a770 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 204 len: 0 microversion: 2.1 time: 0.121063 Jul 18 14:17:50.567975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3508/7234] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:17:50 2022] DELETE /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:17:50.577530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:50.580349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:50.589893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.590414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.591209 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.591655 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.742235 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:50.751979 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40fa028f-5817-4b0b-9e69-26dae1619828 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1553 microversion: 2.1 time: 0.179290 Jul 18 14:17:50.752901 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3727/7235] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:50 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:51.770844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:51.771801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:51.779031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.779501 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.781285 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.781743 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.921321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:51.929468 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2697d2fd-e6ef-4a49-9bf2-c05ba3a1f1d8 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1553 microversion: 2.1 time: 0.163157 Jul 18 14:17:51.930060 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3509/7236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:51 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:52.835723 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7b8df3ea-f97f-4a32-9f04-38aa00a7eccc req-eafda05f-bcca-4581-ac7a-f80d925f7c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1705f5a-374c-4e9c-9714-1196dd39d161", "name": "network-vif-deleted", "tag": "6d13f9bf-3317-49c3-919d-a2563ff611ff"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:52.846179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7b8df3ea-f97f-4a32-9f04-38aa00a7eccc req-eafda05f-bcca-4581-ac7a-f80d925f7c59 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.846818 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7b8df3ea-f97f-4a32-9f04-38aa00a7eccc req-eafda05f-bcca-4581-ac7a-f80d925f7c59 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.859572 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7b8df3ea-f97f-4a32-9f04-38aa00a7eccc req-eafda05f-bcca-4581-ac7a-f80d925f7c59 service nova] Creating event network-vif-deleted:6d13f9bf-3317-49c3-919d-a2563ff611ff for instance b1705f5a-374c-4e9c-9714-1196dd39d161 on n-h2-850003-3 Jul 18 14:17:52.864969 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7b8df3ea-f97f-4a32-9f04-38aa00a7eccc req-eafda05f-bcca-4581-ac7a-f80d925f7c59 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Jul 18 14:17:52.865589 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3728/7237] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:52.948091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:52.948852 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:52.957582 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.958059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.958918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.959430 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.997200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.997633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.998397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lazy-loading 'fault' on Instance uuid b1705f5a-374c-4e9c-9714-1196dd39d161 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:53.042887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fb5b01f9824279be3d0c58e027ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa1774cc3e49d2adb742da43e0e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:53.051708 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-597dcfb8-7dcd-4b23-b24f-f277caaa20b2 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 200 len: 1349 microversion: 2.1 time: 0.108044 Jul 18 14:17:53.052325 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3510/7238] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:52 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:54.071195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:54.071940 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] [instance: b1705f5a-374c-4e9c-9714-1196dd39d161] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:54.078324 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.078783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.079549 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.079987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.093327 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] HTTP exception thrown: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Request method failure captured: Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 HTTP/1.1 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1WnhgeDBdp0hOT-YQorbI6ftQj0MQ7ggB8L6xA-3mV_URzfMIP8lwPvgTZ9t6YDT5WbUduloxxcJqFaIc98Orr5pXFaHp8d2ADdQCdAyQILV49xh6Xq96hUBjd7YjFhq5WUCVOCbSWZsmyk5VdsCmfH4MWbuax1x-F7eC45vAHKzOM8 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_97fa1774cc3e49d2adb742da43e0e3df", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97fa1774cc3e49d2adb742da43e0e3df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 97fa1774cc3e49d2adb742da43e0e3df Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689498212 Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: a7fb5b01f9824279be3d0c58e027ebde Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestMinimumBasicScenario-689498212-project Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b1705f5a-374c-4e9c-9714-1196dd39d161'} Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:54.094985 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Returning 404 to user: Instance b1705f5a-374c-4e9c-9714-1196dd39d161 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-35762c2b-dd91-4829-bda4-7e9805d3c486 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161" status: 404 len: 111 microversion: 2.1 time: 0.031117 Jul 18 14:17:54.102527 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3729/7239] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:54 2022] GET /compute/v2.1/servers/b1705f5a-374c-4e9c-9714-1196dd39d161 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:17:54.106985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c5fb11ba-0e08-43c1-a8fd-a9612fd37909 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] Calling method '.version_select at 0x7f96e45589d0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:54.127549 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c5fb11ba-0e08-43c1-a8fd-a9612fd37909 tempest-TestMinimumBasicScenario-689498212 tempest-TestMinimumBasicScenario-689498212-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1416769922" status: 202 len: 0 microversion: 2.1 time: 0.025562 Jul 18 14:17:54.128134 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3511/7240] 10.222.0.88 () {58 vars in 1271 bytes} [Mon Jul 18 14:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1416769922 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:18:03.305430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7f3be2a5-d7ca-4b55-8e0a-180e94f651dc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: .version_select at 0x7f96d71533a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-983736733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZQBM1ESLfpc+urWq0CqpsFYXHkW+Yx1Vh3RvptySq1Iz2MWBZ89tf7Wz0etoaqSqAyBPLV4GPuVy8dF6NS2LkjH+7N/KBw3pIo3DIF2uRTQlpjGCuIljz7ezj0BdqBaA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:03.321720 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7f3be2a5-d7ca-4b55-8e0a-180e94f651dc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:18:03.327763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-7f3be2a5-d7ca-4b55-8e0a-180e94f651dc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:18:03.359948 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7f3be2a5-d7ca-4b55-8e0a-180e94f651dc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.223894 Jul 18 14:18:03.360568 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3730/7241] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:18:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:09.221477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:09.222698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:09.226851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-784544035", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "d3109ae1-262e-4f4f-bcf2-ca37bd6536a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-983736733", "security_groups": [{"name": "tempest-secgroup-smoke-1333154545"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:09.346248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] validate_networks() for [('d3109ae1-262e-4f4f-bcf2-ca37bd6536a5', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:18:09.849327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:18:09.849987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:18:09.850510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:18:09.850943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:18:09.851376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:18:09.865525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:09.866292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:09.867138 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:09.867767 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:09.887644 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:18:09.894690 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:18:09.910449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:18:09.913206 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:18:09.978466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9b722e7f-77fd-423a-9d27-a2903f430133 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758792 Jul 18 14:18:09.983297 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3512/7242] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:18:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:18:09.987731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:09.993781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e9d93a5-4093-46d3-8717-cf38b02f9e22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:09.994872 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e9d93a5-4093-46d3-8717-cf38b02f9e22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:10.007077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:10.089546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e9d93a5-4093-46d3-8717-cf38b02f9e22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:10.097077 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e9d93a5-4093-46d3-8717-cf38b02f9e22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1265 microversion: 2.1 time: 0.110478 Jul 18 14:18:10.097905 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3731/7243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:09 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:11.114759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:11.115410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:11.126036 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:11.126538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:11.127344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:11.127794 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:11.202042 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:11.211836 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a283c0f8-89fe-4e97-961e-5c5891163de3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1317 microversion: 2.1 time: 0.100834 Jul 18 14:18:11.215809 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3513/7244] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:11 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:12.233010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:12.234700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:12.244009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:12.244542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:12.245425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:12.245939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:12.402719 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:12.411104 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8e25a454-eac2-40dc-893e-9cd2c6a9e715 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.184890 Jul 18 14:18:12.411805 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3732/7245] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:12 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:12.962723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-9c2becb3-a922-4a4b-9cbf-c7bbe58e3f7e req-be2550d2-7342-44f9-a21d-fdc160160088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c3c7e-cc14-4593-88b7-10ed8ea32d73", "tag": "db13f6fd-ad71-429e-a12a-a040e06dbe96"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:12.984015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c2becb3-a922-4a4b-9cbf-c7bbe58e3f7e req-be2550d2-7342-44f9-a21d-fdc160160088 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:12.985052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-9c2becb3-a922-4a4b-9cbf-c7bbe58e3f7e req-be2550d2-7342-44f9-a21d-fdc160160088 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:12.998431 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-9c2becb3-a922-4a4b-9cbf-c7bbe58e3f7e req-be2550d2-7342-44f9-a21d-fdc160160088 service nova] Creating event network-changed:db13f6fd-ad71-429e-a12a-a040e06dbe96 for instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 on n-h1-850003-3 Jul 18 14:18:13.004562 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-9c2becb3-a922-4a4b-9cbf-c7bbe58e3f7e req-be2550d2-7342-44f9-a21d-fdc160160088 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050421 Jul 18 14:18:13.005273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3514/7246] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:13.428884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:13.429507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:13.436692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:13.437256 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:13.437949 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:13.438419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:13.575855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:13.583974 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ad6d4605-1536-4a42-8e06-25e642c686b2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.159002 Jul 18 14:18:13.584575 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3733/7247] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:13 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:14.602342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:14.603063 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:14.610021 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.610515 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.611311 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.611762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.753314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:14.761050 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dcf72038-b024-4880-88c1-b44096d0dec3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.163878 Jul 18 14:18:14.761636 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3515/7248] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:14 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:15.778158 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:15.778917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:15.786685 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:15.787234 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:15.788453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:15.788692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:15.941181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:15.949212 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a77e54cc-eec9-49e5-899f-03c571a4fe41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.174893 Jul 18 14:18:15.950016 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3734/7249] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:15 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:16.967234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:16.967858 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:16.975849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:16.976307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:16.977085 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:16.977533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:17.116953 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:17.124660 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7b4a0cfc-df16-4162-9246-85fd9e44e8b0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.161404 Jul 18 14:18:17.125321 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3516/7250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:16 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:17.965087 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-b650b4f5-d97b-4f84-97a3-d4b134d60c4c req-9d6e431a-99d9-42d8-8def-1dbda7649d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3c3c7e-cc14-4593-88b7-10ed8ea32d73", "name": "network-vif-plugged", "status": "completed", "tag": "db13f6fd-ad71-429e-a12a-a040e06dbe96"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:17.975693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b650b4f5-d97b-4f84-97a3-d4b134d60c4c req-9d6e431a-99d9-42d8-8def-1dbda7649d5f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:17.976149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-b650b4f5-d97b-4f84-97a3-d4b134d60c4c req-9d6e431a-99d9-42d8-8def-1dbda7649d5f service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:17.987945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-b650b4f5-d97b-4f84-97a3-d4b134d60c4c req-9d6e431a-99d9-42d8-8def-1dbda7649d5f service nova] Creating event network-vif-plugged:db13f6fd-ad71-429e-a12a-a040e06dbe96 for instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 on n-h1-850003-3 Jul 18 14:18:17.993126 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-b650b4f5-d97b-4f84-97a3-d4b134d60c4c req-9d6e431a-99d9-42d8-8def-1dbda7649d5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031791 Jul 18 14:18:17.993734 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3735/7251] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:18.141654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:18.142463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:18.149875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.150571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.151466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.152083 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.299219 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:18.307334 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-660ce9d6-5716-4c92-ad71-d340ee00f15d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.170229 Jul 18 14:18:18.307928 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3517/7252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:18 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:19.326384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:19.327090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:19.333996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:19.334486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:19.335264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:19.335704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:19.486055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:19.494563 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40cbb97e-4b64-499d-8773-e776ff1fdd73 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1391 microversion: 2.1 time: 0.173204 Jul 18 14:18:19.495178 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3736/7253] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:19 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:20.511566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:20.512200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:20.515201 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:20.515889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:20.521894 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:20.522663 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:20.523554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:20.523928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:20.666416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:20.674918 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2d9dbd22-606d-4069-926a-8da07dd58890 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1564 microversion: 2.1 time: 0.167279 Jul 18 14:18:20.675520 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3518/7254] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:20 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:20.691881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:20.692898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:20.695310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:20.702111 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:20.702592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:20.703423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:20.703857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:20.847494 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:20.855306 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9e6fcf1b-5c04-41c5-bcd3-66a242f2c568 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1564 microversion: 2.1 time: 0.167559 Jul 18 14:18:20.855895 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3737/7255] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:20 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:22.795368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:22.796001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:22.798380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d1c1446e-5cb3-45e9-81b0-26172c3c33e1 req-910ad374-cdd8-4feb-8d1b-ca311514604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c3c7e-cc14-4593-88b7-10ed8ea32d73", "tag": "db13f6fd-ad71-429e-a12a-a040e06dbe96"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:22.803778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:22.804250 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:22.805481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:22.805481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:22.808916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1c1446e-5cb3-45e9-81b0-26172c3c33e1 req-910ad374-cdd8-4feb-8d1b-ca311514604a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:22.809630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d1c1446e-5cb3-45e9-81b0-26172c3c33e1 req-910ad374-cdd8-4feb-8d1b-ca311514604a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:22.821692 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d1c1446e-5cb3-45e9-81b0-26172c3c33e1 req-910ad374-cdd8-4feb-8d1b-ca311514604a service nova] Creating event network-changed:db13f6fd-ad71-429e-a12a-a040e06dbe96 for instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 on n-h1-850003-3 Jul 18 14:18:22.827050 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d1c1446e-5cb3-45e9-81b0-26172c3c33e1 req-910ad374-cdd8-4feb-8d1b-ca311514604a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033381 Jul 18 14:18:22.828005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3738/7256] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:23.036313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:23.044466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f1cd4047-083a-468d-94f4-dc7419f608da tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1564 microversion: 2.1 time: 0.253044 Jul 18 14:18:23.045071 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3519/7257] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:22 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1564 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:00.360855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=17 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.361704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.366489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:00.367505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:00.375338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:00.375801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:00.376691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:00.377212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:00.457138 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f3b8abe-1a5f-416b-bb20-28812a7ec0f9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action" status: 200 len: 24569 microversion: 2.1 time: 0.098512 Jul 18 14:19:00.457804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3739/7258] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:19:00 2022] POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action => generated 24569 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:19:17.564491 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:19:17.565161 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:19:30.957779 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:30.958581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=40 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:30.962843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:30.963384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:30.971069 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.971537 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.972330 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.972789 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:31.046318 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f8fce2b2-a2e6-489d-ac66-1ea48db85973 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action" status: 202 len: 0 microversion: 2.1 time: 0.090121 Jul 18 14:19:31.046987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3520/7259] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:19:30 2022] POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:31.055944 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:31.056653 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:31.061604 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:31.062291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:31.070432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:31.070892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:31.071686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:31.072129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:31.290428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:31.298333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-65fb1599-aab0-4968-ad56-5fcc69e6cc45 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1688 microversion: 2.1 time: 0.246542 Jul 18 14:19:31.298975 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3740/7260] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:31 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:32.318672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:32.319402 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:32.326522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:32.327015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:32.327809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:32.328266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:32.600828 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:32.608659 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7521e0dd-358d-4e4d-a03f-76b25cfaa925 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1668 microversion: 2.1 time: 0.295543 Jul 18 14:19:32.609245 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3521/7261] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:32 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1668 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:33.702901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:33.703865 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:33.710938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.711397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.712159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.712592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.780390 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5a573122-43c1-4c8f-8b92-a0ad6342d6a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action" status: 200 len: 32646 microversion: 2.1 time: 0.081099 Jul 18 14:19:33.781085 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3741/7262] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:19:33 2022] POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action => generated 32646 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:19:33.793520 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:33.794233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:33.801874 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.802398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.803287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.803843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.882128 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9e6dde41-808f-47f3-b297-d9a427c94f0e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action" status: 202 len: 0 microversion: 2.1 time: 0.092899 Jul 18 14:19:33.882828 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3522/7263] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:19:33 2022] POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:33.893288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:33.894071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:33.903461 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.903988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.904887 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.905708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.045080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:34.052856 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e976ada-55c0-4c9c-9ac5-7cfb3c8f9ea8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1675 microversion: 2.1 time: 0.164570 Jul 18 14:19:34.053435 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3742/7264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:33 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:35.074706 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:35.075427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:35.081910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.082692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.083272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.083723 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.223610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:35.233130 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f4a755f1-e1a0-4fc6-b2c6-2b8a3af0c72d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1683 microversion: 2.1 time: 0.163625 Jul 18 14:19:35.233736 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3523/7265] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:35 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:35.327302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:35.328277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:35.336875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.337361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.338141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.338614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.395748 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ac0515f3-5184-4947-91b0-e8bb16fa6e4b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action" status: 200 len: 34931 microversion: 2.1 time: 0.073151 Jul 18 14:19:35.396400 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3743/7266] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:19:35 2022] POST /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73/action => generated 34931 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:19:36.440763 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:36.441412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:36.443625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5399f5fc-2078-4112-b750-7a9ae888cbd1 req-3d1c8d2f-e2a2-4575-827e-4a2cde01eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c3c7e-cc14-4593-88b7-10ed8ea32d73", "tag": "db13f6fd-ad71-429e-a12a-a040e06dbe96"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:36.450172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:36.451103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.452325 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:36.452994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.454518 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5399f5fc-2078-4112-b750-7a9ae888cbd1 req-3d1c8d2f-e2a2-4575-827e-4a2cde01eb39 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:36.455046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5399f5fc-2078-4112-b750-7a9ae888cbd1 req-3d1c8d2f-e2a2-4575-827e-4a2cde01eb39 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.469036 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5399f5fc-2078-4112-b750-7a9ae888cbd1 req-3d1c8d2f-e2a2-4575-827e-4a2cde01eb39 service nova] Creating event network-changed:db13f6fd-ad71-429e-a12a-a040e06dbe96 for instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 on n-h1-850003-3 Jul 18 14:19:36.474818 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5399f5fc-2078-4112-b750-7a9ae888cbd1 req-3d1c8d2f-e2a2-4575-827e-4a2cde01eb39 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035085 Jul 18 14:19:36.475852 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3744/7267] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:36.486002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:19:36.575200 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-706feb00-272d-4050-b087-8bc83fa170e5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 204 len: 0 microversion: 2.1 time: 0.138128 Jul 18 14:19:36.577098 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3524/7268] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:19:36 2022] DELETE /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:19:36.587124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:36.588342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:36.596030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:36.596421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.597185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:36.597624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.739859 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:36.747672 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-11aa5ccf-b220-44c8-87b9-b338afce249f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1689 microversion: 2.1 time: 0.165892 Jul 18 14:19:36.748264 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3745/7269] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:36 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:37.767220 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:37.767855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:37.775374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.775841 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.776637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.777091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.926788 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.934719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1ad14b6d-efbc-4967-b938-0129640ad73e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1689 microversion: 2.1 time: 0.171891 Jul 18 14:19:37.935587 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3525/7270] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:37 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:38.953748 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:38.954379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:38.961306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.961780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:38.962566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.962999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:39.187447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:39.198033 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bb44e5ab-1f6f-41cf-8ef0-5458dda7ab01 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 200 len: 1689 microversion: 2.1 time: 0.247970 Jul 18 14:19:39.198820 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3746/7271] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:38 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:39.365982 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0455302d-d421-46f3-903b-3fb1d89843a6 req-05bf39c6-5275-4ac2-87ed-73428dfe5d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3c3c7e-cc14-4593-88b7-10ed8ea32d73", "name": "network-vif-deleted", "tag": "db13f6fd-ad71-429e-a12a-a040e06dbe96"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:39.376664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0455302d-d421-46f3-903b-3fb1d89843a6 req-05bf39c6-5275-4ac2-87ed-73428dfe5d79 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:39.377207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0455302d-d421-46f3-903b-3fb1d89843a6 req-05bf39c6-5275-4ac2-87ed-73428dfe5d79 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:39.389973 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0455302d-d421-46f3-903b-3fb1d89843a6 req-05bf39c6-5275-4ac2-87ed-73428dfe5d79 service nova] Creating event network-vif-deleted:db13f6fd-ad71-429e-a12a-a040e06dbe96 for instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 on n-h1-850003-3 Jul 18 14:19:39.395260 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0455302d-d421-46f3-903b-3fb1d89843a6 req-05bf39c6-5275-4ac2-87ed-73428dfe5d79 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jul 18 14:19:39.395884 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3526/7272] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:40.215501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:40.216132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:40.223236 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.223695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.224476 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.225186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.238829 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] HTTP exception thrown: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Request method failure captured: Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 HTTP/1.1 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Wuald00QCz0I7hDh1AiA4eMBBsPxBkESsRo8oDFOkMkH_QovuXXeoggwRTrvH9qfoVR-2ZrBuTOHjSUH2wU8I_WCM1c6LyJryo8spFEV0X7LTK_yo5RTTsL58Vej6LPMX1ZPYL4__DIx2MBS6YotXbpYkOxSBu4vEp1rf4818iwqAk Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f8c61aefdc324b50ae5d4e9b811a2cd0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4f6db2eaa88c4268969e748a9405afac Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '3a3c3c7e-cc14-4593-88b7-10ed8ea32d73'} Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:40.240466 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Returning 404 to user: Instance 3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52c9664a-1dc8-4f8f-8839-860ada48fd94 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73" status: 404 len: 111 microversion: 2.1 time: 0.030328 Jul 18 14:19:40.244856 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3747/7273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:40 2022] GET /compute/v2.1/servers/3a3c3c7e-cc14-4593-88b7-10ed8ea32d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:43.722759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-78845967-e462-4773-b8cd-054c519619d6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '.version_select at 0x7f96d7a268b0>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:43.744714 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-78845967-e462-4773-b8cd-054c519619d6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983736733" status: 202 len: 0 microversion: 2.1 time: 0.026053 Jul 18 14:19:43.745328 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3527/7274] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 14:19:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983736733 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:43.773187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5e33b07e-d89d-4770-97cc-af870f78d10f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: .version_select at 0x7f96d7153af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-355644053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiNTnyHI5EVpQLHosfOWovUsKY+wiKoX+9DQMG/xcDFXZDxpeDfJZO/QhfeVBs5AbMJnlrS891BYZif0J1zD8AttgbM+0I/jsDBHHAu5LK8iIuIgRvq4YNv+USMNwa1xQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:43.789879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-5e33b07e-d89d-4770-97cc-af870f78d10f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:43.796387 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-5e33b07e-d89d-4770-97cc-af870f78d10f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:43.822531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5e33b07e-d89d-4770-97cc-af870f78d10f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053523 Jul 18 14:19:43.823152 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3748/7275] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:19:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:49.478483 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-222745878", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "e92f29a7-8fe8-4645-ba33-2e884ebf57a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-355644053", "security_groups": [{"name": "tempest-secgroup-smoke-229474900"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:49.487848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:49.599441 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] validate_networks() for [('e92f29a7-8fe8-4645-ba33-2e884ebf57a4', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:50.047141 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:50.047856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:50.048438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:50.048868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:50.049300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:50.059453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.059918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.062843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.063399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.084648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:50.091147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:50.106340 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:50.109460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:50.160842 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3c4e4b6b-9301-4f36-b4ba-b52c2fab0bea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.686450 Jul 18 14:19:50.169949 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3528/7276] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:19:50.173093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-389177a4-58be-4af9-bb7b-d79ef64f8452 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:50.173712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-389177a4-58be-4af9-bb7b-d79ef64f8452 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:50.235084 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:50.264424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-389177a4-58be-4af9-bb7b-d79ef64f8452 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.282735 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-389177a4-58be-4af9-bb7b-d79ef64f8452 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1265 microversion: 2.1 time: 0.111056 Jul 18 14:19:50.283984 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3749/7277] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:50 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:51.303101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:51.304688 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:51.339782 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.342943 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.344039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.345107 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.473855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.483904 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-40e03a82-cc8a-4f8a-b9a4-58c3b435efb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1325 microversion: 2.1 time: 0.186979 Jul 18 14:19:51.485073 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3529/7278] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:51 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:52.501378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:52.502857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:52.515035 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.516625 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.518129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.518764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.735413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.744712 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2040cb4e-057a-45c3-b7a7-43b7745f3c29 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.247202 Jul 18 14:19:52.752113 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3750/7279] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:52 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:53.092837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-3a9128b1-0f43-4fbd-9ca8-4e325b90982c req-00abe486-df02-4041-a432-5d41febed3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e43ef84-c863-4b1d-a56b-8e8665d89a82", "tag": "7c92ad67-4c82-4f30-a3fb-8c958bad0117"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:53.103151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3a9128b1-0f43-4fbd-9ca8-4e325b90982c req-00abe486-df02-4041-a432-5d41febed3b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.109905 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-3a9128b1-0f43-4fbd-9ca8-4e325b90982c req-00abe486-df02-4041-a432-5d41febed3b1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.122901 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-3a9128b1-0f43-4fbd-9ca8-4e325b90982c req-00abe486-df02-4041-a432-5d41febed3b1 service nova] Creating event network-changed:7c92ad67-4c82-4f30-a3fb-8c958bad0117 for instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 on n-h1-850003-3 Jul 18 14:19:53.132862 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-3a9128b1-0f43-4fbd-9ca8-4e325b90982c req-00abe486-df02-4041-a432-5d41febed3b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043919 Jul 18 14:19:53.133496 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3530/7280] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:53.762855 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:53.763519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:53.770801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.771659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.772668 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.773183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.935009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.942944 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-be38ccbd-48a8-44cb-90aa-9a67401963ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.184011 Jul 18 14:19:53.943527 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3751/7281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:53 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:54.962746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.963931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.970457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.970931 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.971724 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.972185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.113424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.121529 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36acc3e3-5e6f-4a4c-9a45-73657ac3c248 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.164647 Jul 18 14:19:55.122106 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3531/7282] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:56.138930 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:56.139543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:56.146614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.147097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.147831 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.148696 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.394832 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.403825 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8f5478b6-b733-4133-9569-70cdaa736ff7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.268738 Jul 18 14:19:56.405164 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3752/7283] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:56 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:57.421848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.422633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.429714 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.430205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.431009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.431459 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.570861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.578683 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fcf916cc-cb14-4aa1-8545-f16dca414047 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.161525 Jul 18 14:19:57.579285 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3532/7284] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:58.399771 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-26fd38f2-1463-41b2-a92a-f477518824b1 req-6d408de8-0046-4ce0-9822-ec701283b4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e43ef84-c863-4b1d-a56b-8e8665d89a82", "name": "network-vif-plugged", "status": "completed", "tag": "7c92ad67-4c82-4f30-a3fb-8c958bad0117"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:58.410896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-26fd38f2-1463-41b2-a92a-f477518824b1 req-6d408de8-0046-4ce0-9822-ec701283b4f2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.411378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-26fd38f2-1463-41b2-a92a-f477518824b1 req-6d408de8-0046-4ce0-9822-ec701283b4f2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.425388 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-26fd38f2-1463-41b2-a92a-f477518824b1 req-6d408de8-0046-4ce0-9822-ec701283b4f2 service nova] Creating event network-vif-plugged:7c92ad67-4c82-4f30-a3fb-8c958bad0117 for instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 on n-h1-850003-3 Jul 18 14:19:58.430922 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-26fd38f2-1463-41b2-a92a-f477518824b1 req-6d408de8-0046-4ce0-9822-ec701283b4f2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Jul 18 14:19:58.431537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3753/7285] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:58.596266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.596899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.604498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.604957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.605757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.606229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.750814 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.759514 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-549ec718-3c5b-4093-ab8d-4c8a98fcc5b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.167206 Jul 18 14:19:58.760130 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3533/7286] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:59.777596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.778231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.785657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.786115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.786922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.787367 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.922718 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.931208 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-980d03c7-72e7-49d3-b561-22c6297de6e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1390 microversion: 2.1 time: 0.157871 Jul 18 14:19:59.932037 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3754/7287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:00.948589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.949742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.952608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:00.953333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:00.959272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.959746 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.960546 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.961003 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.096923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.104727 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8a2b5b51-d3bd-4dd1-935b-d8cdabd5eac6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1561 microversion: 2.1 time: 0.160151 Jul 18 14:20:01.105319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3534/7288] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:01.121253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.121870 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.123880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:01.125590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:01.131314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.131772 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.132547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.132987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.273937 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.281918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1ba80f66-6244-4ace-89af-9556b067effe tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1561 microversion: 2.1 time: 0.165032 Jul 18 14:20:01.282537 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3755/7289] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:02.919759 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2dd6bcdd-51d3-4de3-acd0-da6839f35cf3 req-9735ce86-6bf2-461f-9ca5-e27ff3de8bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e43ef84-c863-4b1d-a56b-8e8665d89a82", "tag": "7c92ad67-4c82-4f30-a3fb-8c958bad0117"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:02.922676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.923810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.926757 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:02.938071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.938660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.938936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2dd6bcdd-51d3-4de3-acd0-da6839f35cf3 req-9735ce86-6bf2-461f-9ca5-e27ff3de8bb6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.939413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2dd6bcdd-51d3-4de3-acd0-da6839f35cf3 req-9735ce86-6bf2-461f-9ca5-e27ff3de8bb6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.939531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.939906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.953170 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2dd6bcdd-51d3-4de3-acd0-da6839f35cf3 req-9735ce86-6bf2-461f-9ca5-e27ff3de8bb6 service nova] Creating event network-changed:7c92ad67-4c82-4f30-a3fb-8c958bad0117 for instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 on n-h1-850003-3 Jul 18 14:20:02.959025 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2dd6bcdd-51d3-4de3-acd0-da6839f35cf3 req-9735ce86-6bf2-461f-9ca5-e27ff3de8bb6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045136 Jul 18 14:20:02.959803 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3756/7290] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:03.100381 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.109122 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f34f9bf9-e26c-4c2e-a05b-d10104a0d01b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1561 microversion: 2.1 time: 0.198073 Jul 18 14:20:03.109732 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3535/7291] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:36.414703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:36.415632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:36.417840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:36.418531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:36.425467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.425924 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.426741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.427186 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.492657 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d83c9416-9f73-4cc5-93bb-ed3adc606b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action" status: 200 len: 24563 microversion: 2.1 time: 0.082840 Jul 18 14:20:36.493351 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3757/7292] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:20:36 2022] POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action => generated 24563 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:21:06.940563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.941246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=40 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.946338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:06.947341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:06.954169 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.954642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:06.955496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.955916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.031438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3729665c-794f-4d9b-b8a7-081b0c5b236f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action" status: 202 len: 0 microversion: 2.1 time: 0.092729 Jul 18 14:21:07.032120 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3536/7293] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:21:06 2022] POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:21:07.041206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:07.042106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:07.045979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:07.046667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:07.051525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.051986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.053258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.053717 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.604504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:07.612859 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f47a8aa2-bd48-4f58-8f92-38641b514410 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1671 microversion: 2.1 time: 0.575937 Jul 18 14:21:07.613804 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3758/7294] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:07 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1671 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:08.632490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:08.633207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:08.639775 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.640242 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:08.641030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.641481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:08.776342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:08.784245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-767bb710-6ab8-4c88-a407-cc3dd885eb9b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.157089 Jul 18 14:21:08.784830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3537/7295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:08 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:09.802462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:09.803822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:09.811827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:09.812279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:09.813043 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:09.813478 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:09.945946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:09.954027 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-35fa9792-eaba-44b7-99bb-da3d32d6ffdc tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.155401 Jul 18 14:21:09.954653 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3759/7296] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:09 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:10.971753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:10.972290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:10.979088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:10.979557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:10.980341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:10.980803 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:11.119173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:11.126993 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b226184c-f32c-415c-a0a9-9d4bf20b64bd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.159342 Jul 18 14:21:11.127572 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3538/7297] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:10 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:12.144856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:12.145471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:12.152822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.153273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.154055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.154903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.291321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:12.299240 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0def7c4b-2803-4043-9cdc-fd3b16fcfb17 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.158293 Jul 18 14:21:12.299821 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3760/7298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:12 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:13.317178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:13.317807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:13.324467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.324937 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.325753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.326236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.458936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:13.467226 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d1e9eb2c-d826-462a-ae3d-23f5b2364e7e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.154239 Jul 18 14:21:13.467802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3539/7299] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:13 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:14.485104 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:14.485721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:14.493419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.493877 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.494686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.495131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.628827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:14.637028 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7434d3b9-0342-4526-9af7-368a32142d0c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.155805 Jul 18 14:21:14.637612 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3761/7300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:14 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:15.654656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:15.655449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:15.662482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.662958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:15.663737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.664184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:15.800962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:15.808745 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c2e206b4-52db-4b43-9ded-9d6194f4cc4e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.158579 Jul 18 14:21:15.809320 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3540/7301] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:15 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:16.826666 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:16.827311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:16.834799 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.835249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.836020 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.836453 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.976791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:16.984374 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ab1333e-aa52-4051-8938-bcd757e5dd24 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.161608 Jul 18 14:21:16.984952 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3762/7302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:16 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:18.001621 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:18.002266 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:18.009997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.010489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.011270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.011973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.149736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:18.157913 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ae912f5a-c983-4756-81c6-1ec8bf8d16c8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1676 microversion: 2.1 time: 0.160196 Jul 18 14:21:18.158531 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3541/7303] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:17 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:19.176191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:19.176814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:19.184359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:19.184815 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:19.185586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:19.186029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:19.320534 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:19.328365 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbb1d4a5-acd4-46ee-bae4-2098b099400d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1679 microversion: 2.1 time: 0.156112 Jul 18 14:21:19.328956 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3763/7304] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:19 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:53.549467 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:53.550371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.552859 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:53.553544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:53.559569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.560038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.560834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.561292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.628160 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8f68d1e-81a4-4c32-b815-ef05352eda83 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action" status: 200 len: 69103 microversion: 2.1 time: 0.082685 Jul 18 14:21:53.628852 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3542/7305] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:21:53 2022] POST /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82/action => generated 69103 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:22:10.709055 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:10.710207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:10.716200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:10.716857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:10.716971 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:10.717301 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:10.720228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.720689 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.721682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.722126 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.757769 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:22:10.832305 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-14c1439e-c0d4-4117-80cc-9bcc41ee0cc1 req-b907cec7-67cd-4f42-960b-a8318510ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e43ef84-c863-4b1d-a56b-8e8665d89a82", "tag": "7c92ad67-4c82-4f30-a3fb-8c958bad0117"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:10.846052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14c1439e-c0d4-4117-80cc-9bcc41ee0cc1 req-b907cec7-67cd-4f42-960b-a8318510ef12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.846710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-14c1439e-c0d4-4117-80cc-9bcc41ee0cc1 req-b907cec7-67cd-4f42-960b-a8318510ef12 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.852070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7bf86a2f-d536-4cca-980d-916362d47064 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 204 len: 0 microversion: 2.1 time: 0.147500 Jul 18 14:22:10.853360 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3764/7306] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:22:10 2022] DELETE /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:22:10.860837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-14c1439e-c0d4-4117-80cc-9bcc41ee0cc1 req-b907cec7-67cd-4f42-960b-a8318510ef12 service nova] Creating event network-changed:7c92ad67-4c82-4f30-a3fb-8c958bad0117 for instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 on n-h1-850003-3 Jul 18 14:22:10.867200 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-14c1439e-c0d4-4117-80cc-9bcc41ee0cc1 req-b907cec7-67cd-4f42-960b-a8318510ef12 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157302 Jul 18 14:22:10.868423 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3543/7307] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:10.873563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:10.874355 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:10.880934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.881417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.882185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.882631 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.039300 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.048589 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-00189c56-7a1f-4a6a-9390-155ae6396941 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1685 microversion: 2.1 time: 0.184369 Jul 18 14:22:11.049708 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3765/7308] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:10 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:12.070303 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:12.071040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:12.078522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.078996 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.079805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.080253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.258290 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.269750 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3ba9660a-8e89-428f-ac97-23b26cafd93d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1685 microversion: 2.1 time: 0.206211 Jul 18 14:22:12.270980 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3544/7309] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:13.295354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:13.296679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:13.306464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-075a1013-e7f2-429b-9e1c-52cfb8ed7c19 req-cbea445d-f95d-4d5e-9dc5-cca5c49a8ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e43ef84-c863-4b1d-a56b-8e8665d89a82", "name": "network-vif-deleted", "tag": "7c92ad67-4c82-4f30-a3fb-8c958bad0117"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:13.314522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.315274 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.316618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.317356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.322625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-075a1013-e7f2-429b-9e1c-52cfb8ed7c19 req-cbea445d-f95d-4d5e-9dc5-cca5c49a8ddd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.323393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-075a1013-e7f2-429b-9e1c-52cfb8ed7c19 req-cbea445d-f95d-4d5e-9dc5-cca5c49a8ddd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.344627 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-075a1013-e7f2-429b-9e1c-52cfb8ed7c19 req-cbea445d-f95d-4d5e-9dc5-cca5c49a8ddd service nova] Creating event network-vif-deleted:7c92ad67-4c82-4f30-a3fb-8c958bad0117 for instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 on n-h1-850003-3 Jul 18 14:22:13.354209 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-075a1013-e7f2-429b-9e1c-52cfb8ed7c19 req-cbea445d-f95d-4d5e-9dc5-cca5c49a8ddd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054593 Jul 18 14:22:13.355443 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3545/7310] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:13.429586 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.443813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d9cfc841-3446-46ad-8e39-409b23cbf88b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 200 len: 1500 microversion: 2.1 time: 0.155630 Jul 18 14:22:13.444892 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3766/7311] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:13 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:14.470778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:14.471406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: 2e43ef84-c863-4b1d-a56b-8e8665d89a82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:14.478041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.478535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.479333 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.479785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.494953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] HTTP exception thrown: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Request method failure captured: Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 HTTP/1.1 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wuald00QCz0I7hDh1AiA4eMBBsPxBkESsRo8oDFOkMkH_QovuXXeoggwRTrvH9qfoVR-2ZrBuTOHjSUH2wU8I_WCM1c6LyJryo8spFEV0X7LTK_yo5RTTsL58Vej6LPMX1ZPYL4__DIx2MBS6YotXbpYkOxSBu4vEp1rf4818iwqAk Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f8c61aefdc324b50ae5d4e9b811a2cd0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4f6db2eaa88c4268969e748a9405afac Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': '2e43ef84-c863-4b1d-a56b-8e8665d89a82'} Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:14.496659 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Returning 404 to user: Instance 2e43ef84-c863-4b1d-a56b-8e8665d89a82 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a7c4ae5-d9fa-44c6-9e92-d32301168b48 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82" status: 404 len: 111 microversion: 2.1 time: 0.033798 Jul 18 14:22:14.501109 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3546/7312] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:14 2022] GET /compute/v2.1/servers/2e43ef84-c863-4b1d-a56b-8e8665d89a82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:22:18.357875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-864df4c2-70f8-4d29-a89b-34114ebf4e0b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '.version_select at 0x7f96d7161b80>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:18.361691 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-864df4c2-70f8-4d29-a89b-34114ebf4e0b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:22:19.370417 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-864df4c2-70f8-4d29-a89b-34114ebf4e0b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 38778. Jul 18 14:22:19.390527 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-864df4c2-70f8-4d29-a89b-34114ebf4e0b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355644053" status: 202 len: 0 microversion: 2.1 time: 1.037125 Jul 18 14:22:19.391141 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3767/7313] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 14:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355644053 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:22:19.420208 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: .version_select at 0x7f96e41f6790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-573992390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhrueMKrh9IT9xE1KFiJ8FL1u+1Gosejv2xyo44uvYbQxnksma7hVDo142QOPAY1yuphY555a4rRpK3F/y0BEoshJJ4EzdrX1evtYKC+MFIDcZMe2aTx+RyVqlAfNhu/A=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:19.435963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:22:19.443097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:22:19.456359 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:22:20.464314 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 38782. Jul 18 14:22:20.481385 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ceea6cfd-aa5d-4e0e-ba14-75935a5b2659 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.065232 Jul 18 14:22:20.482023 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3547/7314] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:22:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:26.350342 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:26.354740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2040896456", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "dafd977a-d230-4d12-a8ef-8a6bdad06d7d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-573992390", "security_groups": [{"name": "tempest-secgroup-smoke-479515136"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:26.487503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] validate_networks() for [('dafd977a-d230-4d12-a8ef-8a6bdad06d7d', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:22:26.968264 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:22:26.968840 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:22:26.969648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:22:26.970466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:22:26.970826 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:22:26.981095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.981556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.982578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.982846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.000960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:22:27.006847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:22:27.020311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:22:27.022650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:22:27.068794 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [bd491d0c-716e-483e-bf8c-6370086eabda] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:22:28.077968 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [bd491d0c-716e-483e-bf8c-6370086eabda] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 38830. Jul 18 14:22:28.082438 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-817f2484-5c2e-4f62-92bd-3bdd5387538e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.734030 Jul 18 14:22:28.083108 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3768/7315] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:22:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:22:28.093933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-41761538-47cb-42ff-b606-dad1923d80d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:28.095510 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-41761538-47cb-42ff-b606-dad1923d80d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:28.101513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:28.209492 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-41761538-47cb-42ff-b606-dad1923d80d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:28.217812 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-41761538-47cb-42ff-b606-dad1923d80d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1266 microversion: 2.1 time: 0.128435 Jul 18 14:22:28.228637 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3548/7316] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:28 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:29.235966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:29.237410 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.251896 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.252633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.253843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.254996 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.341059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.352375 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ee41da47-91fc-441b-9398-65a8260baec9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1326 microversion: 2.1 time: 0.120668 Jul 18 14:22:29.353369 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3769/7317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:29 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:30.371286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:30.371917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:30.379272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.379786 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.380594 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.381051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.626899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.635237 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d5601965-f2c0-47c1-b27d-88c274b06fd7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.267800 Jul 18 14:22:30.635830 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3549/7318] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:30 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:30.956851 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-2af32d61-e556-45d3-a6a0-be4fb60b9a2d req-8236014c-9c2f-4c8f-8c55-9ab197cbfdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:30.976018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2af32d61-e556-45d3-a6a0-be4fb60b9a2d req-8236014c-9c2f-4c8f-8c55-9ab197cbfdf2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.976486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-2af32d61-e556-45d3-a6a0-be4fb60b9a2d req-8236014c-9c2f-4c8f-8c55-9ab197cbfdf2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.991642 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-2af32d61-e556-45d3-a6a0-be4fb60b9a2d req-8236014c-9c2f-4c8f-8c55-9ab197cbfdf2 service nova] Creating event network-changed:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h2-850003-3 Jul 18 14:22:30.997843 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-2af32d61-e556-45d3-a6a0-be4fb60b9a2d req-8236014c-9c2f-4c8f-8c55-9ab197cbfdf2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045557 Jul 18 14:22:30.998525 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3770/7319] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:31.654336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:31.654980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:31.663552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.664029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.664865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.665335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.845197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:31.853936 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-915d2012-201b-424f-a5f9-968fe354bff3 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.203835 Jul 18 14:22:31.854588 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3550/7320] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:31 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:32.872372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:32.873073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:32.880289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.880739 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.881519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.881961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.019920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.027951 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-51972010-68ce-405b-81aa-2a8a43e512ec tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.159821 Jul 18 14:22:33.028524 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3771/7321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:32 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:34.045802 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:34.046449 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:34.054348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.054816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.055608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.056062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.197288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.204929 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0e148d0e-243c-4624-b59f-56c0c992e783 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.163249 Jul 18 14:22:34.205504 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3551/7322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:34 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:35.222878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:35.223994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:35.231185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.231455 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.232223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.232654 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.369951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:35.377854 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a5b551a3-5671-4735-895c-cdd0ea382d57 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.159019 Jul 18 14:22:35.378480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3772/7323] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:35 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:36.395721 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:36.396497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:36.403861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:36.404584 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:36.405372 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:36.405881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:36.538592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:36.546231 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3653509a-70bd-4e0a-81e1-0f2503e9dd3d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.154741 Jul 18 14:22:36.546817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3552/7324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:36 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:36.894452 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:22:36.894696 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:22:37.003483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:37.014051 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:37.080027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-7d217c01-bef7-49df-8ac8-919eccdd5222 req-c7bb6cd1-9d1e-4821-8ae5-0372285d124d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "name": "network-vif-plugged", "status": "completed", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:37.089837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7d217c01-bef7-49df-8ac8-919eccdd5222 req-c7bb6cd1-9d1e-4821-8ae5-0372285d124d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.090322 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-7d217c01-bef7-49df-8ac8-919eccdd5222 req-c7bb6cd1-9d1e-4821-8ae5-0372285d124d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.101881 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-7d217c01-bef7-49df-8ac8-919eccdd5222 req-c7bb6cd1-9d1e-4821-8ae5-0372285d124d service nova] Creating event network-vif-plugged:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h2-850003-3 Jul 18 14:22:37.106920 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-7d217c01-bef7-49df-8ac8-919eccdd5222 req-c7bb6cd1-9d1e-4821-8ae5-0372285d124d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109055 Jul 18 14:22:37.107534 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3773/7325] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:37.564189 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:37.564887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:37.572619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.573091 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.573893 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.574379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.732717 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:37.740953 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dbc9e543-a6d3-48b9-a13c-4fd7fecd872a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1391 microversion: 2.1 time: 0.180981 Jul 18 14:22:37.741534 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3553/7326] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:37 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:38.759672 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:38.760373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:38.769618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.771141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.772537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.773212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.910638 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:38.918268 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4d3143ee-96c3-4764-9f0f-1619a57d0de2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1564 microversion: 2.1 time: 0.164115 Jul 18 14:22:38.918786 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3774/7327] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:38 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:38.935054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:38.935685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:38.937665 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:38.944437 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.944887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.945680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.946204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.083461 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.091193 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d0a02efd-9a6e-40ee-b54f-c23fb2a3e40d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1564 microversion: 2.1 time: 0.160193 Jul 18 14:22:39.091770 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3554/7328] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:38 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:40.720569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:40.721364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:40.724164 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-0555edf6-ba66-4b2b-bdf9-948e84231f68 req-241139aa-0666-4c84-8e1c-65e83a2efad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:40.725052 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:40.730524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:40.730737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.731183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.732155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.732626 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.735534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0555edf6-ba66-4b2b-bdf9-948e84231f68 req-241139aa-0666-4c84-8e1c-65e83a2efad9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.736182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-0555edf6-ba66-4b2b-bdf9-948e84231f68 req-241139aa-0666-4c84-8e1c-65e83a2efad9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.749613 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-0555edf6-ba66-4b2b-bdf9-948e84231f68 req-241139aa-0666-4c84-8e1c-65e83a2efad9 service nova] Creating event network-changed:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h2-850003-3 Jul 18 14:22:40.755293 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-0555edf6-ba66-4b2b-bdf9-948e84231f68 req-241139aa-0666-4c84-8e1c-65e83a2efad9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036035 Jul 18 14:22:40.757380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3555/7329] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:22:40.897016 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.905831 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fd8a863b-d592-47bc-9004-e579a6f7f700 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1564 microversion: 2.1 time: 0.189423 Jul 18 14:22:40.906542 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3775/7330] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:40 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:04.157315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=38 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:04.158086 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:04.214995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:04.216057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:04.223405 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:04.223917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:04.224831 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:04.225356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:04.279610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-010c3297-1932-41a9-9892-8c1083cc60c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action" status: 200 len: 24563 microversion: 2.1 time: 0.123799 Jul 18 14:23:04.280323 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3556/7331] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:23:04 2022] POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action => generated 24563 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:23:15.306608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:15.307627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:15.309998 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:15.310661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:15.317459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.317908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:15.318708 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.319144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:15.633777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:15.640444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Old instance type m1.heat2, new instance type m1.heat {{(pid=131366) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 14:23:15.647191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:23:15.647614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:23:15.648090 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:23:15.648505 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:23:15.648918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:23:15.724603 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-90b3ae3a-158b-4ddb-9e5d-d2f9e3144a88 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action" status: 202 len: 0 microversion: 2.1 time: 0.421918 Jul 18 14:23:15.725296 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3776/7332] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:23:15 2022] POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:15.734732 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:15.735458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:15.739472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:15.740321 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:15.748087 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.748556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:15.749528 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.750205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:16.308805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:16.317311 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10ee01f2-fffe-4262-8ec6-c86cc470a03c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1692 microversion: 2.1 time: 0.587107 Jul 18 14:23:16.317914 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3557/7333] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:15 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1692 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:17.336095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:17.336715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:17.343782 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:17.344241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:17.345030 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:17.345467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:17.486550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:17.494824 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db4cc33d-793a-4fe9-be5d-98a0182b3b30 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1692 microversion: 2.1 time: 0.163633 Jul 18 14:23:17.495389 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3777/7334] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:17 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:18.513007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:18.513558 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:18.522344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.522815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.523617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.524071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.658088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:18.665867 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-138f7ec3-6562-4741-82ee-0bab6e6cb380 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.156980 Jul 18 14:23:18.666587 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3558/7335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:18 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:19.683990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:19.684632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:19.691843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:19.692299 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:19.693067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:19.694039 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:19.829024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:19.837676 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-40358a30-5256-4364-a15f-733f6e38437d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.157637 Jul 18 14:23:19.838283 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3778/7336] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:19 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:20.856416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:20.857159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:20.864740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.865197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.865978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.866460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.005184 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:21.013056 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-159c3044-06ba-405b-a002-3258693d7b2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.160655 Jul 18 14:23:21.013640 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3559/7337] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:20 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:22.030789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:22.031434 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:22.039215 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.039673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.040445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.040882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.182671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.190617 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0c974d96-b225-4451-8226-7d4b8f9fdfc6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.164024 Jul 18 14:23:22.191223 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3779/7338] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:22 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:23.208264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:23.209077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:23.216884 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.217364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.218589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.219052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.352370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:23.362093 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-89308e12-08c8-4a23-9204-ff5c5de7e4b1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.157742 Jul 18 14:23:23.363533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3560/7339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:23 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:24.381218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:24.381833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:24.388173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:24.388628 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.389398 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:24.389836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.524947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:24.532782 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cae0aa61-a3ac-425f-aec9-a45666664bf8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.156256 Jul 18 14:23:24.533439 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3780/7340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:24 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:25.549701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:25.550267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:25.557474 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.557936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.558774 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.559221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.712989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:25.720837 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4af474b3-33bc-454b-ad3e-3fdc1ef7f27e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.175148 Jul 18 14:23:25.721424 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3561/7341] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:25 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:26.738444 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:26.739067 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:26.748747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.749207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.750071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.750711 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.892964 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:26.901406 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-185673d7-7755-4c64-95cb-096c319a9142 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.166997 Jul 18 14:23:26.901992 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3781/7342] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:26 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:23:27.920040 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:27.920758 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:27.928002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.928527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:27.929292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.929749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.071879 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:28.080090 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-05a153d4-4f56-4408-b931-95e0d5143fbd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.164659 Jul 18 14:23:28.080688 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3562/7343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:27 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:29.097529 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:29.098200 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:29.105207 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.105662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.106471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.106938 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.244096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:29.252214 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d82b2ffe-672e-4f2e-bded-110b140ad979 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.158577 Jul 18 14:23:29.252817 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3782/7344] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:29 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:30.273082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:30.274336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:30.282058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.282552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.283385 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.283834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.498696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.506438 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a76317c9-bd68-4fef-b994-8c9ce2775eb0 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.237359 Jul 18 14:23:30.507045 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3563/7345] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:30 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:31.524691 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:31.525309 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:31.532667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.533122 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.533897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.534381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.669747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.678231 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16a4c363-8f86-48ed-b8f7-163a3c3448e6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.157514 Jul 18 14:23:31.678849 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3783/7346] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:31 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:32.695718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.696349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.703497 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.703963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.704744 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.705191 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.849967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:32.857774 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4435c796-93b2-4465-9471-4a4a9b3cd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.165922 Jul 18 14:23:32.858405 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3564/7347] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:32 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:23:33.875986 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:33.876581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:33.883806 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:33.884262 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:33.885042 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:33.885485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:34.026699 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:34.035583 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e5e46895-8ad6-4222-976c-e3443f6d7f34 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1697 microversion: 2.1 time: 0.163322 Jul 18 14:23:34.036185 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3784/7348] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:33 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:35.053625 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:35.054230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:35.061412 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.061864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.062704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.063160 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.282730 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:35.291011 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-887be9b3-f98f-41d2-b4fd-906adf2e9638 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1696 microversion: 2.1 time: 0.241988 Jul 18 14:23:35.291628 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3565/7349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:35 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:35.573761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:35.584766 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.585326 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.598886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] Creating event network-vif-unplugged:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h1-850003-3 Jul 18 14:23:35.605232 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:23:35.621776 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-1ff2945b-8c20-47c5-b288-56089c8e0c67 req-223a575c-cb1f-4396-b6c8-2baf97a75be4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051405 Jul 18 14:23:35.623559 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3785/7350] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:23:36.308912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:36.309747 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:36.317513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.318080 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.318957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.319477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.562956 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:36.570869 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-656a83e1-074d-4f54-b15e-288d75a55664 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1696 microversion: 2.1 time: 0.265822 Jul 18 14:23:36.571472 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3566/7351] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:36 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:37.588678 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:37.589382 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:37.596686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.597138 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.597908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.598390 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.637684 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:37.647618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.648073 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.661257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] Creating event network-changed:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h1-850003-3 Jul 18 14:23:37.666998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850003-3', 'n-h1-850003-3'} {{(pid=131367) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 14:23:37.678794 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-2ed6836a-38b0-486f-9a16-ab844023fe1a req-4b61de39-82df-487f-afe1-a57ba7455ae6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044669 Jul 18 14:23:37.679425 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3567/7352] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:23:37.741698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:37.749907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6be8e1e4-7b69-416d-8623-3dfcaea9ac4c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1694 microversion: 2.1 time: 0.165405 Jul 18 14:23:37.750586 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3786/7353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:37 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:38.768647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:38.769366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:38.775823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.776294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:38.777079 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.777533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:38.913282 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:38.922036 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-52ffefaf-73d5-4408-94c3-2b219a6e6026 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1694 microversion: 2.1 time: 0.158680 Jul 18 14:23:38.922662 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3568/7354] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:38 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:39.939761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:39.940939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:39.948349 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:39.948807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:39.949596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:39.950040 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.103098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.112551 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2b8659a9-2ed7-45a0-abbf-748766572e99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1691 microversion: 2.1 time: 0.176630 Jul 18 14:23:40.113165 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3787/7355] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:39 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:40.129353 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:40.129911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:40.137275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.137736 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.138563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.139019 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.205740 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c66f175f-46d6-435d-97a1-88fe46885a3f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action" status: 204 len: 0 microversion: 2.1 time: 0.080413 Jul 18 14:23:40.207016 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3569/7356] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:23:40 2022] POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:40.215037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:40.215663 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:40.231364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.231843 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.232617 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.233065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.380485 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.388333 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f3e55921-2f4b-476e-9d1c-da7f4f330057 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1691 microversion: 2.1 time: 0.177393 Jul 18 14:23:40.389008 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3788/7357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:40 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:40.406640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:40.407368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:40.414535 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.415131 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.415932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.416390 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.764939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.773527 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4b0e8a27-96e2-48b9-b2dd-6bd38b52f2ab tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1691 microversion: 2.1 time: 0.371578 Jul 18 14:23:40.774123 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3570/7358] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:40 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1691 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:41.791404 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:41.792009 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:41.800150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.800614 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.801401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.801847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.943895 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:41.952361 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9da2e3aa-2c31-40a5-b89d-2bc65e2cba21 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1691 microversion: 2.1 time: 0.164951 Jul 18 14:23:41.952941 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3789/7359] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:41 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:42.970990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:42.971600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:42.978780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.979252 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:42.980062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.980521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:43.115950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:43.123664 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c3842d5-e81f-421b-8c19-7ab65ec8ec59 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1683 microversion: 2.1 time: 0.156941 Jul 18 14:23:43.124252 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3571/7360] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:42 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:43.579515 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5a2ed63f-6e35-45d8-82fc-cc3cf3f31314 req-8ce979da-d405-498c-b917-ff3a3b8e2ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "name": "network-vif-plugged", "status": "completed", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:43.588898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5a2ed63f-6e35-45d8-82fc-cc3cf3f31314 req-8ce979da-d405-498c-b917-ff3a3b8e2ec4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:43.589354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5a2ed63f-6e35-45d8-82fc-cc3cf3f31314 req-8ce979da-d405-498c-b917-ff3a3b8e2ec4 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:43.602967 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5a2ed63f-6e35-45d8-82fc-cc3cf3f31314 req-8ce979da-d405-498c-b917-ff3a3b8e2ec4 service nova] Creating event network-vif-plugged:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h1-850003-3 Jul 18 14:23:43.608379 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5a2ed63f-6e35-45d8-82fc-cc3cf3f31314 req-8ce979da-d405-498c-b917-ff3a3b8e2ec4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Jul 18 14:23:43.609048 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3790/7361] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:13.339899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:13.340837 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:13.343379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=30 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:13.344054 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:13.351046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.351524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.352293 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.352761 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.418188 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d58e6629-b186-4928-818a-566deb84306d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action" status: 200 len: 24580 microversion: 2.1 time: 0.081881 Jul 18 14:24:13.418828 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3572/7362] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:24:13 2022] POST /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46/action => generated 24580 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:24:36.999376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-bfd5a970-950d-4ccb-b0b5-277a5e9d9897 req-ccc58536-f86a-49f2-b505-e461e4fcbd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:37.004407 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:37.005065 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=4 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:37.007397 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:37.008288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:37.013036 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:37.013633 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:37.018603 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bfd5a970-950d-4ccb-b0b5-277a5e9d9897 req-ccc58536-f86a-49f2-b505-e461e4fcbd95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:37.019039 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-bfd5a970-950d-4ccb-b0b5-277a5e9d9897 req-ccc58536-f86a-49f2-b505-e461e4fcbd95 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:37.021837 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:37.022320 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:37.023333 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:37.023977 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:37.031201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-bfd5a970-950d-4ccb-b0b5-277a5e9d9897 req-ccc58536-f86a-49f2-b505-e461e4fcbd95 service nova] Creating event network-changed:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h1-850003-3 Jul 18 14:24:37.036489 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-bfd5a970-950d-4ccb-b0b5-277a5e9d9897 req-ccc58536-f86a-49f2-b505-e461e4fcbd95 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041133 Jul 18 14:24:37.037232 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3573/7363] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:37.054901 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:24:37.156696 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d634c029-7b39-45b6-b4e0-9b9601dd2e9e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 204 len: 0 microversion: 2.1 time: 0.163752 Jul 18 14:24:37.157236 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3791/7364] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:24:36 2022] DELETE /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:24:37.171949 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:37.173359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:37.184642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:37.185502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:37.186985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:37.187832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:37.376136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:37.384603 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f81d0288-5acd-4f26-80fe-d4158871efd6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1689 microversion: 2.1 time: 0.221689 Jul 18 14:24:37.385283 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3574/7365] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:37 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:38.403373 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:38.404071 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:38.411086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:38.411539 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:38.412304 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:38.412741 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:38.594590 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:38.602411 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-db76166e-a661-468b-87c4-1b4779d8efe8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1689 microversion: 2.1 time: 0.203585 Jul 18 14:24:38.602979 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3792/7366] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:38 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:39.325064 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ae64feca-145a-4d15-8aaa-b72a1c876863 req-93cf5213-be1e-4c3d-8f68-f825283587f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5ae17-3613-4735-8099-a83a86a4ea46", "name": "network-vif-deleted", "tag": "6bc51c5c-8520-46fe-ad02-96d93f904f3c"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:39.333513 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ae64feca-145a-4d15-8aaa-b72a1c876863 req-93cf5213-be1e-4c3d-8f68-f825283587f9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.333980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ae64feca-145a-4d15-8aaa-b72a1c876863 req-93cf5213-be1e-4c3d-8f68-f825283587f9 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.345780 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ae64feca-145a-4d15-8aaa-b72a1c876863 req-93cf5213-be1e-4c3d-8f68-f825283587f9 service nova] Creating event network-vif-deleted:6bc51c5c-8520-46fe-ad02-96d93f904f3c for instance cdd5ae17-3613-4735-8099-a83a86a4ea46 on n-h1-850003-3 Jul 18 14:24:39.350881 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ae64feca-145a-4d15-8aaa-b72a1c876863 req-93cf5213-be1e-4c3d-8f68-f825283587f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087818 Jul 18 14:24:39.351502 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3575/7367] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:39.620218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:39.620838 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:39.629421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.629667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.630439 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.630890 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.671144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.671781 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.672245 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lazy-loading 'fault' on Instance uuid cdd5ae17-3613-4735-8099-a83a86a4ea46 {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:39.721228 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:39.729220 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a740357c-a065-4bc4-8cb4-e0ee68531fb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 200 len: 1356 microversion: 2.1 time: 0.113043 Jul 18 14:24:39.729816 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3793/7368] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:39 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:40.748911 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:40.749668 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: cdd5ae17-3613-4735-8099-a83a86a4ea46] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:40.756119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:40.756592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:40.757383 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:40.757845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:40.771360 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] HTTP exception thrown: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Request method failure captured: Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 HTTP/1.1 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wuald00QCz0I7hDh1AiA4eMBBsPxBkESsRo8oDFOkMkH_QovuXXeoggwRTrvH9qfoVR-2ZrBuTOHjSUH2wU8I_WCM1c6LyJryo8spFEV0X7LTK_yo5RTTsL58Vej6LPMX1ZPYL4__DIx2MBS6YotXbpYkOxSBu4vEp1rf4818iwqAk Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f8c61aefdc324b50ae5d4e9b811a2cd0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4f6db2eaa88c4268969e748a9405afac Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'cdd5ae17-3613-4735-8099-a83a86a4ea46'} Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:40.773009 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Returning 404 to user: Instance cdd5ae17-3613-4735-8099-a83a86a4ea46 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-82522096-8776-43e0-8b85-5b25d7676722 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jul 18 14:24:40.777991 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3576/7369] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:40 2022] GET /compute/v2.1/servers/cdd5ae17-3613-4735-8099-a83a86a4ea46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:24:44.175516 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4a00f1e4-560a-46c2-b166-ec2a0fdf4ca2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '.version_select at 0x7f96d733cf70>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:44.199043 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4a00f1e4-560a-46c2-b166-ec2a0fdf4ca2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-573992390" status: 202 len: 0 microversion: 2.1 time: 0.028635 Jul 18 14:24:44.204006 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3794/7370] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 14:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-573992390 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:24:44.228881 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f6d36577-13e5-41ef-b00e-5ceecf1be49f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: .version_select at 0x7f96e41b5dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-721003011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4dIINCjcemGUzN0y05fl7k7AA8eOesz2aeR/3cSAV8D1xT1YftZyEERFNXlhogbp0vq56aWadSfa1HXTWBtZjMfpjv/B1qXM1GgylPXa8td4cGvDNv1GI8tdY1xvw3nA=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:44.243581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f6d36577-13e5-41ef-b00e-5ceecf1be49f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:44.250210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-f6d36577-13e5-41ef-b00e-5ceecf1be49f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:44.274593 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f6d36577-13e5-41ef-b00e-5ceecf1be49f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049803 Jul 18 14:24:44.275212 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3577/7371] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:24:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:50.124629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1451922533", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "8116f09a-e3bf-4478-9e6b-c602941b99d9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-721003011", "security_groups": [{"name": "tempest-secgroup-smoke-1426949045"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:50.133501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:50.248994 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] validate_networks() for [('8116f09a-e3bf-4478-9e6b-c602941b99d9', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:24:50.694028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:24:50.694555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:24:50.695129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:24:50.695615 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:24:50.696105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:24:50.722454 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:50.723569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:50.724693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:50.725646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:50.753222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:50.760002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:50.797416 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:24:50.801147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:24:50.879503 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56723fae-abff-4035-b599-1fa16549b7d9 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759035 Jul 18 14:24:50.880858 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3795/7372] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:24:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:24:50.890637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c9dd81d-b0a5-417d-8f41-871544dcf540 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:50.891284 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c9dd81d-b0a5-417d-8f41-871544dcf540 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:50.908481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=12 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:50.983753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c9dd81d-b0a5-417d-8f41-871544dcf540 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:50.993391 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c9dd81d-b0a5-417d-8f41-871544dcf540 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1266 microversion: 2.1 time: 0.106735 Jul 18 14:24:50.993994 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3578/7373] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:50 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:52.017260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:52.018671 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:52.033592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:52.035892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:52.036780 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:52.037934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:52.154791 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:52.166328 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-839de732-beb4-4ea0-8583-f8089fe9312d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1326 microversion: 2.1 time: 0.158253 Jul 18 14:24:52.170875 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3796/7374] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:52 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:53.187020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:53.187892 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:53.196393 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:53.196962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:53.198128 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:53.198682 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:53.375173 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:53.385515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0221661f-490c-4233-acda-74aec55ad0ca tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.202370 Jul 18 14:24:53.386481 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3579/7375] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:53 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:53.687803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-27aec79e-215b-4ac5-9ca5-18b997526122 req-40dcc181-7fa9-4c6b-a9ad-a1dc40b4442b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22ed882-8597-4a7e-b358-7c228a300449", "tag": "b09bd80d-c012-4b43-a137-ef42ec5652c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:53.714178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-27aec79e-215b-4ac5-9ca5-18b997526122 req-40dcc181-7fa9-4c6b-a9ad-a1dc40b4442b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:53.714635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-27aec79e-215b-4ac5-9ca5-18b997526122 req-40dcc181-7fa9-4c6b-a9ad-a1dc40b4442b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:53.728539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-27aec79e-215b-4ac5-9ca5-18b997526122 req-40dcc181-7fa9-4c6b-a9ad-a1dc40b4442b service nova] Creating event network-changed:b09bd80d-c012-4b43-a137-ef42ec5652c9 for instance b22ed882-8597-4a7e-b358-7c228a300449 on n-h1-850003-3 Jul 18 14:24:53.734060 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-27aec79e-215b-4ac5-9ca5-18b997526122 req-40dcc181-7fa9-4c6b-a9ad-a1dc40b4442b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060871 Jul 18 14:24:53.735099 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3797/7376] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:54.403864 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:54.404488 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:54.418174 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:54.418658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:54.419446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:54.419895 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:54.558672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:54.566981 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c866b4dc-4220-4a8e-ba89-a1afdb602985 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.167353 Jul 18 14:24:54.567564 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3580/7377] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:54 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:55.585124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:55.585833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:55.593095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:55.593545 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:55.594357 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:55.595471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:55.732133 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:55.741319 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4dab0d2c-dbef-46ea-a25c-e5c8a3a2b63a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.159547 Jul 18 14:24:55.741905 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3798/7378] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:55 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:56.758342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:56.758980 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:56.765994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:56.767076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:56.767791 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:56.768248 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:56.900384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:56.908739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6f00eb28-fb5f-49f5-a9ac-85fefec6dffd tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.154423 Jul 18 14:24:56.909322 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3581/7379] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:56 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:57.925646 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:57.926311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:57.933240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:57.933690 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:57.934498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:57.934941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:58.090658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:58.098928 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-1a5539b4-41c4-46b0-9b7f-5f52f7c17cb2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.177953 Jul 18 14:24:58.099516 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3799/7380] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:57 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:59.116511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:59.117139 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:59.124320 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:59.124787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:59.125578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:59.126641 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:59.271334 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:59.279746 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2e5b8533-a800-4d32-b462-ebf66e77d160 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.167021 Jul 18 14:24:59.280274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3582/7381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:59 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:59.928306 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-5a116a42-dfee-45ba-abc8-3477d2fd256e req-c0e07bb0-2de0-4664-b175-05948f4b80cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22ed882-8597-4a7e-b358-7c228a300449", "name": "network-vif-plugged", "status": "completed", "tag": "b09bd80d-c012-4b43-a137-ef42ec5652c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:59.937474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5a116a42-dfee-45ba-abc8-3477d2fd256e req-c0e07bb0-2de0-4664-b175-05948f4b80cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:59.937923 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-5a116a42-dfee-45ba-abc8-3477d2fd256e req-c0e07bb0-2de0-4664-b175-05948f4b80cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:59.950193 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-5a116a42-dfee-45ba-abc8-3477d2fd256e req-c0e07bb0-2de0-4664-b175-05948f4b80cc service nova] Creating event network-vif-plugged:b09bd80d-c012-4b43-a137-ef42ec5652c9 for instance b22ed882-8597-4a7e-b358-7c228a300449 on n-h1-850003-3 Jul 18 14:24:59.955318 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-5a116a42-dfee-45ba-abc8-3477d2fd256e req-c0e07bb0-2de0-4664-b175-05948f4b80cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Jul 18 14:24:59.956042 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3800/7382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:00.296928 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:00.297568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:00.304695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:00.305170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:00.305967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:00.306458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:00.436989 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:00.445086 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-091851af-abf2-4ad3-aa2f-84c986874f2d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.152171 Jul 18 14:25:00.445680 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3583/7383] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:00 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:01.458841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:01.459602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:01.464643 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:01.465350 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:01.473253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:01.473705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:01.474536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:01.474976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:01.616196 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:01.624173 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4e4e30bc-d863-4044-af1f-b245b93da3d5 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1392 microversion: 2.1 time: 0.166197 Jul 18 14:25:01.624896 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3801/7384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:01 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:02.641351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:02.642616 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:02.644608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:02.650909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:02.651374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:02.652154 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:02.652606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:02.788419 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:02.796382 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-547194ed-0999-4457-ba93-351e337c0aee tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1564 microversion: 2.1 time: 0.158937 Jul 18 14:25:02.796975 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3584/7385] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:02 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:02.815147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:02.815777 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:02.823255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:02.823715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:02.824501 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:02.824945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:02.965050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:02.972714 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cbf4873b-01ff-4233-8a9d-f189639f9217 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1564 microversion: 2.1 time: 0.162155 Jul 18 14:25:02.973302 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3802/7386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:02 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:04.913145 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:04.913773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:04.918981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fbef3e50-11b7-411f-b684-28b1d12daaa4 req-7f3add21-67f2-4f61-b617-8e4dd6d6efde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22ed882-8597-4a7e-b358-7c228a300449", "tag": "b09bd80d-c012-4b43-a137-ef42ec5652c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:04.929857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:04.930485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:04.931398 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:04.931921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:04.932123 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fbef3e50-11b7-411f-b684-28b1d12daaa4 req-7f3add21-67f2-4f61-b617-8e4dd6d6efde service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:04.932650 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fbef3e50-11b7-411f-b684-28b1d12daaa4 req-7f3add21-67f2-4f61-b617-8e4dd6d6efde service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:04.946340 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fbef3e50-11b7-411f-b684-28b1d12daaa4 req-7f3add21-67f2-4f61-b617-8e4dd6d6efde service nova] Creating event network-changed:b09bd80d-c012-4b43-a137-ef42ec5652c9 for instance b22ed882-8597-4a7e-b358-7c228a300449 on n-h1-850003-3 Jul 18 14:25:04.952597 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fbef3e50-11b7-411f-b684-28b1d12daaa4 req-7f3add21-67f2-4f61-b617-8e4dd6d6efde service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037257 Jul 18 14:25:04.953730 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3803/7387] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:05.084542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:05.092589 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80a7860a-6ca9-4de4-a7d0-e795f95f0a52 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1564 microversion: 2.1 time: 0.183464 Jul 18 14:25:05.093340 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3585/7388] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:04 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:38.384141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:38.385168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:38.387587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:38.388278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=38 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:38.395077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.395537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.396317 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.396761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.461083 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7d457244-93a4-43b5-84a2-84dd0abbf5df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action" status: 200 len: 24576 microversion: 2.1 time: 0.081078 Jul 18 14:25:38.461641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3804/7389] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:25:38 2022] POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action => generated 24576 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:25:56.904499 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:25:56.905038 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:25:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:26:08.937472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:08.938210 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=42 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:08.942990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ebff7b8-aa5c-4877-9912-b471d184c5b8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:08.950733 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ebff7b8-aa5c-4877-9912-b471d184c5b8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:08.951200 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ebff7b8-aa5c-4877-9912-b471d184c5b8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:08.973151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ebff7b8-aa5c-4877-9912-b471d184c5b8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Going to try to stop instance {{(pid=131367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:26:09.014768 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ebff7b8-aa5c-4877-9912-b471d184c5b8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action" status: 202 len: 0 microversion: 2.1 time: 0.078901 Jul 18 14:26:09.015383 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3586/7390] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:26:08 2022] POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:26:09.024634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:09.025364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:09.028462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:09.029243 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:09.035192 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:09.035659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:09.036517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:09.036968 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:09.174776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:09.182395 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b763f923-f7ee-4af5-bd3d-de93f487d709 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.162275 Jul 18 14:26:09.182973 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3805/7391] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:09 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:10.201004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:10.201722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:10.208785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:10.209221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:10.210007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:10.210496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:10.344648 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:10.352445 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e42c22ed-18df-4598-a912-1b7fa6d8963e tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.156877 Jul 18 14:26:10.353031 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3587/7392] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:10 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:11.370419 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:11.371037 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:11.378657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:11.379110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:11.379879 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:11.380321 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:11.510639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:11.518886 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0f0a407d-5c90-4de4-a0c3-b53557df9f22 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.152542 Jul 18 14:26:11.519460 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3806/7393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:11 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:12.536557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:12.537140 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:12.545106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:12.545604 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:12.546482 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:12.546862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:12.682020 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:12.689739 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-11596679-446e-479a-a393-c753228eb473 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.157274 Jul 18 14:26:12.690355 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3588/7394] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:12 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:13.707072 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:13.707683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:13.714658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:13.715110 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:13.715875 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:13.716312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:13.856369 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:13.864794 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8b1a9bcc-7d6b-432c-aaae-34cd4fd656be tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.161629 Jul 18 14:26:13.865372 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3807/7395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:13 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:14.882913 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:14.883541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:14.890729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:14.891197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:14.891995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:14.892518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:15.026935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:15.035201 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9c49d1b4-394e-4884-b15c-7f95bd95af4d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.156207 Jul 18 14:26:15.035720 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3589/7396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:14 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:16.052475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:16.053142 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:16.060291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:16.060749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:16.061528 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:16.061970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:16.197017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:16.204723 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-110033e9-7c25-44e0-9db9-3ba6a2711fac tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.156111 Jul 18 14:26:16.205299 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3808/7397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:16 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:17.221587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:17.222573 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:17.230038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:17.230548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:17.231350 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:17.231806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:17.368836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:17.376690 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2a8e8f90-35a9-4143-92e7-30c99c34af61 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.159664 Jul 18 14:26:17.377773 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3590/7398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:17 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:18.394961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:18.395588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:18.403091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:18.403544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:18.404312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:18.404747 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:18.546276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:18.553919 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5687d51a-2e6b-4d67-b529-40c7fe501cc8 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.163105 Jul 18 14:26:18.554604 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3809/7399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:18 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:19.571568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:19.572361 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:19.579660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:19.580146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:19.580925 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:19.581380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:19.717060 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:19.725359 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cbc2dda3-1558-4292-972c-16fa86f998b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.157788 Jul 18 14:26:19.725953 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3591/7400] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:19 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:20.743287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:20.743943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:20.751170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:20.751635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:20.753007 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:20.753510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:20.886789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:20.894419 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3b11113-0eb7-49f0-9f9d-dda02413d2a2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.155046 Jul 18 14:26:20.895000 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3810/7401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:20 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:21.912182 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:21.912813 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:21.921071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:21.921542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:21.922363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:21.922820 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:22.061136 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:22.069478 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5d01d9a3-8e1f-4c99-b6b5-1eca82f37885 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.161322 Jul 18 14:26:22.070163 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3592/7402] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:21 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:23.087185 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:23.087813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:23.094931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:23.095399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:23.096761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:23.097205 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:23.231384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:23.239093 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-46c0c156-9ada-48d0-a88f-cfee104f3570 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.155874 Jul 18 14:26:23.239679 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3811/7403] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:23 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:24.257627 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:24.258277 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:24.265236 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:24.265693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:24.266502 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:24.266948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:24.407314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:24.415031 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6a553584-2b7f-452f-8573-b1857592038f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1692 microversion: 2.1 time: 0.161897 Jul 18 14:26:24.415835 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3593/7404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:24 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:25.433378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:25.433970 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:25.440920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:25.441374 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:25.442178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:25.442632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:25.577886 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:25.585533 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-506c022c-50bc-4e1d-bd68-a403df366d28 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1669 microversion: 2.1 time: 0.156357 Jul 18 14:26:25.586107 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3812/7405] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:25 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:26.674698 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:26.676363 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:26.683364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:26.683834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:26.684615 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:26.685066 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:26.741755 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-407e2177-fbe4-4eb0-a03c-d8a3e52433df tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action" status: 200 len: 34789 microversion: 2.1 time: 0.070858 Jul 18 14:26:26.742476 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3594/7406] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:26:26 2022] POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action => generated 34789 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:26:26.754544 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fc99226c-9c33-4a09-b29c-b33b45cc673c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:26.761866 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc99226c-9c33-4a09-b29c-b33b45cc673c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:26.762413 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fc99226c-9c33-4a09-b29c-b33b45cc673c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:26.788947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fc99226c-9c33-4a09-b29c-b33b45cc673c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Going to try to start instance {{(pid=131366) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:26:26.830958 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fc99226c-9c33-4a09-b29c-b33b45cc673c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action" status: 202 len: 0 microversion: 2.1 time: 0.081111 Jul 18 14:26:26.832358 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3813/7407] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:26:26 2022] POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:26:26.840575 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:26.841286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:26.849270 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:26.849987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:26.850827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:26.851272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:26.993211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:27.001620 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e8f32e14-e071-466f-bc52-21584ed3677d tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1678 microversion: 2.1 time: 0.165266 Jul 18 14:26:27.002273 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3595/7408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:26 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:28.020573 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:28.021296 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:28.029130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.029585 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.030420 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.030864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.180206 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:28.188293 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25158fe9-d0cc-4899-9c88-6af2749dce56 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1678 microversion: 2.1 time: 0.172846 Jul 18 14:26:28.188880 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3814/7409] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:28 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:29.205759 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:29.206415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:29.214600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:29.215214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:29.216062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:29.216527 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:29.367275 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:29.375292 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6ceb126f-b305-41cd-9cf5-48a4f6fdd3a1 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1682 microversion: 2.1 time: 0.173393 Jul 18 14:26:29.375918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3596/7410] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:29 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:01.589908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:01.590738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:01.592936 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=20 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:01.593602 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:01.600279 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.600734 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.601530 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.601987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.673509 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8aabd37e-3bce-4375-80c6-8c87364767ea tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action" status: 200 len: 59332 microversion: 2.1 time: 0.087937 Jul 18 14:27:01.674194 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3815/7411] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:27:01 2022] POST /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449/action => generated 59332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:27:25.835392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:25.836294 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:25.837705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-46740a46-dccd-498c-ac74-105564d33485 req-16126557-0177-4859-bbb3-029a5c4f2d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22ed882-8597-4a7e-b358-7c228a300449", "tag": "b09bd80d-c012-4b43-a137-ef42ec5652c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:25.840496 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=22 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:25.841413 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:25.845623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:25.846700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:25.847581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.849101 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.850380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.850843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.850960 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46740a46-dccd-498c-ac74-105564d33485 req-16126557-0177-4859-bbb3-029a5c4f2d4d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.851339 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-46740a46-dccd-498c-ac74-105564d33485 req-16126557-0177-4859-bbb3-029a5c4f2d4d service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.868281 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-46740a46-dccd-498c-ac74-105564d33485 req-16126557-0177-4859-bbb3-029a5c4f2d4d service nova] Creating event network-changed:b09bd80d-c012-4b43-a137-ef42ec5652c9 for instance b22ed882-8597-4a7e-b358-7c228a300449 on n-h1-850003-3 Jul 18 14:27:25.873616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-46740a46-dccd-498c-ac74-105564d33485 req-16126557-0177-4859-bbb3-029a5c4f2d4d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040203 Jul 18 14:27:25.878521 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3816/7412] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:27:25.881568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:27:25.974492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f80db571-3dfb-405e-a036-50c0efc02ace tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 204 len: 0 microversion: 2.1 time: 0.142475 Jul 18 14:27:25.978844 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3597/7413] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:25 2022] DELETE /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:27:25.985314 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:25.986024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:25.994422 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.994873 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.996752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.997198 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:26.180470 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:26.188677 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12f3ded2-fea4-447c-a033-aaa8356180a6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1688 microversion: 2.1 time: 0.208188 Jul 18 14:27:26.189278 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3817/7414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:25 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:27.209652 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:27.210322 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:27.218041 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:27.218551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:27.219355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:27.219815 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:27.360994 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:27.369103 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c17a99f3-08cf-4236-a4a2-556baa29ce6a tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1688 microversion: 2.1 time: 0.164390 Jul 18 14:27:27.369707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3598/7415] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:27 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:28.338167 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-84575700-db8f-4cbe-9c7b-807dfb00f09b req-d5ded20d-2441-4fcb-98a9-371e2c72015e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22ed882-8597-4a7e-b358-7c228a300449", "name": "network-vif-deleted", "tag": "b09bd80d-c012-4b43-a137-ef42ec5652c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:28.346569 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-84575700-db8f-4cbe-9c7b-807dfb00f09b req-d5ded20d-2441-4fcb-98a9-371e2c72015e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.347024 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-84575700-db8f-4cbe-9c7b-807dfb00f09b req-d5ded20d-2441-4fcb-98a9-371e2c72015e service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.359084 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-84575700-db8f-4cbe-9c7b-807dfb00f09b req-d5ded20d-2441-4fcb-98a9-371e2c72015e service nova] Creating event network-vif-deleted:b09bd80d-c012-4b43-a137-ef42ec5652c9 for instance b22ed882-8597-4a7e-b358-7c228a300449 on n-h1-850003-3 Jul 18 14:27:28.365440 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-84575700-db8f-4cbe-9c7b-807dfb00f09b req-d5ded20d-2441-4fcb-98a9-371e2c72015e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086772 Jul 18 14:27:28.366063 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3818/7416] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:28.386576 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:28.387229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:28.394255 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.394952 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.395742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.396727 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.429142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.429525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.429984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lazy-loading 'fault' on Instance uuid b22ed882-8597-4a7e-b358-7c228a300449 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:27:28.471416 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:28.480445 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d272db30-b439-4020-bf11-37d5363322ae tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 200 len: 1356 microversion: 2.1 time: 0.097650 Jul 18 14:27:28.480987 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3599/7417] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:28 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:29.499506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:29.500135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: b22ed882-8597-4a7e-b358-7c228a300449] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:29.506507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:29.506976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:29.507789 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:29.508203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:29.521675 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] HTTP exception thrown: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Request method failure captured: Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 HTTP/1.1 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1Wuald00QCz0I7hDh1AiA4eMBBsPxBkESsRo8oDFOkMkH_QovuXXeoggwRTrvH9qfoVR-2ZrBuTOHjSUH2wU8I_WCM1c6LyJryo8spFEV0X7LTK_yo5RTTsL58Vej6LPMX1ZPYL4__DIx2MBS6YotXbpYkOxSBu4vEp1rf4818iwqAk Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f8c61aefdc324b50ae5d4e9b811a2cd0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 4f6db2eaa88c4268969e748a9405afac Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b22ed882-8597-4a7e-b358-7c228a300449'} Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:29.523366 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Returning 404 to user: Instance b22ed882-8597-4a7e-b358-7c228a300449 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-146e1704-d056-4eb6-9cb9-4d4d066a0b15 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449" status: 404 len: 111 microversion: 2.1 time: 0.030635 Jul 18 14:27:29.528816 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3819/7418] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:29 2022] GET /compute/v2.1/servers/b22ed882-8597-4a7e-b358-7c228a300449 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:32.976423 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-741303a0-fe19-44c3-8fa1-f427bc686b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '.version_select at 0x7f96e9a91670>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:32.981159 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-741303a0-fe19-44c3-8fa1-f427bc686b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:27:33.989044 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-741303a0-fe19-44c3-8fa1-f427bc686b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39296. Jul 18 14:27:34.009815 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-741303a0-fe19-44c3-8fa1-f427bc686b99 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-721003011" status: 202 len: 0 microversion: 2.1 time: 1.037525 Jul 18 14:27:34.010447 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3600/7419] 10.222.0.88 () {58 vars in 1280 bytes} [Mon Jul 18 14:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-721003011 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:27:34.043773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: .version_select at 0x7f96d7117310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1234900436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk7HunZqtzOny4aL7yDM+WDIa1iyG2EhjM88hPTs3I/0tgfTN/2v2Vpw87fWtb4sKKAirtkpb91a4hZahQceS3uxiANu+X7ipXq+/5Lkn+xH3XLk/c4q//qnaM3EzmSuw=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:34.060433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:27:34.066658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:27:34.080796 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:27:35.087772 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39300. Jul 18 14:27:35.101892 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cc5df397-8245-41d5-8577-13545b0f1f41 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.062267 Jul 18 14:27:35.102838 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3820/7420] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:27:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:37.578555 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:27:37.579214 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:27:40.702734 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:40.707666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2061637925", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "networks": [{"uuid": "365dfe4c-4d72-4127-9998-4e5e0baa7109"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1234900436", "security_groups": [{"name": "tempest-secgroup-smoke-1573771046"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:40.846974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] validate_networks() for [('365dfe4c-4d72-4127-9998-4e5e0baa7109', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:27:41.337571 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:27:41.338016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:27:41.338557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:27:41.339001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:27:41.339411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:27:41.349699 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.350283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.351111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.351557 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.369632 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:27:41.375168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Getting quotas for user 4f6db2eaa88c4268969e748a9405afac and project f8c61aefdc324b50ae5d4e9b811a2cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:27:41.388176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:27:41.390534 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:27:41.437604 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2cd9816e-394a-4996-9035-e00221826265 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736744 Jul 18 14:27:41.438518 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3601/7421] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:27:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:27:41.446034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:41.450639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-4c33c36a-bb16-4775-af58-16e91f472f5c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.451267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-4c33c36a-bb16-4775-af58-16e91f472f5c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:41.519587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-4c33c36a-bb16-4775-af58-16e91f472f5c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:41.529531 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-4c33c36a-bb16-4775-af58-16e91f472f5c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1267 microversion: 2.1 time: 0.085056 Jul 18 14:27:41.530392 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3821/7422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:42.552875 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:42.553586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:42.567134 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:42.567712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:42.569093 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:42.570326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:42.684569 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:42.694887 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5c74f4d8-d8a1-4032-b641-db3b721dd826 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1337 microversion: 2.1 time: 0.149470 Jul 18 14:27:42.695767 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3602/7423] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:42 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1337 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:43.713578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:43.714997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:43.722395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.722847 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.723624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.724620 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.874721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:43.883661 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-837b5944-c33d-49fa-9382-3a9beb0d7000 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.173966 Jul 18 14:27:43.884257 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3822/7424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:43 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:44.224917 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-8935c014-3877-48db-b816-363e5f212603 req-2440576d-72a1-4acb-8a85-a4bc22a146cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed01b8e2-b549-4ce0-86e3-f385fcfabc82", "tag": "d97971e9-231e-4407-9584-50a36a93c1c9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:44.240323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8935c014-3877-48db-b816-363e5f212603 req-2440576d-72a1-4acb-8a85-a4bc22a146cb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:44.240904 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-8935c014-3877-48db-b816-363e5f212603 req-2440576d-72a1-4acb-8a85-a4bc22a146cb service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:44.261505 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-8935c014-3877-48db-b816-363e5f212603 req-2440576d-72a1-4acb-8a85-a4bc22a146cb service nova] Creating event network-changed:d97971e9-231e-4407-9584-50a36a93c1c9 for instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 on n-h2-850003-3 Jul 18 14:27:44.268587 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-8935c014-3877-48db-b816-363e5f212603 req-2440576d-72a1-4acb-8a85-a4bc22a146cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051089 Jul 18 14:27:44.270257 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3603/7425] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:44.902018 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:44.902705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:44.909800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:44.910269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:44.911049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:44.912136 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:45.063466 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:45.072000 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-71181f53-5602-4571-97f5-8829de7fb729 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.174139 Jul 18 14:27:45.072616 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3823/7426] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:44 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:46.090269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:46.090915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:46.098195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:46.098669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:46.099458 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:46.099912 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:46.236656 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:46.244709 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-04c9f819-1bb9-4f88-bb7b-6779fecfbe1b tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.158800 Jul 18 14:27:46.245292 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3604/7427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:46 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:47.262135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:47.262135 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:47.268947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:47.269399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:47.270292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:47.271704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:47.410086 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:47.418273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fa0c63f9-3d19-4566-a11c-e6d2015e78ff tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.161190 Jul 18 14:27:47.418867 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3824/7428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:47 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:48.434514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:48.435148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:48.442108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:48.442610 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:48.443403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:48.443861 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:48.580833 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:48.589175 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-835ab7cf-cd3d-43e9-a080-c0d60fd43fd2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.158747 Jul 18 14:27:48.589802 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3605/7429] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:48 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:49.606038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:49.606684 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:49.613661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:49.614112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:49.614908 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:49.615340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:49.746902 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:49.754426 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e8b6040a-247c-4f0b-9dbb-1a11929b1770 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.152341 Jul 18 14:27:49.755496 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3825/7430] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:49 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:50.638018 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-ad2b074e-8ccb-4ad4-b3fe-113925f1e966 req-47dcf5eb-8842-4bde-bc07-1ff0899b03fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed01b8e2-b549-4ce0-86e3-f385fcfabc82", "name": "network-vif-plugged", "status": "completed", "tag": "d97971e9-231e-4407-9584-50a36a93c1c9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:50.646360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ad2b074e-8ccb-4ad4-b3fe-113925f1e966 req-47dcf5eb-8842-4bde-bc07-1ff0899b03fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:50.646830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-ad2b074e-8ccb-4ad4-b3fe-113925f1e966 req-47dcf5eb-8842-4bde-bc07-1ff0899b03fd service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:50.658273 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-ad2b074e-8ccb-4ad4-b3fe-113925f1e966 req-47dcf5eb-8842-4bde-bc07-1ff0899b03fd service nova] Creating event network-vif-plugged:d97971e9-231e-4407-9584-50a36a93c1c9 for instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 on n-h2-850003-3 Jul 18 14:27:50.663730 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-ad2b074e-8ccb-4ad4-b3fe-113925f1e966 req-47dcf5eb-8842-4bde-bc07-1ff0899b03fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086651 Jul 18 14:27:50.664345 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3606/7431] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:27:50.772661 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:50.773289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:50.781083 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:50.781543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:50.782459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:50.782907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:50.934376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:50.941922 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-594490a7-add9-4f82-9950-8fcee36d109c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1393 microversion: 2.1 time: 0.173783 Jul 18 14:27:50.942529 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3826/7432] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:50 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:51.955729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.956509 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.962962 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:51.963677 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:51.971418 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.971816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:51.972720 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.973547 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.119749 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:52.127611 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7bd5c8c2-1da3-4a4b-ad2f-119cc24501f7 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1566 microversion: 2.1 time: 0.172827 Jul 18 14:27:52.128230 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3607/7433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:51 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:52.144931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:52.145556 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:52.147540 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:52.154027 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:52.154522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.155294 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:52.155738 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.296509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:52.305022 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9b6bf94f-64c1-4f50-b655-5d45fe705bb4 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1566 microversion: 2.1 time: 0.164948 Jul 18 14:27:52.305599 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3827/7434] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:52 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:53.898776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:53.899658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:53.901310 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6dd140d3-421c-4a75-8016-6235e24920f8 req-1d6d79e1-f45e-447c-bbc4-208dc89e99df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed01b8e2-b549-4ce0-86e3-f385fcfabc82", "tag": "d97971e9-231e-4407-9584-50a36a93c1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:53.908171 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.908973 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:53.910259 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6dd140d3-421c-4a75-8016-6235e24920f8 req-1d6d79e1-f45e-447c-bbc4-208dc89e99df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.910428 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.910746 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6dd140d3-421c-4a75-8016-6235e24920f8 req-1d6d79e1-f45e-447c-bbc4-208dc89e99df service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:53.910887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:53.923479 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6dd140d3-421c-4a75-8016-6235e24920f8 req-1d6d79e1-f45e-447c-bbc4-208dc89e99df service nova] Creating event network-changed:d97971e9-231e-4407-9584-50a36a93c1c9 for instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 on n-h2-850003-3 Jul 18 14:27:53.928665 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6dd140d3-421c-4a75-8016-6235e24920f8 req-1d6d79e1-f45e-447c-bbc4-208dc89e99df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032600 Jul 18 14:27:53.929644 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3828/7435] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:27:54.158332 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:54.168179 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-edab5e12-7d2f-497d-a5a0-8cd3ec336fed tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1566 microversion: 2.1 time: 0.274574 Jul 18 14:27:54.169044 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3608/7436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:53 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:17.812547 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:17.813436 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=38 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:18.026976 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:18.028073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:18.035161 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:18.035630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:18.036430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:18.036880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:18.091975 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a017b248-58cc-4642-becc-26619f946f64 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action" status: 200 len: 24564 microversion: 2.1 time: 0.281135 Jul 18 14:28:18.092532 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3829/7437] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:17 2022] POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action => generated 24564 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:28:24.467342 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:24.467897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:24.470081 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:24.470844 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=36 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:24.477373 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:24.477868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:24.478704 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:24.479163 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:24.505114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lazy-loading 'flavor' on Instance uuid ed01b8e2-b549-4ce0-86e3-f385fcfabc82 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:28:24.575540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-cf7fec70-cc37-4dbc-b098-83ed09b65424 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action" status: 202 len: 0 microversion: 2.1 time: 0.112499 Jul 18 14:28:24.576387 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3609/7438] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:24 2022] POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:28:24.586006 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:24.586693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:24.595173 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:24.595844 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:24.596735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:24.597218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:24.794283 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:24.810530 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d31d61bc-0b3a-44d8-a44c-45da7dd8cb8c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1693 microversion: 2.1 time: 0.229217 Jul 18 14:28:24.811381 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3830/7439] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:24 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:25.830903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:25.831637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:25.838856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:25.839327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:25.840109 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:25.840564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:25.976404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:25.984830 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-22e2f89b-6861-45a5-b0a4-010877f3deb6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1676 microversion: 2.1 time: 0.159289 Jul 18 14:28:25.985409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3610/7440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:25 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:27.078121 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:27.079085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:27.090425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.090891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.091681 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.092130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.141174 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-05d531f7-92c8-4a70-b7a7-6b1d8f9e4616 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action" status: 200 len: 35107 microversion: 2.1 time: 0.066737 Jul 18 14:28:27.142072 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3831/7441] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:27 2022] POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action => generated 35107 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:28:27.153680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:27.154326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:27.161376 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.161834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.162646 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.163090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.233662 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a38aa873-3338-43fe-b92f-b9f871fac62c tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action" status: 202 len: 0 microversion: 2.1 time: 0.084210 Jul 18 14:28:27.234498 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3611/7442] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:27 2022] POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:28:27.248149 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:27.249034 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:27.255922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.256384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.257328 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:27.257786 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:27.404906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:27.412736 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d54e6a7f-f794-4640-bc41-86186669f308 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1682 microversion: 2.1 time: 0.173703 Jul 18 14:28:27.413320 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3832/7443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:27 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:28.431313 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:28.432025 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:28.440150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:28.440614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:28.441411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:28.441862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:28.592115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:28.600676 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-654c2ca8-172e-49d0-b1c9-de3fa22d397f tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1682 microversion: 2.1 time: 0.173560 Jul 18 14:28:28.601317 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3612/7444] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:28 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:29.619187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:29.619808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:29.627376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:29.627827 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:29.628635 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:29.629068 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:29.774952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:29.783257 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8ebb615d-dbef-4c0c-bb1c-08cc9bcf4556 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1685 microversion: 2.1 time: 0.167933 Jul 18 14:28:29.783781 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3833/7445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:29 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:29.875289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:29.876231 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:29.883327 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:29.883798 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:29.884590 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:29.885057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:29.937488 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4ff6964a-c831-4943-ae3b-1fb63c0ac1b6 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action" status: 200 len: 35107 microversion: 2.1 time: 0.066011 Jul 18 14:28:29.938175 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3613/7446] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:29 2022] POST /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82/action => generated 35107 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:28:31.069401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:31.069931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:31.077214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-640f26bb-a966-4b81-a935-5f315934021a req-78ef012b-299b-4cc5-bd2c-aa445df3f0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed01b8e2-b549-4ce0-86e3-f385fcfabc82", "tag": "d97971e9-231e-4407-9584-50a36a93c1c9"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:31.077966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:31.078464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:31.079469 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:31.079952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:31.089637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-640f26bb-a966-4b81-a935-5f315934021a req-78ef012b-299b-4cc5-bd2c-aa445df3f0d6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:31.090415 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-640f26bb-a966-4b81-a935-5f315934021a req-78ef012b-299b-4cc5-bd2c-aa445df3f0d6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:31.102956 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-640f26bb-a966-4b81-a935-5f315934021a req-78ef012b-299b-4cc5-bd2c-aa445df3f0d6 service nova] Creating event network-changed:d97971e9-231e-4407-9584-50a36a93c1c9 for instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 on n-h2-850003-3 Jul 18 14:28:31.109675 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-640f26bb-a966-4b81-a935-5f315934021a req-78ef012b-299b-4cc5-bd2c-aa445df3f0d6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043720 Jul 18 14:28:31.110971 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3614/7447] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:31.111378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Going to try to terminate instance {{(pid=131366) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:28:31.215774 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d74952df-bafd-4602-b2ed-d341a6b7e084 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 204 len: 0 microversion: 2.1 time: 0.153423 Jul 18 14:28:31.219583 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3834/7448] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:28:31 2022] DELETE /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:28:31.228637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:31.229508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:31.236888 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:31.237451 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:31.238587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:31.239168 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:31.431694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:31.441112 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-722cedb4-b7aa-4797-acf8-0d3d87c4c1ef tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1691 microversion: 2.1 time: 0.219087 Jul 18 14:28:31.441721 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3615/7449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:31 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:32.460596 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:32.461285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:32.469063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:32.469531 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:32.470343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:32.470787 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:32.628408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:32.636883 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4eceb28-157c-49ca-b568-155bf469ed90 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1691 microversion: 2.1 time: 0.180855 Jul 18 14:28:32.637498 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3835/7450] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:32 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:33.655489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:33.656058 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:33.663566 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:33.664084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:33.664972 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:33.665420 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:33.738851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6db2eaa88c4268969e748a9405afac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c61aefdc324b50ae5d4e9b811a2cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:33.748390 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bc2b670d-7ed9-4052-a7e7-19617c7d27c2 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 200 len: 1504 microversion: 2.1 time: 0.097173 Jul 18 14:28:33.749039 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3616/7451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:33 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 1504 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:28:33.899178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-50ec03de-ace5-46a2-aa9a-57b4e44dec67 req-05c30b92-334f-4794-bfc9-7c72f3e6b95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed01b8e2-b549-4ce0-86e3-f385fcfabc82", "name": "network-vif-deleted", "tag": "d97971e9-231e-4407-9584-50a36a93c1c9"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:33.909729 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-50ec03de-ace5-46a2-aa9a-57b4e44dec67 req-05c30b92-334f-4794-bfc9-7c72f3e6b95b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:33.910089 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-50ec03de-ace5-46a2-aa9a-57b4e44dec67 req-05c30b92-334f-4794-bfc9-7c72f3e6b95b service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:33.924622 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-50ec03de-ace5-46a2-aa9a-57b4e44dec67 req-05c30b92-334f-4794-bfc9-7c72f3e6b95b service nova] Creating event network-vif-deleted:d97971e9-231e-4407-9584-50a36a93c1c9 for instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 on n-h2-850003-3 Jul 18 14:28:33.930809 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-50ec03de-ace5-46a2-aa9a-57b4e44dec67 req-05c30b92-334f-4794-bfc9-7c72f3e6b95b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034458 Jul 18 14:28:33.930809 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3836/7452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:34.766447 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:34.767075 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] [instance: ed01b8e2-b549-4ce0-86e3-f385fcfabc82] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:34.774288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:34.775247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:34.776031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:34.776741 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:34.791096 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.wsgi [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] HTTP exception thrown: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Request method failure captured: Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: request: GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 HTTP/1.1 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Accept: application/json Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Accept-Encoding: identity Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Connection: close Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Content-Length: 0 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Content-Type: application/json Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Host: 10.222.0.88 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: Openstack-System-Scope: None Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: User-Agent: python-urllib3/1.26.9 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Auth-Token: gAAAAABi1Wuald00QCz0I7hDh1AiA4eMBBsPxBkESsRo8oDFOkMkH_QovuXXeoggwRTrvH9qfoVR-2ZrBuTOHjSUH2wU8I_WCM1c6LyJryo8spFEV0X7LTK_yo5RTTsL58Vej6LPMX1ZPYL4__DIx2MBS6YotXbpYkOxSBu4vEp1rf4818iwqAk Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Id: None Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Domain-Name: None Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Identity-Status: Confirmed Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Is-Admin-Project: True Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Id: default Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Domain-Name: Default Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Role: reader,member Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Roles: reader,member Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f8c61aefdc324b50ae5d4e9b811a2cd0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f8c61aefdc324b50ae5d4e9b811a2cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Id: f8c61aefdc324b50ae5d4e9b811a2cd0 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-359053984 Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-User: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Id: default Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-User-Domain-Name: Default Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-User-Id: 4f6db2eaa88c4268969e748a9405afac Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: X-User-Name: tempest-TestNetworkAdvancedServerOps-359053984-project Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: method: > Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: exception: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: action_args: {'id': 'ed01b8e2-b549-4ce0-86e3-f385fcfabc82'} Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:28:34.792764 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: ERROR nova.api.openstack.wsgi Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Returning 404 to user: Instance ed01b8e2-b549-4ce0-86e3-f385fcfabc82 could not be found. {{(pid=131367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9fa66ce5-453f-4cd4-97e8-0e184b5e4267 tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82" status: 404 len: 111 microversion: 2.1 time: 0.031892 Jul 18 14:28:34.797578 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3617/7453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:34 2022] GET /compute/v2.1/servers/ed01b8e2-b549-4ce0-86e3-f385fcfabc82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:28:37.866981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-afc8a8d2-dbe7-4c57-a7b3-8a47b3274eda tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] Calling method '.version_select at 0x7f96e416a280>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:37.889798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-afc8a8d2-dbe7-4c57-a7b3-8a47b3274eda tempest-TestNetworkAdvancedServerOps-359053984 tempest-TestNetworkAdvancedServerOps-359053984-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1234900436" status: 202 len: 0 microversion: 2.1 time: 0.027910 Jul 18 14:28:37.890758 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3837/7454] 10.222.0.88 () {58 vars in 1283 bytes} [Mon Jul 18 14:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1234900436 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:28:49.370617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=18 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:49.371404 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:49.716722 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75428bc0-68ae-44d0-b921-2be9f286d51c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'create', calling method: .version_select at 0x7f96e9ae1ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1175165680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLEsveMps8gC82JZ+22/dZcGSiRfb7u1VjpoGy8ZJZaUbcctbYCldSfYOfVNAJPTIDaAETFjU/xFOehu/I6WrfzIosS7JdWHIQq4SVzDgxoo0bJ1wxaoLWsG9OVJOSB9Q=="}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:49.732635 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-75428bc0-68ae-44d0-b921-2be9f286d51c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for project 84f590c01d0c41869cd6da483471bf1e. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:28:49.744362 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-75428bc0-68ae-44d0-b921-2be9f286d51c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for user 1563d8c8574f4fd7a75ce2c8b0e7c517 and project 84f590c01d0c41869cd6da483471bf1e. Resources: {'key_pairs'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:28:49.792633 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75428bc0-68ae-44d0-b921-2be9f286d51c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.428603 Jul 18 14:28:49.798500 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3618/7455] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:28:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:50.933538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:50.934479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:50.943692 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1387361931", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1175165680", "security_groups": [{"name": "tempest-secgroup-smoke-137879013"}], "networks": [{"uuid": "eab1cc51-d827-4643-9515-fdbcbcecc0cc"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:51.088928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] validate_networks() for [('eab1cc51-d827-4643-9515-fdbcbcecc0cc', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:28:51.604449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:28:51.604874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:28:51.605348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:28:51.605758 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:28:51.606193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:28:51.615176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:51.615648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:51.616445 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:51.616878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:51.634415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for project 84f590c01d0c41869cd6da483471bf1e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:28:51.640014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for user 1563d8c8574f4fd7a75ce2c8b0e7c517 and project 84f590c01d0c41869cd6da483471bf1e. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:28:51.653839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:28:51.656251 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:28:51.704148 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-544464c3-47b4-45f0-ae59-18c30e57eec0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772769 Jul 18 14:28:51.704847 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3838/7456] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:28:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:28:51.716903 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dd534367-ef0e-4a49-8e07-7b5e1a182098 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:51.717945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dd534367-ef0e-4a49-8e07-7b5e1a182098 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:51.779640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dd534367-ef0e-4a49-8e07-7b5e1a182098 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:51.788515 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dd534367-ef0e-4a49-8e07-7b5e1a182098 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1247 microversion: 2.1 time: 0.076750 Jul 18 14:28:51.789114 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3619/7457] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:51 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:52.813380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:52.814599 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:52.847178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:52.848013 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:52.849464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:52.854443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:53.038302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:53.058443 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-91964467-d327-4b83-ae12-58452ed0bd9e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1317 microversion: 2.1 time: 0.255557 Jul 18 14:28:53.076570 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3839/7458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:52 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:54.084477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:54.085572 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:54.095097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:54.095797 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:54.096678 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:54.097205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:54.334873 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:54.343065 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ec25006f-8b04-4b5f-8dde-3c6db352dc9b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.262900 Jul 18 14:28:54.343655 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3620/7459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:54 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:54.692709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-78f60cd6-7698-4ce9-a763-7345e8cb354f req-dad40b08-ceef-495c-a95e-b1aa68a0e82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:54.717624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-78f60cd6-7698-4ce9-a763-7345e8cb354f req-dad40b08-ceef-495c-a95e-b1aa68a0e82c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:54.718424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-78f60cd6-7698-4ce9-a763-7345e8cb354f req-dad40b08-ceef-495c-a95e-b1aa68a0e82c service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:54.746525 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-78f60cd6-7698-4ce9-a763-7345e8cb354f req-dad40b08-ceef-495c-a95e-b1aa68a0e82c service nova] Creating event network-changed:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h1-850003-3 Jul 18 14:28:54.755559 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-78f60cd6-7698-4ce9-a763-7345e8cb354f req-dad40b08-ceef-495c-a95e-b1aa68a0e82c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068144 Jul 18 14:28:54.756696 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3840/7460] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:55.360587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:55.361213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:55.368800 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.369267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.370057 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.370538 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.512221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:55.519715 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fda3da5e-f52a-4f1f-b76b-09a8dc2074c7 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.163126 Jul 18 14:28:55.520319 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3621/7461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:55 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:56.539632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:56.540292 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:56.546892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.547345 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.548125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.548570 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.685277 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:56.692945 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-457c3408-961e-40ff-b6b1-0a35bb52759b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.158612 Jul 18 14:28:56.693533 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3841/7462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:56 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:57.708922 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:57.709554 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:57.717307 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.717777 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:57.718606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.719059 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:57.854766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:57.862317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bf9c85ff-04ea-44c0-9648-50f20d77d35c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.157294 Jul 18 14:28:57.862899 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3622/7463] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:57 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:58.880627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:58.881263 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:58.889005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:58.889562 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:58.890378 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:58.890828 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:59.038047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:59.047190 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-70f17866-ad96-4bcd-95d1-a8c6e3a4ab07 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.171029 Jul 18 14:28:59.057810 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3842/7464] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:58 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:00.065544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:00.066251 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:00.075624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.076283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.077192 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.077650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.219159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:00.226876 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-986cdf37-20af-406d-b3d5-e81b53aad539 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.165998 Jul 18 14:29:00.228135 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3623/7465] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:00 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:01.141985 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f0b80c6b-c7ce-4416-af82-2b93692cabe2 req-a7985fe2-ad84-470f-a98b-8f7c1d843539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "name": "network-vif-plugged", "status": "completed", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:01.153073 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f0b80c6b-c7ce-4416-af82-2b93692cabe2 req-a7985fe2-ad84-470f-a98b-8f7c1d843539 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.153499 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f0b80c6b-c7ce-4416-af82-2b93692cabe2 req-a7985fe2-ad84-470f-a98b-8f7c1d843539 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.165696 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f0b80c6b-c7ce-4416-af82-2b93692cabe2 req-a7985fe2-ad84-470f-a98b-8f7c1d843539 service nova] Creating event network-vif-plugged:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h1-850003-3 Jul 18 14:29:01.171114 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f0b80c6b-c7ce-4416-af82-2b93692cabe2 req-a7985fe2-ad84-470f-a98b-8f7c1d843539 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Jul 18 14:29:01.171736 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3843/7466] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:29:01.244987 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:01.245660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:01.253072 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.253542 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.254379 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.254836 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.435701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:01.443245 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fc07c3b7-9ffc-4042-9552-e01254019a6c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.202513 Jul 18 14:29:01.443826 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3624/7467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:01 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:02.457195 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:02.457988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:02.464098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:02.464808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:02.471715 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.472170 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:02.472934 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.473370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:02.612735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:02.621005 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d108ee43-be9e-44ea-8159-43e76b312d53 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1372 microversion: 2.1 time: 0.164772 Jul 18 14:29:02.621606 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3844/7468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:02 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:03.638170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:03.638787 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:03.640670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:03.647199 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.647365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.648111 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.648555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.790792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:03.798492 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8afe4ef6-789b-416a-a99b-cde3553ad83e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1556 microversion: 2.1 time: 0.164766 Jul 18 14:29:03.799097 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3625/7469] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:03 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:03.815267 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:03.815882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:03.823629 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.824107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.824878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.825316 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.966592 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:03.974196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f1de8a75-2075-429c-9c1f-eb188e2773cb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1556 microversion: 2.1 time: 0.162972 Jul 18 14:29:03.974786 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3845/7470] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:03 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:06.002308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-97dae2bf-2fba-45ce-86a2-66a5f50f5529 req-de5539d2-a1a9-4de7-ab1d-6a7159e2c0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:06.011713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-97dae2bf-2fba-45ce-86a2-66a5f50f5529 req-de5539d2-a1a9-4de7-ab1d-6a7159e2c0cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:06.012175 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-97dae2bf-2fba-45ce-86a2-66a5f50f5529 req-de5539d2-a1a9-4de7-ab1d-6a7159e2c0cc service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:06.023658 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-97dae2bf-2fba-45ce-86a2-66a5f50f5529 req-de5539d2-a1a9-4de7-ab1d-6a7159e2c0cc service nova] Creating event network-changed:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h1-850003-3 Jul 18 14:29:06.030042 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-97dae2bf-2fba-45ce-86a2-66a5f50f5529 req-de5539d2-a1a9-4de7-ab1d-6a7159e2c0cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031611 Jul 18 14:29:06.030747 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3626/7471] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:30:56.915201 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:30:56.915909 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:31:32.736545 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:31:32.737478 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:31:32.738379 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:32.738914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=36 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:32.743276 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:32.743829 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:32.755947 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:32.756408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:32.757183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:32.757627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:32.794178 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lazy-loading 'flavor' on Instance uuid 864af0c0-358e-4c5a-a1a0-605c6be5a46c {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:31:33.195373 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-911d348d-35cd-43a9-9667-a4e80fc43551 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c/action" status: 202 len: 0 microversion: 2.1 time: 0.460707 Jul 18 14:31:33.196005 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3846/7472] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:31:32 2022] POST /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:31:33.202289 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:31:33.203207 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:31:33.203830 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:33.204589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=38 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:33.210364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:33.211102 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:33.218651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.219118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.219908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.220351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.426863 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:33.435193 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-467e761b-a01a-4943-a1a4-76d90b0cd3ec tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.234700 Jul 18 14:31:33.435762 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3627/7473] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:33 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:34.458757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:34.459467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:34.468462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.468919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.469683 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.470114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.474857 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39710. Jul 18 14:31:34.475553 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39708. Jul 18 14:31:34.614903 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:34.622653 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-fb7d9b09-425a-49e4-ad84-396980cabcb0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.172804 Jul 18 14:31:34.623231 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3847/7474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:34 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:31:35.640847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:35.641472 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:35.650365 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.650827 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.651694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.652142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.670868 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39716. Jul 18 14:31:35.674790 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39718. Jul 18 14:31:35.790771 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:35.798814 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-46e3111d-adda-4241-87a5-7542fb9181fb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.161853 Jul 18 14:31:35.799417 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3628/7475] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:35 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:36.817095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:36.818239 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:36.825269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.825712 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.826507 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.826941 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.960693 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:36.968666 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a830ee01-5895-4eb3-ab86-d8583b176c6f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.155452 Jul 18 14:31:36.969342 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3848/7476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:36 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:31:37.986076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:37.986780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:37.994647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:37.995147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:37.995941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:37.996394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:38.127847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:38.136100 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9a66891a-09fb-4d29-b76c-2ba6384e0bae tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.154021 Jul 18 14:31:38.136684 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3629/7477] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:37 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:39.153150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:39.153773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:39.161049 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:39.161989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:39.162820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:39.163257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:39.299649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:39.308007 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5782a6f0-9c89-436e-b292-25823b4dcb8f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.159072 Jul 18 14:31:39.308594 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3849/7478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:39 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:40.325187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:40.325822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:40.332950 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:40.333941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:40.334762 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:40.335226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:40.470370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:40.479018 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0ca8e7c7-ab60-403e-b810-ace6379012f2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.157806 Jul 18 14:31:40.479598 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3630/7479] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:40 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:41.496425 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:41.497045 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:41.504634 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:41.505597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:41.506417 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:41.506857 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:41.640881 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:41.648550 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f6571ac3-403f-4921-b62a-918b256e7914 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.156050 Jul 18 14:31:41.649127 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3850/7480] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:41 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:42.667029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:42.667695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:42.675811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:42.676283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:42.677088 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:42.677544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:42.812119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:42.821159 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-75dac871-fdd2-4c2a-9fec-a783cf0645df tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.158276 Jul 18 14:31:42.821765 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3631/7481] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:42 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:43.838535 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:43.839181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:43.846266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:43.846714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:43.847474 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:43.847907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:43.990160 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:43.997934 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a1471942-e59a-47df-a604-c78e253ae7e2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.163322 Jul 18 14:31:43.998556 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3851/7482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:43 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:45.015230 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:45.015857 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:45.023023 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:45.023494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:45.024287 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:45.024999 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:45.165906 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:45.173606 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d6f5e06f-7fa7-4f57-87b5-8f805c672cf4 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1701 microversion: 2.1 time: 0.162302 Jul 18 14:31:45.174206 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3632/7483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:45 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:46.191839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:46.192522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:46.200115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:46.200572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:46.201386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:46.201836 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:46.336981 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:46.344813 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e4ec7c00-8406-4df4-b5fe-518e8e5d7090 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1701 microversion: 2.1 time: 0.156966 Jul 18 14:31:46.345407 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3852/7484] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:46 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:47.362939 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:47.363521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:47.370776 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.371240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.372012 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.372455 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.503986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:47.511644 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9327aad5-3d47-4807-80ef-7e729a4ea6b6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1701 microversion: 2.1 time: 0.153046 Jul 18 14:31:47.512221 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3633/7485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:47 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:47.953253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-6fbd00a2-386a-4cfb-9364-706d7ce8c159 req-0fa81120-04a1-4a0c-93f6-02b224f7ffa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "name": "network-vif-plugged", "status": "completed", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:47.963572 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6fbd00a2-386a-4cfb-9364-706d7ce8c159 req-0fa81120-04a1-4a0c-93f6-02b224f7ffa7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.964091 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-6fbd00a2-386a-4cfb-9364-706d7ce8c159 req-0fa81120-04a1-4a0c-93f6-02b224f7ffa7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.976579 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-6fbd00a2-386a-4cfb-9364-706d7ce8c159 req-0fa81120-04a1-4a0c-93f6-02b224f7ffa7 service nova] Creating event network-vif-plugged:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h1-850003-3 Jul 18 14:31:47.981539 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-6fbd00a2-386a-4cfb-9364-706d7ce8c159 req-0fa81120-04a1-4a0c-93f6-02b224f7ffa7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Jul 18 14:31:47.982166 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3853/7486] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:48.529279 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:48.529829 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:48.537519 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:48.538211 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:48.539396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:48.540052 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:48.676205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:48.684321 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7cdfd497-8e24-4159-a67c-71eb094ef14b tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1701 microversion: 2.1 time: 0.159076 Jul 18 14:31:48.684933 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3634/7487] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:48 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:49.704805 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:49.705520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:49.713452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:49.713914 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:49.714737 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:49.715266 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:49.879197 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:49.889082 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9eac317-dd63-4d08-ada6-27a8c4e2d862 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.190524 Jul 18 14:31:49.890346 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3854/7488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:49 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:50.908368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:50.908946 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:50.919188 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:50.919766 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:50.920643 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:50.921181 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:51.084670 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:51.092890 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-14fc6974-2a1e-4b86-a4c2-b8eb67177243 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.188676 Jul 18 14:31:51.103924 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3635/7489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:50 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:52.116919 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:52.117848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:52.128286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:52.128987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:52.130462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:52.130915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:52.286958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:52.295554 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b4a0714b-2e64-459f-aac1-7d25183508d8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.186612 Jul 18 14:31:52.296088 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3855/7490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:52 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:53.314352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:53.315082 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:53.322849 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:53.323312 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:53.324104 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:53.324549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:53.468408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:53.476856 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a6f9f812-c960-4d53-a79b-8ad2a7f6a5c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.166353 Jul 18 14:31:53.479359 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3636/7491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:53 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:54.494077 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:54.494816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:54.502290 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:54.502763 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:54.503563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:54.504038 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:54.646421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:54.655798 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d258f8a8-ea83-4fac-b48f-664ec4ace79a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.165391 Jul 18 14:31:54.656087 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3856/7492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:54 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:55.672368 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:55.673654 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:55.681370 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:55.681984 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:55.682834 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:55.683280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:55.839233 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:55.847379 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f86a9fe2-1bb3-4753-a015-e9f44d35b34e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.179205 Jul 18 14:31:55.848341 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3637/7493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:55 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:56.865912 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:56.867282 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:56.874846 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:56.876852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:56.878421 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:56.878864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:57.048514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:57.057256 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bd7da369-2041-4931-93cc-6f0dc25882f3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.195641 Jul 18 14:31:57.058194 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3857/7494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:56 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:58.077600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:58.078336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:58.085914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:58.086406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:58.087386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:58.087661 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:58.266349 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:58.275686 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-8c4a986e-7ef2-4f72-adf3-65314e4838dc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.202079 Jul 18 14:31:58.286836 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3638/7495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:58 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:59.294660 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:59.295407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:59.304450 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:59.304997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:59.305878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:59.306701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:59.447199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:59.456205 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6f259e91-87a8-4dae-8d20-f3c199501097 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1696 microversion: 2.1 time: 0.165461 Jul 18 14:31:59.456801 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3858/7496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:59 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:00.473165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:00.473811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:00.480998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:00.481460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:00.482263 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:00.482718 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:00.617919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:00.626317 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d1383b70-78bf-4216-9500-958d4e8c92c3 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1678 microversion: 2.1 time: 0.157097 Jul 18 14:32:00.626917 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3639/7497] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:00 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:01.645498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:01.646116 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:01.653359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:01.653852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:01.654656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:01.655103 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:01.787751 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:01.795472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-73f69c92-1523-4f8e-8c5d-d6e8faffa796 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1678 microversion: 2.1 time: 0.153978 Jul 18 14:32:01.796052 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3859/7498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:01 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:02.016530 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b1c082ea-a36a-4815-958a-180d4cf9618a req-0cfd3204-cadd-409a-8d7c-695abb3b2d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "name": "network-vif-unplugged", "status": "completed", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:32:02.027439 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b1c082ea-a36a-4815-958a-180d4cf9618a req-0cfd3204-cadd-409a-8d7c-695abb3b2d37 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:02.028249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b1c082ea-a36a-4815-958a-180d4cf9618a req-0cfd3204-cadd-409a-8d7c-695abb3b2d37 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:02.044905 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b1c082ea-a36a-4815-958a-180d4cf9618a req-0cfd3204-cadd-409a-8d7c-695abb3b2d37 service nova] Creating event network-vif-unplugged:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h1-850003-3 Jul 18 14:32:02.051094 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b1c082ea-a36a-4815-958a-180d4cf9618a req-0cfd3204-cadd-409a-8d7c-695abb3b2d37 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038110 Jul 18 14:32:02.056134 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3640/7499] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:32:02.813557 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:02.814231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:02.817640 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:02.823742 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:02.824190 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:02.824958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:02.825393 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:02.828230 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:02.966323 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:02.974796 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-671250e3-5bca-46b7-90ae-514910ed9b21 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1621 microversion: 2.1 time: 0.165001 Jul 18 14:32:02.975390 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3860/7500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:02 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1621 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:02.992507 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:32:02.993170 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:02.999465 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:02.999924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:03.000695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:03.001142 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:03.096413 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fd75d423-e6f3-4acb-88a5-34851242ef03 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c/action" status: 202 len: 0 microversion: 2.1 time: 0.108570 Jul 18 14:32:03.097282 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3641/7501] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:32:02 2022] POST /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:32:03.105823 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:03.106467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:03.113432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:03.114555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:03.115340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:03.115776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:03.258928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:03.270705 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80eceffe-173f-49db-bcbe-ab7bcb964416 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1629 microversion: 2.1 time: 0.168831 Jul 18 14:32:03.271385 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3861/7502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:03 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:04.290712 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:04.291259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:04.293360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=33 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:04.298979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:04.299434 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:04.300240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:04.300701 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:04.303756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:04.443640 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:04.452116 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a39cfaac-c314-4ddc-a08f-b3ab0e51e00f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.166924 Jul 18 14:32:04.452726 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3642/7503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:04 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:32:05.247338 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3f5d2fd6-c4e9-4e91-a9ee-417ca91a9ba4 req-27b91e62-ef0a-424f-bae8-c8a21d52bfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:32:05.258025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f5d2fd6-c4e9-4e91-a9ee-417ca91a9ba4 req-27b91e62-ef0a-424f-bae8-c8a21d52bfa5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:05.258546 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3f5d2fd6-c4e9-4e91-a9ee-417ca91a9ba4 req-27b91e62-ef0a-424f-bae8-c8a21d52bfa5 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:05.270616 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3f5d2fd6-c4e9-4e91-a9ee-417ca91a9ba4 req-27b91e62-ef0a-424f-bae8-c8a21d52bfa5 service nova] Creating event network-changed:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h2-850003-3 Jul 18 14:32:05.276793 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3f5d2fd6-c4e9-4e91-a9ee-417ca91a9ba4 req-27b91e62-ef0a-424f-bae8-c8a21d52bfa5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107583 Jul 18 14:32:05.277959 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3862/7504] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:32:05.470347 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:05.470981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:05.478696 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:05.479162 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:05.479959 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:05.480414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:05.614608 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:05.623215 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c9fc55a-49de-471d-8067-becce77caf75 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.156845 Jul 18 14:32:05.623817 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3643/7505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:05 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:06.641594 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:06.642526 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:06.649848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:06.650695 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:06.651884 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:06.652551 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:06.806286 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:06.817733 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c689080c-5362-4f25-96fe-d04a8f6f19fd tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.181346 Jul 18 14:32:06.819317 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3863/7506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:06 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:07.835394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:07.836029 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:07.843533 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:07.844126 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:07.844870 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:07.845369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:08.002715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:08.012410 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-81feb0a2-8120-47a6-a43e-2466efadb67f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.181160 Jul 18 14:32:08.020618 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3644/7507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:07 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:09.031464 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:09.032271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:09.039969 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:09.040563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:09.042233 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:09.042649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:09.209163 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:09.217366 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-80e0789f-4737-4db5-9b23-ce4842f92e99 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.189957 Jul 18 14:32:09.218274 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3864/7508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:09 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:10.242809 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:10.243548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:10.251308 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:10.251850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:10.252659 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:10.253116 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:10.411433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:10.419371 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-7ce1f7a6-02c7-444d-aa3c-3c247c5eb234 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.185647 Jul 18 14:32:10.419959 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3645/7509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:10 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:11.436288 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:11.436817 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:11.443993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:11.444443 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:11.445212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:11.445648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:11.608543 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:11.616816 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0be4bd16-b42d-424d-aa30-ddf86c118e2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.184517 Jul 18 14:32:11.617407 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3865/7510] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:11 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:12.638207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:12.639498 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:12.654481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:12.655446 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:12.657207 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:12.658460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:12.817801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:12.826113 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6598cc7f-7b6e-4cc9-805e-d5fb1b2efac5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.195534 Jul 18 14:32:12.826794 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3646/7511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:12 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:13.847665 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:13.848517 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:13.856462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:13.856911 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:13.858112 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:13.858740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:14.023044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:14.037955 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0975a353-9668-4fc8-9ecb-4feecd83efc5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.195310 Jul 18 14:32:14.039611 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3866/7512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:13 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:15.059585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:15.060223 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:15.067629 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:15.068097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:15.068887 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:15.069354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:15.208716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:15.217156 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-735b01a8-b063-4ef0-9699-442bc68a0ca6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.161368 Jul 18 14:32:15.217759 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3647/7513] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:15 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:16.235250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:16.235853 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:16.243632 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:16.244085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:16.244864 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:16.245302 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:16.377929 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:16.385789 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0626261f-1dca-4a1e-8381-6bef4fecb6be tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.154583 Jul 18 14:32:16.386400 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3867/7514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:16 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:17.403806 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:17.404444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:17.411602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:17.412071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:17.412862 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:17.413315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:17.547205 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:17.555542 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f930cf24-b50d-4d29-a277-f15d90796feb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.156256 Jul 18 14:32:17.556115 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3648/7515] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:17 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:18.573403 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:18.573999 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:18.581131 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:18.581593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:18.582959 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:18.583414 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:18.724467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:18.732142 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c10dd871-e349-4bc7-afb6-77c4beb4c057 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.162703 Jul 18 14:32:18.732727 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3868/7516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:18 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:19.748555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:19.749187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:19.756400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:19.756865 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:19.757657 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:19.758110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:19.897966 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:19.906163 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2b18e7d4-16df-4fc4-9a26-bead0f263adb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.161515 Jul 18 14:32:19.906956 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3649/7517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:19 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:19.908254 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fcf79459-a1d9-4e42-9649-6fb8f72c19a0 req-7db82335-c826-4b5f-826e-a59d14b7dbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "name": "network-vif-plugged", "status": "completed", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:32:19.918990 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fcf79459-a1d9-4e42-9649-6fb8f72c19a0 req-7db82335-c826-4b5f-826e-a59d14b7dbf0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:19.919820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fcf79459-a1d9-4e42-9649-6fb8f72c19a0 req-7db82335-c826-4b5f-826e-a59d14b7dbf0 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:19.932299 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fcf79459-a1d9-4e42-9649-6fb8f72c19a0 req-7db82335-c826-4b5f-826e-a59d14b7dbf0 service nova] Creating event network-vif-plugged:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h2-850003-3 Jul 18 14:32:19.937697 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fcf79459-a1d9-4e42-9649-6fb8f72c19a0 req-7db82335-c826-4b5f-826e-a59d14b7dbf0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033490 Jul 18 14:32:19.938345 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3869/7518] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:32:20.925176 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:20.926038 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:20.934756 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:20.935228 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:20.936044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:20.936508 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:21.085587 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:21.097131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c419720a-6f02-415c-a143-c27e7074948d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1687 microversion: 2.1 time: 0.176222 Jul 18 14:32:21.098346 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3650/7519] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:20 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:22.115047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:22.115745 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:22.123191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:22.123563 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:22.124340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:22.124816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:22.267988 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:22.275960 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6abbeb4c-90c8-436e-833a-1d36124031ba tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1674 microversion: 2.1 time: 0.165275 Jul 18 14:32:22.276547 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3870/7520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:22 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:36.379259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:36.380155 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:36.380856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-4ab64264-0bc0-481a-8b88-bfe67fa7ddbd req-75e4fbb3-76a5-4b58-808e-20de490aedc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:36.384819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=21 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:36.385622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=57 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:36.387074 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=17 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:36.388247 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=53 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:36.391669 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.392400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.393395 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4ab64264-0bc0-481a-8b88-bfe67fa7ddbd req-75e4fbb3-76a5-4b58-808e-20de490aedc7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.393833 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-4ab64264-0bc0-481a-8b88-bfe67fa7ddbd req-75e4fbb3-76a5-4b58-808e-20de490aedc7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.394570 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.394998 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.406466 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-4ab64264-0bc0-481a-8b88-bfe67fa7ddbd req-75e4fbb3-76a5-4b58-808e-20de490aedc7 service nova] Creating event network-changed:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h2-850003-3 Jul 18 14:33:36.411922 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-4ab64264-0bc0-481a-8b88-bfe67fa7ddbd req-75e4fbb3-76a5-4b58-808e-20de490aedc7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 Jul 18 14:33:36.412920 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3871/7521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:33:36.430351 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:33:36.526534 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3a4fb51d-2420-4450-aa64-edcced8e0b2f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "DELETE /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 204 len: 0 microversion: 2.1 time: 0.152820 Jul 18 14:33:36.530630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3651/7522] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:33:36 2022] DELETE /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:33:36.538452 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:36.539483 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:36.547760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.548394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.550047 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.550856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.702364 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:36.711024 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cd6f0f67-c2f1-46f3-9d5e-263deaa27bf9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.177550 Jul 18 14:33:36.711024 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3872/7523] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:36 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:37.729108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:37.729889 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:37.738354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:37.738926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:37.739896 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:37.740360 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:37.899457 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:37.909068 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-62de2f30-e988-470e-ac22-c0dc2d7a6382 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1680 microversion: 2.1 time: 0.183969 Jul 18 14:33:37.909730 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3652/7524] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:37 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:38.632295 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-3edcbfb5-a547-4c7f-80da-0de26c82b37e req-8d70736f-1145-40e2-a466-ff73cfe58283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864af0c0-358e-4c5a-a1a0-605c6be5a46c", "name": "network-vif-deleted", "tag": "d4a36438-fcbd-4e9e-8433-567fa8ae7531"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:38.644102 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3edcbfb5-a547-4c7f-80da-0de26c82b37e req-8d70736f-1145-40e2-a466-ff73cfe58283 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.644561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-3edcbfb5-a547-4c7f-80da-0de26c82b37e req-8d70736f-1145-40e2-a466-ff73cfe58283 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:38.657274 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-3edcbfb5-a547-4c7f-80da-0de26c82b37e req-8d70736f-1145-40e2-a466-ff73cfe58283 service nova] Creating event network-vif-deleted:d4a36438-fcbd-4e9e-8433-567fa8ae7531 for instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c on n-h2-850003-3 Jul 18 14:33:38.662746 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-3edcbfb5-a547-4c7f-80da-0de26c82b37e req-8d70736f-1145-40e2-a466-ff73cfe58283 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124510 Jul 18 14:33:38.663430 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3873/7525] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:33:38.929679 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:38.930485 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:38.938600 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.939130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:38.940983 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.941711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:38.986942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.987403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:38.988046 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lazy-loading 'fault' on Instance uuid 864af0c0-358e-4c5a-a1a0-605c6be5a46c {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:33:39.037444 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:39.045466 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d617525-e2cb-41b7-8236-cda8921ebde2 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 200 len: 1337 microversion: 2.1 time: 0.119727 Jul 18 14:33:39.046236 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3653/7526] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:38 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 1337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:40.067168 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:40.067897 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 864af0c0-358e-4c5a-a1a0-605c6be5a46c] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:40.074401 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:40.074860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:40.075642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:40.076093 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:40.090252 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] HTTP exception thrown: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Request method failure captured: Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c HTTP/1.1 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1W4c9UWaKtZw4fY_ajAiqSeRzXawN6LaTFkeEbsOrtuuz0jk19diHxbjo5bN28mKio8fJzy0ydW-h1koKc8nkfxVQ5JQqpTzXhhgykqPO9-8nEKFOq8p3NOOtAZTDGaScUbuz0ZLA1SFOwiMMtlNkgfc_GC9D5HlLDjXVdYq3LRlx9I Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 84f590c01d0c41869cd6da483471bf1e Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestShelveInstance-643765035 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_84f590c01d0c41869cd6da483471bf1e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestShelveInstance-643765035 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 84f590c01d0c41869cd6da483471bf1e Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestShelveInstance-643765035 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestShelveInstance-643765035-project Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1563d8c8574f4fd7a75ce2c8b0e7c517 Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestShelveInstance-643765035-project Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '864af0c0-358e-4c5a-a1a0-605c6be5a46c'} Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:33:40.091925 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Returning 404 to user: Instance 864af0c0-358e-4c5a-a1a0-605c6be5a46c could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-465eadaa-7a5d-4cde-a534-6febb5db59fa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c" status: 404 len: 111 microversion: 2.1 time: 0.032031 Jul 18 14:33:40.096839 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3874/7527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:40 2022] GET /compute/v2.1/servers/864af0c0-358e-4c5a-a1a0-605c6be5a46c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:33:40.272151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6990b249-589c-4968-9ca4-b84bba4604d0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '.version_select at 0x7f96e9aaea60>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:40.276030 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6990b249-589c-4968-9ca4-b84bba4604d0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:33:41.284102 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-6990b249-589c-4968-9ca4-b84bba4604d0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39988. Jul 18 14:33:41.304951 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6990b249-589c-4968-9ca4-b84bba4604d0 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1175165680" status: 202 len: 0 microversion: 2.1 time: 1.037025 Jul 18 14:33:41.305548 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3654/7528] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 14:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1175165680 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:33:41.333105 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'create', calling method: .version_select at 0x7f96e45ef0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-535475932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHosTC2gdgg5MC0wevdQXPx2ZVrpgrA2p2hMxGF10gc8lED5Xmb3LSvdWCeL3VYbMv6wQmlAq6VfcRe8VB9c1oLIIT9cYpud+v/hjHN0+HaypjtyzqVhoIcP79eiTpIoDQ=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:41.350213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for project 84f590c01d0c41869cd6da483471bf1e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:33:41.355537 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for user 1563d8c8574f4fd7a75ce2c8b0e7c517 and project 84f590c01d0c41869cd6da483471bf1e. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:33:41.368693 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:33:42.375745 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [7cf6c59d-7bc5-48a6-8e3e-e7fc04af9fb5] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39992. Jul 18 14:33:42.393469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f8628df3-4755-467f-9088-b476336d0dcb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.064553 Jul 18 14:33:42.394101 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3875/7529] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:33:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:33:58.782435 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:58.787531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:58.787850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-383093520", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-535475932", "security_groups": [{"name": "tempest-secgroup-smoke-1363290820"}], "networks": [{"uuid": "eab1cc51-d827-4643-9515-fdbcbcecc0cc"}], "block_device_mapping_v2": [{"uuid": "cfab0313-de47-4df4-9dc9-df9ef34afeda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:58.909240 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] validate_networks() for [('eab1cc51-d827-4643-9515-fdbcbcecc0cc', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:33:59.373532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:33:59.374001 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:33:59.374567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:33:59.375028 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:33:59.375468 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:33:59.386522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:59.386522 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:59.387476 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:59.387796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:59.406525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for project 84f590c01d0c41869cd6da483471bf1e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:33:59.414544 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Getting quotas for user 1563d8c8574f4fd7a75ce2c8b0e7c517 and project 84f590c01d0c41869cd6da483471bf1e. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:33:59.478130 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:33:59.480258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfab0313-de47-4df4-9dc9-df9ef34afeda',volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:33:59.613908 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d8f8bb4d-06f2-414d-8bde-9083ae9c8cb5 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833255 Jul 18 14:33:59.614612 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3655/7530] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:33:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:33:59.625028 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9737d8c4-5674-4133-8ce8-69cc98950100 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:59.625649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9737d8c4-5674-4133-8ce8-69cc98950100 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:59.629961 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=12 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:59.630657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:59.632014 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:59.693730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9737d8c4-5674-4133-8ce8-69cc98950100 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:59.700582 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9737d8c4-5674-4133-8ce8-69cc98950100 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1087 microversion: 2.1 time: 0.079942 Jul 18 14:33:59.701149 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3876/7531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:59 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:00.718289 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1a24e03d-c055-423c-87fa-bf65fa60a258 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:00.718930 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1a24e03d-c055-423c-87fa-bf65fa60a258 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:00.781335 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1a24e03d-c055-423c-87fa-bf65fa60a258 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:00.789014 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1a24e03d-c055-423c-87fa-bf65fa60a258 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1087 microversion: 2.1 time: 0.075777 Jul 18 14:34:00.789622 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3656/7532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:00 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:01.806979 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-595af01e-5fc6-4c31-a468-ceeb5b618a86 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:01.807601 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-595af01e-5fc6-4c31-a468-ceeb5b618a86 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:01.864623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-595af01e-5fc6-4c31-a468-ceeb5b618a86 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:01.871650 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-595af01e-5fc6-4c31-a468-ceeb5b618a86 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1087 microversion: 2.1 time: 0.068925 Jul 18 14:34:01.872352 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3877/7533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:01 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:02.889004 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e9146091-8010-4890-ad5b-4e32547f67e9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:02.889633 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e9146091-8010-4890-ad5b-4e32547f67e9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:02.954110 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e9146091-8010-4890-ad5b-4e32547f67e9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:02.961041 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e9146091-8010-4890-ad5b-4e32547f67e9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1087 microversion: 2.1 time: 0.076116 Jul 18 14:34:02.961630 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3657/7534] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:02 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:03.977225 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:03.977848 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:03.986927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:03.987384 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:03.988183 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:03.988669 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:04.051622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:04.059282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d40a80eb-68c0-4125-a578-0e2dd7853e5e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1137 microversion: 2.1 time: 0.086056 Jul 18 14:34:04.059857 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3878/7535] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:03 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:05.076968 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:05.077708 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:05.086715 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:05.087281 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:05.088148 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:05.088674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:05.183286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:05.192278 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-e3b65c4d-05c7-4a68-be76-4c1616807f3c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1203 microversion: 2.1 time: 0.119173 Jul 18 14:34:05.193051 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3658/7536] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:05 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1203 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:06.210096 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:06.211503 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:06.226489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:06.227386 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:06.228415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:06.229150 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:06.311581 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-a6637147-451c-4924-87ea-1ad5fb6f03dc req-bdbbfdc4-ac8b-4396-90f7-cdcaa940e544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:34:06.325790 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6637147-451c-4924-87ea-1ad5fb6f03dc req-bdbbfdc4-ac8b-4396-90f7-cdcaa940e544 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:06.330466 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-a6637147-451c-4924-87ea-1ad5fb6f03dc req-bdbbfdc4-ac8b-4396-90f7-cdcaa940e544 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:06.365829 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-a6637147-451c-4924-87ea-1ad5fb6f03dc req-bdbbfdc4-ac8b-4396-90f7-cdcaa940e544 service nova] Creating event network-changed:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:34:06.396097 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-a6637147-451c-4924-87ea-1ad5fb6f03dc req-bdbbfdc4-ac8b-4396-90f7-cdcaa940e544 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089213 Jul 18 14:34:06.396728 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3659/7537] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:34:06.417956 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:06.434231 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-0eefba5e-b740-41bf-9119-6eba3fbea594 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1271 microversion: 2.1 time: 0.228144 Jul 18 14:34:06.444998 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3879/7538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:06 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:07.452195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:07.452899 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:07.460267 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:07.460740 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:07.461551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:07.462007 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:07.609785 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:07.618236 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-bdf70b5d-d838-44ce-9b67-df3ac1636389 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1271 microversion: 2.1 time: 0.171040 Jul 18 14:34:07.619186 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3660/7539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:07 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:08.635147 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:08.636619 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:08.643682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:08.644129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:08.644909 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:08.645514 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:08.797199 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:08.805459 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-8963e6e8-cc12-4c53-a073-01db5c4f8fd9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1271 microversion: 2.1 time: 0.174162 Jul 18 14:34:08.806056 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3880/7540] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:08 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:09.823526 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:09.824354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:09.827090 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:34:09.832710 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:09.833259 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:09.833981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:09.834450 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:09.978835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:09.988362 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-21a231fe-585c-4d00-a04a-7f347610febb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1271 microversion: 2.1 time: 0.169137 Jul 18 14:34:09.988968 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3661/7541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:09 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:11.008057 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:11.008616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:11.016171 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:11.016630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:11.017424 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:11.017869 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:11.154524 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:11.162832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-52c5b093-8a80-4d7f-a30f-a0266c977737 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.159186 Jul 18 14:34:11.163414 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3881/7542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:11 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:12.180609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:12.181229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:12.189754 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:12.190234 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:12.191016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:12.191464 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:12.332436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:12.340244 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4c8d4ce2-468a-4fb0-b359-26dd3654a300 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.163625 Jul 18 14:34:12.340837 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3662/7543] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:12 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:13.357700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:13.358366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:13.360247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=4 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:34:13.366760 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:13.367218 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:13.368005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:13.368432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:13.505351 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:13.512976 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6af388be-87b7-499a-9d72-51d442f05bb6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.159268 Jul 18 14:34:13.513677 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3882/7544] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:13 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:14.531359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:14.531919 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:14.534384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=10 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:34:14.540778 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:14.541245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:14.542031 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:14.542516 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:14.680440 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:14.688210 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-378f3659-eb01-4a38-9173-c3ba11eee338 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.161579 Jul 18 14:34:14.688806 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3663/7545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:14 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:15.706250 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:15.706885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:15.713808 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:15.714289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:15.715063 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:15.715498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:15.855361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:15.864075 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-7238c31f-669e-4f35-89aa-e4625643015a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.162271 Jul 18 14:34:15.864658 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3883/7546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:15 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:16.881159 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:16.881742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:16.888823 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:16.889283 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:16.890078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:16.890553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:17.028623 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:17.036941 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-92ebe03b-92d7-4c92-98db-6dc9db75aad8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.159734 Jul 18 14:34:17.037531 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3664/7547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:16 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:17.592483 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:34:17.593038 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:34:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:34:18.054900 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:18.055472 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:18.062673 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:18.063139 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:18.064538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:18.064983 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:18.202550 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:18.211193 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dc5cc447-1bf6-4b81-9a6a-ad7b87acef3d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.160342 Jul 18 14:34:18.211768 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3884/7548] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:18 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:19.229077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:19.229731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:19.237514 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:19.238000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:19.238801 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:19.239286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:19.380265 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:19.387937 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-eccde579-7be6-4f50-b59a-adb413efb63f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.162738 Jul 18 14:34:19.388533 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3665/7549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:19 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:34:20.405705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:20.406337 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:20.413854 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:20.414343 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:20.415106 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:20.415542 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:20.559426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:20.568691 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-2e3d9937-db96-4666-95ef-eede225f9fcc tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.167305 Jul 18 14:34:20.569288 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3885/7550] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:20 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:20.817579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-b928e225-ac5a-4a95-8ae5-0a35686ccc07 req-0d0aaea2-a0e7-471f-8154-040921fab568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "name": "network-vif-plugged", "status": "completed", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:34:20.826951 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b928e225-ac5a-4a95-8ae5-0a35686ccc07 req-0d0aaea2-a0e7-471f-8154-040921fab568 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:20.827695 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-b928e225-ac5a-4a95-8ae5-0a35686ccc07 req-0d0aaea2-a0e7-471f-8154-040921fab568 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:20.839335 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-b928e225-ac5a-4a95-8ae5-0a35686ccc07 req-0d0aaea2-a0e7-471f-8154-040921fab568 service nova] Creating event network-vif-plugged:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:34:20.844845 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-b928e225-ac5a-4a95-8ae5-0a35686ccc07 req-0d0aaea2-a0e7-471f-8154-040921fab568 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093719 Jul 18 14:34:20.845478 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3666/7551] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:34:21.586050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:21.586704 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:21.593891 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:21.594391 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:21.595764 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:21.596229 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:21.731621 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:21.739243 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-ff79ccfa-2ffd-4c38-aca7-d3f358e00c46 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1259 microversion: 2.1 time: 0.157181 Jul 18 14:34:21.739854 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3886/7552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:21 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:22.760924 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:22.761838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:22.768541 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:22.768997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:22.778477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:22.778995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:22.930067 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:22.937933 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-9373e5ae-90a4-4370-aa60-b2d18d0c5505 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1443 microversion: 2.1 time: 0.183454 Jul 18 14:34:22.938684 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3667/7553] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:22 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:22.957749 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:34:22.958399 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:34:22.965510 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:22.965993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:22.966973 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:22.967502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:23.112785 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:34:23.120792 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-b9bcb535-f861-4d7e-b687-4a07d1763280 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1443 microversion: 2.1 time: 0.170606 Jul 18 14:34:23.121371 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3887/7554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:34:22 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:34:24.869856 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-d672f64b-90f0-4b17-87fe-539287f29b5c req-9f6dea99-7724-4094-9628-655b17d8ad9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:34:24.878524 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d672f64b-90f0-4b17-87fe-539287f29b5c req-9f6dea99-7724-4094-9628-655b17d8ad9a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:34:24.878978 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-d672f64b-90f0-4b17-87fe-539287f29b5c req-9f6dea99-7724-4094-9628-655b17d8ad9a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:34:24.890373 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-d672f64b-90f0-4b17-87fe-539287f29b5c req-9f6dea99-7724-4094-9628-655b17d8ad9a service nova] Creating event network-changed:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:34:24.896114 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-d672f64b-90f0-4b17-87fe-539287f29b5c req-9f6dea99-7724-4094-9628-655b17d8ad9a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030864 Jul 18 14:34:24.896985 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3668/7555] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:36:22.150587 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=28 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:22.151946 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=60 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:22.156220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:36:22.156783 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:22.164426 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:22.164882 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:22.165807 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:22.166287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:22.189224 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.objects.instance [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lazy-loading 'flavor' on Instance uuid 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de {{(pid=131366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:36:22.258484 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [f9cd522c-4ab7-4905-af9d-0312d6f26b97] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:36:23.265568 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [f9cd522c-4ab7-4905-af9d-0312d6f26b97] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40260. Jul 18 14:36:23.268695 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-d75ec100-cbee-423e-bd81-98288a113303 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de/action" status: 202 len: 0 microversion: 2.1 time: 1.120428 Jul 18 14:36:23.269306 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3888/7556] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:36:22 2022] POST /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:36:23.276068 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 14:36:23.277004 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 14:36:23.277618 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:23.278400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=56 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:23.282843 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:23.283592 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:23.291567 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:23.292114 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:23.292915 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:23.293366 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:23.434071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:23.442255 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dcd3420b-8972-4ecf-a8a5-a81b9609784d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.168141 Jul 18 14:36:23.442843 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3669/7557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:23 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:36:24.462203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:24.462849 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:24.470107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:24.470606 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:24.471376 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:24.471820 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:24.605721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:24.613867 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-31e4a5be-2c3a-4a59-b5b7-3b8b6c468863 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.156891 Jul 18 14:36:24.614474 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3889/7558] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:24 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:25.631317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:25.631940 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:25.644839 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:25.645300 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:25.646084 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:25.646551 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:25.653056 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40274. Jul 18 14:36:25.656091 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40272. Jul 18 14:36:25.782071 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:25.790267 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-6646d597-efbc-406f-b43e-18de1db55a1e tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.162938 Jul 18 14:36:25.790844 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3670/7559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:25 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:26.807700 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:26.808315 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:26.815257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:26.815703 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:26.816459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:26.816898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:26.946917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:26.954906 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3c5d5d1-0f70-4df6-8bfe-5326f5e1e99d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.151248 Jul 18 14:36:26.955480 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3890/7560] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:26 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:27.973132 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:27.973796 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:27.981268 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:27.981773 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:27.982637 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:27.983127 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:28.112624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:28.120280 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-375dd4b1-4c76-4028-ad7a-1ecf3b1602b1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.151341 Jul 18 14:36:28.120854 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3671/7561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:27 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:29.136893 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:29.137520 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:29.144552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:29.145011 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:29.145788 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:29.146257 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:29.278885 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:29.287004 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-609a19d2-7979-4d09-ad62-93f25d360882 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.154155 Jul 18 14:36:29.287571 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3891/7562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:29 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:30.303768 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:30.304389 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:30.311348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:30.311807 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:30.312624 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:30.313100 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:30.450593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:30.458879 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d136618d-b565-4544-944d-830d3a9a3f19 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.159612 Jul 18 14:36:30.459473 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3672/7563] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:30 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:31.475475 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:31.476060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:31.482945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:31.483394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:31.484152 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:31.484588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:31.619916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:31.627585 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-36d0b4d7-6558-43b9-945e-492975f8be09 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.156167 Jul 18 14:36:31.628171 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3892/7564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:31 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:32.645328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:32.645967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:32.653150 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:32.653609 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:32.654411 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:32.654855 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:32.905460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:32.913610 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5b7cd5c6-ba56-42f1-981b-cf6fd8b4dd5c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.272750 Jul 18 14:36:32.914196 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3673/7565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:32 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:33.931658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:33.932463 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:33.940622 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:33.941080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:33.941862 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:33.942370 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:34.139589 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:34.148469 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-197ab14b-a111-452b-956a-5904dd939721 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.220665 Jul 18 14:36:34.149263 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3893/7566] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:33 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:35.165408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:35.166048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:35.173179 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:35.173642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:35.175151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:35.175606 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:35.308967 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:35.316526 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-3894623d-dbbd-4922-ac60-4a1d77a385e1 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.155129 Jul 18 14:36:35.317096 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3674/7567] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:35 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:36.335061 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:36.335624 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:36.342253 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:36.342710 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:36.343490 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:36.343933 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:36.476430 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:36.484206 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-925620de-02f8-443c-8083-ea15e58f605f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.154026 Jul 18 14:36:36.484977 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3894/7568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:36 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:37.501753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:37.502319 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:37.510051 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:37.510550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:37.511359 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:37.511818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:37.652344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:37.660039 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a595a0a5-7a5e-4cb8-9de3-5afd3304ced9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.162385 Jul 18 14:36:37.661013 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3675/7569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:37 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:38.677639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:38.678278 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:38.685273 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.685721 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:38.686509 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.686943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:38.820159 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:38.827849 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ee8a9c2-a78b-49c6-9427-2ab64312a270 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1508 microversion: 2.1 time: 0.154135 Jul 18 14:36:38.828431 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3895/7570] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:38 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:38.845000 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:36:38.845588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:38.852563 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.853030 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:38.853810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.854288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:38.928257 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-93d956ff-ffd4-483f-af93-0a33cf9d0d7c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "POST /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de/action" status: 202 len: 0 microversion: 2.1 time: 0.087142 Jul 18 14:36:38.928798 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3676/7571] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:36:38 2022] POST /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:36:38.937085 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:38.937767 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:38.944579 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.945041 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:38.945812 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:38.946289 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:39.143800 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:39.153196 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-25430aa0-708d-4ec8-aaf0-68d4758774c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1516 microversion: 2.1 time: 0.220030 Jul 18 14:36:39.153975 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3896/7572] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:38 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:39.483997 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-1b3ec90b-1698-4e42-9b26-abcd058d41e4 req-1d8529ac-81fc-4d4d-bbdc-301f9d095257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "name": "network-vif-unplugged", "status": "completed", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:36:39.495256 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1b3ec90b-1698-4e42-9b26-abcd058d41e4 req-1d8529ac-81fc-4d4d-bbdc-301f9d095257 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:39.495658 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-1b3ec90b-1698-4e42-9b26-abcd058d41e4 req-1d8529ac-81fc-4d4d-bbdc-301f9d095257 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:39.509076 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.compute.server_external_events [req-1b3ec90b-1698-4e42-9b26-abcd058d41e4 req-1d8529ac-81fc-4d4d-bbdc-301f9d095257 service nova] Unable to find a host for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de. Dropping event network-vif-unplugged {{(pid=131367) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 14:36:39.509985 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-1b3ec90b-1698-4e42-9b26-abcd058d41e4 req-1d8529ac-81fc-4d4d-bbdc-301f9d095257 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030472 Jul 18 14:36:39.510793 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3677/7573] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 14:36:40.171098 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:40.171841 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:40.179287 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:40.179813 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:40.180651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:40.181180 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:40.631636 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:40.640489 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6ef1bf27-d333-40ce-88ca-89db0b8b97f8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1518 microversion: 2.1 time: 0.473324 Jul 18 14:36:40.641260 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3897/7574] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:40 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1518 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:41.659529 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:41.660147 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:41.667151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:41.667614 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:41.668387 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:41.668835 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:41.804214 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:41.811963 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d2b13c50-1fb2-40f4-9c7b-f6a075e26aa9 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1518 microversion: 2.1 time: 0.156844 Jul 18 14:36:41.812544 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3678/7575] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:41 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:42.829157 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:42.829920 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:42.837462 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:42.837918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:42.838731 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:42.839175 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:42.973822 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:42.981430 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-f4b633f7-e6d2-49f1-8844-a126b4a534fe tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1518 microversion: 2.1 time: 0.156219 Jul 18 14:36:42.982014 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3898/7576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:42 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:43.999304 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:43.999933 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:44.007156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:44.007617 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:44.008396 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:44.008850 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:44.145877 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:44.153980 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a57e3734-a05d-4ad5-8c9a-4b2db9cd1c56 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1518 microversion: 2.1 time: 0.158591 Jul 18 14:36:44.154918 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3679/7577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:43 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:45.172265 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:45.172816 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:45.180639 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:45.181129 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:45.181917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:45.182394 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:45.324498 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:45.332242 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-86c849e7-fe4e-407f-9995-c8ed2d04f827 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.163982 Jul 18 14:36:45.332969 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3899/7578] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:45 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:46.349315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:46.349945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:46.357119 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:46.357589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:46.358406 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:46.358868 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:46.491685 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:46.499366 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4d0ee0e5-8c03-4d7f-8463-ebd8abbcc018 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.153970 Jul 18 14:36:46.499950 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3680/7579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:46 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:47.517109 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:47.517667 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:47.524939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:47.525400 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:47.526187 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:47.526740 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:47.656957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:47.665193 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-23f5f937-4447-4ce8-b4e9-6289e805d105 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.152299 Jul 18 14:36:47.665879 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3900/7580] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:47 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:48.682494 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:48.683121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:48.690729 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:48.691185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:48.691957 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:48.692400 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:48.824555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:48.832264 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0e0c510e-e0fa-402c-9b73-59f76facfd84 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.153694 Jul 18 14:36:48.832843 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3681/7581] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:48 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:49.849608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:49.850184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:49.857268 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:49.857726 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:49.858552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:49.858997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:49.997992 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:50.006491 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-dcc4ef2e-e3fd-4d2a-bd36-670b907b958d tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.160918 Jul 18 14:36:50.007067 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3901/7582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:49 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:51.024579 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:51.025288 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:51.032245 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:51.032711 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:51.034133 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:51.034602 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:51.165336 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:51.172963 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-a394ba5b-02be-4b4f-aea5-4e7837229319 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.152658 Jul 18 14:36:51.173547 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3682/7583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:51 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:52.190686 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:52.191312 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:52.194114 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:52.199679 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:52.200141 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:52.200915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:52.201359 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:52.206019 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:52.333408 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:52.341171 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-aeac378c-cbeb-43a6-b918-f285ff2c35e6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.155100 Jul 18 14:36:52.341754 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3902/7584] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:52 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:53.359694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:53.360315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:53.363605 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=31 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:53.368970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:53.369429 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:53.370232 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:53.370680 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:53.373448 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:53.511197 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:53.519058 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-fbe0385f-b725-43b8-9c80-d25c7a3f6faa tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.163284 Jul 18 14:36:53.519646 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3683/7585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:53 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:54.536311 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:54.537059 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:54.544506 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:54.544966 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:54.545757 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:54.546223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:54.690471 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:54.698281 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-e0d2853e-4afc-497a-a0f6-617133c9e927 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.165952 Jul 18 14:36:54.698867 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3903/7586] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:54 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:55.616588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-62ff345b-7db3-4df2-891c-63aa799f7ac8 req-b65153b3-19c7-4c88-bfd9-91b9598e1ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "name": "network-vif-plugged", "status": "completed", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:36:55.625851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-62ff345b-7db3-4df2-891c-63aa799f7ac8 req-b65153b3-19c7-4c88-bfd9-91b9598e1ca7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:55.626354 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-62ff345b-7db3-4df2-891c-63aa799f7ac8 req-b65153b3-19c7-4c88-bfd9-91b9598e1ca7 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:55.638514 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-62ff345b-7db3-4df2-891c-63aa799f7ac8 req-b65153b3-19c7-4c88-bfd9-91b9598e1ca7 service nova] Creating event network-vif-plugged:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:36:55.644462 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-62ff345b-7db3-4df2-891c-63aa799f7ac8 req-b65153b3-19c7-4c88-bfd9-91b9598e1ca7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Jul 18 14:36:55.645088 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3684/7587] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:36:55.715181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:55.715793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:55.723060 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:55.723448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:55.724216 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:55.724648 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:55.858193 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:55.866626 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c8065068-83a0-4b31-83b5-eab237915f14 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.155339 Jul 18 14:36:55.875740 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3904/7588] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:55 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:56.885536 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:56.886276 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:56.893187 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:56.893653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:56.894484 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:56.894945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:57.036990 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:57.044967 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-80a545a0-7673-4496-bc47-ea21c359b08a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1574 microversion: 2.1 time: 0.164803 Jul 18 14:36:57.045785 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3685/7589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:56 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:36:58.062046 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:36:58.062730 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:36:58.069776 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:58.070241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:58.071044 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:36:58.071538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:36:58.207995 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:36:58.215797 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9ea6fdb4-3b64-4c3b-835b-8f03d8d33c3a tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1561 microversion: 2.1 time: 0.157685 Jul 18 14:36:58.216391 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3905/7590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:36:58 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:37:37.601483 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:37:37.602198 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:37:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:38:12.452854 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=5 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:12.453753 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=13 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:12.455899 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=7 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:12.457219 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=23 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:12.459186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:12.459697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:12.467923 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:12.468392 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:12.469369 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:12.469819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:12.496463 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:38:12.518457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-f775c830-efa5-4c65-9e83-3f09c0d4ce19 req-01350028-15dd-4fc7-8640-342875db94d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:12.528993 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f775c830-efa5-4c65-9e83-3f09c0d4ce19 req-01350028-15dd-4fc7-8640-342875db94d2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:12.529447 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-f775c830-efa5-4c65-9e83-3f09c0d4ce19 req-01350028-15dd-4fc7-8640-342875db94d2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:12.545071 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-f775c830-efa5-4c65-9e83-3f09c0d4ce19 req-01350028-15dd-4fc7-8640-342875db94d2 service nova] Creating event network-changed:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:38:12.551140 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-f775c830-efa5-4c65-9e83-3f09c0d4ce19 req-01350028-15dd-4fc7-8640-342875db94d2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097863 Jul 18 14:38:12.552191 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3906/7591] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:38:12.579429 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-16631113-3915-4803-ba0e-dc4726088894 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 204 len: 0 microversion: 2.1 time: 0.128756 Jul 18 14:38:12.580274 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3686/7592] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:38:12 2022] DELETE /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:38:12.597423 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:12.600536 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:12.610406 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:12.610980 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:12.612381 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:12.613432 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:12.764271 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:12.773005 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-5570ce61-5d62-49d1-83f3-6100832b85eb tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.188091 Jul 18 14:38:12.773584 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3907/7593] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:12 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:13.792272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:13.792995 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:13.800945 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:13.801410 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:13.802226 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:13.802683 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:13.956249 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:13.964244 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f12cf433-a9c8-43fc-92b8-76fe08fb222c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1567 microversion: 2.1 time: 0.176421 Jul 18 14:38:13.964838 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3687/7594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:13 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:14.967231 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-ca7095af-7d0a-4614-853c-786f86155029 req-69f2e453-4e70-454e-b744-e034a5d88a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad87d79-6b33-4d3c-9974-db1c5dfcf1de", "name": "network-vif-deleted", "tag": "0b560cab-2c94-4326-8b6f-35ff11b9f786"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:14.977203 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ca7095af-7d0a-4614-853c-786f86155029 req-69f2e453-4e70-454e-b744-e034a5d88a45 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:14.977658 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-ca7095af-7d0a-4614-853c-786f86155029 req-69f2e453-4e70-454e-b744-e034a5d88a45 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:14.982099 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:14.983550 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:14.990468 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-ca7095af-7d0a-4614-853c-786f86155029 req-69f2e453-4e70-454e-b744-e034a5d88a45 service nova] Creating event network-vif-deleted:0b560cab-2c94-4326-8b6f-35ff11b9f786 for instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de on n-h1-850003-3 Jul 18 14:38:14.991146 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:14.991692 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:14.992977 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:14.993548 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:14.995831 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-ca7095af-7d0a-4614-853c-786f86155029 req-69f2e453-4e70-454e-b744-e034a5d88a45 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032237 Jul 18 14:38:14.996641 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3908/7595] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:38:15.064424 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:15.072235 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-26cd2f54-891e-474c-9a70-33b5c1f74e02 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1218 microversion: 2.1 time: 0.094200 Jul 18 14:38:15.072828 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3688/7596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:14 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:38:16.090487 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:16.091194 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:16.098241 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:16.098694 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:16.099560 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:16.100223 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:16.164701 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:16.172640 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12c85a50-6ea8-404b-b295-4204c4f81b0f tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1218 microversion: 2.1 time: 0.087362 Jul 18 14:38:16.173228 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3909/7597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:16 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:17.188920 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:17.189664 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:17.196845 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:17.197317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:17.198108 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:17.198597 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:17.261364 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:17.269897 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-10c0bb2f-0bc8-428d-ad01-a8d146819755 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1218 microversion: 2.1 time: 0.084939 Jul 18 14:38:17.270507 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3689/7598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:17 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:18.287479 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:18.288204 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:18.295489 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:18.295931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:18.296714 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:18.297130 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:18.358907 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:18.367512 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-9893a979-71d0-4942-ac35-a2766d938478 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1218 microversion: 2.1 time: 0.084446 Jul 18 14:38:18.368115 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3910/7599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:18 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:19.384408 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:19.385178 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:19.392876 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:19.393344 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:19.394436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:19.394914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:19.426371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:19.426848 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:19.427341 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lazy-loading 'fault' on Instance uuid 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:38:19.472183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1563d8c8574f4fd7a75ce2c8b0e7c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f590c01d0c41869cd6da483471bf1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:19.483051 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f2443f5-e951-4fbc-90a7-648e4fd6e9c8 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 200 len: 1223 microversion: 2.1 time: 0.102644 Jul 18 14:38:19.483834 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3690/7600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:19 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:20.500649 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:20.501291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] [instance: 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:20.509285 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:20.509743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:20.510555 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:20.511025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:20.526434 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] HTTP exception thrown: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Request method failure captured: Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de HTTP/1.1 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1W4c9UWaKtZw4fY_ajAiqSeRzXawN6LaTFkeEbsOrtuuz0jk19diHxbjo5bN28mKio8fJzy0ydW-h1koKc8nkfxVQ5JQqpTzXhhgykqPO9-8nEKFOq8p3NOOtAZTDGaScUbuz0ZLA1SFOwiMMtlNkgfc_GC9D5HlLDjXVdYq3LRlx9I Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 84f590c01d0c41869cd6da483471bf1e Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestShelveInstance-643765035 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_84f590c01d0c41869cd6da483471bf1e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84f590c01d0c41869cd6da483471bf1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestShelveInstance-643765035 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 84f590c01d0c41869cd6da483471bf1e Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestShelveInstance-643765035 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestShelveInstance-643765035-project Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: 1563d8c8574f4fd7a75ce2c8b0e7c517 Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestShelveInstance-643765035-project Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '6ad87d79-6b33-4d3c-9974-db1c5dfcf1de'} Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:38:20.528144 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Returning 404 to user: Instance 6ad87d79-6b33-4d3c-9974-db1c5dfcf1de could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c6a4ee4a-a06c-47f4-958c-f32fc37de96c tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de" status: 404 len: 111 microversion: 2.1 time: 0.032933 Jul 18 14:38:20.533918 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3911/7601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:20 2022] GET /compute/v2.1/servers/6ad87d79-6b33-4d3c-9974-db1c5dfcf1de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:38:20.704769 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b9b77d2f-df8d-4ef7-8daa-a0c7768400f6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] Calling method '.version_select at 0x7f96d77a0e50>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:20.726666 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b9b77d2f-df8d-4ef7-8daa-a0c7768400f6 tempest-TestShelveInstance-643765035 tempest-TestShelveInstance-643765035-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-535475932" status: 202 len: 0 microversion: 2.1 time: 0.025716 Jul 18 14:38:20.727409 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3691/7602] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 14:38:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-535475932 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:38:37.929538 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=14 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:37.930412 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=24 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:38.100867 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-cf86c2a0-416a-44ce-a526-d1234c7769fd tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Action: 'create', calling method: .version_select at 0x7f96e46fe3a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1256193852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmCm8JksOx/GNMB563WAkvNuZSQpi54vM2RUvwiFhLKhTXw6PTNrGlCJG1tQgNIdxi8v4OB0Mj8S0/++3QAxFqt5F4kLVl7zloeR5ONf/hzkfzp96DPqF34k2YK28ceLA=="}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:38.115522 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cf86c2a0-416a-44ce-a526-d1234c7769fd tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:38:38.120951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-cf86c2a0-416a-44ce-a526-d1234c7769fd tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for user ff91310b220948a7b76dad492f3aeded and project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'key_pairs'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:38:38.147396 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-cf86c2a0-416a-44ce-a526-d1234c7769fd tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.222908 Jul 18 14:38:38.148017 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3912/7603] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 14:38:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:38:39.238384 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:39.239258 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:39.243269 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1720360328", "imageRef": "df1d514c-8a50-4216-9a84-c81f6f685344", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1256193852", "security_groups": [{"name": "tempest-secgroup-smoke-1018888847"}], "networks": [{"uuid": "ea554b5e-db76-423d-a177-19ff57479a77"}]}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:39.355693 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.network.neutron [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] validate_networks() for [('ea554b5e-db76-423d-a177-19ff57479a77', None, None, None, None, None)] {{(pid=131367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:38:39.763221 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Flavor limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:38:39.763666 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Image limits 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:38:39.764156 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Flavor pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:38:39.764612 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Image pref 0:0:0 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:38:39.765044 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.virt.hardware [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:38:39.776674 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:39.777151 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:39.777992 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:39.778477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:39.795738 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:38:39.801144 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.quota [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for user ff91310b220948a7b76dad492f3aeded and project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'cores', 'ram', 'instances'} {{(pid=131367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:38:39.814589 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Going to run 1 instances... {{(pid=131367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:38:39.816897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df1d514c-8a50-4216-9a84-c81f6f685344',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:38:39.863686 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5f13ef01-6ff0-4dbf-b7b3-3c044c18533f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.627184 Jul 18 14:38:39.864707 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3692/7604] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:38:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:38:39.875366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-07745d8a-d218-4330-8c14-5e882cb1a3ee tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:39.876480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-07745d8a-d218-4330-8c14-5e882cb1a3ee tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:39.937318 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-07745d8a-d218-4330-8c14-5e882cb1a3ee tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:39.948472 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-07745d8a-d218-4330-8c14-5e882cb1a3ee tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1249 microversion: 2.1 time: 0.077857 Jul 18 14:38:39.949486 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3913/7605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:39 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:40.968555 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:40.969106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:40.976438 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:40.976909 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:40.977709 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:40.978183 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:41.039832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:41.048088 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-c0269fab-ee27-43bc-bb91-98a5c437f990 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1253 microversion: 2.1 time: 0.083931 Jul 18 14:38:41.048680 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3693/7606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:40 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:42.071137 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:42.071856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:42.080927 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:42.081709 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:42.083608 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:42.084372 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:42.167616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:42.177090 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-635151cc-1e99-4792-9de8-a5c1476e57f3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1309 microversion: 2.1 time: 0.109967 Jul 18 14:38:42.188440 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3914/7607] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:42 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:43.197096 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:43.197914 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:43.213161 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:43.213921 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:43.214926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:43.215388 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:43.449213 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:43.460494 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-1018144d-007d-43c1-b0a9-62ffc0da39b0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.267534 Jul 18 14:38:43.472872 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3694/7608] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:43 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:43.753852 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-506c60b2-6a96-4fe0-b3b6-808508d8f93e req-7224d3cf-1586-42dd-8746-9986cc23dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:43.763504 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-506c60b2-6a96-4fe0-b3b6-808508d8f93e req-7224d3cf-1586-42dd-8746-9986cc23dad1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:43.763945 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-506c60b2-6a96-4fe0-b3b6-808508d8f93e req-7224d3cf-1586-42dd-8746-9986cc23dad1 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:43.776225 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-506c60b2-6a96-4fe0-b3b6-808508d8f93e req-7224d3cf-1586-42dd-8746-9986cc23dad1 service nova] Creating event network-changed:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:38:43.781629 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-506c60b2-6a96-4fe0-b3b6-808508d8f93e req-7224d3cf-1586-42dd-8746-9986cc23dad1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105926 Jul 18 14:38:43.782713 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3915/7609] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:38:44.478433 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:44.479222 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:44.486588 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:44.487317 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:44.488386 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:44.488847 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:44.624916 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:44.632805 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-665e054d-bb84-4090-9b4a-58f9b745d56f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.158269 Jul 18 14:38:44.633317 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3695/7610] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:44 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:45.651552 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:45.652255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:45.659532 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:45.659987 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:45.660750 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:45.661191 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:45.795939 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:45.804120 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a6781637-a376-4b22-b9c6-b9789423186c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.156876 Jul 18 14:38:45.804699 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3916/7611] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:45 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:46.821810 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:46.822549 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:46.829371 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:46.829832 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:46.830650 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:46.831094 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:46.960958 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:46.968388 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b93b0979-280a-441d-a154-7de3b08d5c02 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.150555 Jul 18 14:38:46.968960 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3696/7612] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:46 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:47.986356 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:47.986972 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:47.993974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:47.994467 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:47.995222 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:47.995656 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:48.138179 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:48.146711 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3e3d8a5-9d74-482e-aee2-60d0a0786737 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.164282 Jul 18 14:38:48.147667 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3917/7613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:47 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:49.163936 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:49.164564 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:49.172286 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:49.172752 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:49.173531 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:49.173979 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:49.308460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:49.315941 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-00179d88-f64f-4dc3-8346-9c3d01057423 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.155992 Jul 18 14:38:49.316524 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3697/7614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:49 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:50.152100 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-0d1c6b0e-5908-485d-9e8b-0cd255446036 req-a2ed2d73-7d4f-44b4-8565-a3c2f91e2ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "name": "network-vif-plugged", "status": "completed", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:50.158630 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:50.163502 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0d1c6b0e-5908-485d-9e8b-0cd255446036 req-a2ed2d73-7d4f-44b4-8565-a3c2f91e2ae2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:50.163957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-0d1c6b0e-5908-485d-9e8b-0cd255446036 req-a2ed2d73-7d4f-44b4-8565-a3c2f91e2ae2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:50.177696 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-0d1c6b0e-5908-485d-9e8b-0cd255446036 req-a2ed2d73-7d4f-44b4-8565-a3c2f91e2ae2 service nova] Creating event network-vif-plugged:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:38:50.183062 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-0d1c6b0e-5908-485d-9e8b-0cd255446036 req-a2ed2d73-7d4f-44b4-8565-a3c2f91e2ae2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035263 Jul 18 14:38:50.183675 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3918/7615] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:38:50.333518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:50.334167 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:50.336106 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:50.336816 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=6 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:38:50.344070 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:50.344543 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:50.345338 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:50.345890 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:50.488015 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:50.495786 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5302a432-027b-4b49-861e-f81d6d79195f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.166217 Jul 18 14:38:50.496370 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3698/7616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:50 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:51.513388 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:51.514097 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:51.521291 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:51.521752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:51.522568 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:51.523010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:51.663578 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:51.671321 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-12102755-6fdb-4ef5-85ee-776f0d65c16c tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1375 microversion: 2.1 time: 0.163165 Jul 18 14:38:51.671898 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3919/7617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:51 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:52.688326 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:52.688932 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:52.695944 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:52.696532 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:52.697660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:52.697792 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:52.829552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:52.837313 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d342a5cd-162f-4ad6-83cc-edf90eef456f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1559 microversion: 2.1 time: 0.152946 Jul 18 14:38:52.837896 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3699/7618] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:52 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:52.854095 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:38:52.854761 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:38:52.862330 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:52.862798 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:52.863565 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:52.864010 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:52.994270 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:38:53.001832 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-c03f3db0-39a3-4061-b0e3-e8f1085b30b2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1559 microversion: 2.1 time: 0.151689 Jul 18 14:38:53.002445 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3920/7619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:38:52 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:38:55.476583 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-6479b41b-f33b-4179-9ef6-b1aee1c0cc67 req-a510542c-ef07-47b5-af2a-65f8aeb5e712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:38:55.485518 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6479b41b-f33b-4179-9ef6-b1aee1c0cc67 req-a510542c-ef07-47b5-af2a-65f8aeb5e712 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:38:55.485981 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-6479b41b-f33b-4179-9ef6-b1aee1c0cc67 req-a510542c-ef07-47b5-af2a-65f8aeb5e712 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:38:55.498038 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-6479b41b-f33b-4179-9ef6-b1aee1c0cc67 req-a510542c-ef07-47b5-af2a-65f8aeb5e712 service nova] Creating event network-changed:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:38:55.503634 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-6479b41b-f33b-4179-9ef6-b1aee1c0cc67 req-a510542c-ef07-47b5-af2a-65f8aeb5e712 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030771 Jul 18 14:38:55.504246 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3700/7620] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:40:56.931235 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:40:56.931924 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:40:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:40:57.417638 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:40:57.418206 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:40:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:40:57.609867 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:40:57.610100 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:40:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:40:59.057230 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:40:59.057780 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:41:24.440728 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:41:24.441318 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:41:25.557451 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:41:25.558499 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:41:25.559124 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:25.559997 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=34 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:25.564819 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2051784101"}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:41:25.565910 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:25.574002 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:25.574480 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:25.575255 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:25.575698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:25.857805 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-17498411-be07-4197-b9dd-e022a1ed5632 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "POST /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461/action" status: 202 len: 0 microversion: 2.1 time: 0.301726 Jul 18 14:41:25.858130 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3921/7621] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:41:25 2022] POST /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 14:41:33.048780 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:41:33.049621 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:41:33.050314 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:33.051272 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=46 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:33.120974 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-efde4e7c-fa2e-4934-828a-8231af97b93b req-231eabc4-a085-44a1-a74c-baf3c69d69fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "name": "network-vif-plugged", "status": "completed", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:41:33.130098 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-efde4e7c-fa2e-4934-828a-8231af97b93b req-231eabc4-a085-44a1-a74c-baf3c69d69fa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:33.130585 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-efde4e7c-fa2e-4934-828a-8231af97b93b req-231eabc4-a085-44a1-a74c-baf3c69d69fa service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:33.141942 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-efde4e7c-fa2e-4934-828a-8231af97b93b req-231eabc4-a085-44a1-a74c-baf3c69d69fa service nova] Creating event network-vif-plugged:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:41:33.146989 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-efde4e7c-fa2e-4934-828a-8231af97b93b req-231eabc4-a085-44a1-a74c-baf3c69d69fa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099707 Jul 18 14:41:33.148485 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3701/7622] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:41:44.483240 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:44.484017 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:44.488566 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-825135708", "imageRef": "2efb63a2-2a2c-446c-9b6f-6dc0df36a915", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1256193852", "security_groups": [{"name": "tempest-secgroup-smoke-1018888847"}], "networks": [{"uuid": "ea554b5e-db76-423d-a177-19ff57479a77"}]}} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:41:44.515902 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40862. Jul 18 14:41:44.518193 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40864. Jul 18 14:41:44.724026 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.network.neutron [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] validate_networks() for [('ea554b5e-db76-423d-a177-19ff57479a77', None, None, None, None, None)] {{(pid=131366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:41:45.165440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Flavor limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:41:45.165874 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Image limits 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:41:45.166389 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Flavor pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:41:45.166842 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Image pref 0:0:0 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:41:45.167293 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.virt.hardware [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:41:45.176623 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:45.177101 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:45.177917 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:45.178396 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:45.196115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:41:45.201989 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.quota [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Getting quotas for user ff91310b220948a7b76dad492f3aeded and project 12ba7a1f8cbe411aba53b8a4d3e791ca. Resources: {'cores', 'ram', 'instances'} {{(pid=131366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:41:45.214588 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Going to run 1 instances... {{(pid=131366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:41:45.217065 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2efb63a2-2a2c-446c-9b6f-6dc0df36a915',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:41:45.266907 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-16135746-44d1-4b21-b064-5c11ffd36504 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786537 Jul 18 14:41:45.270200 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3922/7623] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 14:41:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:41:45.277427 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:45.278970 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:45.284121 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-58306220-86e5-4300-a949-69e028f156e0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:45.284838 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-58306220-86e5-4300-a949-69e028f156e0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:45.295801 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7a114f6-386f-44fa-a97d-07b037f4f23f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40884. Jul 18 14:41:45.303117 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ce05961-5e9f-481a-903a-04ca1083b24d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40882. Jul 18 14:41:45.415568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-58306220-86e5-4300-a949-69e028f156e0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:45.424493 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-58306220-86e5-4300-a949-69e028f156e0 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1248 microversion: 2.1 time: 0.150643 Jul 18 14:41:45.425093 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3702/7624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:45 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1248 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:46.443080 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:46.443863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:46.452878 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:46.453433 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:46.454366 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:46.454814 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:46.532768 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:46.540604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a9ce7fd7-32a6-42f3-8d7a-7e8f2c57d6d8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1306 microversion: 2.1 time: 0.102608 Jul 18 14:41:46.541448 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3923/7625] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:46 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:47.560819 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:47.562165 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:47.575556 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:47.576323 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:47.577118 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:47.577886 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:47.721553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:47.729552 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0a2856b4-347b-417e-9cb7-dc0b2c7566aa tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.173136 Jul 18 14:41:47.730251 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3703/7626] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:47 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:48.750249 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:48.751860 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:48.762015 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:48.762974 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:48.764598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:48.765361 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:48.919743 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:48.934632 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-288608fd-917f-4cb8-916a-369488a6f7d7 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.189378 Jul 18 14:41:48.936122 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3924/7627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:48 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:41:49.088343 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-c577a3cd-6a9a-4e1a-8e8e-690d30d1106e req-c254a0b3-c296-4f27-bf24-cfe727f3e888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "name": "network-vif-unplugged", "status": "completed", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:41:49.099062 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c577a3cd-6a9a-4e1a-8e8e-690d30d1106e req-c254a0b3-c296-4f27-bf24-cfe727f3e888 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:49.099521 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-c577a3cd-6a9a-4e1a-8e8e-690d30d1106e req-c254a0b3-c296-4f27-bf24-cfe727f3e888 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:49.113310 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-c577a3cd-6a9a-4e1a-8e8e-690d30d1106e req-c254a0b3-c296-4f27-bf24-cfe727f3e888 service nova] Creating event network-vif-unplugged:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:41:49.120150 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-c577a3cd-6a9a-4e1a-8e8e-690d30d1106e req-c254a0b3-c296-4f27-bf24-cfe727f3e888 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036456 Jul 18 14:41:49.121600 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3704/7628] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:41:49.952477 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:49.953025 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:49.960107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:49.960561 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:49.961340 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:49.961775 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:50.123459 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:50.133273 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-681f762a-2821-44a5-8b1d-458550d732b8 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.184717 Jul 18 14:41:50.133877 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3925/7629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:49 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:51.152172 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:51.153676 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:51.162783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:51.163586 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:51.164622 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:51.165292 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:51.326115 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:51.334622 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-0d9035c8-4f1b-40ca-8c37-a3ad1d6c0e86 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.187485 Jul 18 14:41:51.335334 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3705/7630] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:51 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:52.352801 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:52.353449 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:52.360657 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:52.361115 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:52.361958 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:52.362457 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:52.542380 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:52.550096 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-722b0712-6cf0-4f0f-8a5c-b27fa1699f6e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.201996 Jul 18 14:41:52.551061 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3926/7631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:52 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:53.570634 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:53.572394 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:53.581619 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:53.582493 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:53.583328 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:53.583784 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:53.739545 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:53.747540 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-dc39c605-a5e0-41bb-849c-f89e59d40fa9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.182636 Jul 18 14:41:53.748263 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3706/7632] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:53 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:54.767258 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:54.767898 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:54.775127 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:54.775581 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:54.776368 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:54.776802 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:54.925735 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:54.934011 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-970d6d3e-73b9-412f-a2ce-7ffd92611e6b tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.170898 Jul 18 14:41:54.934633 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3927/7633] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:54 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:55.490552 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [req-5154028f-66fe-4a3e-af1f-94e4cf8392c1 req-d173313c-f435-47c8-a3b8-faac3aa4cf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:41:55.500731 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell0:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:55.514436 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5154028f-66fe-4a3e-af1f-94e4cf8392c1 req-d173313c-f435-47c8-a3b8-faac3aa4cf23 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:55.514737 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [req-5154028f-66fe-4a3e-af1f-94e4cf8392c1 req-d173313c-f435-47c8-a3b8-faac3aa4cf23 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:55.531187 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.compute.server_external_events [req-5154028f-66fe-4a3e-af1f-94e4cf8392c1 req-d173313c-f435-47c8-a3b8-faac3aa4cf23 service nova] Creating event network-changed:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:41:55.537131 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [req-5154028f-66fe-4a3e-af1f-94e4cf8392c1 req-d173313c-f435-47c8-a3b8-faac3aa4cf23 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050546 Jul 18 14:41:55.538594 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3707/7634] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:41:55.951354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:55.952155 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:55.954107 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=2 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:55.954803 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell0:SELECT=6 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:41:55.962756 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:55.963213 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:55.964005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:55.964448 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:56.105125 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:56.113436 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-6a08dfdd-3c6e-40de-a3bd-124f5fdeff4a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.166001 Jul 18 14:41:56.114070 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3928/7635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:55 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:57.131935 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:57.132651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:57.140195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:57.140660 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:57.141477 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:57.141954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:57.425002 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:57.432478 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-b1c30f94-6994-4577-8f53-39c4cdac7fb3 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.304893 Jul 18 14:41:57.433056 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3708/7636] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:57 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:58.449108 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:58.449856 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:58.456733 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:58.457184 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:58.457957 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:58.458500 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:58.592682 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:58.600349 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-56fd0144-37a3-4f58-a661-3f58e71b9a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.155410 Jul 18 14:41:58.600933 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3929/7637] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:58 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:41:59.616927 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:41:59.617562 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:41:59.624716 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:59.625186 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:59.625969 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:41:59.626453 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:41:59.764452 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:41:59.771999 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-329562d7-33bb-46cb-b3f0-84b842f47dde tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.158989 Jul 18 14:41:59.772580 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3709/7638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:41:59 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:00.789005 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:42:00.789642 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:42:00.796951 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:00.797407 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:00.798260 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:00.798688 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:00.946220 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:42:00.954871 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-31daf243-1c11-4cbb-8634-a44677c9c1ed tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.169714 Jul 18 14:42:00.955741 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3930/7639] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:42:00 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:01.972315 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:42:01.972926 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:42:01.979825 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:01.980280 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:01.981048 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:01.981511 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:02.113954 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:42:02.122473 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d4840f03-1a1b-4038-aa45-4b9132f382d4 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.154000 Jul 18 14:42:02.123063 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3710/7640] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:42:01 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:02.757752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-fa1448ee-62ed-4841-a266-bd5aef6ba1ff req-cbc36966-cc09-49a8-8c29-708140589458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "name": "network-vif-plugged", "status": "completed", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:42:02.768023 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fa1448ee-62ed-4841-a266-bd5aef6ba1ff req-cbc36966-cc09-49a8-8c29-708140589458 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:02.768473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-fa1448ee-62ed-4841-a266-bd5aef6ba1ff req-cbc36966-cc09-49a8-8c29-708140589458 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:02.780554 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-fa1448ee-62ed-4841-a266-bd5aef6ba1ff req-cbc36966-cc09-49a8-8c29-708140589458 service nova] Creating event network-vif-plugged:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:42:02.785613 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-fa1448ee-62ed-4841-a266-bd5aef6ba1ff req-cbc36966-cc09-49a8-8c29-708140589458 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Jul 18 14:42:02.786501 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3931/7641] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:42:03.140805 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:42:03.141851 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:42:03.148908 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:03.149380 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:03.150194 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:03.150653 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:03.287382 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:42:03.295719 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-d415c4f8-23e5-4d4d-a7e9-de6b143e87ec tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1374 microversion: 2.1 time: 0.159618 Jul 18 14:42:03.296317 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3711/7642] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:42:03 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:04.314943 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:42:04.315659 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:42:04.322269 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:04.322713 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:04.323486 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:04.323928 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:04.461616 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:42:04.469950 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-98f548fa-baaf-48ea-bd1d-b7943e4bddf2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1558 microversion: 2.1 time: 0.160180 Jul 18 14:42:04.470563 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3932/7643] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:42:04 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:04.488348 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:42:04.488985 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:42:04.496077 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:04.496553 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:04.497355 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:04.497818 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:04.638780 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:42:04.646450 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-2509cd46-caa0-450c-af71-f1f526c7dfbf tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1558 microversion: 2.1 time: 0.162463 Jul 18 14:42:04.647031 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3712/7644] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:42:04 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:42:06.235662 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-d9ef0d3b-836d-48cf-89b7-43f5fb500b03 req-22d79871-25a6-4ff8-b53a-67009629b0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:42:06.245519 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d9ef0d3b-836d-48cf-89b7-43f5fb500b03 req-22d79871-25a6-4ff8-b53a-67009629b0f6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:42:06.246593 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-d9ef0d3b-836d-48cf-89b7-43f5fb500b03 req-22d79871-25a6-4ff8-b53a-67009629b0f6 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:42:06.258787 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-d9ef0d3b-836d-48cf-89b7-43f5fb500b03 req-22d79871-25a6-4ff8-b53a-67009629b0f6 service nova] Creating event network-changed:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:42:06.264070 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-d9ef0d3b-836d-48cf-89b7-43f5fb500b03 req-22d79871-25a6-4ff8-b53a-67009629b0f6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032194 Jul 18 14:42:06.264677 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3933/7645] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:43:44.884595 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=24 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:44.885403 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=52 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:44.952016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1818350838"}} {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:43:44.953078 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:43:44.959103 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:44.959568 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:44.960356 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:44.960811 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:45.247228 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-f883263c-1105-4652-8cee-963363fc96d9 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "POST /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714/action" status: 202 len: 0 microversion: 2.1 time: 0.364474 Jul 18 14:43:45.247893 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3713/7646] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 14:43:44 2022] POST /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 14:43:51.360467 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 14:43:51.363078 n-d-850003-3 devstack@n-api.service[131366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 14:43:51.363931 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:51.364863 n-d-850003-3 devstack@n-api.service[131366]: DEBUG dbcounter [-] [131366] Writing DB stats nova_cell1:SELECT=60 {{(pid=131366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:51.370354 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-261796ff-f14e-467b-bd33-d8f310b3766d req-f740d635-f85b-40f6-b64b-1be94f683354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "name": "network-vif-plugged", "status": "completed", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:43:51.389583 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-261796ff-f14e-467b-bd33-d8f310b3766d req-f740d635-f85b-40f6-b64b-1be94f683354 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:51.390331 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-261796ff-f14e-467b-bd33-d8f310b3766d req-f740d635-f85b-40f6-b64b-1be94f683354 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:51.405394 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-261796ff-f14e-467b-bd33-d8f310b3766d req-f740d635-f85b-40f6-b64b-1be94f683354 service nova] Creating event network-vif-plugged:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:43:51.416840 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-261796ff-f14e-467b-bd33-d8f310b3766d req-f740d635-f85b-40f6-b64b-1be94f683354 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056403 Jul 18 14:43:51.418807 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3934/7647] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:43:58.925374 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_api:SELECT=2 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:58.926195 n-d-850003-3 devstack@n-api.service[131367]: DEBUG dbcounter [-] [131367] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:43:58.930941 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:43:58.931783 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:43:58.943697 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:58.944352 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:58.945329 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:58.945986 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:58.950736 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3251526-0a6e-4a17-80d5-e44aaf21483f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 41176. Jul 18 14:43:58.959827 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] [cb86f9cd-7411-45d6-a61a-a744aef5c275] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 41174. Jul 18 14:43:58.981713 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:43:59.019880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-25cc9ad8-b601-4a46-b6cc-c3ee554dec77 req-877c83ac-9dc6-4089-ac13-ff4492775f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:43:59.031181 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-25cc9ad8-b601-4a46-b6cc-c3ee554dec77 req-877c83ac-9dc6-4089-ac13-ff4492775f5a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:59.032050 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-25cc9ad8-b601-4a46-b6cc-c3ee554dec77 req-877c83ac-9dc6-4089-ac13-ff4492775f5a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:59.045604 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-25cc9ad8-b601-4a46-b6cc-c3ee554dec77 req-877c83ac-9dc6-4089-ac13-ff4492775f5a service nova] Creating event network-changed:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:43:59.051861 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-25cc9ad8-b601-4a46-b6cc-c3ee554dec77 req-877c83ac-9dc6-4089-ac13-ff4492775f5a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126310 Jul 18 14:43:59.053224 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3935/7648] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:43:59.096695 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-5ad65566-f35e-4592-94f5-e751145539c2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 204 len: 0 microversion: 2.1 time: 0.173177 Jul 18 14:43:59.100913 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3714/7649] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:43:58 2022] DELETE /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:43:59.106793 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:43:59.107525 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:43:59.114627 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:59.115132 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:59.115915 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:43:59.116346 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:43:59.285922 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:43:59.302282 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a3938e4c-ab81-43be-a738-1b258c333a18 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1683 microversion: 2.1 time: 0.199628 Jul 18 14:43:59.303362 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3936/7650] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:43:59 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:44:00.322918 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:00.323672 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:00.331478 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:00.331948 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:00.332750 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:00.333204 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:00.483049 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:44:00.491579 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-4890e24a-db48-4f9d-8ee2-4fd60883e502 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1683 microversion: 2.1 time: 0.172823 Jul 18 14:44:00.492452 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3715/7651] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:00 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:44:01.333953 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-cd92a2cf-fc59-4aa3-8694-30503bdeef7d req-4d75bc71-c4fa-45cf-8366-db74c2bff71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a5ee30-f061-4659-af2b-18ba47d81714", "name": "network-vif-deleted", "tag": "b915f461-ce5c-4c99-8a89-d22b0aad8d60"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:44:01.343428 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-cd92a2cf-fc59-4aa3-8694-30503bdeef7d req-4d75bc71-c4fa-45cf-8366-db74c2bff71a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:01.343880 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-cd92a2cf-fc59-4aa3-8694-30503bdeef7d req-4d75bc71-c4fa-45cf-8366-db74c2bff71a service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:01.356532 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-cd92a2cf-fc59-4aa3-8694-30503bdeef7d req-4d75bc71-c4fa-45cf-8366-db74c2bff71a service nova] Creating event network-vif-deleted:b915f461-ce5c-4c99-8a89-d22b0aad8d60 for instance b5a5ee30-f061-4659-af2b-18ba47d81714 on n-h2-850003-3 Jul 18 14:44:01.361801 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-cd92a2cf-fc59-4aa3-8694-30503bdeef7d req-4d75bc71-c4fa-45cf-8366-db74c2bff71a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109428 Jul 18 14:44:01.362677 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3937/7652] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:44:01.515525 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:01.516095 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:01.522929 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:01.523399 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:01.524185 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:01.524642 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:01.560491 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:01.560942 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:01.561414 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lazy-loading 'fault' on Instance uuid b5a5ee30-f061-4659-af2b-18ba47d81714 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:44:01.612426 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:44:01.621195 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-36b93d20-a5da-4dc7-b8cc-fd349b9805f2 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 200 len: 1338 microversion: 2.1 time: 0.113634 Jul 18 14:44:01.621781 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3716/7653] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:01 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:44:02.640212 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:02.640916 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: b5a5ee30-f061-4659-af2b-18ba47d81714] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:02.647247 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:02.647698 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:02.648460 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:02.648892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:02.662025 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] HTTP exception thrown: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Request method failure captured: Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 HTTP/1.1 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1XBoK2sxOOm7pbgeMRfTRrR9D66ikUnnK8pz5Ie0-H9kfvbF09mT8ujHXtv25ylrZ6Y75g0m5zNgr2VyDcQKC0BpIf5ia-DJmfTRwat6I5BsT1Hx_BgrZrUf7kKD8liLd0C4UiJU5Vo0wbgsJBq8t3RoR6onc4cwwzih4z2nZPATtV4 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 12ba7a1f8cbe411aba53b8a4d3e791ca Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_12ba7a1f8cbe411aba53b8a4d3e791ca", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 12ba7a1f8cbe411aba53b8a4d3e791ca Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestSnapshotPattern-943302650-project Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff91310b220948a7b76dad492f3aeded Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestSnapshotPattern-943302650-project Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': 'b5a5ee30-f061-4659-af2b-18ba47d81714'} Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:44:02.663705 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Returning 404 to user: Instance b5a5ee30-f061-4659-af2b-18ba47d81714 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-bfce979f-439d-4894-9f9c-9cbdfe2f7393 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714" status: 404 len: 111 microversion: 2.1 time: 0.030406 Jul 18 14:44:02.668918 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3938/7654] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:02 2022] GET /compute/v2.1/servers/b5a5ee30-f061-4659-af2b-18ba47d81714 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:44:04.016910 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:04.017460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:04.019415 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-997cd202-d22a-4e7f-9fed-40011615fa72 req-3723bbf3-f45d-4698-81d4-97502b94a1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:44:04.025963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:04.026489 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:04.027490 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:04.027963 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:04.029773 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-997cd202-d22a-4e7f-9fed-40011615fa72 req-3723bbf3-f45d-4698-81d4-97502b94a1d2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:04.030358 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-997cd202-d22a-4e7f-9fed-40011615fa72 req-3723bbf3-f45d-4698-81d4-97502b94a1d2 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:04.045724 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-997cd202-d22a-4e7f-9fed-40011615fa72 req-3723bbf3-f45d-4698-81d4-97502b94a1d2 service nova] Creating event network-changed:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:44:04.051799 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-997cd202-d22a-4e7f-9fed-40011615fa72 req-3723bbf3-f45d-4698-81d4-97502b94a1d2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037702 Jul 18 14:44:04.052421 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3939/7655] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:44:04.065651 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Going to try to terminate instance {{(pid=131367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:44:04.175397 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-ebe32988-c48f-4af0-bce9-9b9785d1c74e tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "DELETE /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 204 len: 0 microversion: 2.1 time: 0.163195 Jul 18 14:44:04.176007 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3717/7656] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 14:44:04 2022] DELETE /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:44:04.184892 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:04.186618 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:04.193858 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:04.194597 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:04.195609 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:04.196348 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:04.338906 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.policy [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131366) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:44:04.347808 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a80a6156-8a07-4c85-bfa1-a4964c7a620f tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1684 microversion: 2.1 time: 0.167234 Jul 18 14:44:04.348401 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3940/7657] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:04 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:44:05.365897 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:05.366647 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:05.373742 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:05.374246 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:05.375033 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:05.375481 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:05.609397 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:44:05.618138 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-57189b27-a8bc-43df-b2a8-ac31bc34a047 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1684 microversion: 2.1 time: 0.256352 Jul 18 14:44:05.619380 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3718/7658] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:05 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1684 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:44:06.171651 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [req-04a8df61-c925-47fb-98ee-b73b8d6e385e req-b63b4a7c-84e9-4d08-9c27-e44495b3a380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c0d4d-9e8e-44b1-a3db-aca3ae0bf461", "name": "network-vif-deleted", "tag": "309d84b7-c907-4762-9923-91da6c4b67c7"}]} {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:44:06.181029 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-04a8df61-c925-47fb-98ee-b73b8d6e385e req-b63b4a7c-84e9-4d08-9c27-e44495b3a380 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:06.181473 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [req-04a8df61-c925-47fb-98ee-b73b8d6e385e req-b63b4a7c-84e9-4d08-9c27-e44495b3a380 service nova] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:06.193263 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.compute.server_external_events [req-04a8df61-c925-47fb-98ee-b73b8d6e385e req-b63b4a7c-84e9-4d08-9c27-e44495b3a380 service nova] Creating event network-vif-deleted:309d84b7-c907-4762-9923-91da6c4b67c7 for instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 on n-h1-850003-3 Jul 18 14:44:06.198309 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [req-04a8df61-c925-47fb-98ee-b73b8d6e385e req-b63b4a7c-84e9-4d08-9c27-e44495b3a380 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 Jul 18 14:44:06.199374 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3941/7659] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:44:06.636593 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:06.637229 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.compute.api [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:06.644460 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:06.644934 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:06.645822 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:06.646264 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:06.681253 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:06.682016 n-d-850003-3 devstack@n-api.service[131367]: DEBUG oslo_concurrency.lockutils [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:06.682694 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.objects.instance [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lazy-loading 'fault' on Instance uuid 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 {{(pid=131367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:44:06.735097 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.policy [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91310b220948a7b76dad492f3aeded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba7a1f8cbe411aba53b8a4d3e791ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:44:06.742020 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-51e9896d-b552-4f5d-8d20-e47ea6b9b461 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 200 len: 1339 microversion: 2.1 time: 0.109668 Jul 18 14:44:06.742654 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3719/7660] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:06 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:44:07.761440 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '>' {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:07.762176 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.compute.api [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [instance: 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461] Fetching instance by UUID {{(pid=131366) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:44:07.768492 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:07.768952 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:07.769752 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:44:07.770307 n-d-850003-3 devstack@n-api.service[131366]: DEBUG oslo_concurrency.lockutils [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Lock "e6953118-0e33-49b1-a435-fe09456f4bf3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:44:07.784010 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.wsgi [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] HTTP exception thrown: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Request method failure captured: Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: request: GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 HTTP/1.1 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Accept: application/json Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Accept-Encoding: identity Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Connection: close Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Content-Length: 0 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Content-Type: application/json Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Host: 10.222.0.88 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: Openstack-System-Scope: None Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: User-Agent: python-urllib3/1.26.9 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Auth-Token: gAAAAABi1XBoK2sxOOm7pbgeMRfTRrR9D66ikUnnK8pz5Ie0-H9kfvbF09mT8ujHXtv25ylrZ6Y75g0m5zNgr2VyDcQKC0BpIf5ia-DJmfTRwat6I5BsT1Hx_BgrZrUf7kKD8liLd0C4UiJU5Vo0wbgsJBq8t3RoR6onc4cwwzih4z2nZPATtV4 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Id: None Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Domain-Name: None Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Identity-Status: Confirmed Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Is-Admin-Project: True Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Id: default Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Domain-Name: Default Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Id: 12ba7a1f8cbe411aba53b8a4d3e791ca Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Project-Name: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Role: reader,member Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Roles: reader,member Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_12ba7a1f8cbe411aba53b8a4d3e791ca", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/12ba7a1f8cbe411aba53b8a4d3e791ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}] Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Id: 12ba7a1f8cbe411aba53b8a4d3e791ca Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-Tenant-Name: tempest-TestSnapshotPattern-943302650 Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-User: tempest-TestSnapshotPattern-943302650-project Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Id: default Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-User-Domain-Name: Default Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-User-Id: ff91310b220948a7b76dad492f3aeded Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: X-User-Name: tempest-TestSnapshotPattern-943302650-project Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: method: > Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: exception: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: action_args: {'id': '632c0d4d-9e8e-44b1-a3db-aca3ae0bf461'} Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: {{(pid=131366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:44:07.785610 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: ERROR nova.api.openstack.wsgi Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: DEBUG nova.api.openstack.wsgi [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Returning 404 to user: Instance 632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 could not be found. {{(pid=131366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: INFO nova.api.openstack.requestlog [None req-a2dd4ea5-0689-4954-a1f6-8876fe0bcb5a tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461" status: 404 len: 111 microversion: 2.1 time: 0.031071 Jul 18 14:44:07.790598 n-d-850003-3 devstack@n-api.service[131366]: [pid: 131366|app: 0|req: 3942/7661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 14:44:07 2022] GET /compute/v2.1/servers/632c0d4d-9e8e-44b1-a3db-aca3ae0bf461 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:44:07.963504 n-d-850003-3 devstack@n-api.service[131367]: DEBUG nova.api.openstack.wsgi [None req-072c992d-6ecf-4c5d-9411-eaf16a550175 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] Calling method '.version_select at 0x7f96e4962d30>' {{(pid=131367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:44:07.967015 n-d-850003-3 devstack@n-api.service[131367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-072c992d-6ecf-4c5d-9411-eaf16a550175 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [b7489200-585e-4e98-a2bd-b48b9340953e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:44:08.973664 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [None req-072c992d-6ecf-4c5d-9411-eaf16a550175 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] [b7489200-585e-4e98-a2bd-b48b9340953e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 41252. Jul 18 14:44:08.991939 n-d-850003-3 devstack@n-api.service[131367]: INFO nova.api.openstack.requestlog [None req-072c992d-6ecf-4c5d-9411-eaf16a550175 tempest-TestSnapshotPattern-943302650 tempest-TestSnapshotPattern-943302650-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1256193852" status: 202 len: 0 microversion: 2.1 time: 1.032571 Jul 18 14:44:08.992526 n-d-850003-3 devstack@n-api.service[131367]: [pid: 131367|app: 0|req: 3720/7662] 10.222.0.88 () {58 vars in 1256 bytes} [Mon Jul 18 14:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1256193852 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:44:16.940194 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:44:16.940839 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:44:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:44:17.426135 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:44:17.426681 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:44:17.618211 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:44:17.618412 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:46:24.450985 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:46:24.451657 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:47:36.949799 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:47:36.950442 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:47:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:47:37.434316 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:47:37.434897 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:47:37.627364 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:47:37.627592 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:49:19.071101 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:49:19.071705 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:49:36.852314 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:49:36.853152 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:49:44.459819 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:49:44.460391 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:50:56.959122 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:50:56.959751 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:50:57.443406 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:50:57.444018 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:50:57.636014 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:50:57.636219 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:52:39.079141 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:52:39.079925 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:52:56.860915 n-d-850003-3 devstack@n-api.service[131367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:52:56.861641 n-d-850003-3 devstack@n-api.service[131367]: Mon Jul 18 14:52:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:53:04.469566 n-d-850003-3 devstack@n-api.service[131366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:53:04.470171 n-d-850003-3 devstack@n-api.service[131366]: Mon Jul 18 14:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!